-- Logs begin at Thu 2022-09-08 09:28:39 UTC, end at Thu 2022-09-08 11:57:46 UTC. -- Sep 08 10:02:40.925996 n-d-833090-19 systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 10:02:40.935354 n-d-833090-19 devstack@n-api.service[106567]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 10:02:40 2022] *** Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: nodename: n-d-833090-19 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: machine: x86_64 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: clock source: unix Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: pcre jit disabled Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: detected number of CPU cores: 4 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: current working directory: / Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: detected binary path: /usr/bin/uwsgi-core Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: your processes number limit is 47680 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: your memory page size is 4096 bytes Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: detected max file descriptor number: 2048 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: lock engine: pthread robust mutexes Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: thunder lock: enabled Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 10:02:40.937866 n-d-833090-19 devstack@n-api.service[106567]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 10:02:40.976629 n-d-833090-19 devstack@n-api.service[106567]: Python main interpreter initialized at 0x55a6a98469c0 Sep 08 10:02:40.976629 n-d-833090-19 devstack@n-api.service[106567]: python threads support enabled Sep 08 10:02:40.976629 n-d-833090-19 devstack@n-api.service[106567]: your server socket listen backlog is limited to 100 connections Sep 08 10:02:40.976629 n-d-833090-19 devstack@n-api.service[106567]: your mercy for graceful operations on workers is 90 seconds Sep 08 10:02:40.977015 n-d-833090-19 devstack@n-api.service[106567]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 10:02:40.977090 n-d-833090-19 devstack@n-api.service[106567]: *** Operational MODE: preforking *** Sep 08 10:02:40.977317 n-d-833090-19 devstack@n-api.service[106567]: *** uWSGI is running in multiple interpreter mode *** Sep 08 10:02:40.977317 n-d-833090-19 devstack@n-api.service[106567]: spawned uWSGI master process (pid: 106567) Sep 08 10:02:40.977521 n-d-833090-19 systemd[1]: Started Devstack devstack@n-api.service. Sep 08 10:02:40.978288 n-d-833090-19 devstack@n-api.service[106567]: spawned uWSGI worker 1 (pid: 106576, cores: 1) Sep 08 10:02:40.978952 n-d-833090-19 devstack@n-api.service[106567]: spawned uWSGI worker 2 (pid: 106577, cores: 1) Sep 08 10:02:40.978952 n-d-833090-19 devstack@n-api.service[106567]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 10:02:41.662302 n-d-833090-19 devstack@n-api.service[106577]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:02:41.662955 n-d-833090-19 devstack@n-api.service[106576]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:02:42.751025 n-d-833090-19 devstack@n-api.service[106576]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:02:42.751025 n-d-833090-19 devstack@n-api.service[106576]: from cryptography.utils import int_from_bytes Sep 08 10:02:42.751793 n-d-833090-19 devstack@n-api.service[106576]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:02:42.751793 n-d-833090-19 devstack@n-api.service[106576]: from cryptography.utils import int_from_bytes Sep 08 10:02:42.753672 n-d-833090-19 devstack@n-api.service[106577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:02:42.753672 n-d-833090-19 devstack@n-api.service[106577]: from cryptography.utils import int_from_bytes Sep 08 10:02:42.754091 n-d-833090-19 devstack@n-api.service[106577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:02:42.754091 n-d-833090-19 devstack@n-api.service[106577]: from cryptography.utils import int_from_bytes Sep 08 10:02:45.242495 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:02:45.243053 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:02:45.243279 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:02:45.243669 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:02:45.243948 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:02:45.244159 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:02:45.244557 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.244642 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:02:45.244721 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.244941 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:02:45.245038 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.245267 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.245372 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:02:45.245554 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:02:45.245648 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.245887 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.245982 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.246210 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.246304 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.246531 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.246624 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.246859 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.246965 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.247119 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.247215 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.247433 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.247537 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.247785 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-19 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.247873 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.248108 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.248201 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.248416 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.248501 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.248711 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.248798 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249030 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249115 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249335 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249422 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-19 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249658 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249745 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.249962 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.250054 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.250271 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.250457 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.250591 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.252406 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.252557 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.252557 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.252802 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.252944 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253077 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253200 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253323 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253448 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253580 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253693 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253814 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.253943 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254079 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254198 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254330 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254454 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254588 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254712 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254834 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.254965 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-19 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255096 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255219 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255341 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255455 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255619 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255751 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.255881 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256005 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256141 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-19 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256273 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256404 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256518 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256728 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256871 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.256997 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.257127 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.257371 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.257509 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.257688 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.257816 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258002 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258136 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258329 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258467 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258656 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258784 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.258969 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.259103 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.259275 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.259410 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.259617 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.259748 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.259941 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260068 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260250 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260379 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260556 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260682 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260814 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.260944 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.261103 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.261232 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.261426 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.261555 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.261752 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.261879 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262077 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262217 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262342 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262464 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262587 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262724 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.262882 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263017 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263203 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263333 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263536 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263680 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263840 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.263968 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.264091 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.264222 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.264407 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.264543 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.264734 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.264863 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265040 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265174 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265349 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265477 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265656 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265783 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.265966 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.266101 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.266278 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.266406 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.266590 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.266716 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.266895 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.267030 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.267204 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.267336 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.267577 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.267707 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.267902 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268047 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268214 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268357 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268524 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268657 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268850 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.268987 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.269158 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.269285 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.269481 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.269609 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.269792 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.269927 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.270099 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.270225 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.270407 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.270543 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.270718 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.270846 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271040 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271168 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271367 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271551 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271688 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271819 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.271956 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272080 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272213 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272346 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272519 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272656 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272847 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.272975 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.273156 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.273284 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.273725 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.273858 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274040 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274167 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274346 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274474 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274652 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274777 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.274960 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.275087 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.275266 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.275404 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.275601 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.275736 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.275908 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276040 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276215 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276352 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276520 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276648 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276826 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.276952 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.277133 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.277267 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.277439 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.277566 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.277747 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.277872 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278056 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278193 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278362 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278489 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278668 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278794 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.278971 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.279107 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.279278 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.279405 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.279626 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.279753 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.279933 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280066 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280239 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280368 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280545 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280681 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280852 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.280988 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.281158 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.281286 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.281471 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.281596 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.281797 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.281921 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.282071 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.282199 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.282385 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.282510 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.282686 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.282814 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283021 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283148 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283339 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283487 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283673 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283802 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.283986 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.284112 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.284291 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.284416 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.284607 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.284729 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.284899 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285027 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285207 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285376 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285515 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285639 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285805 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.285940 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.286110 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.286368 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.286498 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.286629 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.286763 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.286887 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287012 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287148 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287299 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287428 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287631 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287767 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.287955 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.288097 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.288281 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.288408 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.288594 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.288730 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.288905 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.289046 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.289213 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.289352 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.289536 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:02:45.289663 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.289877 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290014 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290199 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290325 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290516 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290643 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290836 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.290971 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.291167 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.291295 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.291502 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.291635 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.291821 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.291951 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.292136 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.292266 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.292459 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.292596 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.292786 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.292923 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.293108 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.293235 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.293426 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.293564 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.293743 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.293880 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.294060 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.294186 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.294376 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.294514 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.294697 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.294835 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.295018 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.295145 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.295339 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.295491 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.295681 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.295807 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296010 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296136 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296336 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296476 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296662 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296788 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.296987 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.297121 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.297307 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.297444 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.297617 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.297743 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.297932 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.298060 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.298244 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.298417 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.299127 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.299547 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.299796 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.299997 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.300218 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.300429 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.300636 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.300636 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.301018 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.301018 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.301429 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.301645 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.301841 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.301975 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302100 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302224 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302358 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302358 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302593 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302726 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302859 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302981 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.302981 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.303237 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.303360 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.303542 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.303734 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.303968 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.304187 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.304344 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.304482 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.304614 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.304748 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.305067 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.305204 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.305446 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.305665 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.305831 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.306081 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.306291 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.306427 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.306703 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.306885 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.307085 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.307281 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.307548 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.307760 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.307960 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308161 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308355 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308500 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308636 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308763 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308887 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.308887 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.309122 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.309261 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.309494 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.309623 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.309808 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.309936 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.310124 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.310262 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.310440 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.310568 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.310756 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.310898 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.311068 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.311211 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.311383 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.311532 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.311744 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.311884 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.312059 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.312190 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.312390 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.312518 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.312706 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.312834 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313017 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313148 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313350 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313478 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313661 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313790 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.313974 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.314116 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.314856 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.314971 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.315168 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.315301 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.315522 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.315654 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.315810 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.315949 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.316126 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.316435 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.316572 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.316761 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.316888 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.317076 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.317204 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.317396 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.317525 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.317717 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.317845 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318037 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318170 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318357 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318486 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318677 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318812 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.318999 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.319125 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.319312 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.319442 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.319681 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.319809 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.319992 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.320131 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.320300 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.320429 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.320609 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.320736 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.320922 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321059 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321233 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321362 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321543 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321680 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321851 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.321989 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.322162 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.322297 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.322473 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.322600 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.322782 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.322920 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.323093 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.323222 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.323402 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.323554 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.323737 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.323872 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324047 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324182 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324370 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324497 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324684 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324814 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.324992 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.325120 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.325299 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.325421 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.325608 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.325739 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.325954 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.326089 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.326263 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.326391 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.326589 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.326716 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.326906 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.327040 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.327225 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.327362 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.327577 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.327707 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.327892 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328018 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328211 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328350 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328524 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328650 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328839 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.328965 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.329151 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.329286 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.329463 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.329588 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.329800 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.329948 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.330118 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.330253 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.330439 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.330567 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.330751 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.330885 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.331077 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.331214 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.331389 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.331544 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.331737 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.331865 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.332048 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.332178 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.332366 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.332496 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.332695 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.332821 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333013 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333155 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333329 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333456 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333648 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333775 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.333964 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.334093 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.334278 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.334413 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.334591 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.334717 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.334902 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335029 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335213 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335348 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335545 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335691 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335867 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.335981 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.336183 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.336303 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.336492 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.336704 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.336832 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.336954 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.337114 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.337244 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.337426 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.337568 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.337743 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.337873 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338049 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338177 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338363 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338500 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338676 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338803 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.338992 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.339119 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.339307 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.339437 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.339643 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.339772 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.339953 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.340081 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.340287 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.340424 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.340571 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.340698 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.340882 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341008 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341190 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341319 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341498 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341624 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341807 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.341933 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.342118 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.342246 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.342426 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.342554 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.342732 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.342871 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343037 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343163 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343354 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343538 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343678 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343813 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.343992 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.344120 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.344298 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.344432 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.344609 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.344748 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.344917 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.345043 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.345235 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.345430 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.345567 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.345692 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.345873 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346001 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346181 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346308 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346485 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346621 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346809 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.346937 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.347121 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.347256 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.347429 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.347581 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.347762 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.347893 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.348069 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.348197 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.348390 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.348518 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.348711 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.348848 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349015 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349142 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349328 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349455 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349653 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349786 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.349966 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.350095 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.350276 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.350403 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.350589 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.350723 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.350901 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.351038 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.351252 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.351390 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.351575 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.351702 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.351854 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352001 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352246 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352427 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352554 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352685 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352811 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.352944 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.353078 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.353204 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.353373 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.353499 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.353683 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.353823 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.354002 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.354262 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.354390 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.354603 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.354744 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.354913 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.355040 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.355233 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.355368 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.355610 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.355837 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.355982 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.356177 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.356314 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.356498 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.356626 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.356820 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.356958 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.357175 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.357314 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.357489 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.357616 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.357802 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.357931 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.358116 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.358246 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.358435 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.358564 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.358743 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.358874 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.359052 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.359179 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.359358 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.359507 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.359693 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.359820 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360006 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360134 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360313 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360440 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360622 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360735 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.360917 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.361540 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.361754 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.361884 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362063 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362205 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362371 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362500 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362677 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362805 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.362985 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.363127 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.363301 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.363428 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.363635 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.363764 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.363944 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.364080 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.364251 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.364378 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.364576 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.364705 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.364888 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365024 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365195 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365324 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365502 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365630 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365806 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.365936 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.366148 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.366276 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.366455 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.366583 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.366788 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.366923 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.367101 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.367228 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.367412 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.367564 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.367748 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.367878 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368065 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368192 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368379 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368515 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368685 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368811 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.368993 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.369120 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.369300 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.369437 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.369611 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.369737 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.369920 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370046 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370224 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370363 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370534 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370661 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370840 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.370967 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.371148 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.371283 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.371473 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.371616 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.371790 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.371920 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.372097 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.372233 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.372418 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.372549 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.372711 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.372838 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373018 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373155 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373324 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373453 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373628 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373756 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.373945 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374075 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374251 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374384 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374554 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374687 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374860 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.374999 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.375161 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.375289 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.375511 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.375641 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.375800 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.375935 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.376107 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.376235 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.376413 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.376551 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.376772 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.377394 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.377580 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.377716 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.377882 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378018 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378193 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378319 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378504 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378632 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378808 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.378948 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.379114 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.379250 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.379423 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.379575 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.379756 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.379896 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380061 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380189 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380367 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380493 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380677 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380812 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.380987 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.381122 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.381289 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.381415 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.381595 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.381730 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.381897 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382029 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382200 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382329 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382506 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382634 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382814 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.382940 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.383118 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.383245 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.383423 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.383603 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.383742 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.383867 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384052 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384189 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384357 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384486 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384680 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384807 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.384991 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.385131 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.385296 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.385468 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.385595 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.385726 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.385893 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.386029 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.386237 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.386365 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.386544 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.386672 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.386872 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387007 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387193 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387320 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387527 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387658 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387851 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.387978 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.388161 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.388286 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.388473 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.388602 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.388783 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.388911 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.389086 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.389213 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.389402 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.389530 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.389712 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.389841 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390024 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390151 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390328 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390453 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390655 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390782 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.390941 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.391078 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.391254 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.391396 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.391604 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.391731 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.391923 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.392049 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.392239 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.392885 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.393072 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.393201 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.393375 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.393515 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.393685 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.393822 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394001 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394128 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394308 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394434 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394620 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394756 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.394931 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.395058 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.395239 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.395365 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.395575 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.395718 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.395886 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396006 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396193 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396319 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396500 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396628 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396808 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.396935 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.397119 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.397246 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.397427 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.397563 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.397733 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.397859 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.398049 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.398178 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.398357 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.398777 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.398911 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.399058 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.399223 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.399364 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.399554 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.399706 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.399864 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.400019 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.400146 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.400335 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.400578 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.400707 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.400894 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401022 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401208 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401346 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401515 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401650 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401828 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.401963 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.402139 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.402278 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.402454 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.402582 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.402817 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.402957 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.403084 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.403216 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.403506 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.403637 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.403807 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.403937 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.404119 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.404247 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.404432 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.404572 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.404739 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.404866 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405045 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405172 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405359 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405488 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405667 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405794 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.405979 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.406100 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.406287 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.406556 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.406684 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.406902 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.407022 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.407209 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.407336 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.407556 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.407690 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.408504 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.408642 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.408827 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.408963 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.409133 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.409262 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.409551 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.409703 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.409865 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.409995 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.410178 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.410307 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.410498 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.410624 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.410815 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.410945 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.411139 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.411274 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.411448 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.411629 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.411790 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.411919 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.412104 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.412234 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.412415 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.412543 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.412746 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.412877 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.413059 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.413193 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.413377 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.413515 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.413685 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.413815 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414015 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414153 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414341 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414479 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414659 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414794 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.414982 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.415112 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.415360 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.415521 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.415699 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.415829 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416013 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416148 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416328 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416465 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416640 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416771 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.416951 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.417080 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.417255 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.417383 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.417568 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.417697 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.417873 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418003 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418179 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418309 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418490 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418618 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418796 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.418931 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.419103 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.419231 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.419411 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.419575 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.419749 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.419883 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420054 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420169 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420359 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420496 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420684 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420822 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.420990 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.421128 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.421307 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.421434 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.421619 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.421759 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.421937 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422064 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422248 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422383 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422553 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422694 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422859 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.422987 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.423175 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.423303 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.423497 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.423661 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.423831 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.423960 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.424138 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.424267 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.424479 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.424610 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.424787 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.424915 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.425111 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.425240 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.425444 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.425581 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.425774 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.425903 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.426087 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.426215 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.426439 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.426569 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.426741 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.426868 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.427050 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.427185 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.427362 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.427520 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.427705 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.427855 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428032 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428174 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428341 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428470 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428646 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428774 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.428955 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.429097 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.429259 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.429394 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.429563 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.429699 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.429867 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430005 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430175 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430310 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430480 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430648 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430785 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.430911 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.431074 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.431206 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.431394 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.431543 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.431741 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.431922 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.432105 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.432261 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.432387 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.432543 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.432721 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.432935 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.433067 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.433247 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.433376 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.433555 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.433754 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.433947 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.434130 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.434263 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.434425 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.434589 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.434820 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.434949 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.435141 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.435277 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.435529 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.435677 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.435804 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.435992 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.436173 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.436391 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.436512 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.436630 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.436755 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.436888 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.437013 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.437202 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.437525 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.437662 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.437844 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.437983 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.438158 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.438287 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.438477 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.438618 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.438794 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.438929 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.439102 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.439729 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.439961 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.440177 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.440344 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.440503 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.440593 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.440820 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.440918 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.441137 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.441315 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.441447 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.441572 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.441755 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.441923 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.442072 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.442210 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.442387 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.442519 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.442697 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.442828 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.443009 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.443139 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.443324 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.443452 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.443680 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.443809 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444006 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444134 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444340 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444478 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444654 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444788 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.444976 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.445113 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.445350 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.445506 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.445735 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.445863 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.445995 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446127 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446306 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446474 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446598 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446717 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446842 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.446966 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.447100 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.447226 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.447408 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.447593 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.447754 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.447882 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.448074 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.448213 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.448386 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.448514 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.448703 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.448840 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449017 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449159 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449329 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449461 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449640 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449778 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.449955 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.450083 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.450271 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.450475 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.450606 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.450799 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.450928 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.451137 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.451266 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.451487 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.451634 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.451820 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.451962 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.452143 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.452279 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.452467 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.452666 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.452796 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.452985 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.453113 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.453318 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.453447 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.453643 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.453785 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.453967 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.454095 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.454291 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.454418 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.454608 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.454745 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.455442 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.455594 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.455806 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.455953 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.456102 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.456231 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.456414 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.456542 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.456726 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.456948 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.457079 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.457305 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.457434 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.457625 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.457754 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.457932 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.458061 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.458253 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.458389 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.458562 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.458696 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.458877 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.459098 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.459228 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.459452 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.459604 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.459795 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.459934 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.460124 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.460253 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.460438 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.460565 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.460749 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.460878 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461057 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461184 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461370 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461503 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461679 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461808 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.461985 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.462121 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.462300 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.462429 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.462627 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.462755 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.462901 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463029 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463209 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463347 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463545 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463676 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463855 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.463993 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.464159 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.464300 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.464467 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.464601 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.464769 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.464896 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.465077 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.465218 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.465389 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.465517 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.465695 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.465822 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466001 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466142 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466308 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466435 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466615 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466743 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.466921 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467051 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467225 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467354 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467539 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467659 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467857 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.467987 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.468163 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.468300 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.468475 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.468611 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.468781 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.468910 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.469092 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.469220 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.469404 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.469532 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.469732 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.469861 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470035 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470161 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470350 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470507 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470679 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470806 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.470988 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.471115 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.471303 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.471639 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.471781 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.471966 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.472095 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.472281 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.472410 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.472592 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.472729 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.472938 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.473066 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.473256 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.473384 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.473572 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.473790 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.473920 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.474130 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.474258 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.474460 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.474589 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.474797 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.474925 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.475109 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.475243 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.475423 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.475605 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.475757 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.475897 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.476065 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.476194 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.476378 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.476506 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.476695 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.476825 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477006 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477141 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477342 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477473 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477626 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477745 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.477935 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.478071 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.478244 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.478371 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.478564 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.478690 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.478871 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479016 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479182 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479317 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479513 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479645 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479828 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.479960 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.480139 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.480268 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.480448 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.480585 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.480759 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.480889 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.481073 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.481202 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.481384 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.481512 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.481699 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.481828 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482018 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482139 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482331 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482458 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482647 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482776 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.482956 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.483084 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.483265 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.483599 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.483728 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.483914 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.484054 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.484236 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.484365 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.484565 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.484703 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.484881 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.485049 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.485175 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.485299 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.485559 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.485856 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486038 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486199 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486334 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486514 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486640 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486835 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.486960 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.487148 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.487280 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.487500 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.487645 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.487823 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.487952 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.488161 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.488300 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.488436 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.488567 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.488740 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.488868 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.489054 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.489191 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.489379 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.489515 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.489694 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.489824 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490005 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490142 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490313 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490442 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490626 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490761 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.490931 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.491060 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.491237 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.491364 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.491570 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.491712 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.491915 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492050 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492184 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492298 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492470 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492599 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492776 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.492903 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493079 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493206 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493385 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493513 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493687 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493814 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.493992 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.494125 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.494304 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.494438 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.494608 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.494736 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.494910 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495036 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495214 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495351 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495542 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495672 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495849 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.495987 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.496154 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.496292 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.496465 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.496593 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.496768 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.496904 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497073 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497210 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497377 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497505 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497682 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497819 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.497987 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.498128 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.498322 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.498450 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.498658 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.498789 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.498975 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.499103 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.499292 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.499423 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.499628 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.499755 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.499953 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.500084 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.500265 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.500394 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.500578 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.500711 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.500893 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.501028 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.501205 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.501331 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.501516 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.502144 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.502357 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.502487 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.502670 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.502797 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.502985 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.503123 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.503298 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.503427 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.503634 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.503766 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.503948 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.504090 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.504261 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.504389 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.504572 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.504699 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.504905 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505042 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505216 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505342 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505533 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505661 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505848 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.505977 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.506163 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.506298 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.506476 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.506601 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.506788 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.506917 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.507098 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.507218 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.507415 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.507563 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.507756 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.507883 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.508068 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.508205 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.508381 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.508518 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.508693 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.508820 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509007 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509143 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509319 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509456 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509632 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509760 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.509948 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.510076 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.510264 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.510406 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.510591 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.510718 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.510917 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.511045 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.511228 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.511370 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.511571 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.511700 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.511884 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.512024 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.512159 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:02:45.512285 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.512536 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.512880 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.513210 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.513526 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.513840 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.514149 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:02:45.514392 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:02:45.666356 n-d-833090-19 devstack@n-api.service[106577]: INFO dbcounter [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Registered counter for database nova_api Sep 08 10:02:45.667659 n-d-833090-19 devstack@n-api.service[106576]: INFO dbcounter [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Registered counter for database nova_api Sep 08 10:02:45.688357 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_db.sqlalchemy.engines [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.691187 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_db.sqlalchemy.engines [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.695742 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writer thread running {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.698796 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writer thread running {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.752499 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.context [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=106577) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:02:45.755070 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.context [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=106576) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:02:45.756385 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:02:45.756860 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:02:45.758423 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:02:45.758888 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_concurrency.lockutils [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:02:45.759149 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:02:45.759356 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_concurrency.lockutils [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:02:45.759628 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:02:45.760954 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_concurrency.lockutils [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:02:45.761619 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:02:45.761725 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_concurrency.lockutils [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:02:45.762088 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_concurrency.lockutils [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:02:45.763625 n-d-833090-19 devstack@n-api.service[106577]: INFO dbcounter [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Registered counter for database nova_cell0 Sep 08 10:02:45.764070 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_concurrency.lockutils [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106576) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:02:45.766162 n-d-833090-19 devstack@n-api.service[106576]: INFO dbcounter [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Registered counter for database nova_cell0 Sep 08 10:02:45.768217 n-d-833090-19 devstack@n-api.service[106577]: INFO dbcounter [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Registered counter for database nova_cell1 Sep 08 10:02:45.770875 n-d-833090-19 devstack@n-api.service[106576]: INFO dbcounter [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Registered counter for database nova_cell1 Sep 08 10:02:45.777049 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_db.sqlalchemy.engines [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.777825 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_db.sqlalchemy.engines [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.778435 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_db.sqlalchemy.engines [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.783077 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writer thread running {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.783727 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_db.sqlalchemy.engines [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.784441 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writer thread running {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.926072 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writer thread running {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.928567 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writer thread running {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.936287 n-d-833090-19 devstack@n-api.service[106577]: INFO dbcounter [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Registered counter for database nova_cell0 Sep 08 10:02:45.937318 n-d-833090-19 devstack@n-api.service[106576]: INFO dbcounter [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Registered counter for database nova_cell0 Sep 08 10:02:45.943835 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_db.sqlalchemy.engines [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.947570 n-d-833090-19 devstack@n-api.service[106576]: DEBUG oslo_db.sqlalchemy.engines [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:02:45.948257 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writer thread running {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:45.952142 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writer thread running {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:02:46.285364 n-d-833090-19 devstack@n-api.service[106577]: WARNING keystonemiddleware.auth_token [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:02:46.290743 n-d-833090-19 devstack@n-api.service[106576]: WARNING keystonemiddleware.auth_token [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:02:46.293510 n-d-833090-19 devstack@n-api.service[106577]: WARNING keystonemiddleware.auth_token [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:02:46.299516 n-d-833090-19 devstack@n-api.service[106576]: WARNING keystonemiddleware.auth_token [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:02:46.635906 n-d-833090-19 devstack@n-api.service[106577]: WARNING keystonemiddleware.auth_token [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:02:46.643306 n-d-833090-19 devstack@n-api.service[106577]: WARNING keystonemiddleware.auth_token [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:02:46.646070 n-d-833090-19 devstack@n-api.service[106576]: WARNING keystonemiddleware.auth_token [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:02:46.648725 n-d-833090-19 devstack@n-api.service[106577]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6a98469c0 pid: 106577 (default app) Sep 08 10:02:46.650788 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:02:46.652010 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Sep 08 10:02:46.652274 n-d-833090-19 devstack@n-api.service[106576]: WARNING keystonemiddleware.auth_token [None req-ea60818e-8040-4497-9d95-06d4c103ec97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:02:46.652425 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Thu Sep 8 10:02:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:02:46.657748 n-d-833090-19 devstack@n-api.service[106576]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6a98469c0 pid: 106576 (default app) Sep 08 10:04:08.952016 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:08.953583 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Sep 08 10:04:08.954254 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:08.967329 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_api:SELECT=3 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:08.968365 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_cell0:SELECT=3 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:08.969561 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_cell1:SELECT=3 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:08.970455 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:09.873647 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-3f6c5bae-3281-4ffc-aeb2-e879d318e6e6 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:09.908025 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-3f6c5bae-3281-4ffc-aeb2-e879d318e6e6 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946520 Sep 08 10:04:09.908761 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:04:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:04:12.601343 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:12.602422 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-4c06175c-95b1-43f7-8841-ebee756b536e None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 08 10:04:12.603005 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:13.059424 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-aaffc5b6-327e-4ca5-9a1b-29a2f7375df0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "disk": 1, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:13.107800 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-aaffc5b6-327e-4ca5-9a1b-29a2f7375df0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498060 Sep 08 10:04:13.108537 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:13.122129 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_api:SELECT=3 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:13.123420 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_cell0:SELECT=3 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:13.124170 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_cell1:SELECT=3 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:13.124891 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:13.333129 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-9db2cf35-3423-4341-b706-bab202a8c606 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:13.404727 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-9db2cf35-3423-4341-b706-bab202a8c606 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288132 Sep 08 10:04:13.405961 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Thu Sep 8 10:04:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:16.062526 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-aaffc5b6-327e-4ca5-9a1b-29a2f7375df0 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:16.062526 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-aaffc5b6-327e-4ca5-9a1b-29a2f7375df0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 08 10:04:16.062526 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:16.902088 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-499c1ce8-5f90-4e3c-83d6-cfb99331de08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:16.949245 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-499c1ce8-5f90-4e3c-83d6-cfb99331de08 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.879328 Sep 08 10:04:16.950484 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:16.963546 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-05871335-01ca-4da9-9694-b3ec65489b80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:17.022654 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-05871335-01ca-4da9-9694-b3ec65489b80 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063092 Sep 08 10:04:17.024174 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Thu Sep 8 10:04:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:19.860323 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-499c1ce8-5f90-4e3c-83d6-cfb99331de08 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:19.861344 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-499c1ce8-5f90-4e3c-83d6-cfb99331de08 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 08 10:04:19.862926 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:20.608765 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-227762e8-83e4-48cc-8e6d-1a9c1859842d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:20.632344 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-227762e8-83e4-48cc-8e6d-1a9c1859842d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.761983 Sep 08 10:04:20.633916 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:20.647700 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-0a496598-9989-426f-bf47-e7bbf7e248fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:20.686215 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-0a496598-9989-426f-bf47-e7bbf7e248fe admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043673 Sep 08 10:04:20.687446 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Thu Sep 8 10:04:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:04:23.321475 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-227762e8-83e4-48cc-8e6d-1a9c1859842d admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:23.323262 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-227762e8-83e4-48cc-8e6d-1a9c1859842d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Sep 08 10:04:23.323897 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:23.790322 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-ed33639b-840c-42d0-95b3-fff4fc509e9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:23.812792 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-ed33639b-840c-42d0-95b3-fff4fc509e9d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482387 Sep 08 10:04:23.813353 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:04:23.825743 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-b8c909d1-b7ee-4a43-a83f-241ca767dea4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:23.867362 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-b8c909d1-b7ee-4a43-a83f-241ca767dea4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045389 Sep 08 10:04:23.868296 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Thu Sep 8 10:04:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:26.607906 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-ed33639b-840c-42d0-95b3-fff4fc509e9d admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:26.608919 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-ed33639b-840c-42d0-95b3-fff4fc509e9d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 08 10:04:26.609318 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:27.085937 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-8dbaa236-d813-428f-b73e-c90ca2ae8a87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:27.109519 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-8dbaa236-d813-428f-b73e-c90ca2ae8a87 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493098 Sep 08 10:04:27.110982 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:04:27.123256 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-854057ef-a2e1-4569-ba45-b5064387164f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:27.155277 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-854057ef-a2e1-4569-ba45-b5064387164f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035599 Sep 08 10:04:27.156299 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Thu Sep 8 10:04:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:29.811195 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-8dbaa236-d813-428f-b73e-c90ca2ae8a87 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:29.812286 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-8dbaa236-d813-428f-b73e-c90ca2ae8a87 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 08 10:04:29.817724 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:30.302843 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-3103072d-2248-4759-bcf7-838229671249 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:30.329453 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-3103072d-2248-4759-bcf7-838229671249 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.510573 Sep 08 10:04:30.330003 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:04:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:04:32.967211 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-8dbaa236-d813-428f-b73e-c90ca2ae8a87 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:32.968211 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-8dbaa236-d813-428f-b73e-c90ca2ae8a87 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 08 10:04:32.968610 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:33.471383 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-765144f1-a9e2-4c4c-8560-c779d58489db admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:33.491033 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-765144f1-a9e2-4c4c-8560-c779d58489db admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.515973 Sep 08 10:04:33.491627 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:33.504253 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-0abf3ff5-e5bb-4b13-a629-da2becfbc23c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:33.533145 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-0abf3ff5-e5bb-4b13-a629-da2becfbc23c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032508 Sep 08 10:04:33.533724 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Thu Sep 8 10:04:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:04:36.426727 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-765144f1-a9e2-4c4c-8560-c779d58489db admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:36.428856 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-765144f1-a9e2-4c4c-8560-c779d58489db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002774 Sep 08 10:04:36.429354 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:36.844349 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4f0a6041-9610-4f7b-9175-52ba751a7ca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:36.865667 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4f0a6041-9610-4f7b-9175-52ba751a7ca0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.429861 Sep 08 10:04:36.866294 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:36.878828 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-358a7219-fb27-4857-9d4b-2f8eec19cfdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:36.902751 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-358a7219-fb27-4857-9d4b-2f8eec19cfdd admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027574 Sep 08 10:04:36.903326 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Thu Sep 8 10:04:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:39.559260 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4f0a6041-9610-4f7b-9175-52ba751a7ca0 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:39.560327 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4f0a6041-9610-4f7b-9175-52ba751a7ca0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Sep 08 10:04:39.560736 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:39.957949 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-9356d743-cefe-42ec-a05e-2d1780eb3df4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:39.978307 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-9356d743-cefe-42ec-a05e-2d1780eb3df4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.411223 Sep 08 10:04:39.978874 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:39.990806 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-b3392f25-6ff4-44da-9098-d66b9e0a7a93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:39.996251 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:40.017402 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-b3392f25-6ff4-44da-9098-d66b9e0a7a93 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030200 Sep 08 10:04:40.018081 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Thu Sep 8 10:04:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:42.646378 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-9356d743-cefe-42ec-a05e-2d1780eb3df4 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:42.647341 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-9356d743-cefe-42ec-a05e-2d1780eb3df4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 08 10:04:42.647791 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:43.113276 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-c03be04b-9525-435b-86a1-d3414d7a5827 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4"}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:43.134107 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-c03be04b-9525-435b-86a1-d3414d7a5827 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479664 Sep 08 10:04:43.134667 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:04:43.147064 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-3b407f92-f49d-40e3-8390-2d391b8c83ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:43.174378 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-3b407f92-f49d-40e3-8390-2d391b8c83ce admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031173 Sep 08 10:04:43.175080 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Thu Sep 8 10:04:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:04:45.901456 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-c03be04b-9525-435b-86a1-d3414d7a5827 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:04:45.902400 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-c03be04b-9525-435b-86a1-d3414d7a5827 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 08 10:04:45.903104 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:04:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:04:46.362446 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-e8b81867-26db-4bc8-bb09-bea9a11ff1c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "vcpus": 8, "name": "m1.xlarge"}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:46.368680 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:04:46.387127 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-e8b81867-26db-4bc8-bb09-bea9a11ff1c8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477561 Sep 08 10:04:46.388152 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Thu Sep 8 10:04:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:04:46.401318 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-b2a1ab7f-feab-4e0e-b4b9-dd35e299fb74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:04:46.444240 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-b2a1ab7f-feab-4e0e-b4b9-dd35e299fb74 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047554 Sep 08 10:04:46.445832 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Thu Sep 8 10:04:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:05:07.036008 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-e8b81867-26db-4bc8-bb09-bea9a11ff1c8 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:07.036954 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-e8b81867-26db-4bc8-bb09-bea9a11ff1c8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 08 10:05:07.037897 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:07.048473 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:05:07.431579 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-5ef3e754-ea09-4b2f-99d1-b29ee3dab0f4 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:07.450432 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-5ef3e754-ea09-4b2f-99d1-b29ee3dab0f4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406612 Sep 08 10:05:07.450968 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:05:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:05:08.761412 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-e8b81867-26db-4bc8-bb09-bea9a11ff1c8 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:08.762493 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-e8b81867-26db-4bc8-bb09-bea9a11ff1c8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 08 10:05:08.762935 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:09.336546 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-3ca64608-7cf7-4005-b0fb-7087464b95c9 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:09.341777 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.wsgi [None req-3ca64608-7cf7-4005-b0fb-7087464b95c9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-3ca64608-7cf7-4005-b0fb-7087464b95c9 admin admin] Request method failure captured: Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Accept: application/json Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Accept-Encoding: gzip, deflate Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Connection: keep-alive Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Content-Length: 0 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Host: 10.222.0.59 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Openstack-Api-Version: compute 2.92 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: Openstack-System-Scope: None Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: User-Agent: python-novaclient Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Auth-Token: gAAAAABjGb5UM-kmnXgX0ahhkhiFyeQQ43JdkCBFlStLztMgf1zrg5DOSqTPNvPXxACqutE4gKF6o0o3o3O4MLY7rLHJ2lcIcB3bhi8uQ5V_HgoMQSKzQ1bPA9c6svNXOpl7BWGpsj92zsEqppR6uR2uDpH1bS4S2ljD5jtJv4uvNZ_mKXHFy-8 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Domain-Id: None Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Domain-Name: None Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Identity-Status: Confirmed Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Is-Admin-Project: True Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Domain-Id: default Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Domain-Name: Default Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Name: admin Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Role: reader,admin,member Sep 08 10:05:09.345062 n-d-833090-19 devstack@n-api.service[106576]: X-Roles: reader,admin,member Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eac9a69009d64217880abdce718ab760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eac9a69009d64217880abdce718ab760", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant: admin Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant-Name: admin Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-User: admin Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-User-Domain-Id: default Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-User-Domain-Name: Default Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-User-Id: 2607d5bb0fa740e19db28f744f26a0c0 Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: X-User-Name: admin Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: method: > Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: exception: Flavor 42 could not be found. Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: action_args: {'id': '42'} Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:05:09.346813 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:09.347970 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.349144 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-3ca64608-7cf7-4005-b0fb-7087464b95c9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:05:09.350858 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-3ca64608-7cf7-4005-b0fb-7087464b95c9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.405665 Sep 08 10:05:09.350858 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:05:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:05:09.356842 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-d7795277-2d39-4a92-8710-dbd2616e8ddb admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:09.380203 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-d7795277-2d39-4a92-8710-dbd2616e8ddb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026897 Sep 08 10:05:09.381253 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Sep 8 10:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:05:09.402957 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-0b2d53a8-c4b3-45f5-8379-b8af8732c105 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:09.426282 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-0b2d53a8-c4b3-45f5-8379-b8af8732c105 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030038 Sep 08 10:05:09.426842 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Sep 8 10:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:05:09.436972 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-c3eb8426-3638-474a-a8e4-d71bcd30ee76 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:09.442335 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.wsgi [None req-c3eb8426-3638-474a-a8e4-d71bcd30ee76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-c3eb8426-3638-474a-a8e4-d71bcd30ee76 admin admin] Request method failure captured: Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Accept: application/json Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Accept-Encoding: gzip, deflate Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Connection: keep-alive Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Content-Length: 0 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Host: 10.222.0.59 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Openstack-Api-Version: compute 2.92 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: Openstack-System-Scope: None Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: User-Agent: python-novaclient Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Auth-Token: gAAAAABjGb5UM-kmnXgX0ahhkhiFyeQQ43JdkCBFlStLztMgf1zrg5DOSqTPNvPXxACqutE4gKF6o0o3o3O4MLY7rLHJ2lcIcB3bhi8uQ5V_HgoMQSKzQ1bPA9c6svNXOpl7BWGpsj92zsEqppR6uR2uDpH1bS4S2ljD5jtJv4uvNZ_mKXHFy-8 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Domain-Id: None Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Domain-Name: None Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Identity-Status: Confirmed Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Is-Admin-Project: True Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Domain-Id: default Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Domain-Name: Default Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Name: admin Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Role: reader,admin,member Sep 08 10:05:09.446293 n-d-833090-19 devstack@n-api.service[106577]: X-Roles: reader,admin,member Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eac9a69009d64217880abdce718ab760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eac9a69009d64217880abdce718ab760", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant: admin Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant-Name: admin Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-User: admin Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-User-Domain-Id: default Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-User-Domain-Name: Default Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-User-Id: 2607d5bb0fa740e19db28f744f26a0c0 Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: X-User-Name: admin Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: method: > Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: exception: Flavor 42 could not be found. Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: action_args: {'id': '42'} Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:05:09.447768 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:09.448632 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:09.449697 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-c3eb8426-3638-474a-a8e4-d71bcd30ee76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:05:09.450915 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-c3eb8426-3638-474a-a8e4-d71bcd30ee76 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014452 Sep 08 10:05:09.450915 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:05:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:05:10.704572 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-0b2d53a8-c4b3-45f5-8379-b8af8732c105 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:10.705626 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-0b2d53a8-c4b3-45f5-8379-b8af8732c105 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 08 10:05:10.706027 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:11.238781 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-963a300a-a83b-43d3-87a6-281692b25ac0 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:11.243958 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.wsgi [None req-963a300a-a83b-43d3-87a6-281692b25ac0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-963a300a-a83b-43d3-87a6-281692b25ac0 admin admin] Request method failure captured: Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Accept: application/json Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Accept-Encoding: gzip, deflate Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Connection: keep-alive Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Content-Length: 0 Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Host: 10.222.0.59 Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Openstack-Api-Version: compute 2.92 Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: Openstack-System-Scope: None Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: User-Agent: python-novaclient Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Auth-Token: gAAAAABjGb5WmKdDXjvqYPym-EqhJb7ZQNF_dsIRIR81qIdzQIxRS6s8DmIsNoRXCb7QuE3VtOiZezP9SrSJSZVP23Cc9HkWyo39t-9MFwdO_RdviR6xRUU6T9JPdRi3mSl5luF24CJV6irHIfpDVs7yWwm2_gU8pDLQnBm6xcW5BpHtXJIlM5k Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Domain-Id: None Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Domain-Name: None Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Identity-Status: Confirmed Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Is-Admin-Project: True Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Domain-Id: default Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Domain-Name: Default Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Name: admin Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Role: reader,admin,member Sep 08 10:05:11.245494 n-d-833090-19 devstack@n-api.service[106577]: X-Roles: reader,admin,member Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eac9a69009d64217880abdce718ab760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eac9a69009d64217880abdce718ab760", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant: admin Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant-Name: admin Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-User: admin Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-User-Domain-Id: default Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-User-Domain-Name: Default Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-User-Id: 2607d5bb0fa740e19db28f744f26a0c0 Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: X-User-Name: admin Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: method: > Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: exception: Flavor 84 could not be found. Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: action_args: {'id': '84'} Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:05:11.247095 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:11.248176 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.249584 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-963a300a-a83b-43d3-87a6-281692b25ac0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:05:11.250863 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-963a300a-a83b-43d3-87a6-281692b25ac0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396885 Sep 08 10:05:11.250863 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:05:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:05:11.257260 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-f51df88c-db85-402c-9a9d-0cac4c7d159b admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:11.273051 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-f51df88c-db85-402c-9a9d-0cac4c7d159b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020002 Sep 08 10:05:11.273576 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Sep 8 10:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:05:11.283302 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-3f6a5a48-a7b6-4e6b-a7ff-c8bd1a70adfe admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:11.299258 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-3f6a5a48-a7b6-4e6b-a7ff-c8bd1a70adfe admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019483 Sep 08 10:05:11.299849 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Sep 8 10:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:05:11.309513 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-8e91c7a4-90b8-4b55-836a-f8825e56b699 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:11.314527 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.wsgi [None req-8e91c7a4-90b8-4b55-836a-f8825e56b699 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-8e91c7a4-90b8-4b55-836a-f8825e56b699 admin admin] Request method failure captured: Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Accept: application/json Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Accept-Encoding: gzip, deflate Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Connection: keep-alive Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Content-Length: 0 Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Host: 10.222.0.59 Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Openstack-Api-Version: compute 2.92 Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: Openstack-System-Scope: None Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: User-Agent: python-novaclient Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Auth-Token: gAAAAABjGb5WmKdDXjvqYPym-EqhJb7ZQNF_dsIRIR81qIdzQIxRS6s8DmIsNoRXCb7QuE3VtOiZezP9SrSJSZVP23Cc9HkWyo39t-9MFwdO_RdviR6xRUU6T9JPdRi3mSl5luF24CJV6irHIfpDVs7yWwm2_gU8pDLQnBm6xcW5BpHtXJIlM5k Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Domain-Id: None Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Domain-Name: None Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Identity-Status: Confirmed Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Is-Admin-Project: True Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Domain-Id: default Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Domain-Name: Default Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Name: admin Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Role: reader,admin,member Sep 08 10:05:11.316073 n-d-833090-19 devstack@n-api.service[106576]: X-Roles: reader,admin,member Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eac9a69009d64217880abdce718ab760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eac9a69009d64217880abdce718ab760", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant: admin Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant-Name: admin Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-User: admin Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-User-Domain-Id: default Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-User-Domain-Name: Default Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-User-Id: 2607d5bb0fa740e19db28f744f26a0c0 Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: X-User-Name: admin Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: method: > Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: exception: Flavor 84 could not be found. Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: action_args: {'id': '84'} Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:05:11.317709 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:11.319377 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:11.320621 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-8e91c7a4-90b8-4b55-836a-f8825e56b699 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:05:11.321819 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-8e91c7a4-90b8-4b55-836a-f8825e56b699 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011570 Sep 08 10:05:11.321819 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:05:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:05:12.561015 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-3f6a5a48-a7b6-4e6b-a7ff-c8bd1a70adfe admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:12.563129 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-3f6a5a48-a7b6-4e6b-a7ff-c8bd1a70adfe admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004788 Sep 08 10:05:12.563554 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:13.122330 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-11fe14a6-8f99-4d60-ace9-66aae076cbd7 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:13.128240 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.wsgi [None req-11fe14a6-8f99-4d60-ace9-66aae076cbd7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-11fe14a6-8f99-4d60-ace9-66aae076cbd7 admin admin] Request method failure captured: Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Accept: application/json Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Accept-Encoding: gzip, deflate Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Connection: keep-alive Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Content-Length: 0 Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Host: 10.222.0.59 Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Openstack-Api-Version: compute 2.92 Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: Openstack-System-Scope: None Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: User-Agent: python-novaclient Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Auth-Token: gAAAAABjGb5Yi6qpKPJSuex00NCgsCxcA1R30vtbteCiQbD93N7gMbYlbHYyjqwWSWqZegm2bMtOoM12yt6LbzMwSu12pVlRpPv8ZWq_pnuEfAj3IU0r_-dYsV4R6waehQs7oAwIYioo6jiEiBTjn849biQXW0drlvadSDBSJZ5a0_3fjzF-rAU Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Domain-Id: None Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Domain-Name: None Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Identity-Status: Confirmed Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Is-Admin-Project: True Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Domain-Id: default Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Domain-Name: Default Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Project-Name: admin Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Role: reader,admin,member Sep 08 10:05:13.129749 n-d-833090-19 devstack@n-api.service[106576]: X-Roles: reader,admin,member Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eac9a69009d64217880abdce718ab760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eac9a69009d64217880abdce718ab760", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant: admin Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-Tenant-Name: admin Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-User: admin Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-User-Domain-Id: default Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-User-Domain-Name: Default Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-User-Id: 2607d5bb0fa740e19db28f744f26a0c0 Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: X-User-Name: admin Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: method: > Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: exception: Flavor 451 could not be found. Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: action_args: {'id': '451'} Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:05:13.131670 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:13.132447 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.133682 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-11fe14a6-8f99-4d60-ace9-66aae076cbd7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106576) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:05:13.135012 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-11fe14a6-8f99-4d60-ace9-66aae076cbd7 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.428867 Sep 08 10:05:13.135012 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:05:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:05:13.141552 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-1f161eea-9e9c-49b7-a09a-f92bb1e5f329 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:13.157444 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-1f161eea-9e9c-49b7-a09a-f92bb1e5f329 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019427 Sep 08 10:05:13.158022 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Sep 8 10:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:05:13.167694 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:13.183282 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019188 Sep 08 10:05:13.183833 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Sep 8 10:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:05:13.193985 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-5042fc48-2ed9-4ac1-9473-23564b48c73b admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:13.198963 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.wsgi [None req-5042fc48-2ed9-4ac1-9473-23564b48c73b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-5042fc48-2ed9-4ac1-9473-23564b48c73b admin admin] Request method failure captured: Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Accept: application/json Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Accept-Encoding: gzip, deflate Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Connection: keep-alive Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Content-Length: 0 Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Host: 10.222.0.59 Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Openstack-Api-Version: compute 2.92 Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: Openstack-System-Scope: None Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: User-Agent: python-novaclient Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Auth-Token: gAAAAABjGb5Yi6qpKPJSuex00NCgsCxcA1R30vtbteCiQbD93N7gMbYlbHYyjqwWSWqZegm2bMtOoM12yt6LbzMwSu12pVlRpPv8ZWq_pnuEfAj3IU0r_-dYsV4R6waehQs7oAwIYioo6jiEiBTjn849biQXW0drlvadSDBSJZ5a0_3fjzF-rAU Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Domain-Id: None Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Domain-Name: None Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Identity-Status: Confirmed Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Is-Admin-Project: True Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Domain-Id: default Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Domain-Name: Default Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Project-Name: admin Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Role: reader,admin,member Sep 08 10:05:13.200493 n-d-833090-19 devstack@n-api.service[106577]: X-Roles: reader,admin,member Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eac9a69009d64217880abdce718ab760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eac9a69009d64217880abdce718ab760"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eac9a69009d64217880abdce718ab760", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant: admin Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant-Id: eac9a69009d64217880abdce718ab760 Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-Tenant-Name: admin Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-User: admin Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-User-Domain-Id: default Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-User-Domain-Name: Default Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-User-Id: 2607d5bb0fa740e19db28f744f26a0c0 Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: X-User-Name: admin Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: method: > Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: exception: Flavor 451 could not be found. Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: action_args: {'id': '451'} Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:05:13.201978 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:13.202853 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: ERROR nova.api.openstack.wsgi Sep 08 10:05:13.204066 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-5042fc48-2ed9-4ac1-9473-23564b48c73b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:05:13.205027 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-5042fc48-2ed9-4ac1-9473-23564b48c73b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012050 Sep 08 10:05:13.205027 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:05:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:05:14.425000 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:14.426024 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 08 10:05:14.426486 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:14.957190 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-afc7294b-ce91-4791-986f-3d78c1397ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:05:14.976113 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-afc7294b-ce91-4791-986f-3d78c1397ccf admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408544 Sep 08 10:05:14.976659 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Sep 8 10:05:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:05:16.202246 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:16.203249 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 08 10:05:16.203695 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:16.737489 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-cffe5ec2-94e9-47d5-a106-2b802a71ab7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:05:16.757009 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-cffe5ec2-94e9-47d5-a106-2b802a71ab7d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.419548 Sep 08 10:05:16.757558 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Sep 8 10:05:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:05:17.990510 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:17.991604 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 Sep 08 10:05:17.992006 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:18.524324 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-8bec31a9-eccb-4112-9a40-adb8e06fb2a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:05:18.547820 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-8bec31a9-eccb-4112-9a40-adb8e06fb2a6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.416101 Sep 08 10:05:18.548962 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Sep 8 10:05:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:05:19.794943 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:19.796036 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 08 10:05:19.796455 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:20.327325 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-488dd436-63c7-4133-88f9-1b177d735d9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:05:20.346021 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-488dd436-63c7-4133-88f9-1b177d735d9f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.413988 Sep 08 10:05:20.346566 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Sep 8 10:05:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:05:21.580500 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:21.581578 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 08 10:05:21.581921 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:05:22.111496 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-fe500d77-9023-4bcd-b0c3-34514c583e19 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:05:22.132082 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-fe500d77-9023-4bcd-b0c3-34514c583e19 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.412871 Sep 08 10:05:22.132621 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Thu Sep 8 10:05:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:06:19.358591 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:06:19.359725 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-4769ff55-e663-473b-b681-4730334310f2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 08 10:06:19.360132 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Thu Sep 8 10:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:06:19.371327 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:06:19.770535 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-63582fac-3dae-4225-b4de-0d38fbfb19b2 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:06:19.791383 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-63582fac-3dae-4225-b4de-0d38fbfb19b2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.424557 Sep 08 10:06:19.791955 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:06:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:06:19.813391 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_api:SELECT=14 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:06:19.817767 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-16716dd8-fdf6-4f33-9fc7-e845b2985c55 admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:06:19.825762 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-16716dd8-fdf6-4f33-9fc7-e845b2985c55 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013771 Sep 08 10:06:19.826397 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Thu Sep 8 10:06:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:06:19.838924 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-aba201bb-3764-4b03-bc2a-3a5679c9d06e admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:06:19.846576 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-aba201bb-3764-4b03-bc2a-3a5679c9d06e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011244 Sep 08 10:06:19.847128 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Thu Sep 8 10:06:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:06:19.858911 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-f8a8d842-4262-4fec-ac37-6c07aa0588ba admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:06:19.869092 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-f8a8d842-4262-4fec-ac37-6c07aa0588ba admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013809 Sep 08 10:06:19.869623 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Thu Sep 8 10:06:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:06:19.881979 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-a5fcd7ff-3b24-4431-8885-dcf8dd933e64 admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:06:19.889164 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-a5fcd7ff-3b24-4431-8885-dcf8dd933e64 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010993 Sep 08 10:06:19.889933 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Thu Sep 8 10:06:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:11:49.816032 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-f8a8d842-4262-4fec-ac37-6c07aa0588ba admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:11:49.817058 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-f8a8d842-4262-4fec-ac37-6c07aa0588ba admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 08 10:11:49.817452 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:11:49.957532 n-d-833090-19 devstack@n-api.service[106577]: DEBUG dbcounter [-] [106577] Writing DB stats nova_api:SELECT=6 {{(pid=106577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:11:50.100700 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:11:50.105491 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:11:50.105969 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:11:50.106400 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:11:50.107132 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:11:50.107614 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:11:50.108038 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:11:50.148710 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-69b4a865-b3a9-4eb2-af65-ad8dfd21826e admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.192325 Sep 08 10:11:50.149281 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:11:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:11:51.233481 n-d-833090-19 devstack@n-api.service[106576]: DEBUG nova.api.openstack.wsgi [None req-f8a8d842-4262-4fec-ac37-6c07aa0588ba admin admin] Calling method '>' {{(pid=106576) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:11:51.234495 n-d-833090-19 devstack@n-api.service[106576]: INFO nova.api.openstack.requestlog [None req-f8a8d842-4262-4fec-ac37-6c07aa0588ba admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 08 10:11:51.234892 n-d-833090-19 devstack@n-api.service[106576]: [pid: 106576|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Sep 8 10:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:11:51.425104 n-d-833090-19 devstack@n-api.service[106577]: DEBUG nova.api.openstack.wsgi [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Calling method '>' {{(pid=106577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:11:51.428601 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:11:51.429113 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:11:51.429545 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:11:51.430260 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:11:51.430707 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:11:51.431129 n-d-833090-19 devstack@n-api.service[106577]: DEBUG oslo_concurrency.lockutils [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:11:51.454298 n-d-833090-19 devstack@n-api.service[106577]: INFO nova.api.openstack.requestlog [None req-01ea64b7-5d2d-4f7c-881d-898da2f987eb admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.081224 Sep 08 10:11:51.454857 n-d-833090-19 devstack@n-api.service[106577]: [pid: 106577|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:11:51 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:12:40.242707 n-d-833090-19 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 10:12:40.243286 n-d-833090-19 devstack@n-api.service[106567]: Thu Sep 8 10:12:40 2022 - graceful shutdown triggered... Sep 08 10:12:40.243910 n-d-833090-19 devstack@n-api.service[106577]: Gracefully killing worker 2 (pid: 106577)... Sep 08 10:12:40.244652 n-d-833090-19 devstack@n-api.service[106576]: Gracefully killing worker 1 (pid: 106576)... Sep 08 10:12:40.370949 n-d-833090-19 devstack@n-api.service[106576]: DEBUG dbcounter [-] [106576] Writing DB stats nova_api:SELECT=4 {{(pid=106576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:12:41.243575 n-d-833090-19 devstack@n-api.service[106567]: worker 1 buried after 1 seconds Sep 08 10:12:41.243575 n-d-833090-19 devstack@n-api.service[106567]: worker 2 buried after 1 seconds Sep 08 10:12:41.243575 n-d-833090-19 devstack@n-api.service[106567]: goodbye to uWSGI. Sep 08 10:12:41.245180 n-d-833090-19 systemd[1]: devstack@n-api.service: Succeeded. Sep 08 10:12:41.245761 n-d-833090-19 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 10:12:41.248810 n-d-833090-19 systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 10:12:41.267805 n-d-833090-19 devstack@n-api.service[122445]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 10:12:41 2022] *** Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: nodename: n-d-833090-19 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: machine: x86_64 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: clock source: unix Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: pcre jit disabled Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: detected number of CPU cores: 4 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: current working directory: / Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: detected binary path: /usr/bin/uwsgi-core Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: your processes number limit is 47680 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: your memory page size is 4096 bytes Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: detected max file descriptor number: 2048 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: lock engine: pthread robust mutexes Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: thunder lock: enabled Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 10:12:41.287235 n-d-833090-19 devstack@n-api.service[122445]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 10:12:41.333625 n-d-833090-19 devstack@n-api.service[122445]: Python main interpreter initialized at 0x562f556979c0 Sep 08 10:12:41.333625 n-d-833090-19 devstack@n-api.service[122445]: python threads support enabled Sep 08 10:12:41.333625 n-d-833090-19 devstack@n-api.service[122445]: your server socket listen backlog is limited to 100 connections Sep 08 10:12:41.333625 n-d-833090-19 devstack@n-api.service[122445]: your mercy for graceful operations on workers is 90 seconds Sep 08 10:12:41.334042 n-d-833090-19 devstack@n-api.service[122445]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 10:12:41.334042 n-d-833090-19 devstack@n-api.service[122445]: *** Operational MODE: preforking *** Sep 08 10:12:41.334255 n-d-833090-19 devstack@n-api.service[122445]: *** uWSGI is running in multiple interpreter mode *** Sep 08 10:12:41.334255 n-d-833090-19 devstack@n-api.service[122445]: spawned uWSGI master process (pid: 122445) Sep 08 10:12:41.334474 n-d-833090-19 systemd[1]: Started Devstack devstack@n-api.service. Sep 08 10:12:41.335068 n-d-833090-19 devstack@n-api.service[122445]: spawned uWSGI worker 1 (pid: 122456, cores: 1) Sep 08 10:12:41.335428 n-d-833090-19 devstack@n-api.service[122445]: spawned uWSGI worker 2 (pid: 122457, cores: 1) Sep 08 10:12:41.335705 n-d-833090-19 devstack@n-api.service[122445]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 10:12:42.001401 n-d-833090-19 devstack@n-api.service[122456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:12:42.013068 n-d-833090-19 devstack@n-api.service[122457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 10:12:43.170190 n-d-833090-19 devstack@n-api.service[122456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:12:43.170190 n-d-833090-19 devstack@n-api.service[122456]: from cryptography.utils import int_from_bytes Sep 08 10:12:43.170832 n-d-833090-19 devstack@n-api.service[122456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:12:43.170832 n-d-833090-19 devstack@n-api.service[122456]: from cryptography.utils import int_from_bytes Sep 08 10:12:43.184040 n-d-833090-19 devstack@n-api.service[122457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:12:43.184040 n-d-833090-19 devstack@n-api.service[122457]: from cryptography.utils import int_from_bytes Sep 08 10:12:43.184628 n-d-833090-19 devstack@n-api.service[122457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 10:12:43.184628 n-d-833090-19 devstack@n-api.service[122457]: from cryptography.utils import int_from_bytes Sep 08 10:12:45.605200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:12:45.605769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:12:45.606080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:12:45.606331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:12:45.606596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:12:45.606998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.607327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.607682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.608013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.608352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.608667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.609594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.609931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.610266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.610578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.610901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.611294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-19 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.611616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.611921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.612241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.612570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.612881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.613213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.613537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.614058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.614799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.614954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.615240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.615736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.615942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.616246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.616568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.616885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.617220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.617538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.617968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-19 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.618290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.618598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.618920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.619354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.619763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.620015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.620346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.620672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.620984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.621319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.621649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.621973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.622548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.622865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.623181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.623522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.623852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.624165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.624473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.625314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.625631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.625960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.626287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.626652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.626877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.627134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.627475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.627812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.628130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.628445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.628757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.629070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.629381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.629691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.630000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.631278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.631278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.631278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.631278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.631660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.631917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.632334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.632592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.632906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.633256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.633580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.633894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.634219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.634547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.634858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.635172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.635586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.635829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.636175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.636486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.636742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.637050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.637365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.637690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.638003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.638315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.638627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.638932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.639245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.639586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.639903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.640251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.641065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.641429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.641701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.642018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.642332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.642647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.642980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.643307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.643647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.643963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.644277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.644592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.644922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.645232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.645545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.645875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.646190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.646504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.646829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.647143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.647478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.647802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.648112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.648424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.648748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.649914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.649914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.649914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.650202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.650351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.650558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.650868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.651182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.651516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.651849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.652183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.652499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.652812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.653125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.653455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.653802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.654140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.654495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.654816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.655157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.655522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.655922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.656758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.657083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.657416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.657734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.658052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.658370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.658697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.659023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.659363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.659711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.660036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.660362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.660683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.661010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.661353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.661685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.662004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.662351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.662709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.663035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.663366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.663721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.664041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.664358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.664674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.665029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.665474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.665796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.666124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.666444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.666778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.667099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.667420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.667765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.668085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.668577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.668937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.669262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.669595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.669922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.670245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.670574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.671220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.671220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.672417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.672417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.672417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.673027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.673027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.673449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.673449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.673744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.674059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.674450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.674766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.675086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.675412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.675778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.676094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.676412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.676732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.677045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.677385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.677700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.678013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.678355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.678656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.678969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.679293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.679635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.679955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.680274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.680592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.680921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.681241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.681565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.681911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.682257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.682565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.682890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.683221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.683600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.683908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.684225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.684538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.684852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.685161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.685478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.685789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.686104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.686411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.686721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.687033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.687407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.687748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.688066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.688372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.688684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.689039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.689349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.689695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.690037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.690368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.690701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.691019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.691341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.691700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.692024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.692341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.692660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.692989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.693307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.693637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.693952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.694289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.694602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.694930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.695244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.695589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.695939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.696284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.696606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.696938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.697260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.697580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.697898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.698218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.698537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.698856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.699187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.699598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.699931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.700248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.700578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.700896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.701341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.701670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.701997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.702334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.702701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.703533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.703854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.704185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.704508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.704827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.705145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.705458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.705770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.706088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.706411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.706729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.707044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.707356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.707702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.708019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.708330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.708640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.708956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.709285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.709601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.709931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.710258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.710569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.710880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.711216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.711549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.711864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.712051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 10:12:45.712504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.712592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 10:12:45.712746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.712850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.712934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 10:12:45.713118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.713219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 10:12:45.713432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.713587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 10:12:45.713754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.713854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.714082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.714185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.714451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.714566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.714720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.714812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.715039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.715131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.715399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.715517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.715758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.715849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.716085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.716233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.716416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.716508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.716676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.716774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.716996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.717095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.717327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-19 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.717426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.717656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.717747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.717970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.718062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.718287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.718414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.719167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.719275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.719503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.719613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.719818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.719910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.720140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.720232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.720467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.720648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.720967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.721066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.721280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.721370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.721595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.721695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.721937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.722038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.722356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.722484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.722677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.722801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.723014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.723344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.723820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.724021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.724168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.724318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.724461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.724713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.724881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.725034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.725178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.725318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-19 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.725469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.725612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.725762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.725904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.726055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.726197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.726352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.726502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.726653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.726796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.726938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.727173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.727308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.727859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.728356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.728551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.728843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.728944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.729166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.729267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.729492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.729600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.729812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.729928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.730145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.730244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.730464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.730563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.730778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.730882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.731090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.731194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.731402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.731527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.731784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.731944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.732158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.732320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.732562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.732834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.732988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.733095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.733246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.733386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.733561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.733717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.733875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.734568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.734738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.734914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.735062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.735213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.735378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.735523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.735680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.735800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.735999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.736168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.736318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.736542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.736634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.736875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.737032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.737211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.737366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.737511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.737625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.737793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.737963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.738133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.738281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.738420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.738649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.738793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.738940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.739089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.739239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.739408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.739611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.739701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.739798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.739977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.740086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.740277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.740367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.740594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.740715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.740905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.741006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.741225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.741324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.741543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.741717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.741869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.741961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.742183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.742294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.742497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.742603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.742809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.742909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.743120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.743218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.743434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.743546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.743768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.743866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.744092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.744181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.744410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.744522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.744724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.744816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.744967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.745062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.745273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.745366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.745586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.745729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.745911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.746003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.746227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.746326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.746563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.746733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.746902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.747177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.747779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.747964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.748119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.748299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.748464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.748618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.748773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.749119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.749269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.749419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.749560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.750324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.750524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.750680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.750822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.750973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.751134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.751286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.751436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.751658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.751821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.751964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.752114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.752114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.752423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.752581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.752740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.752883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.753027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.753244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.753374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.753510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.753606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.753697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.753810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.753950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.754048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.754188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.754289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.754521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.754612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.754846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.754944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.755167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.755260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.755523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.755705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.755859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.756097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.756270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.756426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.756570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.756743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.756894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.757061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.757215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.757359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.757535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.757695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.757862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.757967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.758182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.758275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.758512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.758611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.758830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.758931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.759204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.759318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.759490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.759771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.759921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.760103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.760251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.760400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.760555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.760730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.760842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.761051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.761165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.761375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.761502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.761781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.761955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.762108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.762278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.762426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.762566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.762724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.762883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.763027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.763167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.763411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 10:12:45.763576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.763735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.763942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.764101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.764260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.764442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.764602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.764764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.764918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.765072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.765354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.765505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.765734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.765854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.766049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.766177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.766370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.766463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.766684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.766785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.767065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.767163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.767387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.767548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.767741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.767862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.768068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.768171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.768382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.768472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.768703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.768804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.769977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.770075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.770299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.770390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.770627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.770746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.770962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.771057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.771290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.771388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.771626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.771732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.771952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.772052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.772283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.772444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.772596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.772694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.772909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.773000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.773225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.773411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.773558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.773660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.773860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.774025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.774227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.774361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.774548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.774702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.774872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.775025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.775193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.775341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.775543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.775796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.775890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.776117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.776234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.776437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.776538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.776769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.776860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.777098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.777203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.777419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.777511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.777736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.777830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.778079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.778206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.778387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.778540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.778714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.778813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.779044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.779145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.779366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.779554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.779711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.779810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.780027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.780120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.780343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.780436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.780661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.780753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.781491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.781619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.781809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.781942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.782124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.782244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.782446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.782608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.782763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.782929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.783074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.783230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.783500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.783637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.783738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.783829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.784048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.784150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.784364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.784465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.784681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.784785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.785001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.785111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.785556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.785722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.785875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.786904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.787990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.788134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.788274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.788552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.788712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.788855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.789010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.789177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.789320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.789489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.789847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.789990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.790142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.790291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.790440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.790581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.790738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.790895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.791045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.791246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.791400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.791685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.791832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.791989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.792978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.793940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.794112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.794213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.794425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.794515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.794738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.794879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.795053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.795153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.795363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.795499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.795789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.795894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.796034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.796141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.796314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.796458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.797223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.797413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.797540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.797640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.797852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.797954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.798163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.798255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.798595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.798756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.798846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.798937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.799106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.799244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.799438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.799858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.799966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.800068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.800386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.800702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.800900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.801985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.802144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.802324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.802468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.802681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.802884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.802978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.803063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.803274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.803455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.803749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.803936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.804258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.804583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.804757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.804904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.805055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.805200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.805322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.805517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.805706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.805932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.806070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.806424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.806544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.806750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.806841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.807073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.807165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.807393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.807515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.807738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.807845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.808061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.808161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.808383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.808474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.808703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.808868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.809022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.809122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.809342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.809441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.809660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.809756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.810949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.811993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.812746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.812922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.813081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.813184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.813491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.813608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.813746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.813878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.814995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.815090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.815316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.815407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.815728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.815844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.815989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.816128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.816309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.816427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.816630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.816754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.816951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.817078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.817267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.817400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.817581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.817735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.817992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.818108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.818226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.818391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.818545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.818714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.818864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.819037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.819204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.819369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.819541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.819840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.819959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.820158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.820277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.820472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.820593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.820789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.820883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.821121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.821215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.821444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.821553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.821775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.821869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.822105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.822209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.822419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.822526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.822732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.822832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.823048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.823151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.823366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.823501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.823703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.823835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.824043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.824233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.824396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.824544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.824696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.824850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.825002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.825152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.825309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.825475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.825833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.826197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.826521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.826855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.827187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.827536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.828420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.828590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.828758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.828926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.829204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.829364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.829510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.829668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.829860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.830066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.830216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.830464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.830622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.830765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.830915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.831072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.831223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.831393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.831584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.831844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.832007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.832178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.832321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.832470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.832843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.833067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.833247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.833415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.833567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.833720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.833870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.834921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.835064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.835214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.835363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.835560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.835810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.835810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.836097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.836250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.836400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.836561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.836717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.836862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.837885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.838990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.839140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.839290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.839438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.839620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.839774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.839926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.840069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.840796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.840796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.841108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.841260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.841863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.841863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.841863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.842282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.842426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.842426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.842747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.842898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.843048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.843244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.843432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.843658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.843820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.843963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.844105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.844258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.844410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.844566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.844710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.844852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.845002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.845154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.845306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.845473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.845617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.845784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.846900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.847964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.848118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.848261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.848413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.848563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.848712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.848860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.849928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.850961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.851112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.851253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.851393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.851704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.851881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.852912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.853885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.854206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.854370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.854522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.854667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.854816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.854966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.855109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.855311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.855500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.855664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.855816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.855985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.856213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.856370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.856520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.856663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.856805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.856947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.857855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.858140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.858282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.858431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.858573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.883974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.884853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.885113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.885605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.885760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.885954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.886873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.887200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.887365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.887584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.887744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.887901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.887901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.888211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.888495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.888755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.889039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.889304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.889543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.889751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.889751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.890311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.891104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.891239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.891239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.891505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.891639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.891761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.892926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.893864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.894026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.894155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.894279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.894518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.894987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.895144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.895270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.895395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.895709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.895709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.895954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.896159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.896287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.896412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.896534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.896659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.896870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.897899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.898928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.899880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.900041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.900195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.900373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.900621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.900880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.901127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.901342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.901484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.901610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.901734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.901734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.902023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.902288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.902510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.902723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.902723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.903102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.903274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.903442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.903645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.903817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.903950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.904081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.904241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.904387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.904539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.904761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.905225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.905414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.905557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.905902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.906158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.906402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.906774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.907118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.907268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.907409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.908952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.909711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.910625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.910625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.910625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.910625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.910625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.910625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.911303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.911581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.911716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.911877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.912917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.914012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.915439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.916687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.917920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.918612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.919726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.920701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.921898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.923037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.924800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.925406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.925666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.926557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.926557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.926557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.926930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.927111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.927439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.927787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.928117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.928445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.928767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.929093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.929419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.929753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.930425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.930776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.931101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.931423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.931787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.932111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.932435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.932770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.933077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.933403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.933721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.934172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.934372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.934706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.935127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.935563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.935812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.936043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.936366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.936735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.937587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.937882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.938645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.938645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.938913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.939170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.939512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.939839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.940225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.940506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.940828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.941150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.941469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.941836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.942139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.942473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.942792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.943111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.943531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.944091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.944413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.944891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.945245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.945575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.945922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.946192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.946521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.946840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.947139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.947453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.947801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.948109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.948437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.948752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.949063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.949388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.949700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.950263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.950623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.951242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.951675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.952023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.952300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.952615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.953539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.953855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.954168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.954490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.954809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.955171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.955600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.955978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.956246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.956435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.956750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.957091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.957377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.957687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.957997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.958307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.958624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.958936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.959245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.959581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.959892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.960208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.960517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.960833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.961144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.961458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.961813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.962128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.962419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.962748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.963059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.963366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.963716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.964029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.964388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.964675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.964990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.965346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.965710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.965875 n-d-833090-19 devstack@n-api.service[122456]: INFO dbcounter [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Registered counter for database nova_api Sep 08 10:12:45.966350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.966593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.966919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.967262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.967618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.967983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.968245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.968588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.968918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.969235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.969551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.969866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.970179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.970493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.970805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.971146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.971469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.971790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.972107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.972418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.972730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.973044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.973361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.973675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.974020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.974346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.974670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.974992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.975314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.975660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.975964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.976314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.976593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.976902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.977328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.977550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.977860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.978299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.978643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.978969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.979294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.979630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.979959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.980283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.981616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.981616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.981616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.981616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.982441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.982851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.983185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.983642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.984216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.984405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.984673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.984927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.985261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.985557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.985978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.986161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.986782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_db.sqlalchemy.engines [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:45.986988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.986988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.987324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.987324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.987879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.988037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.988326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.988545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.988852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.989157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.989465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.989772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.990078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.990385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.990689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.990998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.991304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.991719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.992059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.992394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.992710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.993000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.993397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.993562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writer thread running {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:45.993702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.993948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.994364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.994674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.994962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.995299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.995632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.995949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.996263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.996632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.996898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.997192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.997772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.998098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.998510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.998784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.999407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:45.999407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.000255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.000514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.000941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.001430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.002041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.002041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.002317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.002470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.002802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.003141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.003489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.003796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.004114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.004532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.004773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.005267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.006009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.006402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.006799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.007219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.007564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.007945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.008274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.008641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.008940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 10:12:46.009200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 10:12:46.051786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.context [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=122456) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:12:46.056335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:12:46.056335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:12:46.057944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:12:46.058740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:12:46.063280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:12:46.063280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:12:46.064029 n-d-833090-19 devstack@n-api.service[122456]: INFO dbcounter [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Registered counter for database nova_cell0 Sep 08 10:12:46.070070 n-d-833090-19 devstack@n-api.service[122456]: INFO dbcounter [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Registered counter for database nova_cell1 Sep 08 10:12:46.073304 n-d-833090-19 devstack@n-api.service[122457]: INFO dbcounter [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Registered counter for database nova_api Sep 08 10:12:46.077605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_db.sqlalchemy.engines [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.079581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_db.sqlalchemy.engines [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.086147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writer thread running {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.087532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writer thread running {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.095885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_db.sqlalchemy.engines [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.102926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writer thread running {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.161982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.context [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=122457) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 10:12:46.165929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:12:46.166502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:12:46.168012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:12:46.168998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:12:46.169595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:12:46.172253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:12:46.174249 n-d-833090-19 devstack@n-api.service[122457]: INFO dbcounter [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Registered counter for database nova_cell0 Sep 08 10:12:46.179914 n-d-833090-19 devstack@n-api.service[122457]: INFO dbcounter [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Registered counter for database nova_cell1 Sep 08 10:12:46.187795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_db.sqlalchemy.engines [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.189555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_db.sqlalchemy.engines [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.195554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writer thread running {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.197635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writer thread running {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.248222 n-d-833090-19 devstack@n-api.service[122456]: INFO dbcounter [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Registered counter for database nova_cell0 Sep 08 10:12:46.255168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_db.sqlalchemy.engines [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.259742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writer thread running {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.351581 n-d-833090-19 devstack@n-api.service[122457]: INFO dbcounter [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Registered counter for database nova_cell0 Sep 08 10:12:46.358779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_db.sqlalchemy.engines [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 10:12:46.364193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writer thread running {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 10:12:46.585915 n-d-833090-19 devstack@n-api.service[122456]: WARNING keystonemiddleware.auth_token [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:12:46.593853 n-d-833090-19 devstack@n-api.service[122456]: WARNING keystonemiddleware.auth_token [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:12:46.712707 n-d-833090-19 devstack@n-api.service[122457]: WARNING keystonemiddleware.auth_token [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:12:46.720744 n-d-833090-19 devstack@n-api.service[122457]: WARNING keystonemiddleware.auth_token [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:12:46.938261 n-d-833090-19 devstack@n-api.service[122456]: WARNING keystonemiddleware.auth_token [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:12:46.944719 n-d-833090-19 devstack@n-api.service[122456]: WARNING keystonemiddleware.auth_token [None req-4d7198d8-1ba8-40b5-8cab-d61a8a6419d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:12:46.950299 n-d-833090-19 devstack@n-api.service[122456]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f556979c0 pid: 122456 (default app) Sep 08 10:12:47.109753 n-d-833090-19 devstack@n-api.service[122457]: WARNING keystonemiddleware.auth_token [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 10:12:47.115814 n-d-833090-19 devstack@n-api.service[122457]: WARNING keystonemiddleware.auth_token [None req-cccc356d-4287-4542-9ffe-c96c48dedfd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 10:12:47.121080 n-d-833090-19 devstack@n-api.service[122457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f556979c0 pid: 122457 (default app) Sep 08 10:13:27.294408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.295288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.297961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.299246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.627883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.629974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.630962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:27.631854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:28.550936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dd0b207-fa36-47c2-ae93-6e7863c24f1c tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-581294822", "id": 1969468151, "os-flavor-access:is_public": "True"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:28.625691 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7dd0b207-fa36-47c2-ae93-6e7863c24f1c tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 1.337012 Sep 08 10:13:28.634005 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1/1] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:13:27 2022] POST /compute/v2.1/flavors => generated 448 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:13:29.036668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '.version_select at 0x7f2352ca2b80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.047912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=122457) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 08 10:13:29.049583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.050144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.050510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.077929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.078344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.079070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.084580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdee8732-e134-4b36-ab83-c238e6971f1d tempest-FlavorsV255TestJSON-870474773 tempest-FlavorsV255TestJSON-870474773-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.097718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.098478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.099161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.107389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fdee8732-e134-4b36-ab83-c238e6971f1d tempest-FlavorsV255TestJSON-870474773 tempest-FlavorsV255TestJSON-870474773-project] 10.222.0.59 "GET /compute/v2.1/flavors/1969468151" status: 200 len: 448 microversion: 2.55 time: 0.471546 Sep 08 10:13:29.108578 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2/2] 10.222.0.59 () {60 vars in 1199 bytes} [Thu Sep 8 10:13:28 2022] GET /compute/v2.1/flavors/1969468151 => generated 448 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:13:29.111654 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-866451fc-515a-4914-83fc-3e4d09a732e2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.490056 Sep 08 10:13:29.112458 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1/3] 10.222.0.59 () {58 vars in 1167 bytes} [Thu Sep 8 10:13:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:29.480732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.482359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.483124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.483589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.484322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.485221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.485651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.499638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Calling method '.version_select at 0x7f2352c120d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.507144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.509093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.509542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.529141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.530384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.530959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.531615 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-556fee60-46ee-4e1e-867b-d61032154f6b tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] 10.222.0.59 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.421808 Sep 08 10:13:29.541170 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1164 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:29.545968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ada9820-9d91-4407-a36d-6b565b164ba4 tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] Action: 'update', calling method: .version_select at 0x7f2352fee310>, body: {"flavor": {"description": "new"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:29.546520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.547447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.548219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.555590 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-018624d4-02a1-4ed0-907e-43738aa96298 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.441855 Sep 08 10:13:29.556614 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2/5] 10.222.0.59 () {60 vars in 1208 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:13:29.562096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0fab8113-57cc-4755-b76e-86581cc6d6de tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-581430910", "name": "tempest-test_aggregate-1987969330"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:29.607950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-0fab8113-57cc-4755-b76e-86581cc6d6de tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 435a8d29-3f37-4ed2-abc2-9dd77fdeb3ad for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:13:29.613769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ada9820-9d91-4407-a36d-6b565b164ba4 tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/1969468151" status: 200 len: 449 microversion: 2.55 time: 0.071290 Sep 08 10:13:29.614328 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 4/6] 10.222.0.59 () {62 vars in 1219 bytes} [Thu Sep 8 10:13:29 2022] PUT /compute/v2.1/flavors/1969468151 => generated 449 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:13:29.721328 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0fab8113-57cc-4755-b76e-86581cc6d6de tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.163263 Sep 08 10:13:29.723343 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3/7] 10.222.0.59 () {60 vars in 1165 bytes} [Thu Sep 8 10:13:29 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:29.767824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df4c21bf-f738-4ca1-bbae-fc53a7f057dc tempest-AZAdminNegativeTestJSON-18772848 tempest-AZAdminNegativeTestJSON-18772848-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.769586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df4c21bf-f738-4ca1-bbae-fc53a7f057dc tempest-AZAdminNegativeTestJSON-18772848 tempest-AZAdminNegativeTestJSON-18772848-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f6766e7b972048a6984cc81aa88919b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9c2c326f64ee4b22c8a2437549864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df4c21bf-f738-4ca1-bbae-fc53a7f057dc tempest-AZAdminNegativeTestJSON-18772848 tempest-AZAdminNegativeTestJSON-18772848-project] Request method failure captured: Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBGQv3LuCH6m4dheOFu9iv2bwM-VjcYD55VQ2B_puootmepzkqjq9RDkHB7R2oXNTLpUogUCtKMaWgjvytf1Hn7jELXAHj9eJp0BZKH5Tm_9uUeZNIXRBtW_T4AvDj0_kHpa32DzMAJutBl0kyWWMKsDt4nJGr91qnmYrmozb0Yv7I Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25c9c2c326f64ee4b22c8a2437549864 Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AZAdminNegativeTestJSON-18772848 Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:29.773190 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25c9c2c326f64ee4b22c8a2437549864"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25c9c2c326f64ee4b22c8a2437549864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25c9c2c326f64ee4b22c8a2437549864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25c9c2c326f64ee4b22c8a2437549864", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AZAdminNegativeTestJSON-18772848 Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25c9c2c326f64ee4b22c8a2437549864 Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-18772848 Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AZAdminNegativeTestJSON-18772848-project Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: f6766e7b972048a6984cc81aa88919b5 Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AZAdminNegativeTestJSON-18772848-project Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 10:13:29.774237 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:29.774959 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:29.775942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df4c21bf-f738-4ca1-bbae-fc53a7f057dc tempest-AZAdminNegativeTestJSON-18772848 tempest-AZAdminNegativeTestJSON-18772848-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:29.780557 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df4c21bf-f738-4ca1-bbae-fc53a7f057dc tempest-AZAdminNegativeTestJSON-18772848 tempest-AZAdminNegativeTestJSON-18772848-project] 10.222.0.59 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.159363 Sep 08 10:13:29.780557 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 5/8] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:29.784524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.786359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.786846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.787280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.788127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.789171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.789741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.818238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] 10.222.0.59 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.041672 Sep 08 10:13:29.819647 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 6/9] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:29.821720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.822713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa1728ed-5644-47f2-945d-79b1fe2f96cc tempest-AZAdminV2TestJSON-980790666 tempest-AZAdminV2TestJSON-980790666-project-admin] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002079 Sep 08 10:13:29.823130 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 7/10] 10.222.0.59 () {56 vars in 886 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 10:13:29.829067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8394e845-7821-494f-85b7-f2b75cf604fb tempest-FlavorsV255TestJSON-870474773 tempest-FlavorsV255TestJSON-870474773-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.862913 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8394e845-7821-494f-85b7-f2b75cf604fb tempest-FlavorsV255TestJSON-870474773 tempest-FlavorsV255TestJSON-870474773-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.038587 Sep 08 10:13:29.863892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 8/11] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:13:29.872653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-434007e1-cbed-4de2-8758-f7efec2a0a6d tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.885245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-434007e1-cbed-4de2-8758-f7efec2a0a6d tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.020161 Sep 08 10:13:29.886116 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 9/12] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:29.891792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2ea18a9-268e-4ebd-82d3-cb938fbb515f tempest-FlavorsV255TestJSON-870474773 tempest-FlavorsV255TestJSON-870474773-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:29.915755 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2ea18a9-268e-4ebd-82d3-cb938fbb515f tempest-FlavorsV255TestJSON-870474773 tempest-FlavorsV255TestJSON-870474773-project] 10.222.0.59 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.027364 Sep 08 10:13:29.917126 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 10/13] 10.222.0.59 () {60 vars in 1166 bytes} [Thu Sep 8 10:13:29 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:13:29.922871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68700913-f9e0-4e4a-a61b-9f995025e967 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:29.963729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68700913-f9e0-4e4a-a61b-9f995025e967 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:29.964238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68700913-f9e0-4e4a-a61b-9f995025e967 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:29.965614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68700913-f9e0-4e4a-a61b-9f995025e967 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:29.989498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba314536-911b-4338-8c6f-14a771b8fdb4 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1545692508", "id": 419911014, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:30.035599 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba314536-911b-4338-8c6f-14a771b8fdb4 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.310795 Sep 08 10:13:30.040757 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4/14] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:29 2022] POST /compute/v2.1/flavors => generated 427 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:30.056881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a481f05-f906-49e6-a04a-7356936fc0cc tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.097217 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a481f05-f906-49e6-a04a-7356936fc0cc tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1969468151" status: 202 len: 0 microversion: 2.55 time: 0.055036 Sep 08 10:13:30.098014 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 5/15] 10.222.0.59 () {60 vars in 1202 bytes} [Thu Sep 8 10:13:30 2022] DELETE /compute/v2.1/flavors/1969468151 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:13:30.104834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0472295f-c378-4df3-bc74-e20c779aaaec tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.124489 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0472295f-c378-4df3-bc74-e20c779aaaec tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/419911014" status: 202 len: 0 microversion: 2.1 time: 0.025011 Sep 08 10:13:30.128101 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 6/16] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:30 2022] DELETE /compute/v2.1/flavors/419911014 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:30.130809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22b4f13b-17ea-46eb-8d8e-a3663fa9c48c tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.165310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22b4f13b-17ea-46eb-8d8e-a3663fa9c48c tempest-FlavorsV255TestJSON-2031201852 tempest-FlavorsV255TestJSON-2031201852-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.039110 Sep 08 10:13:30.165907 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 7/17] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:13:30.171637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9437d25c-a003-46fa-a8cd-bcbf0db38065 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.193323 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9437d25c-a003-46fa-a8cd-bcbf0db38065 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026253 Sep 08 10:13:30.195502 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 8/18] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:30.214866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ebf1b16-df4b-427d-a0d4-27538d8a0e5f tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1732613883", "id": 106737093, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:30.235985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ebf1b16-df4b-427d-a0d4-27538d8a0e5f tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.025965 Sep 08 10:13:30.236582 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 9/19] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:30.249745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03e15068-ef3c-49f3-a2ae-fe924a200501 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.271252 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03e15068-ef3c-49f3-a2ae-fe924a200501 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.026097 Sep 08 10:13:30.271943 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 10/20] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:30.290749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75782e11-600a-4e5a-93ad-71bc291e427f tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.309516 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-75782e11-600a-4e5a-93ad-71bc291e427f tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/106737093" status: 202 len: 0 microversion: 2.1 time: 0.022297 Sep 08 10:13:30.310541 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 11/21] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:30 2022] DELETE /compute/v2.1/flavors/106737093 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:13:30.321287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99eedf61-5241-4ab1-a0f0-51b027ac0dc1 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.344767 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99eedf61-5241-4ab1-a0f0-51b027ac0dc1 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027008 Sep 08 10:13:30.347665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 12/22] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:30.365154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-938b1168-3dcf-4dfd-98d9-f755f98a2910 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-191439454", "id": 283200849, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:30.391174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-938b1168-3dcf-4dfd-98d9-f755f98a2910 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.030036 Sep 08 10:13:30.391844 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 13/23] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:30 2022] POST /compute/v2.1/flavors => generated 425 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:30.406386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8bd26495-2de5-4a58-9929-8069bbf4d621 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.426430 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8bd26495-2de5-4a58-9929-8069bbf4d621 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/283200849" status: 202 len: 0 microversion: 2.1 time: 0.026412 Sep 08 10:13:30.427016 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 14/24] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:30 2022] DELETE /compute/v2.1/flavors/283200849 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:13:30.438086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04b4a2eb-5614-45de-995d-9c00378efbf5 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.459990 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04b4a2eb-5614-45de-995d-9c00378efbf5 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028182 Sep 08 10:13:30.460729 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 15/25] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:30.480116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8b15040-f7a7-455d-85bd-34aa400785a0 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-764078176", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:30.502245 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8b15040-f7a7-455d-85bd-34aa400785a0 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.025459 Sep 08 10:13:30.503533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 16/26] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:30 2022] POST /compute/v2.1/flavors => generated 506 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:30.515138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b4c4f1f-59ca-4136-a023-b1336836b2c1 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.533619 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b4c4f1f-59ca-4136-a023-b1336836b2c1 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/fb6d55c3-7a70-41a1-b4eb-feac3adc9c68" status: 202 len: 0 microversion: 2.1 time: 0.022752 Sep 08 10:13:30.534447 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 17/27] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:13:30 2022] DELETE /compute/v2.1/flavors/fb6d55c3-7a70-41a1-b4eb-feac3adc9c68 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:13:30.543768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-73b70b30-0f4b-4af7-b59f-6492b0ce72d8 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.564427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-73b70b30-0f4b-4af7-b59f-6492b0ce72d8 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025917 Sep 08 10:13:30.565180 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 18/28] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:30.588708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d31e3ad6-01cd-4e4d-9e2e-2d4efa27d57c tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-306209204", "id": "3c01a8b4-2811-4ea2-8403-4428004a9a97", "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:30.619718 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d31e3ad6-01cd-4e4d-9e2e-2d4efa27d57c tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.036680 Sep 08 10:13:30.620805 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 19/29] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:30 2022] POST /compute/v2.1/flavors => generated 506 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:30.637858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f6b92db-6e0a-4042-a82c-139fc4d0043a tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.657495 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f6b92db-6e0a-4042-a82c-139fc4d0043a tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/3c01a8b4-2811-4ea2-8403-4428004a9a97" status: 202 len: 0 microversion: 2.1 time: 0.028003 Sep 08 10:13:30.658693 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 20/30] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:13:30 2022] DELETE /compute/v2.1/flavors/3c01a8b4-2811-4ea2-8403-4428004a9a97 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:13:30.668874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7e72bd6-3e28-403d-8811-115e37278d12 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.690726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7e72bd6-3e28-403d-8811-115e37278d12 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026498 Sep 08 10:13:30.691320 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 21/31] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:30.710683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d781cd3-5a9b-41b2-a2bd-74de9877813f tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-636450937", "id": 1688545623, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:30.742896 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d781cd3-5a9b-41b2-a2bd-74de9877813f tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.035440 Sep 08 10:13:30.752767 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 22/32] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:30 2022] POST /compute/v2.1/flavors => generated 413 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:30.763774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00e8c1a1-00a4-4e7e-ba06-02292b177fcb tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:30.779195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=8,nova_api:DELETE=18 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:30.784951 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00e8c1a1-00a4-4e7e-ba06-02292b177fcb tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1688545623" status: 200 len: 413 microversion: 2.1 time: 0.029053 Sep 08 10:13:30.785528 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 23/33] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/1688545623 => generated 413 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:30.965683 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68700913-f9e0-4e4a-a61b-9f995025e967 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.045395 Sep 08 10:13:30.967304 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 11/34] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:13:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:31.300188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a99a33e4-bb5c-4945-8c1e-13ed53fb29ba tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.381013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a99a33e4-bb5c-4945-8c1e-13ed53fb29ba tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.586890 Sep 08 10:13:31.390034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 24/35] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:30 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:31.415986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-41770413-89ec-442c-85b0-a7477a9000c2 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.459679 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-41770413-89ec-442c-85b0-a7477a9000c2 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1688545623" status: 202 len: 0 microversion: 2.1 time: 0.052372 Sep 08 10:13:31.460294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 12/36] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:13:31 2022] DELETE /compute/v2.1/flavors/1688545623 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:31.472600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-354f7869-5648-4c03-84cf-7c8c63283abc tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.507430 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-354f7869-5648-4c03-84cf-7c8c63283abc tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040748 Sep 08 10:13:31.521263 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 25/37] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:31.531966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7bdf4dc8-529e-49c2-a028-2bfba38ead89 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-612991875", "id": 863018138, "os-flavor-access:is_public": "False"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:31.562762 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7bdf4dc8-529e-49c2-a028-2bfba38ead89 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.037957 Sep 08 10:13:31.564098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 26/38] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:31 2022] POST /compute/v2.1/flavors => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:31.578911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-368c2a5b-fb6c-4956-995b-e41eb7569536 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "863018138"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:31.609095 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-368c2a5b-fb6c-4956-995b-e41eb7569536 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] HTTP exception thrown: Flavor 863018138 could not be found. Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-368c2a5b-fb6c-4956-995b-e41eb7569536 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] Request method failure captured: Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 106 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBG3KyOQO6ycZ2-OWmXJSC0XUxdvCCLB3QwUhJqtkFEY6Pzo1n_SquIYZnzlrzG4tx--CocHruf2-0LxGxNMX6z6r2WNX7ELixhZDKTMMq4W02bF_6H4K2jUqMkclktkM6cXg6HT0OK78kgWavuKCeb0WPX_ePs255vN4esTFoDTZ4 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 7aea808057af477ea87b13ae9c797189 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsAdminTestJSON-2066419234 Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:13:31.619936 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7aea808057af477ea87b13ae9c797189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7aea808057af477ea87b13ae9c797189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7aea808057af477ea87b13ae9c797189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7aea808057af477ea87b13ae9c797189", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsAdminTestJSON-2066419234 Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 7aea808057af477ea87b13ae9c797189 Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2066419234 Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsAdminTestJSON-2066419234-project Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: cd82c8cd0ae742388c12308ce66a90b3 Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsAdminTestJSON-2066419234-project Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "test", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "863018138"}} Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:13:31.621287 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor 863018138 could not be found. Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '863018138'}}} Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 863018138 could not be found. Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:31.622019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 863018138 could not be found. Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:31.622938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:31.623999 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:31.623999 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:31.623999 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:31.623999 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 863018138 could not be found. Sep 08 10:13:31.623999 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:31.631379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-368c2a5b-fb6c-4956-995b-e41eb7569536 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] Returning 400 to user: Flavor 863018138 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:31.636080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-368c2a5b-fb6c-4956-995b-e41eb7569536 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.059782 Sep 08 10:13:31.640557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 27/39] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:31 2022] POST /compute/v2.1/servers => generated 80 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:13:31.649217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb69f92f-1360-4636-89a0-81ed4a446c24 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.675284 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb69f92f-1360-4636-89a0-81ed4a446c24 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/863018138" status: 202 len: 0 microversion: 2.1 time: 0.031466 Sep 08 10:13:31.679363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 28/40] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:31 2022] DELETE /compute/v2.1/flavors/863018138 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:31.696001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f91a474f-3c25-4161-ace2-3dd8580620fe tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.719474 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f91a474f-3c25-4161-ace2-3dd8580620fe tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038925 Sep 08 10:13:31.735297 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 29/41] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:31.740301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3829278-8ee0-420b-b552-8648a7e92b86 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-96896579", "id": 333133943, "os-flavor-access:is_public": "False"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:31.764384 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3829278-8ee0-420b-b552-8648a7e92b86 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.027211 Sep 08 10:13:31.764987 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 30/42] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:31 2022] POST /compute/v2.1/flavors => generated 410 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:31.776594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87242ff5-aee3-4350-bf48-0ef3f3482f67 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2014960339", "id": 74510820, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:31.795527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87242ff5-aee3-4350-bf48-0ef3f3482f67 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.022439 Sep 08 10:13:31.796576 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 31/43] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:31.809174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10eceabc-651a-4430-b643-14a12dddd4fa tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.832059 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10eceabc-651a-4430-b643-14a12dddd4fa tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.027424 Sep 08 10:13:31.832834 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 32/44] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:31.845705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b11a0108-4248-4888-b413-f1c07539afaa tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.856342 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b11a0108-4248-4888-b413-f1c07539afaa tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.014209 Sep 08 10:13:31.856920 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 33/45] 10.222.0.59 () {58 vars in 1177 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:31.869275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e7121fc-179b-4c6a-94c5-5211f4036ffa tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.879672 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e7121fc-179b-4c6a-94c5-5211f4036ffa tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.013821 Sep 08 10:13:31.880231 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 34/46] 10.222.0.59 () {58 vars in 1171 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:31.892721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-393ca294-6a05-4f6b-8919-e3a893389c11 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.903425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-393ca294-6a05-4f6b-8919-e3a893389c11 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.014384 Sep 08 10:13:31.904212 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 35/47] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:31.916360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-834334fb-9c33-42cf-9593-567c744fe934 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.937231 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-834334fb-9c33-42cf-9593-567c744fe934 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5389 microversion: 2.1 time: 0.024248 Sep 08 10:13:31.939595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 36/48] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5389 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:31.958468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08799495-0685-46bd-bed4-3ab9a23a4784 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:31.959503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-119303820", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "availability_zone": "tempest-test_az-581430910"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:31.975573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:31.976765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:31.977407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:31.978451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:31.979087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:31.979712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:31.982915 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08799495-0685-46bd-bed4-3ab9a23a4784 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5389 microversion: 2.1 time: 0.028444 Sep 08 10:13:31.983838 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 37/49] 10.222.0.59 () {58 vars in 1175 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5389 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.003164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02e14b34-84a8-4f1b-ac9f-6de79f3af9be tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.025538 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02e14b34-84a8-4f1b-ac9f-6de79f3af9be tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5389 microversion: 2.1 time: 0.027302 Sep 08 10:13:32.031515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 38/50] 10.222.0.59 () {58 vars in 1173 bytes} [Thu Sep 8 10:13:31 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5389 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.051938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a32983e1-6edc-4cda-b107-715613556df1 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.073079 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a32983e1-6edc-4cda-b107-715613556df1 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5389 microversion: 2.1 time: 0.029953 Sep 08 10:13:32.073790 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 39/51] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5389 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.092553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd747d97-611c-4219-a2e2-83c735e88629 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.111114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd747d97-611c-4219-a2e2-83c735e88629 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/74510820" status: 202 len: 0 microversion: 2.1 time: 0.022145 Sep 08 10:13:32.111730 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 40/52] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:13:32 2022] DELETE /compute/v2.1/flavors/74510820 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:13:32.119821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8cf83b8-c840-4397-8bf0-64d8485edbb0 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.141927 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8cf83b8-c840-4397-8bf0-64d8485edbb0 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025838 Sep 08 10:13:32.142603 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 41/53] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:32.161193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1eed680f-f6a3-4f21-868b-514ce0ca58a7 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.182891 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1eed680f-f6a3-4f21-868b-514ce0ca58a7 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/333133943" status: 202 len: 0 microversion: 2.1 time: 0.025067 Sep 08 10:13:32.187918 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 42/54] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:32 2022] DELETE /compute/v2.1/flavors/333133943 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:32.192173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab1f3dd8-681f-485e-a348-3afa1ebf4749 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.213189 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab1f3dd8-681f-485e-a348-3afa1ebf4749 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024328 Sep 08 10:13:32.220167 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 43/55] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.236378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb2785b8-8932-4067-af09-1a1ad0eda19d tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-321005981", "id": 2122639107, "os-flavor-access:is_public": "False"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:32.255037 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb2785b8-8932-4067-af09-1a1ad0eda19d tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022736 Sep 08 10:13:32.262946 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 44/56] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:32.269422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a52b168-b9fc-4ad3-b812-de07242cbb28 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.293868 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a52b168-b9fc-4ad3-b812-de07242cbb28 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028789 Sep 08 10:13:32.294889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 45/57] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:32.313726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-176cdf76-096d-44c1-8204-6eedecd5a848 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.342908 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-176cdf76-096d-44c1-8204-6eedecd5a848 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034364 Sep 08 10:13:32.344031 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 46/58] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.371774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44a620b6-2ae2-4fcc-bed3-909afae687b5 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.414290 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44a620b6-2ae2-4fcc-bed3-909afae687b5 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/2122639107" status: 202 len: 0 microversion: 2.1 time: 0.051503 Sep 08 10:13:32.419139 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 47/59] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:13:32 2022] DELETE /compute/v2.1/flavors/2122639107 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:32.428431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc691477-82b2-4c7e-a991-d018de65da3c tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.468293 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc691477-82b2-4c7e-a991-d018de65da3c tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044771 Sep 08 10:13:32.470278 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 48/60] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.489626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8a00291-ecde-4c84-a832-abda1641700d tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-753195137", "id": 956250722, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:32.516050 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8a00291-ecde-4c84-a832-abda1641700d tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.030024 Sep 08 10:13:32.523773 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 49/61] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:32 2022] POST /compute/v2.1/flavors => generated 410 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:32.530464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ad1f039-b447-47d9-bc6b-fa163ae678a5 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.559841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ad1f039-b447-47d9-bc6b-fa163ae678a5 tempest-FlavorsAdminTestJSON-2066419234 tempest-FlavorsAdminTestJSON-2066419234-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.034667 Sep 08 10:13:32.574600 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 50/62] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:32.581175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de2d51e4-a06d-4091-8272-bf395cb5c951 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.608881 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de2d51e4-a06d-4091-8272-bf395cb5c951 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/956250722" status: 202 len: 0 microversion: 2.1 time: 0.030530 Sep 08 10:13:32.611589 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 51/63] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:32 2022] DELETE /compute/v2.1/flavors/956250722 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:32.619842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db20487d-3ab8-4d7a-9f43-79eda03d5439 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:32.642118 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db20487d-3ab8-4d7a-9f43-79eda03d5439 tempest-FlavorsAdminTestJSON-149264633 tempest-FlavorsAdminTestJSON-149264633-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026471 Sep 08 10:13:32.643285 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 52/64] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:33.480785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:13:33.890898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:13:33.891325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:13:33.891823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:13:33.892497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:13:33.893381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:13:33.909900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:33.910379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:33.910984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:33.911740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:33.912196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:33.912615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:33.949751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Getting quotas for project f20f27a838b04da2b30d045d70a7e6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:13:33.960005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Getting quotas for user 826be1a3be064b87a370115bce01ab2c and project f20f27a838b04da2b30d045d70a7e6e7. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:13:33.977442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:13:33.982193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:13:34.087442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9326f0f6-dce9-4ac8-9399-30c045bf6f49 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.583450 Sep 08 10:13:34.087679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 13/65] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:13:34.105669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08cf6cc1-b474-4bf3-895d-8ddf554cf764 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.106423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08cf6cc1-b474-4bf3-895d-8ddf554cf764 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:34.249530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08cf6cc1-b474-4bf3-895d-8ddf554cf764 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:34.273475 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08cf6cc1-b474-4bf3-895d-8ddf554cf764 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1241 microversion: 2.1 time: 0.172009 Sep 08 10:13:34.274222 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 14/66] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:34.443083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f235220bc10>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.446078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.451016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.451679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.485339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.485820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.486796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.500863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.501343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.501940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.509484 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b9c257f-1e3f-474e-b664-47534eca45cf tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.489166 Sep 08 10:13:34.510303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 53/67] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.524641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f23521251f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.532854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=122456) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 08 10:13:34.533578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.534783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.535398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.553609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.554354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.554816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.567600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.568386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.569017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.582196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a73e3f4-2971-40b8-99b4-3c35c8f7458a tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.061736 Sep 08 10:13:34.582949 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 15/68] 10.222.0.59 () {58 vars in 1167 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:34.601624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f2352245550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.604281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.605634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.606532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.628896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.629606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.630440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.649852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:34.651574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.652938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.653706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.662824 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f279f1d8-0c48-4017-9d00-bb2d220e2cc3 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.066242 Sep 08 10:13:34.663997 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 54/69] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.675599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f23520c6160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.677673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.678152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.678734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.704091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.705033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.705468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.717137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-892c1fef-5949-40a6-bec8-77a435f81586 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.045389 Sep 08 10:13:34.717759 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 16/70] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.735410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afe24092-d012-4a38-acbb-c4b3a945c594 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f235220b940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.737289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe24092-d012-4a38-acbb-c4b3a945c594 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.737768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe24092-d012-4a38-acbb-c4b3a945c594 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.738197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe24092-d012-4a38-acbb-c4b3a945c594 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.760171 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afe24092-d012-4a38-acbb-c4b3a945c594 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030204 Sep 08 10:13:34.765059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 55/71] 10.222.0.59 () {58 vars in 1179 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.773642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f23520c6dc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.775679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.776259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.777385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.792315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.793367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.793808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.806428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.806927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.807406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.814536 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d089eb7b-de91-4eb8-9872-479f8ec99d57 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.044804 Sep 08 10:13:34.815346 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 17/72] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.831232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f23522450d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.835818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.836572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.837325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.867880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.868542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.869424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.878194 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5cdcaa22-d31b-4e7b-888e-666bed227e26 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.055680 Sep 08 10:13:34.879002 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 56/73] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.896765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f23520e2280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.899081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.899892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.900504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.914138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.914684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.915122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.923711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cd4938d-1a78-4256-9506-334b270b0926 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.033826 Sep 08 10:13:34.924665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 18/74] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:34.940459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Calling method '.version_select at 0x7f2352268790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:34.942955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.944026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.944655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.967277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.968220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.969076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.981910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.982390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:34.982925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:34.993870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:13:34.994607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8feb3a2f-9901-4662-9b3a-a1ec1749c201 tempest-HypervisorAdminTestJSON-774160723 tempest-HypervisorAdminTestJSON-774160723-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:13:34.999221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:34.999850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:35.000375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:35.001242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:35.001757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:35.002246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:35.015825 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.compute.rpcapi [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 10:13:35.017418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] Releasing lock "compute-rpcapi-router" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:13:35.102728 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a42dc3d-85d8-43c0-854b-821eb52bfad5 None None] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.167317 Sep 08 10:13:35.103574 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 57/75] 10.222.0.59 () {58 vars in 1173 bytes} [Thu Sep 8 10:13:34 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:35.299028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6024169-b5e7-4a2f-91c2-320f13857fbb tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:35.299864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6024169-b5e7-4a2f-91c2-320f13857fbb tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:35.392162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6024169-b5e7-4a2f-91c2-320f13857fbb tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:35.401119 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6024169-b5e7-4a2f-91c2-320f13857fbb tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1241 microversion: 2.1 time: 0.108642 Sep 08 10:13:35.401677 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 19/76] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:35 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:36.426354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:36.428538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:36.451196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:36.451926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:36.452507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:36.454828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:36.456066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:36.456682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:38.398890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:38.432333 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b6a00aa0-531e-4192-b138-bb1dbbeb2211 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 2.010485 Sep 08 10:13:38.435124 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 58/77] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:36 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:39.205855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94ffa560-d070-41b7-8510-ba76bc0f3c9e tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-805280529", "ram": 512, "vcpus": 1, "disk": 10, "id": 128258728, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:39.243742 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94ffa560-d070-41b7-8510-ba76bc0f3c9e tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.764750 Sep 08 10:13:39.244729 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 20/78] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:38 2022] POST /compute/v2.1/flavors => generated 412 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:39.261977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75a0883a-d20c-4ef7-b427-622a5d5e5b34 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:39.314311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-75a0883a-d20c-4ef7-b427-622a5d5e5b34 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057368 Sep 08 10:13:39.317317 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 59/79] 10.222.0.59 () {60 vars in 1221 bytes} [Thu Sep 8 10:13:39 2022] POST /compute/v2.1/flavors/128258728/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:39.822634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f70c991e-cd57-4ba9-aa48-eb991f7b0480 tempest-FlavorsExtraSpecsTestJSON-1594836184 tempest-FlavorsExtraSpecsTestJSON-1594836184-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:39.826733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-109022036", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:39.847197 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f70c991e-cd57-4ba9-aa48-eb991f7b0480 tempest-FlavorsExtraSpecsTestJSON-1594836184 tempest-FlavorsExtraSpecsTestJSON-1594836184-project] 10.222.0.59 "GET /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.523623 Sep 08 10:13:39.848322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 21/80] 10.222.0.59 () {58 vars in 1200 bytes} [Thu Sep 8 10:13:39 2022] GET /compute/v2.1/flavors/128258728/os-extra_specs => generated 66 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:39.854404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:39.855284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:39.862987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:39.863713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:39.864328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:39.865375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:39.866017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:39.866627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:39.962466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:13:40.259136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:40.277007 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d583661d-7810-43ce-9a0f-92216dcc66a7 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.426548 Sep 08 10:13:40.283804 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 22/81] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:39 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:40.386931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:13:40.387353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:13:40.388001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:13:40.388489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:13:40.388907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:13:40.411775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:40.412454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:40.413049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:40.413983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:40.414945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:40.415561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:40.452513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Getting quotas for project 4d09cccc2ead4beab8ef6098a558b70b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:13:40.460665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Getting quotas for user efbef3c3fa284cc687b1b482efcf27b2 and project 4d09cccc2ead4beab8ef6098a558b70b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:13:40.479102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:13:40.482511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:13:40.555988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5f0e0179-bb64-43a2-b3a8-4a53105e4c9d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121746 Sep 08 10:13:40.564843 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 60/82] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:13:40.571573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f1f4f5c1-ff91-4260-912a-5f9ee2644365 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:40.606178 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f1f4f5c1-ff91-4260-912a-5f9ee2644365 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039505 Sep 08 10:13:40.607490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 61/83] 10.222.0.59 () {60 vars in 1221 bytes} [Thu Sep 8 10:13:40 2022] POST /compute/v2.1/flavors/128258728/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:40.681454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Calling method '.version_select at 0x7f23520e2430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:40.686953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:40.691932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:40.692903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:40.693842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:40.694449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:40.696468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:40.743694 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27f102d6-8792-4fcf-ab3a-a8eb4a4d41b2 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.457670 Sep 08 10:13:40.747606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 23/84] 10.222.0.59 () {58 vars in 1128 bytes} [Thu Sep 8 10:13:40 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:40.757050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-484ce58a-1bd1-4c19-b766-b933b7ddd1f4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:40.757643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-484ce58a-1bd1-4c19-b766-b933b7ddd1f4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:40.759662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:40.903850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-484ce58a-1bd1-4c19-b766-b933b7ddd1f4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:40.915525 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-484ce58a-1bd1-4c19-b766-b933b7ddd1f4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1219 microversion: 2.1 time: 0.166789 Sep 08 10:13:40.931330 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 24/85] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:40 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1219 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:40.942767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-387a31cd-7588-466b-bbe6-683d120832a5 tempest-FlavorsExtraSpecsTestJSON-1594836184 tempest-FlavorsExtraSpecsTestJSON-1594836184-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:40.973109 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-387a31cd-7588-466b-bbe6-683d120832a5 tempest-FlavorsExtraSpecsTestJSON-1594836184 tempest-FlavorsExtraSpecsTestJSON-1594836184-project] 10.222.0.59 "GET /compute/v2.1/flavors/128258728/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.038387 Sep 08 10:13:40.974902 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 25/86] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:13:40 2022] GET /compute/v2.1/flavors/128258728/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:41.187385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2105676921", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:41.287914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:13:41.412837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9ea2122-246a-4bc0-9fcb-dd3fed2f857d tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Calling method '.version_select at 0x7f23520b83a0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:41.417602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9ea2122-246a-4bc0-9fcb-dd3fed2f857d tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'd4e0329fc4eb4a6487ab5e3c90481cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e25b1abbc4627bbcd56224eb983df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9ea2122-246a-4bc0-9fcb-dd3fed2f857d tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Request method failure captured: Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPWieJthGJyqbY6Y46zJwUSlWov42c8rHPc-Q615_u3_KRYfke3DjXf7sBgOg4RmacrFb-Du3RWTYrIfwPzmZxy6vlZoJSiNr0UODxf3M1mNRyYbCpC0xKMwdJqJso0nToaBcPCH3ypgO08YUak3he4Gxsss3Zn3Ykq9KE4Zp3biU Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:41.426343 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_049e25b1abbc4627bbcd56224eb983df", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d4e0329fc4eb4a6487ab5e3c90481cea Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:13:41.427689 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:41.428505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 10:13:41.429737 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:41.430922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9ea2122-246a-4bc0-9fcb-dd3fed2f857d tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:41.431202 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b9ea2122-246a-4bc0-9fcb-dd3fed2f857d tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.452993 Sep 08 10:13:41.433069 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 26/87] 10.222.0.59 () {58 vars in 1128 bytes} [Thu Sep 8 10:13:40 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 457 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:41.450012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18b72208-a7fc-4e97-88b0-268a3ef98b11 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:41.517836 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18b72208-a7fc-4e97-88b0-268a3ef98b11 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083209 Sep 08 10:13:41.519379 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 27/88] 10.222.0.59 () {60 vars in 1221 bytes} [Thu Sep 8 10:13:41 2022] POST /compute/v2.1/flavors/128258728/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:41.677762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:13:41.678874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:13:41.679640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:13:41.680312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:13:41.680859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:13:41.692755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:41.693538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:41.694796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:41.695718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:41.696307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:41.696880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:41.718272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Getting quotas for project 0eeb1fcfc0f54224beb031df87cb2ac5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:13:41.723214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Getting quotas for user 9a2f11fc7fc6430fadcfd3e0749a1053 and project 0eeb1fcfc0f54224beb031df87cb2ac5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:13:41.738410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:13:41.743190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:13:41.867954 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad2662d1-8f34-4e04-ad8b-959df8518ffc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258925 Sep 08 10:13:41.868618 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 62/89] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:13:41.885168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:41.888872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:41.894724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07f70e48-0ff8-4845-80b2-2d02dedcd82a tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1751214457", "id": 455942347, "os-flavor-access:is_public": "False"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:41.897883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:41.898878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:41.899556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:41.900816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:41.902098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:41.902749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:41.944393 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07f70e48-0ff8-4845-80b2-2d02dedcd82a tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.423841 Sep 08 10:13:41.946658 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 28/90] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:41 2022] POST /compute/v2.1/flavors => generated 428 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:41.956002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-146f6f4f-68a0-4c19-a47d-d105484bd910 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Calling method '.version_select at 0x7f23520b8040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:41.962746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-146f6f4f-68a0-4c19-a47d-d105484bd910 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'd4e0329fc4eb4a6487ab5e3c90481cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e25b1abbc4627bbcd56224eb983df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-146f6f4f-68a0-4c19-a47d-d105484bd910 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Request method failure captured: Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hosts/n-d-833090-19/reboot HTTP/1.1 Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPWieJthGJyqbY6Y46zJwUSlWov42c8rHPc-Q615_u3_KRYfke3DjXf7sBgOg4RmacrFb-Du3RWTYrIfwPzmZxy6vlZoJSiNr0UODxf3M1mNRyYbCpC0xKMwdJqJso0nToaBcPCH3ypgO08YUak3he4Gxsss3Zn3Ykq9KE4Zp3biU Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:41.965889 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_049e25b1abbc4627bbcd56224eb983df", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d4e0329fc4eb4a6487ab5e3c90481cea Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'n-d-833090-19'} Sep 08 10:13:41.967257 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:41.968234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 10:13:41.969217 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:41.971641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-146f6f4f-68a0-4c19-a47d-d105484bd910 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:41.972808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-146f6f4f-68a0-4c19-a47d-d105484bd910 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-833090-19/reboot" status: 403 len: 111 microversion: 2.1 time: 0.023399 Sep 08 10:13:41.974257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 29/91] 10.222.0.59 () {58 vars in 1191 bytes} [Thu Sep 8 10:13:41 2022] GET /compute/v2.1/os-hosts/n-d-833090-19/reboot => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:41.996451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7d001a02-51e1-4f58-b29e-fc59b9e055ea tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.011165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7d001a02-51e1-4f58-b29e-fc59b9e055ea tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034858 Sep 08 10:13:42.015332 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 30/92] 10.222.0.59 () {58 vars in 1200 bytes} [Thu Sep 8 10:13:41 2022] GET /compute/v2.1/flavors/128258728/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:42.025576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-813a10a7-eb2c-42b3-9e0a-e4159c03d98e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.029486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-813a10a7-eb2c-42b3-9e0a-e4159c03d98e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:42.206139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-813a10a7-eb2c-42b3-9e0a-e4159c03d98e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:42.217399 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-813a10a7-eb2c-42b3-9e0a-e4159c03d98e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1219 microversion: 2.1 time: 0.200638 Sep 08 10:13:42.221093 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 31/93] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1219 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:42.238349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.239306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:42.241951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:42.253914 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-439b7f4d-330a-4c1c-8879-6606ec7de9e4 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.381033 Sep 08 10:13:42.267490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 63/94] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:41 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:42.267490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9025a5c-117a-4ff8-bdb9-1bab3cfc34db tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4ca03c63f297432ba3681f93ce3f9a1f"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:42.271502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:42.273392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:42.274020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:42.274828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:42.275800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:42.276357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:42.422103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:42.440236 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c76112b-1521-45bd-abbe-12d452dc973f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1223 microversion: 2.1 time: 0.213798 Sep 08 10:13:42.458757 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 32/95] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1223 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:42.477961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-702902b6-c1bd-4337-a970-890d3ef4f3bf tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Calling method '.version_select at 0x7f23520b8310>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.510336 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-702902b6-c1bd-4337-a970-890d3ef4f3bf tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-702902b6-c1bd-4337-a970-890d3ef4f3bf tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:13:42.525426 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:13:42.527300 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:13:42.528082 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 10:13:42.529126 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.530302 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.532662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-702902b6-c1bd-4337-a970-890d3ef4f3bf tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:42.534068 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-702902b6-c1bd-4337-a970-890d3ef4f3bf tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.070418 Sep 08 10:13:42.538923 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 33/96] 10.222.0.59 () {58 vars in 1212 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:13:42.549982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-95d57f65-348d-4ee0-8c90-93e063938c32 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:42.628993 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-95d57f65-348d-4ee0-8c90-93e063938c32 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/128258728/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.087777 Sep 08 10:13:42.631115 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 34/97] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:13:42 2022] PUT /compute/v2.1/flavors/128258728/os-extra_specs/hw:numa_nodes => generated 22 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:42.649145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a285511-82f9-4540-ade8-0244cb146bc0 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Calling method '.version_select at 0x7f2351ff4dc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.660872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a285511-82f9-4540-ade8-0244cb146bc0 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'd4e0329fc4eb4a6487ab5e3c90481cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e25b1abbc4627bbcd56224eb983df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a285511-82f9-4540-ade8-0244cb146bc0 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Request method failure captured: Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hosts/n-d-833090-19 HTTP/1.1 Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPWieJthGJyqbY6Y46zJwUSlWov42c8rHPc-Q615_u3_KRYfke3DjXf7sBgOg4RmacrFb-Du3RWTYrIfwPzmZxy6vlZoJSiNr0UODxf3M1mNRyYbCpC0xKMwdJqJso0nToaBcPCH3ypgO08YUak3he4Gxsss3Zn3Ykq9KE4Zp3biU Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:42.673096 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_049e25b1abbc4627bbcd56224eb983df", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d4e0329fc4eb4a6487ab5e3c90481cea Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'n-d-833090-19'} Sep 08 10:13:42.674261 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:42.674929 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 10:13:42.675927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.678004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a285511-82f9-4540-ade8-0244cb146bc0 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:42.679224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a285511-82f9-4540-ade8-0244cb146bc0 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-833090-19" status: 403 len: 109 microversion: 2.1 time: 0.045105 Sep 08 10:13:42.682043 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 35/98] 10.222.0.59 () {58 vars in 1170 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/os-hosts/n-d-833090-19 => generated 109 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:42.700240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4dd9ec81-38d5-4f15-9a73-6fe8324725dc tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.726233 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4dd9ec81-38d5-4f15-9a73-6fe8324725dc tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040837 Sep 08 10:13:42.727713 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 36/99] 10.222.0.59 () {58 vars in 1200 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/flavors/128258728/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:42.733342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d69eae5-b37d-41c1-8fb6-daf92b9099d3 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Calling method '.version_select at 0x7f2351e9dee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.744075 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9d69eae5-b37d-41c1-8fb6-daf92b9099d3 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d69eae5-b37d-41c1-8fb6-daf92b9099d3 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:13:42.745268 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:13:42.746442 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.747083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:42.748069 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.751842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d69eae5-b37d-41c1-8fb6-daf92b9099d3 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:42.754240 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d69eae5-b37d-41c1-8fb6-daf92b9099d3 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024574 Sep 08 10:13:42.755379 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 37/100] 10.222.0.59 () {58 vars in 1191 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:13:42.765718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-52baf056-ce56-41bb-9a71-9f88e5d337c8 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.829761 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-52baf056-ce56-41bb-9a71-9f88e5d337c8 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/128258728/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.070321 Sep 08 10:13:42.833127 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 38/101] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:13:42 2022] DELETE /compute/v2.1/flavors/128258728/os-extra_specs/hw:numa_nodes => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:13:42.852254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cd604f8-018f-4e52-a867-41e048cd7526 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Calling method '.version_select at 0x7f2351ecee50>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.857158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5cd604f8-018f-4e52-a867-41e048cd7526 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'd4e0329fc4eb4a6487ab5e3c90481cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e25b1abbc4627bbcd56224eb983df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cd604f8-018f-4e52-a867-41e048cd7526 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Request method failure captured: Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hosts/n-d-833090-19/shutdown HTTP/1.1 Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPWieJthGJyqbY6Y46zJwUSlWov42c8rHPc-Q615_u3_KRYfke3DjXf7sBgOg4RmacrFb-Du3RWTYrIfwPzmZxy6vlZoJSiNr0UODxf3M1mNRyYbCpC0xKMwdJqJso0nToaBcPCH3ypgO08YUak3he4Gxsss3Zn3Ykq9KE4Zp3biU Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:42.861743 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_049e25b1abbc4627bbcd56224eb983df", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d4e0329fc4eb4a6487ab5e3c90481cea Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'n-d-833090-19'} Sep 08 10:13:42.862910 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:42.864002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 10:13:42.865015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:42.865814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cd604f8-018f-4e52-a867-41e048cd7526 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:42.865814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5cd604f8-018f-4e52-a867-41e048cd7526 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-833090-19/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.029577 Sep 08 10:13:42.873131 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 39/102] 10.222.0.59 () {58 vars in 1197 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/os-hosts/n-d-833090-19/shutdown => generated 113 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:42.883757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-30c39cb3-b08e-4ff2-b372-e0cd5af750ef tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.926022 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9025a5c-117a-4ff8-bdb9-1bab3cfc34db tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/455942347/action" status: 200 len: 96 microversion: 2.1 time: 0.669960 Sep 08 10:13:42.926676 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 64/103] 10.222.0.59 () {60 vars in 1197 bytes} [Thu Sep 8 10:13:42 2022] POST /compute/v2.1/flavors/455942347/action => generated 96 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:42.938784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c1fb335-9800-43bd-980a-58d1cfd7ae4c tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Calling method '.version_select at 0x7f235209a940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:42.941241 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-30c39cb3-b08e-4ff2-b372-e0cd5af750ef tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/128258728/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.070954 Sep 08 10:13:42.944376 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 40/104] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:13:42 2022] DELETE /compute/v2.1/flavors/128258728/os-extra_specs/hw:cpu_policy => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:13:43.005284 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-7c1fb335-9800-43bd-980a-58d1cfd7ae4c tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c1fb335-9800-43bd-980a-58d1cfd7ae4c tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:43.036310 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:13:43.037392 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:13:43.038135 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 10:13:43.039010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c1fb335-9800-43bd-980a-58d1cfd7ae4c tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:43.040278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c1fb335-9800-43bd-980a-58d1cfd7ae4c tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.110242 Sep 08 10:13:43.050962 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 65/105] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:13:43.069616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7833879f-0add-47b0-92aa-a9c4e6d9545f tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.110260 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7833879f-0add-47b0-92aa-a9c4e6d9545f tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/128258728/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056106 Sep 08 10:13:43.121239 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 66/106] 10.222.0.59 () {58 vars in 1200 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/flavors/128258728/os-extra_specs => generated 19 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:43.126612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49d7b75a-510e-441e-8c19-80680c0d6ad5 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Calling method '.version_select at 0x7f2351f6e4c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.132740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49d7b75a-510e-441e-8c19-80680c0d6ad5 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'd4e0329fc4eb4a6487ab5e3c90481cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e25b1abbc4627bbcd56224eb983df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49d7b75a-510e-441e-8c19-80680c0d6ad5 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Request method failure captured: Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hosts/n-d-833090-19/startup HTTP/1.1 Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBPWieJthGJyqbY6Y46zJwUSlWov42c8rHPc-Q615_u3_KRYfke3DjXf7sBgOg4RmacrFb-Du3RWTYrIfwPzmZxy6vlZoJSiNr0UODxf3M1mNRyYbCpC0xKMwdJqJso0nToaBcPCH3ypgO08YUak3he4Gxsss3Zn3Ykq9KE4Zp3biU Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:13:43.140683 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_049e25b1abbc4627bbcd56224eb983df", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d4e0329fc4eb4a6487ab5e3c90481cea Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'n-d-833090-19'} Sep 08 10:13:43.142028 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:43.142666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 10:13:43.143634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.151043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49d7b75a-510e-441e-8c19-80680c0d6ad5 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:43.152597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49d7b75a-510e-441e-8c19-80680c0d6ad5 tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-d-833090-19/startup" status: 403 len: 110 microversion: 2.1 time: 0.029782 Sep 08 10:13:43.161253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 67/107] 10.222.0.59 () {58 vars in 1194 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/os-hosts/n-d-833090-19/startup => generated 110 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:43.166471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ebcd1eb-4e19-4508-94c9-325689771880 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.212717 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ebcd1eb-4e19-4508-94c9-325689771880 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/128258728" status: 202 len: 0 microversion: 2.1 time: 0.049992 Sep 08 10:13:43.220549 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 68/108] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:43 2022] DELETE /compute/v2.1/flavors/128258728 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:43.227429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-912b7c21-bdb3-494b-926c-a09df66f3e37 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Calling method '.version_select at 0x7f2351fdcaf0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.249151 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-912b7c21-bdb3-494b-926c-a09df66f3e37 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-912b7c21-bdb3-494b-926c-a09df66f3e37 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:43.253994 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'nonexistent_hostname'} Sep 08 10:13:43.255166 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:13:43.256013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 10:13:43.257059 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:43.258200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.259742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-912b7c21-bdb3-494b-926c-a09df66f3e37 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:43.260656 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-912b7c21-bdb3-494b-926c-a09df66f3e37 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.037332 Sep 08 10:13:43.266044 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 69/109] 10.222.0.59 () {58 vars in 1215 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:13:43.272635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c2d9b8d-ea0e-4edc-bae9-646bfdc53945 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.308316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c2d9b8d-ea0e-4edc-bae9-646bfdc53945 tempest-FlavorsExtraSpecsTestJSON-1273648854 tempest-FlavorsExtraSpecsTestJSON-1273648854-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044891 Sep 08 10:13:43.319175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 70/110] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:43.328814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.334369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:43.342271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:43.342997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:43.343679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:43.344550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:43.345204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:43.345823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:43.433556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:43.444218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-68e16eb3-d980-4c4e-853f-df3534156eda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1223 microversion: 2.1 time: 0.121830 Sep 08 10:13:43.445480 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 71/111] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:43.451424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2314e790-0b83-47d2-8c85-2d0d113438ad tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Action: 'update', calling method: .version_select at 0x7f2351e9c8b0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2314e790-0b83-47d2-8c85-2d0d113438ad tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-hosts/n-d-833090-19 HTTP/1.1 Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 51 Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:43.456850 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: {"status": "enable", "maintenance_mode": "invalid"} Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:43.458014 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'n-d-833090-19', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.458684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:43.460012 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2314e790-0b83-47d2-8c85-2d0d113438ad tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2314e790-0b83-47d2-8c85-2d0d113438ad tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-833090-19" status: 400 len: 199 microversion: 2.1 time: 0.011265 Sep 08 10:13:43.461170 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 72/112] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:13:43 2022] PUT /compute/v2.1/os-hosts/n-d-833090-19 => generated 199 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:13:43.463671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.464517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:43.474993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:43.475625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:43.476294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:43.477053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:43.477508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:43.477940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:43.620458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-afd39960-42a5-455e-a87d-9120f74e7de7 tempest-FlavorsAccessTestJSON-1497732957 tempest-FlavorsAccessTestJSON-1497732957-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.688424 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-afd39960-42a5-455e-a87d-9120f74e7de7 tempest-FlavorsAccessTestJSON-1497732957 tempest-FlavorsAccessTestJSON-1497732957-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.742819 Sep 08 10:13:43.720874 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 41/113] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:42 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:43.795063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:43.804376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4511c3eb-a586-42db-94e8-dfb093bb32ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.344915 Sep 08 10:13:43.805391 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 73/114] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:43.821802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:43.822991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:43.846945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:43.850528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:43.851314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:43.852820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:43.853994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:43.855573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.005713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:44.015442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3b5b1bf-12c7-49a1-bffe-e863a0901a11 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1279 microversion: 2.1 time: 0.208773 Sep 08 10:13:44.020215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 74/115] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:44.034492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-959ba946-48aa-4120-91b0-3b923c167137 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Action: 'update', calling method: .version_select at 0x7f2351fdcc10>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-959ba946-48aa-4120-91b0-3b923c167137 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-hosts/n-d-833090-19 HTTP/1.1 Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 51 Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:44.039031 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: {"status": "invalid", "maintenance_mode": "enable"} Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:44.040410 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'n-d-833090-19', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.041205 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.042585 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.043591 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.043591 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:13:44.043591 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:13:44.043591 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 10:13:44.043591 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.052403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-959ba946-48aa-4120-91b0-3b923c167137 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:44.053692 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-959ba946-48aa-4120-91b0-3b923c167137 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-833090-19" status: 400 len: 189 microversion: 2.1 time: 0.031288 Sep 08 10:13:44.057389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 75/116] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:13:44 2022] PUT /compute/v2.1/os-hosts/n-d-833090-19 => generated 189 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:13:44.075729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7de3c25-7648-4b9c-9c83-b430d559eab4 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4ca03c63f297432ba3681f93ce3f9a1f"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:44.272596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6695ddf7-e770-4bf3-a01e-6329108ac456 tempest-InstanceUsageAuditLogTestJSON-303825398 tempest-InstanceUsageAuditLogTestJSON-303825398-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:44.317391 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6695ddf7-e770-4bf3-a01e-6329108ac456 tempest-InstanceUsageAuditLogTestJSON-303825398 tempest-InstanceUsageAuditLogTestJSON-303825398-project-admin] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08 10:13:43" status: 200 len: 318 microversion: 2.1 time: 0.594992 Sep 08 10:13:44.318484 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 42/117] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:13:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2010%3A13%3A43 => generated 318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:44.436662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e5fd918-594b-49f9-8e98-56e94162f1da", "tag": "b778c1ac-798f-4f31-bbc3-8b9e4178cfb0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:44.461171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.464733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.466747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.518266 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Creating event network-changed:b778c1ac-798f-4f31-bbc3-8b9e4178cfb0 for instance 3e5fd918-594b-49f9-8e98-56e94162f1da on n-h1-833090-19 Sep 08 10:13:44.521571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:13:44.523224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-593679ec-79d4-40bf-b54d-51b51346cff3 req-68c2217b-2bd4-47e7-9d29-1439dfb932b6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:13:44.526284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.529177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.531497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.532457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.534691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.536109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.556491 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.rpcapi [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 10:13:44.561162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] Releasing lock "compute-rpcapi-router" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:13:44.591778 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d756d41-6b6f-43cb-ba7e-a9297788d431 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271685 Sep 08 10:13:44.593015 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 43/118] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:44.598940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd715ad6-bb8b-4671-a083-0af05883caef tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Action: 'update', calling method: .version_select at 0x7f2351ff4af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:44.633751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd715ad6-bb8b-4671-a083-0af05883caef tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'd4e0329fc4eb4a6487ab5e3c90481cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e25b1abbc4627bbcd56224eb983df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd715ad6-bb8b-4671-a083-0af05883caef tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Request method failure captured: Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/os-hosts/n-d-833090-19 HTTP/1.1 Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 50 Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPWieJthGJyqbY6Y46zJwUSlWov42c8rHPc-Q615_u3_KRYfke3DjXf7sBgOg4RmacrFb-Du3RWTYrIfwPzmZxy6vlZoJSiNr0UODxf3M1mNRyYbCpC0xKMwdJqJso0nToaBcPCH3ypgO08YUak3he4Gxsss3Zn3Ykq9KE4Zp3biU Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:44.642941 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/049e25b1abbc4627bbcd56224eb983df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_049e25b1abbc4627bbcd56224eb983df", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 049e25b1abbc4627bbcd56224eb983df Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328120577 Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d4e0329fc4eb4a6487ab5e3c90481cea Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328120577-project Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: {"status": "enable", "maintenance_mode": "enable"} Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 10:13:44.644311 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'n-d-833090-19', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:44.645018 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 10:13:44.646056 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.657286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd715ad6-bb8b-4671-a083-0af05883caef tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:44.664164 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd715ad6-bb8b-4671-a083-0af05883caef tempest-HostsAdminNegativeTestJSON-1328120577 tempest-HostsAdminNegativeTestJSON-1328120577-project] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-833090-19" status: 403 len: 111 microversion: 2.1 time: 0.066360 Sep 08 10:13:44.667448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 44/119] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:13:44 2022] PUT /compute/v2.1/os-hosts/n-d-833090-19 => generated 111 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:44.674956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7de3c25-7648-4b9c-9c83-b430d559eab4 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/455942347/action" status: 200 len: 21 microversion: 2.1 time: 0.616250 Sep 08 10:13:44.679311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e8748da-9c63-4541-ab1d-aefb3c6f614f tempest-InstanceUsageAuditLogTestJSON-303825398 tempest-InstanceUsageAuditLogTestJSON-303825398-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:44.683397 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 76/120] 10.222.0.59 () {60 vars in 1197 bytes} [Thu Sep 8 10:13:44 2022] POST /compute/v2.1/flavors/455942347/action => generated 21 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:44.696267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:44.697642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:44.701702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=79,nova_api:SAVEPOINT=4,nova_api:INSERT=9,nova_api:RELEASE=4,nova_api:DELETE=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:44.707225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.707990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.708648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.709558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.710211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.710836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.737778 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e8748da-9c63-4541-ab1d-aefb3c6f614f tempest-InstanceUsageAuditLogTestJSON-303825398 tempest-InstanceUsageAuditLogTestJSON-303825398-project-admin] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.067394 Sep 08 10:13:44.741146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 45/121] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:13:44 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:44.769960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e6168a2-d9c8-410b-b11a-ccc0c3528206 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Action: 'update', calling method: .version_select at 0x7f2352009430>, body: {"status": null, "maintenance_mode": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e6168a2-d9c8-410b-b11a-ccc0c3528206 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/os-hosts/n-d-833090-19 HTTP/1.1 Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 42 Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:13:44.779962 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: {"status": null, "maintenance_mode": null} Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 10:13:44.781656 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'n-d-833090-19', 'body': {'status': None, 'maintenance_mode': None}} Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi None Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.782357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.783622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.785070 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:13:44.785070 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:13:44.785070 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 10:13:44.785070 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.785070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e6168a2-d9c8-410b-b11a-ccc0c3528206 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:44.786201 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e6168a2-d9c8-410b-b11a-ccc0c3528206 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/n-d-833090-19" status: 400 len: 127 microversion: 2.1 time: 0.041957 Sep 08 10:13:44.788289 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 46/122] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:13:44 2022] PUT /compute/v2.1/os-hosts/n-d-833090-19 => generated 127 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:13:44.807995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d6c3dbb-a48a-4571-aa5f-8a944f7ce8cd tempest-FlavorsAccessTestJSON-1497732957 tempest-FlavorsAccessTestJSON-1497732957-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:44.828552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:44.838378 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c48f4f5-6d6e-403c-b6ba-81b5bc2902d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1271 microversion: 2.1 time: 0.153038 Sep 08 10:13:44.842994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 77/123] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:44 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:44.857193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9ebaca8-3d5c-4173-8bed-72d75519b532 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Action: 'update', calling method: .version_select at 0x7f2351e48820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:44.863435 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.hosts [None req-b9ebaca8-3d5c-4173-8bed-72d75519b532 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Enabling host nonexistent_hostname. Sep 08 10:13:44.883398 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b9ebaca8-3d5c-4173-8bed-72d75519b532 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9ebaca8-3d5c-4173-8bed-72d75519b532 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Request method failure captured: Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 50 Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBT_ywla1TvamSJSXRjEiikRbL9fv9NOp-jeqfqvMesfzO41ht0QukUBK4a-kqAfHrnCwlUSL43p8RKQ0rkSNMtFsyfgiMvh95Kt0YBK674RfjTVgnF0osIqUN-FIZ_V1LWDSr7wteGHbcsytvHvXdRvSTZwdl_mc4T5vza6Dzl87E Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:44.885414 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f685271ef4264196884b568c29455a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f685271ef4264196884b568c29455a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f685271ef4264196884b568c29455a1f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f685271ef4264196884b568c29455a1f Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1641995652 Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2e48591defb246e8ad0a2ce5af800e92 Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1641995652-project-admin Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: {"status": "enable", "maintenance_mode": "enable"} Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:44.886495 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:13:44.887191 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:13:44.888150 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:44.891119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9ebaca8-3d5c-4173-8bed-72d75519b532 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:44.891871 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9ebaca8-3d5c-4173-8bed-72d75519b532 tempest-HostsAdminNegativeTestJSON-1641995652 tempest-HostsAdminNegativeTestJSON-1641995652-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.043437 Sep 08 10:13:44.896025 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 78/124] 10.222.0.59 () {60 vars in 1211 bytes} [Thu Sep 8 10:13:44 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:13:44.899942 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d6c3dbb-a48a-4571-aa5f-8a944f7ce8cd tempest-FlavorsAccessTestJSON-1497732957 tempest-FlavorsAccessTestJSON-1497732957-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100524 Sep 08 10:13:44.901102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 47/125] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:44.912250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:44.913049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:44.919826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80c6a2d0-2068-4525-9467-f7b1e0c6b8f6 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:44.936911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.937934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.938453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.939275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:44.939981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:44.942620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:44.970455 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80c6a2d0-2068-4525-9467-f7b1e0c6b8f6 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/455942347" status: 202 len: 0 microversion: 2.1 time: 0.055582 Sep 08 10:13:44.973657 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 48/126] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:13:44 2022] DELETE /compute/v2.1/flavors/455942347 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:13:44.990043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9481ba2a-72a9-446d-ae12-8d4358b9bcd3 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:45.056090 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9481ba2a-72a9-446d-ae12-8d4358b9bcd3 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078251 Sep 08 10:13:45.059762 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 49/127] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:45.065212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:45.079055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:45.085910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:45.089771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:45.093559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:45.094517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:45.095130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:45.095749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:45.289496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:45.299059 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b252216c-03ca-4e5b-86dc-fcd23de0a560 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1277 microversion: 2.1 time: 0.237449 Sep 08 10:13:45.319172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 50/128] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:45 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:45.338118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf557b3e-9c64-44de-93ae-6eb63b54b066 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-853677330", "id": 1053023065, "os-flavor-access:is_public": "False"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:45.377707 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf557b3e-9c64-44de-93ae-6eb63b54b066 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.055959 Sep 08 10:13:45.382826 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 51/129] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:13:45 2022] POST /compute/v2.1/flavors => generated 430 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:45.414897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-92a7e126-d684-461d-a8ca-53b497949c03 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:45.447512 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-92a7e126-d684-461d-a8ca-53b497949c03 tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/1053023065/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.050652 Sep 08 10:13:45.456528 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 52/130] 10.222.0.59 () {58 vars in 1209 bytes} [Thu Sep 8 10:13:45 2022] GET /compute/v2.1/flavors/1053023065/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:13:45.467265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-92b1aaff-6019-428e-b0cd-292808e6ffaa tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:45.506016 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-92b1aaff-6019-428e-b0cd-292808e6ffaa tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1053023065" status: 202 len: 0 microversion: 2.1 time: 0.043546 Sep 08 10:13:45.514614 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 53/131] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:13:45 2022] DELETE /compute/v2.1/flavors/1053023065 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:13:45.534005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-290e0a90-1336-4ca5-aa2f-d2ed4db5e8fe tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:45.625058 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-290e0a90-1336-4ca5-aa2f-d2ed4db5e8fe tempest-FlavorsAccessTestJSON-543824711 tempest-FlavorsAccessTestJSON-543824711-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102478 Sep 08 10:13:45.629595 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 54/132] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:45.874715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:45.876539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:45.912489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:45.918887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:45.922690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:45.926838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:45.932458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:45.934732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:46.051401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:46.067043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1c08d37-79d1-4ffb-a1ff-675c718b3fe0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 1.169430 Sep 08 10:13:46.091115 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 79/133] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:44 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:46.194577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:46.208053 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-396a07d6-b94e-47de-93b9-f91f4a652778 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1277 microversion: 2.1 time: 0.339005 Sep 08 10:13:46.228908 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 55/134] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:45 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:46.341769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:46.342359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:46.361739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:46.367796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:46.368429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:46.371886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:46.373330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:46.374477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:46.821095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:46.830004 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b219685-b900-4051-9f8b-f5e0bc9f78b4 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1277 microversion: 2.1 time: 0.493321 Sep 08 10:13:46.830599 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 80/135] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:46 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1277 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:47.102733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:47.103679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:47.117101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:47.117101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:47.117101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:47.122080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:47.131793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:47.133790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:47.243413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:47.244221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:47.261837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:47.262674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:47.263408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:47.264653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:47.272364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:47.273123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:47.579241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:47.591994 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55ade2f5-1bd0-482e-9bc1-fc5bdce04658 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1277 microversion: 2.1 time: 0.353356 Sep 08 10:13:47.613285 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 81/136] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:47 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1277 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:47.831913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:47.842388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0b26d6ba-f208-4352-8565-bd2048b491c0 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.744194 Sep 08 10:13:47.863551 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 56/137] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:47 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:47.866349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:47.867121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:47.875611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:47.877615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:47.882613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:47.883682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:47.884445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:47.885785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:47.933250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:48.618995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:48.621296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:48.624611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=79,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:48.639159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:48.639712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:48.655231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:48.658642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:48.662255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:48.663225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:48.663225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:48.664838 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0b207fa-5121-498d-b366-d48479aedfaa tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.802480 Sep 08 10:13:48.683992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 82/138] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:47 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:48.871990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:48.873131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:48.894013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:48.897924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:48.900358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:48.906525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:48.909471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:48.910241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:50.126790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:50.142686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a29f001-e39e-4f47-b3c8-20f6ff8ecf89 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 1.275660 Sep 08 10:13:50.155916 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 83/139] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:48 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:50.184102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:50.184835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:50.216785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:50.224840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:50.225352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:50.225803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:50.226525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:50.226982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:50.227410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:50.236852 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5670cf9f-8dc5-4db5-a0ed-15cca427a6fb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 1.619657 Sep 08 10:13:50.242460 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 57/140] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:48 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:50.647090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:50.671890 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-557ab561-fe4d-479b-b3d6-578081e57371 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.517058 Sep 08 10:13:50.675211 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 84/141] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:50 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:51.171316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:51.172336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:51.181336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.184207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.184936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:51.190884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.191687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.192576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:51.266459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:51.267945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:51.278812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.281167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.283761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:51.285495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.291940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.292979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:51.707853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:51.727191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:51.732649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:51.739872 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1790f2f9-4979-45fa-beb9-b65f4b9fca75 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.573309 Sep 08 10:13:51.751567 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 58/142] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:51 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:51.765260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b57dac2c-a2b2-4cfb-b7a2-ab0498354709 req-48bc0624-7707-4ad0-9cfb-9e1eff86a03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0647d366-0477-45f6-91a8-84b1387168c5", "tag": "9c9f32e8-e2d6-4411-b6f8-7592a660caa0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:51.788181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:51.789240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b57dac2c-a2b2-4cfb-b7a2-ab0498354709 req-48bc0624-7707-4ad0-9cfb-9e1eff86a03a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.790357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b57dac2c-a2b2-4cfb-b7a2-ab0498354709 req-48bc0624-7707-4ad0-9cfb-9e1eff86a03a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.792525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b57dac2c-a2b2-4cfb-b7a2-ab0498354709 req-48bc0624-7707-4ad0-9cfb-9e1eff86a03a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:51.805332 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-444bbecd-45d1-403c-abd0-11b386311367 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.543767 Sep 08 10:13:51.820467 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 85/143] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:51 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:51.820467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:51.820467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:51.820823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b57dac2c-a2b2-4cfb-b7a2-ab0498354709 req-48bc0624-7707-4ad0-9cfb-9e1eff86a03a service nova] Creating event network-changed:9c9f32e8-e2d6-4411-b6f8-7592a660caa0 for instance 0647d366-0477-45f6-91a8-84b1387168c5 on n-h2-833090-19 Sep 08 10:13:51.824515 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b57dac2c-a2b2-4cfb-b7a2-ab0498354709 req-48bc0624-7707-4ad0-9cfb-9e1eff86a03a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072440 Sep 08 10:13:51.826093 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 59/144] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:51.833755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.834467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.835213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:51.836216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:51.836874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:51.837602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:52.240812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:52.265594 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f74891f5-09e8-41f9-8328-a8d4fbfffa37 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.452656 Sep 08 10:13:52.283452 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 86/145] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:51 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:52.768230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:52.768849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:52.779108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:52.780654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:52.782425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:52.786761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:52.787257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:52.787736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:52.964159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:52.999475 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c29cd5e8-db00-45a1-9564-0a11572be5ff tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.234085 Sep 08 10:13:53.000685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 87/146] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:52 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:53.007922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.008870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:53.015797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.016603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.017345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.018322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.018957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.019600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.102059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1d23ff4-c737-4d99-8d4d-a12267d06c37 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Calling method '.version_select at 0x7f2351e3a4c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.103867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1d23ff4-c737-4d99-8d4d-a12267d06c37 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '82f48e284cfa43299c19234a716421d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f1333e09e8476e90156d0152634aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1d23ff4-c737-4d99-8d4d-a12267d06c37 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Request method failure captured: Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBdaZAxd3kBYOvN8lFHu5_kY9vdxfdsFitZs1blBlDS5y1O0sm8InVxW1Odh1bWI6SuJDlKVOvRO7RmJVEjGcUxkfZodF1zPMXaVf2l2SrfVUvEOiwU_60FgsgwBkropQVguNUA_9Cbd3FnYdrltj13n-O_ilHKfIpthmxXRmtlAmE Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:53.111073 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76f1333e09e8476e90156d0152634aad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76f1333e09e8476e90156d0152634aad", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 82f48e284cfa43299c19234a716421d7 Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:13:53.112613 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:53.113533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 10:13:53.114764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.120186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1d23ff4-c737-4d99-8d4d-a12267d06c37 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.121321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1d23ff4-c737-4d99-8d4d-a12267d06c37 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.658717 Sep 08 10:13:53.122960 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 60/147] 10.222.0.59 () {58 vars in 1167 bytes} [Thu Sep 8 10:13:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 661 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:53.139494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9640e234-4a12-47b1-bfbc-6ff185bd1c2c tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Calling method '.version_select at 0x7f2351e0c940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.148703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9640e234-4a12-47b1-bfbc-6ff185bd1c2c tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '82f48e284cfa43299c19234a716421d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f1333e09e8476e90156d0152634aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9640e234-4a12-47b1-bfbc-6ff185bd1c2c tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Request method failure captured: Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBdaZAxd3kBYOvN8lFHu5_kY9vdxfdsFitZs1blBlDS5y1O0sm8InVxW1Odh1bWI6SuJDlKVOvRO7RmJVEjGcUxkfZodF1zPMXaVf2l2SrfVUvEOiwU_60FgsgwBkropQVguNUA_9Cbd3FnYdrltj13n-O_ilHKfIpthmxXRmtlAmE Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:53.151920 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76f1333e09e8476e90156d0152634aad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76f1333e09e8476e90156d0152634aad", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 82f48e284cfa43299c19234a716421d7 Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:13:53.153252 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:53.154147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 10:13:53.155313 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.157326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9640e234-4a12-47b1-bfbc-6ff185bd1c2c tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.158431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9640e234-4a12-47b1-bfbc-6ff185bd1c2c tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028654 Sep 08 10:13:53.159621 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 61/148] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:53.169245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-923e629a-7c33-4be0-ac72-a6c371454531 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Calling method '.version_select at 0x7f2351e0c160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.171172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-923e629a-7c33-4be0-ac72-a6c371454531 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '82f48e284cfa43299c19234a716421d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f1333e09e8476e90156d0152634aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-923e629a-7c33-4be0-ac72-a6c371454531 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Request method failure captured: Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBdaZAxd3kBYOvN8lFHu5_kY9vdxfdsFitZs1blBlDS5y1O0sm8InVxW1Odh1bWI6SuJDlKVOvRO7RmJVEjGcUxkfZodF1zPMXaVf2l2SrfVUvEOiwU_60FgsgwBkropQVguNUA_9Cbd3FnYdrltj13n-O_ilHKfIpthmxXRmtlAmE Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:13:53.173092 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76f1333e09e8476e90156d0152634aad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76f1333e09e8476e90156d0152634aad", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 82f48e284cfa43299c19234a716421d7 Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:13:53.174390 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:53.175305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 10:13:53.176759 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.178581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-923e629a-7c33-4be0-ac72-a6c371454531 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.181341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-923e629a-7c33-4be0-ac72-a6c371454531 tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016267 Sep 08 10:13:53.183171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 62/149] 10.222.0.59 () {58 vars in 1179 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:53.257625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.269575 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-052873b8-6556-4bf6-b98c-1fa592210f0b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.266886 Sep 08 10:13:53.277761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 88/150] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:53.375383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Calling method '.version_select at 0x7f2351ff4f70>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.377335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.378158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.378776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.394014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.394129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.394581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.405145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.405617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.406350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.412713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89b3de1d-53cf-402d-93b7-dba98e66d06a tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.223635 Sep 08 10:13:53.413289 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 63/151] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:53.419050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.420573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:53.423499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8b54c351-7660-459f-bc58-75ea2b162cee req-90a1c91d-fac2-4749-98e4-8ccd7f2e67cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a2a9804-8f7b-4e91-99bc-7f41289f8f86", "tag": "5b81aa87-ab86-4a5e-8508-7e75337c565e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:53.426948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.427532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.428091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.428655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.429122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.429533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.436198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b54c351-7660-459f-bc58-75ea2b162cee req-90a1c91d-fac2-4749-98e4-8ccd7f2e67cc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.436877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b54c351-7660-459f-bc58-75ea2b162cee req-90a1c91d-fac2-4749-98e4-8ccd7f2e67cc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.437454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b54c351-7660-459f-bc58-75ea2b162cee req-90a1c91d-fac2-4749-98e4-8ccd7f2e67cc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.458016 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8b54c351-7660-459f-bc58-75ea2b162cee req-90a1c91d-fac2-4749-98e4-8ccd7f2e67cc service nova] Creating event network-changed:5b81aa87-ab86-4a5e-8508-7e75337c565e for instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 on n-h2-833090-19 Sep 08 10:13:53.463272 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8b54c351-7660-459f-bc58-75ea2b162cee req-90a1c91d-fac2-4749-98e4-8ccd7f2e67cc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184067 Sep 08 10:13:53.464366 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 89/152] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:53.470150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25cb86a8-babd-46b6-ba4b-782342d7c28e tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Calling method '.version_select at 0x7f2351e0cf70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.472100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25cb86a8-babd-46b6-ba4b-782342d7c28e tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '82f48e284cfa43299c19234a716421d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f1333e09e8476e90156d0152634aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25cb86a8-babd-46b6-ba4b-782342d7c28e tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Request method failure captured: Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBdaZAxd3kBYOvN8lFHu5_kY9vdxfdsFitZs1blBlDS5y1O0sm8InVxW1Odh1bWI6SuJDlKVOvRO7RmJVEjGcUxkfZodF1zPMXaVf2l2SrfVUvEOiwU_60FgsgwBkropQVguNUA_9Cbd3FnYdrltj13n-O_ilHKfIpthmxXRmtlAmE Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:13:53.474230 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76f1333e09e8476e90156d0152634aad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76f1333e09e8476e90156d0152634aad", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 82f48e284cfa43299c19234a716421d7 Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '1'} Sep 08 10:13:53.475614 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:53.476508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 10:13:53.477661 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.479703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25cb86a8-babd-46b6-ba4b-782342d7c28e tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.480724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25cb86a8-babd-46b6-ba4b-782342d7c28e tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015146 Sep 08 10:13:53.481425 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 90/153] 10.222.0.59 () {58 vars in 1173 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:13:53.492603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5330d4b-1af1-4002-b3ba-12e15b202e00 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Calling method '.version_select at 0x7f2351df83a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.496067 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f5330d4b-1af1-4002-b3ba-12e15b202e00 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] HTTP exception thrown: Hypervisor with ID '9d381afd-f6e5-4799-a0df-29709bba307f' could not be found. Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5330d4b-1af1-4002-b3ba-12e15b202e00 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Request method failure captured: Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hypervisors/9d381afd-f6e5-4799-a0df-29709bba307f/uptime HTTP/1.1 Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBgaamB0HLWq2vH7cFikSvG06Y6X9VEcrxB4rvSrPMeuvXrqcjCpPOA7VavUAsGhKhDbA3BtOt_el2ZBw3_Ql3OwyPCXKocTa46g9PqkqeQfnfnE3FIN7chYbFl0CB7nBooxR-gpiYbWpdr-cX8XF0JNvHBoiOHYIWnCfbnLLiKx3U Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: a92090933fd9450f8effb93f4169932b Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-665664970 Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:53.514369 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a92090933fd9450f8effb93f4169932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a92090933fd9450f8effb93f4169932b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a92090933fd9450f8effb93f4169932b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a92090933fd9450f8effb93f4169932b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-665664970 Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: a92090933fd9450f8effb93f4169932b Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-665664970 Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: e0a31c9e9f49441f983bcf9e9c80e19d Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: exception: Hypervisor with ID '9d381afd-f6e5-4799-a0df-29709bba307f' could not be found. Sep 08 10:13:53.515750 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9d381afd-f6e5-4799-a0df-29709bba307f'} Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9d381afd-f6e5-4799-a0df-29709bba307f' Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 08 10:13:53.516526 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9d381afd-f6e5-4799-a0df-29709bba307f' could not be found. Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.517909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9d381afd-f6e5-4799-a0df-29709bba307f' could not be found. Sep 08 10:13:53.519223 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.520817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5330d4b-1af1-4002-b3ba-12e15b202e00 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Returning 404 to user: Hypervisor with ID '9d381afd-f6e5-4799-a0df-29709bba307f' could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.521944 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5330d4b-1af1-4002-b3ba-12e15b202e00 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/9d381afd-f6e5-4799-a0df-29709bba307f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033293 Sep 08 10:13:53.522765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 91/154] 10.222.0.59 () {58 vars in 1278 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors/9d381afd-f6e5-4799-a0df-29709bba307f/uptime => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:13:53.533605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Calling method '.version_select at 0x7f235209a8b0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.536706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.537367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.537959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.555981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.557898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.558741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.571611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:53.572961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:53.573658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:53.580585 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0cf8a1d3-7a60-4e0c-b153-55d3f6ddd15d tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.051114 Sep 08 10:13:53.581813 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 92/155] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:13:53.597467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc44e4d1-370c-4775-9f3c-b2b4dfd8658a tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Calling method '.version_select at 0x7f2351e0c310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.599792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc44e4d1-370c-4775-9f3c-b2b4dfd8658a tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '82f48e284cfa43299c19234a716421d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f1333e09e8476e90156d0152634aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc44e4d1-370c-4775-9f3c-b2b4dfd8658a tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Request method failure captured: Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBdaZAxd3kBYOvN8lFHu5_kY9vdxfdsFitZs1blBlDS5y1O0sm8InVxW1Odh1bWI6SuJDlKVOvRO7RmJVEjGcUxkfZodF1zPMXaVf2l2SrfVUvEOiwU_60FgsgwBkropQVguNUA_9Cbd3FnYdrltj13n-O_ilHKfIpthmxXRmtlAmE Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:13:53.601757 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76f1333e09e8476e90156d0152634aad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76f1333e09e8476e90156d0152634aad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76f1333e09e8476e90156d0152634aad", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 76f1333e09e8476e90156d0152634aad Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052 Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 82f48e284cfa43299c19234a716421d7 Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732536052-project Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '1'} Sep 08 10:13:53.602918 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:13:53.604188 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 10:13:53.605119 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.606067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc44e4d1-370c-4775-9f3c-b2b4dfd8658a tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.606067 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc44e4d1-370c-4775-9f3c-b2b4dfd8658a tempest-HypervisorAdminNegativeTestJSON-1732536052 tempest-HypervisorAdminNegativeTestJSON-1732536052-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014199 Sep 08 10:13:53.606067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 93/156] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:13:53.613779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2dc5f9c-75ff-4ec2-895c-098bcc7e69a0 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Calling method '.version_select at 0x7f2351df89d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:53.616020 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a2dc5f9c-75ff-4ec2-895c-098bcc7e69a0 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] HTTP exception thrown: Hypervisor with ID 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf' could not be found. Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2dc5f9c-75ff-4ec2-895c-098bcc7e69a0 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Request method failure captured: Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hypervisors/dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf HTTP/1.1 Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBgaamB0HLWq2vH7cFikSvG06Y6X9VEcrxB4rvSrPMeuvXrqcjCpPOA7VavUAsGhKhDbA3BtOt_el2ZBw3_Ql3OwyPCXKocTa46g9PqkqeQfnfnE3FIN7chYbFl0CB7nBooxR-gpiYbWpdr-cX8XF0JNvHBoiOHYIWnCfbnLLiKx3U Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: a92090933fd9450f8effb93f4169932b Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-665664970 Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:13:53.617688 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a92090933fd9450f8effb93f4169932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a92090933fd9450f8effb93f4169932b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a92090933fd9450f8effb93f4169932b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a92090933fd9450f8effb93f4169932b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-665664970 Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: a92090933fd9450f8effb93f4169932b Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-665664970 Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: e0a31c9e9f49441f983bcf9e9c80e19d Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: exception: Hypervisor with ID 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf' could not be found. Sep 08 10:13:53.618926 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf'} Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf' Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 08 10:13:53.619924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:13:53.621050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf' could not be found. Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf' could not be found. Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2dc5f9c-75ff-4ec2-895c-098bcc7e69a0 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] Returning 404 to user: Hypervisor with ID 'dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf' could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:13:53.622391 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a2dc5f9c-75ff-4ec2-895c-098bcc7e69a0 tempest-HypervisorAdminNegativeTestJSON-665664970 tempest-HypervisorAdminNegativeTestJSON-665664970-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf" status: 404 len: 123 microversion: 2.1 time: 0.009321 Sep 08 10:13:53.623922 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 94/157] 10.222.0.59 () {58 vars in 1257 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/os-hypervisors/dff2e3eb-2937-4a7e-ad1c-d9cad4f414bf => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:13:53.749906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:53.763505 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7724dcb7-d186-45a3-bfd5-4589e5aac1bf tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.348987 Sep 08 10:13:53.768078 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 64/158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:53 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:54.023023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:54.023793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:54.035161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:54.035970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:54.037128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:54.040331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:54.040961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:54.042260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:54.296174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:54.303831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:54.315773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:54.326688 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f83c3ec-4cd4-49e7-bc7a-7f996d9e9430 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.308359 Sep 08 10:13:54.340339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:54.340527 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 95/159] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:54 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:54.341892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:54.347524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:54.348557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:54.349519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:54.350367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:54.532134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:54.535697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:54.541788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3df47b1d-126a-47c0-9ba6-2a29895d0ae8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.252397 Sep 08 10:13:54.542577 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 65/160] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:54 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:54.790671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:54.792390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:54.808752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:54.813878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:54.814618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:54.815430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:54.827615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:54.831495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:55.182649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:55.196791 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c915906-ac81-4b5a-8be3-9ced46a11520 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.412578 Sep 08 10:13:55.201009 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 96/161] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:54 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:55.364454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:55.366091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:55.377043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:55.379103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=22 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:13:55.382037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:55.382955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:55.384353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:55.386354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:55.387546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:55.388516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:55.566600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:55.568004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:55.578546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:55.580949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:55.582145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:55.584996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:55.585749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:55.587024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:55.829499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:55.837345 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ec34a10-8132-4e47-af24-e95b792e2ff9 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.488748 Sep 08 10:13:55.844364 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 66/162] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:55 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:55.912367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:55.940637 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98a512b2-0cf3-4e46-9922-97376eb8459b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.378707 Sep 08 10:13:55.948260 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 97/163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:55 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:56.299932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cd6a847-70e2-4e3d-85db-a90ca91e3b0c tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Action: 'create', calling method: .version_select at 0x7f2351fd5ee0>, body: {"keypair": {"name": "tempest-keypair-405782888", "type": "ssh", "user_id": "09c74710222d429da2d126cf8cbcce7c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRZkUw1n8ntU363sI4ISlUCOGOJkDxOd/2qb+9obPszhVYG7Ugxu6r2uLPFuymzw9h1M4pNI+aRd19XbMJljVm7SvTFzJUPYrY1v/9xSZ7kTEgyiVriIbf3qbJT6EfQwQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:56.327843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4cf0a83b-e024-4ec3-87f5-fde5becf78da tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1015466313", "id": 751567535, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:56.350884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-4cd6a847-70e2-4e3d-85db-a90ca91e3b0c tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Getting quotas for project 44b09198f04248ee846c315889eba5b7. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:13:56.358220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-4cd6a847-70e2-4e3d-85db-a90ca91e3b0c tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Getting quotas for user 71f3689384444b8bbe6fdb43807cfb3d and project 44b09198f04248ee846c315889eba5b7. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:13:56.363105 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4cf0a83b-e024-4ec3-87f5-fde5becf78da tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.413393 Sep 08 10:13:56.363923 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 98/164] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:13:55 2022] POST /compute/v2.1/flavors => generated 468 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:13:56.378808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:56.380056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:56.389624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:56.390112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:56.390544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:56.391237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:56.391726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:56.392335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:56.401832 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cd6a847-70e2-4e3d-85db-a90ca91e3b0c tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.553821 Sep 08 10:13:56.403602 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 67/165] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:13:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 558 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:13:56.419603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28f847b1-203b-4daa-9fc2-65dbeb0967cc tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:56.646849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28f847b1-203b-4daa-9fc2-65dbeb0967cc tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/751567535/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.240196 Sep 08 10:13:56.647833 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 68/166] 10.222.0.59 () {62 vars in 1262 bytes} [Thu Sep 8 10:13:56 2022] POST /compute/v2.1/flavors/751567535/os-extra_specs => generated 62 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:56.653802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-589075b7-166d-4b6a-a7e5-1e553824bce6 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Action: 'create', calling method: .version_select at 0x7f2351e0cf70>, body: {"keypair": {"name": "tempest-keypair-868134812", "type": "ssh", "user_id": "09c74710222d429da2d126cf8cbcce7c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1a/gbKqfVdIqK+d+L2bQFoi+iptNfLabSiKfF3W2PXj4Pm+oAkJN3GrElHaZQxYUOWw4fCtjGW4L1V1LeMfIXspud1CYGRVA2Gdm0H++2QuQFkM0TuFFE97tHc3zjTow=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:56.686701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-589075b7-166d-4b6a-a7e5-1e553824bce6 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Getting quotas for project 44b09198f04248ee846c315889eba5b7. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:13:56.690469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-589075b7-166d-4b6a-a7e5-1e553824bce6 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Getting quotas for user 71f3689384444b8bbe6fdb43807cfb3d and project 44b09198f04248ee846c315889eba5b7. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:13:56.706576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:56.716355 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-589075b7-166d-4b6a-a7e5-1e553824bce6 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.066942 Sep 08 10:13:56.716552 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a76f3586-2ab3-4320-be16-8a05bca54547 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.341898 Sep 08 10:13:56.717797 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 69/167] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:13:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:13:56.727874 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 99/168] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:56 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:56.738252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34664200-63a4-4750-8615-7de8f10e0b4e tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:56.756849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34664200-63a4-4750-8615-7de8f10e0b4e tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/751567535" status: 202 len: 0 microversion: 2.86 time: 0.027617 Sep 08 10:13:56.757792 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 100/169] 10.222.0.59 () {60 vars in 1199 bytes} [Thu Sep 8 10:13:56 2022] DELETE /compute/v2.1/flavors/751567535 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:13:56.764413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad4dd2ac-dcd6-426d-a3e5-87a40eed7cbf tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Calling method '.version_select at 0x7f2351e3fc10>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:56.779543 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad4dd2ac-dcd6-426d-a3e5-87a40eed7cbf tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-405782888?user_id=09c74710222d429da2d126cf8cbcce7c" status: 200 len: 511 microversion: 2.10 time: 0.020169 Sep 08 10:13:56.780131 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 101/170] 10.222.0.59 () {60 vars in 1337 bytes} [Thu Sep 8 10:13:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-405782888?user_id=09c74710222d429da2d126cf8cbcce7c => generated 511 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:13:56.791491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3c4365a-6619-46da-a4bc-705f4476c052 tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:56.827988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3c4365a-6619-46da-a4bc-705f4476c052 tempest-FlavorMetadataValidation-1950685659 tempest-FlavorMetadataValidation-1950685659-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.046377 Sep 08 10:13:56.828913 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 102/171] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:13:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:13:56.851718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f7fd7645-d7f6-4a59-ae96-ef9e0c5438f7 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Action: 'create', calling method: .version_select at 0x7f2351e0ce50>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-287511100", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANG9rJQqOAEdksLLXTkrpRZqF7xIECuY9JbK9POXQuDYX0yCPeCNmdVdogR5U2Ccl3xd3PsYnSPCUnFbKUecZU+viEai/bK/QEPeYhNz8JgYtitqvFB08XYTYNTUFtUWA=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:56.881547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-f7fd7645-d7f6-4a59-ae96-ef9e0c5438f7 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Getting quotas for project 44b09198f04248ee846c315889eba5b7. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:13:56.888892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-f7fd7645-d7f6-4a59-ae96-ef9e0c5438f7 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Getting quotas for user 71f3689384444b8bbe6fdb43807cfb3d and project 44b09198f04248ee846c315889eba5b7. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:13:56.953822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f7fd7645-d7f6-4a59-ae96-ef9e0c5438f7 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.107496 Sep 08 10:13:56.965168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a84fa45d-b6a3-40fb-bf7a-73c4d2c7e797 req-07f5ef63-57ba-4e5e-8234-db5b3432494e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e5fd918-594b-49f9-8e98-56e94162f1da", "name": "network-vif-plugged", "status": "completed", "tag": "b778c1ac-798f-4f31-bbc3-8b9e4178cfb0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:13:56.966730 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 103/172] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:13:56 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:13:56.975430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:56.977853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:56.990740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a84fa45d-b6a3-40fb-bf7a-73c4d2c7e797 req-07f5ef63-57ba-4e5e-8234-db5b3432494e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:56.991361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:56.992328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:56.993158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:56.995137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:56.996035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:56.996869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:57.001140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a84fa45d-b6a3-40fb-bf7a-73c4d2c7e797 req-07f5ef63-57ba-4e5e-8234-db5b3432494e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:57.001619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a84fa45d-b6a3-40fb-bf7a-73c4d2c7e797 req-07f5ef63-57ba-4e5e-8234-db5b3432494e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:57.021119 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a84fa45d-b6a3-40fb-bf7a-73c4d2c7e797 req-07f5ef63-57ba-4e5e-8234-db5b3432494e service nova] Creating event network-vif-plugged:b778c1ac-798f-4f31-bbc3-8b9e4178cfb0 for instance 3e5fd918-594b-49f9-8e98-56e94162f1da on n-h1-833090-19 Sep 08 10:13:57.035567 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a84fa45d-b6a3-40fb-bf7a-73c4d2c7e797 req-07f5ef63-57ba-4e5e-8234-db5b3432494e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316281 Sep 08 10:13:57.040172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 70/173] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:13:57.047374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73ae68ab-c11f-425b-ab87-b58030fd3cbe tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Calling method '.version_select at 0x7f2351dcc040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:57.059723 n-d-833090-19 devstack@n-api.service[122456]: WARNING oslo_db.sqlalchemy.utils [None req-73ae68ab-c11f-425b-ab87-b58030fd3cbe tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:13:57.072427 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-73ae68ab-c11f-425b-ab87-b58030fd3cbe tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "GET /compute/v2.1/os-keypairs?user_id=09c74710222d429da2d126cf8cbcce7c" status: 200 len: 724 microversion: 2.10 time: 0.030139 Sep 08 10:13:57.087977 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 71/174] 10.222.0.59 () {60 vars in 1259 bytes} [Thu Sep 8 10:13:57 2022] GET /compute/v2.1/os-keypairs?user_id=09c74710222d429da2d126cf8cbcce7c => generated 724 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:13:57.093268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:57.094905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:57.108786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:57.110066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:57.110752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:57.111841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:57.112865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:57.116470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:57.356361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:57.370339 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-466d93be-0384-4292-88db-5581fe807830 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.401424 Sep 08 10:13:57.388002 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 104/175] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:56 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:57.403036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89c30094-863b-4df3-9cfd-7fcd57d8ef75 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Calling method '.version_select at 0x7f2351df89d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:57.443030 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89c30094-863b-4df3-9cfd-7fcd57d8ef75 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-287511100" status: 204 len: 0 microversion: 2.10 time: 0.052316 Sep 08 10:13:57.444802 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 105/176] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Sep 8 10:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-287511100 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:13:57.460330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da154f0a-bf65-45f4-b824-f83bd62fa766 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Calling method '.version_select at 0x7f2351e0c790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:57.489164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:57.505177 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da154f0a-bf65-45f4-b824-f83bd62fa766 tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868134812?user_id=09c74710222d429da2d126cf8cbcce7c" status: 204 len: 0 microversion: 2.10 time: 0.052351 Sep 08 10:13:57.505909 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 106/177] 10.222.0.59 () {60 vars in 1340 bytes} [Thu Sep 8 10:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868134812?user_id=09c74710222d429da2d126cf8cbcce7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:13:57.506627 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b982a80-3d44-4169-9aa7-9df760eb181b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.417110 Sep 08 10:13:57.508977 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 72/178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:57 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:57.516802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1f641e8-411a-4e10-ae30-32d6f31f0ede tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] Calling method '.version_select at 0x7f2351de0670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:57.562744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1f641e8-411a-4e10-ae30-32d6f31f0ede tempest-KeyPairsV210TestJSON-1551897941 tempest-KeyPairsV210TestJSON-1551897941-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-405782888?user_id=09c74710222d429da2d126cf8cbcce7c" status: 204 len: 0 microversion: 2.10 time: 0.051029 Sep 08 10:13:57.564025 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 107/179] 10.222.0.59 () {60 vars in 1340 bytes} [Thu Sep 8 10:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-405782888?user_id=09c74710222d429da2d126cf8cbcce7c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:13:57.744957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:57.745804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:57.777064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:57.779314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:57.780775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:57.784280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:57.786300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:57.787216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:58.041176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:58.058972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0795d226-5bc9-4fec-aa6a-49f5594af77d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.318444 Sep 08 10:13:58.060166 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 73/180] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:57 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:58.422924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:58.425775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:58.445193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:58.445728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:58.451662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:58.455892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:58.457143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:58.457598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:58.538854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:58.540610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:58.549469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:58.551309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:58.556679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:58.557959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:58.558636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:58.559273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:58.861426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:58.875356 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c15b720f-ccdb-4ad0-aed1-3085add0e84f tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1337 microversion: 2.1 time: 0.472408 Sep 08 10:13:58.878164 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 108/181] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:58 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1337 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:58.900855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:58.922702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55ff3b56-d37a-4f3e-a581-f4c7911abf14 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.387937 Sep 08 10:13:58.923584 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 74/182] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:58 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:13:59.088402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:59.089325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:59.096802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:59.097531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:59.098129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:59.099298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:59.099889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:59.100464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:59.903221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:59.904138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:13:59.918079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:59.918896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:59.920448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:59.922094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:13:59.923006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:13:59.923917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:13:59.958771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:13:59.971570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af489fe6-643a-496d-bf75-cd1493e2fd01 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.889786 Sep 08 10:13:59.972394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 109/183] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:59 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:13:59.980815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:13:59.984561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:00.000188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:00.000686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:00.001120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:00.001825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:00.002276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:00.002697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:00.550239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:00.559939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:00.562989 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46de837e-ed7a-4822-b78d-5a34785e3e8a tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1487 microversion: 2.1 time: 0.666441 Sep 08 10:14:00.573687 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04f043b3-2208-4c77-bbd6-817678645faa tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.598146 Sep 08 10:14:00.573856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 110/184] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:59 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:00.575902 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 75/185] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:13:59 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1487 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:00.601114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:00.602695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:00.610277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:00.610987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:00.611685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:00.612587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:00.613255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:00.613833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:01.001306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:01.001997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:01.010898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:01.024316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:01.024803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:01.025547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:01.026000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:01.026420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:01.544750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:01.561248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b510cd2-7270-4d20-a741-1d1f31be202e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.564392 Sep 08 10:14:01.567389 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 76/186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:00 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:01.610608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:01.611414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:01.631740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:01.633449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:01.636134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:01.640830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:01.641661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:01.642282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:01.882462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:01.894026 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9edca47c-9686-4ced-8627-270e4a77fd16 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1640 microversion: 2.1 time: 1.296613 Sep 08 10:14:01.907522 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 111/187] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:00 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1640 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:01.923061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:01.930188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:01.945139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:01.947915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:01.951067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:01.953078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:01.954382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:01.957545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:02.035060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:14:02.188300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:02.198080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9620652a-68dc-4348-acc7-894344ab6bda tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.595701 Sep 08 10:14:02.198676 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 77/188] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:01 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:02.272178 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c7b7de1-abcb-43e6-a494-ef671c2dd871 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 204 len: 0 microversion: 2.1 time: 0.355134 Sep 08 10:14:02.273428 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 112/189] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:14:01 2022] DELETE /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:14:02.282245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:02.282859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:02.300441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:02.303103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:02.305534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:02.307067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:02.308859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:02.310771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:02.586619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:02.588740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:02.637449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:02.637966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:02.638416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:02.639142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:02.639624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:02.640052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:03.212760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:03.222971 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a8fcf82-3481-468b-a0d1-ce9097a67f53 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1493 microversion: 2.1 time: 0.944476 Sep 08 10:14:03.232729 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 78/190] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:02 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1493 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:03.550021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:03.560311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4726a1a6-c9df-468b-b8e3-fd1d9f24e6dd tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.978539 Sep 08 10:14:03.561793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 113/191] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:02 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:03.585705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:03.587122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:03.602334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:03.603566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:03.604038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:03.606698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:03.608379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:03.609904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:03.763917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-75ae7827-f7f9-4503-9424-7ace358858b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-878570683", "ram": 512, "vcpus": 1, "disk": 10, "id": 685297330, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:03.799332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-75ae7827-f7f9-4503-9424-7ace358858b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.565170 Sep 08 10:14:03.802486 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 79/192] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:04.105293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7054528b-2c71-4884-ba81-b055d4e836e5 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.114127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-7054528b-2c71-4884-ba81-b055d4e836e5 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] HTTP exception thrown: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7054528b-2c71-4884-ba81-b055d4e836e5 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Request method failure captured: Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/flavors/685297330/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBpiWGUZ-vsDJPRJ89uX4AAW80hhuOPv5V9UkcV9IDpIYmmIQD4NLjbPkm5STu1i4ctOowdN7xD3g12dFcFx6NXQ-ltS_Oi4h4f45KxLFrw2rReXYpbdkAmREXpl-DTwbJLqIfCHpr6XQl38BomP-fsGPU6IOf19XBJ05uw0AeuMbM Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:04.120689 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7a8d86ef4bce4816aeaaf69f0f486378", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2ce81ef2513d4d1c8859f16a0d0889a6 Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:04.121875 n-d-833090-19 devstack@n-api.service[122456]: exception: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'flavor_id': '685297330', 'id': 'hw:cpu_thread_policy'} Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.122460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.123615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.125649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7054528b-2c71-4884-ba81-b055d4e836e5 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Returning 404 to user: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:04.129331 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7054528b-2c71-4884-ba81-b055d4e836e5 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] 10.222.0.59 "GET /compute/v2.1/flavors/685297330/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.314350 Sep 08 10:14:04.131028 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 80/193] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:14:03 2022] GET /compute/v2.1/flavors/685297330/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:04.151103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87af6cd4-b5f0-4ae1-881c-84dfd3a19463 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.155914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87af6cd4-b5f0-4ae1-881c-84dfd3a19463 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '2ce81ef2513d4d1c8859f16a0d0889a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8d86ef4bce4816aeaaf69f0f486378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87af6cd4-b5f0-4ae1-881c-84dfd3a19463 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Request method failure captured: Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/flavors/685297330/os-extra_specs HTTP/1.1 Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 66 Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBpiWGUZ-vsDJPRJ89uX4AAW80hhuOPv5V9UkcV9IDpIYmmIQD4NLjbPkm5STu1i4ctOowdN7xD3g12dFcFx6NXQ-ltS_Oi4h4f45KxLFrw2rReXYpbdkAmREXpl-DTwbJLqIfCHpr6XQl38BomP-fsGPU6IOf19XBJ05uw0AeuMbM Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:04.158073 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7a8d86ef4bce4816aeaaf69f0f486378", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2ce81ef2513d4d1c8859f16a0d0889a6 Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 08 10:14:04.159268 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'flavor_id': '685297330', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:04.160445 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 10:14:04.161484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.162662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87af6cd4-b5f0-4ae1-881c-84dfd3a19463 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:04.162662 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87af6cd4-b5f0-4ae1-881c-84dfd3a19463 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] 10.222.0.59 "POST /compute/v2.1/flavors/685297330/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.022019 Sep 08 10:14:04.162662 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 81/194] 10.222.0.59 () {60 vars in 1221 bytes} [Thu Sep 8 10:14:04 2022] POST /compute/v2.1/flavors/685297330/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:14:04.177951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e295823e-e764-4f59-bef4-4aaca709e7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.215304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e295823e-e764-4f59-bef4-4aaca709e7c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/685297330/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041574 Sep 08 10:14:04.217358 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 82/195] 10.222.0.59 () {60 vars in 1221 bytes} [Thu Sep 8 10:14:04 2022] POST /compute/v2.1/flavors/685297330/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:14:04.342801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:04.352232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00f17526-a158-43a7-9325-f69fcefb04c2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.786416 Sep 08 10:14:04.363849 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 114/196] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:03 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:04.368794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ed9314-739c-451e-a70d-7bab9c3b2eea tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.370561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4ed9314-739c-451e-a70d-7bab9c3b2eea tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '2ce81ef2513d4d1c8859f16a0d0889a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8d86ef4bce4816aeaaf69f0f486378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ed9314-739c-451e-a70d-7bab9c3b2eea tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Request method failure captured: Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBpiWGUZ-vsDJPRJ89uX4AAW80hhuOPv5V9UkcV9IDpIYmmIQD4NLjbPkm5STu1i4ctOowdN7xD3g12dFcFx6NXQ-ltS_Oi4h4f45KxLFrw2rReXYpbdkAmREXpl-DTwbJLqIfCHpr6XQl38BomP-fsGPU6IOf19XBJ05uw0AeuMbM Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:14:04.373070 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7a8d86ef4bce4816aeaaf69f0f486378", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2ce81ef2513d4d1c8859f16a0d0889a6 Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:04.374254 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'flavor_id': '685297330', 'id': 'hw:numa_nodes'} Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:04.374821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.375882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ed9314-739c-451e-a70d-7bab9c3b2eea tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:04.376778 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4ed9314-739c-451e-a70d-7bab9c3b2eea tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] 10.222.0.59 "DELETE /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009474 Sep 08 10:14:04.376845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bca9c736-30a3-446a-88a5-0e452534542b tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] Calling method '.version_select at 0x7f2351e9daf0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.379680 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 115/197] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:14:04 2022] DELETE /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:04.393180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.394481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:04.400410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bca9c736-30a3-446a-88a5-0e452534542b tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.181087 Sep 08 10:14:04.401594 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 83/198] 10.222.0.59 () {60 vars in 1226 bytes} [Thu Sep 8 10:14:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:04.406458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e58cccf-ff10-469c-ba06-42405c7acb08 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.410115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:04.411347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:04.411880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:04.412662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:04.413190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:04.413681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:04.435365 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e58cccf-ff10-469c-ba06-42405c7acb08 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/685297330/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032426 Sep 08 10:14:04.436599 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 84/199] 10.222.0.59 () {60 vars in 1221 bytes} [Thu Sep 8 10:14:04 2022] POST /compute/v2.1/flavors/685297330/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:14:04.441631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2b66063-eed3-42b7-b1c3-1039c9ed1c2f tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] Action: 'update', calling method: .version_select at 0x7f2351e12a60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.457795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:04.703827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2b66063-eed3-42b7-b1c3-1039c9ed1c2f tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.265770 Sep 08 10:14:04.704846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 85/200] 10.222.0.59 () {62 vars in 1247 bytes} [Thu Sep 8 10:14:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:04.712389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-abddfe65-6cee-484c-889e-f33bf46eb367 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.713726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:04.715873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-abddfe65-6cee-484c-889e-f33bf46eb367 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '2ce81ef2513d4d1c8859f16a0d0889a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8d86ef4bce4816aeaaf69f0f486378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-abddfe65-6cee-484c-889e-f33bf46eb367 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Request method failure captured: Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 22 Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBpiWGUZ-vsDJPRJ89uX4AAW80hhuOPv5V9UkcV9IDpIYmmIQD4NLjbPkm5STu1i4ctOowdN7xD3g12dFcFx6NXQ-ltS_Oi4h4f45KxLFrw2rReXYpbdkAmREXpl-DTwbJLqIfCHpr6XQl38BomP-fsGPU6IOf19XBJ05uw0AeuMbM Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:04.717655 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7a8d86ef4bce4816aeaaf69f0f486378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7a8d86ef4bce4816aeaaf69f0f486378", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7a8d86ef4bce4816aeaaf69f0f486378 Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2ce81ef2513d4d1c8859f16a0d0889a6 Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: {"hw:numa_nodes": "1"} Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:04.718997 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'flavor_id': '685297330', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:04.719702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 10:14:04.720995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.722064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-abddfe65-6cee-484c-889e-f33bf46eb367 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:04.722064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-abddfe65-6cee-484c-889e-f33bf46eb367 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658 tempest-FlavorsExtraSpecsNegativeTestJSON-887775658-project] 10.222.0.59 "PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013180 Sep 08 10:14:04.724278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02cdbc99-e1c6-4c27-9aaf-882d3fae2541 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1493 microversion: 2.1 time: 0.342889 Sep 08 10:14:04.726428 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 86/201] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:14:04 2022] PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:04.727057 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 116/202] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:04 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1493 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:04.734081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0570a35e-6c11-4ca7-85e5-efde35fa66dd tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] Calling method '.version_select at 0x7f2351d398b0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.736929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:04.766905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.768326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:04.778359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:04.778925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:04.779253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:04.780568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:04.781031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:04.781457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:04.783017 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0570a35e-6c11-4ca7-85e5-efde35fa66dd tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.054068 Sep 08 10:14:04.783584 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 117/203] 10.222.0.59 () {60 vars in 1226 bytes} [Thu Sep 8 10:14:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:04.796076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb93190d-e800-4fe6-88a7-ad036c31209b tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:04.806597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-eb93190d-e800-4fe6-88a7-ad036c31209b tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] HTTP exception thrown: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb93190d-e800-4fe6-88a7-ad036c31209b tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Request method failure captured: Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/flavors/685297330/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBqQG5DAIcDyJJI7751DyycsTClPFvw16dckXbeNEHnqBegFs9hEq-ER0fTVItJ6R26PmOzzdGiG83Qc05jEp100UHQJ2shlMRPNlGaskhREvbDaBaBcvN-12ri5CqmqyFEMVqdyT7ruLp4hML8cyFbSgfXLhpyyVIGhug60sD2z9Q Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50eed0cec2634fd4997b012af8b2fd2f Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:04.808790 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50eed0cec2634fd4997b012af8b2fd2f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50eed0cec2634fd4997b012af8b2fd2f Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dbfca2a7103342629866cbb0a1161ec3 Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:04.810211 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'flavor_id': '685297330', 'id': 'hw:cpu_thread_policy'} Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.810941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. Sep 08 10:14:04.812385 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.816486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb93190d-e800-4fe6-88a7-ad036c31209b tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Returning 404 to user: Flavor 685297330 has no extra specs with key hw:cpu_thread_policy. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:04.817656 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb93190d-e800-4fe6-88a7-ad036c31209b tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/685297330/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.026221 Sep 08 10:14:04.819003 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 118/204] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:14:04 2022] DELETE /compute/v2.1/flavors/685297330/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:04.827238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-edd63063-6943-439f-8a93-1182feaf684c tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] Action: 'update', calling method: .version_select at 0x7f2352034a60>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.949025 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-edd63063-6943-439f-8a93-1182feaf684c tempest-QuotaClassesAdmin257Test-490177555 tempest-QuotaClassesAdmin257Test-490177555-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.125814 Sep 08 10:14:04.964924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 119/205] 10.222.0.59 () {62 vars in 1247 bytes} [Thu Sep 8 10:14:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:04.983296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-204058f1-ec2b-494d-b7c6-58ef6cbc688f tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:04.988859 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-204058f1-ec2b-494d-b7c6-58ef6cbc688f tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-204058f1-ec2b-494d-b7c6-58ef6cbc688f tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Request method failure captured: Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 27 Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBqQG5DAIcDyJJI7751DyycsTClPFvw16dckXbeNEHnqBegFs9hEq-ER0fTVItJ6R26PmOzzdGiG83Qc05jEp100UHQJ2shlMRPNlGaskhREvbDaBaBcvN-12ri5CqmqyFEMVqdyT7ruLp4hML8cyFbSgfXLhpyyVIGhug60sD2z9Q Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50eed0cec2634fd4997b012af8b2fd2f Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:04.990229 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50eed0cec2634fd4997b012af8b2fd2f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50eed0cec2634fd4997b012af8b2fd2f Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dbfca2a7103342629866cbb0a1161ec3 Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: {"hw:cpu_policy": "shared"} Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:04.991361 n-d-833090-19 devstack@n-api.service[122457]: exception: Request body and URI mismatch Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'flavor_id': '685297330', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:04.992768 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-204058f1-ec2b-494d-b7c6-58ef6cbc688f tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-204058f1-ec2b-494d-b7c6-58ef6cbc688f tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025343 Sep 08 10:14:04.994247 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 120/206] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:14:04 2022] PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes => generated 73 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:14:05.007262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b565e77-0934-4eed-82e2-be31049c4775 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b565e77-0934-4eed-82e2-be31049c4775 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Request method failure captured: Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 49 Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBqQG5DAIcDyJJI7751DyycsTClPFvw16dckXbeNEHnqBegFs9hEq-ER0fTVItJ6R26PmOzzdGiG83Qc05jEp100UHQJ2shlMRPNlGaskhREvbDaBaBcvN-12ri5CqmqyFEMVqdyT7ruLp4hML8cyFbSgfXLhpyyVIGhug60sD2z9Q Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50eed0cec2634fd4997b012af8b2fd2f Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:05.025384 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50eed0cec2634fd4997b012af8b2fd2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50eed0cec2634fd4997b012af8b2fd2f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50eed0cec2634fd4997b012af8b2fd2f Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dbfca2a7103342629866cbb0a1161ec3 Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 08 10:14:05.026588 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'flavor_id': '685297330', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance: Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 08 10:14:05.027202 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.028387 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b565e77-0934-4eed-82e2-be31049c4775 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b565e77-0934-4eed-82e2-be31049c4775 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026599 Sep 08 10:14:05.030182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 121/207] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:14:04 2022] PUT /compute/v2.1/flavors/685297330/os-extra_specs/hw:numa_nodes => generated 117 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:14:05.050804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46cef895-7be0-453d-b32a-7aed722b97d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:05.105968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46cef895-7be0-453d-b32a-7aed722b97d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/685297330" status: 202 len: 0 microversion: 2.1 time: 0.069624 Sep 08 10:14:05.106571 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 122/208] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:14:05 2022] DELETE /compute/v2.1/flavors/685297330 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:14:05.127500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03bd74aa-ac99-43cb-a0c8-a7437070fe86 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:05.172905 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03bd74aa-ac99-43cb-a0c8-a7437070fe86 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962 tempest-FlavorsExtraSpecsNegativeTestJSON-1827637962-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060329 Sep 08 10:14:05.174247 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 123/209] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:14:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:05.282111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:05.308907 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a1c440c-8d6c-4b29-8128-44ef413b42f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.579099 Sep 08 10:14:05.310762 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 87/210] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:04 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:05.377315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:05.378193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:05.397156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:05.398506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:05.400613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:05.401552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:05.403006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:05.403857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:05.754504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:05.755183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:05.771708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:05.772507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:05.773666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:05.775048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:05.778098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:05.780526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:05.900488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:05.909549 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7df6609-d01d-4b69-9a36-bc18d8f414bc tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.536556 Sep 08 10:14:05.913132 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 124/211] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:05 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:05.992712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b4f9b6c6-4a2f-44de-93ac-ea1a3677a185 req-3a68a371-eb0b-4f6c-86c7-5a7a149df29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e5fd918-594b-49f9-8e98-56e94162f1da", "name": "network-vif-deleted", "tag": "b778c1ac-798f-4f31-bbc3-8b9e4178cfb0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:06.013013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b4f9b6c6-4a2f-44de-93ac-ea1a3677a185 req-3a68a371-eb0b-4f6c-86c7-5a7a149df29d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:06.014120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b4f9b6c6-4a2f-44de-93ac-ea1a3677a185 req-3a68a371-eb0b-4f6c-86c7-5a7a149df29d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:06.015024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b4f9b6c6-4a2f-44de-93ac-ea1a3677a185 req-3a68a371-eb0b-4f6c-86c7-5a7a149df29d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:06.028789 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b4f9b6c6-4a2f-44de-93ac-ea1a3677a185 req-3a68a371-eb0b-4f6c-86c7-5a7a149df29d service nova] Creating event network-vif-deleted:b778c1ac-798f-4f31-bbc3-8b9e4178cfb0 for instance 3e5fd918-594b-49f9-8e98-56e94162f1da on n-h1-833090-19 Sep 08 10:14:06.034727 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b4f9b6c6-4a2f-44de-93ac-ea1a3677a185 req-3a68a371-eb0b-4f6c-86c7-5a7a149df29d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Sep 08 10:14:06.036130 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 125/212] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:06.244969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '826be1a3be064b87a370115bce01ab2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20f27a838b04da2b30d045d70a7e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:06.256884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3854e34c-9d25-4758-b086-d50e99d00864 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 200 len: 1451 microversion: 2.1 time: 0.506931 Sep 08 10:14:06.259518 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 88/213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:05 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 1451 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:06.336854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:06.337851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:06.348573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:06.351552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:06.352858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:06.355292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:06.356608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:06.357391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:06.942701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:06.943340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:06.955796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:06.956288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:06.956942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:06.957705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:06.958156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:06.958714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:07.064004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:07.072776 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de58e4cb-6b8d-465b-b5a1-2ac17aaec2c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.740233 Sep 08 10:14:07.073912 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 126/214] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:06 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:07.284020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:07.284889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:07.294987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:07.295618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:07.295937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:07.296648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:07.297093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:07.301631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:07.349075 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] HTTP exception thrown: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Request method failure captured: Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da HTTP/1.1 Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBFsLpaEnTVd8TIWBwJgGHWmiROMTS4yPxBiVLSwIiI-XrtRYbwQ5DnrstluWGni-MIOypwbKO2b3HlKgcEj4wht32Ux8-KxbjR4Y11G4GkGqbXsKB6AkkXKUImANlQ5fixJv_A3IlSNBqvsd10qYDyGWj_YsHrZBn9tVJ1P5gIHRs Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f20f27a838b04da2b30d045d70a7e6e7 Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:14:07.360368 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f20f27a838b04da2b30d045d70a7e6e7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f20f27a838b04da2b30d045d70a7e6e7 Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminTestJSON-1612576123-project Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 826be1a3be064b87a370115bce01ab2c Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminTestJSON-1612576123-project Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:07.361920 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3e5fd918-594b-49f9-8e98-56e94162f1da'} Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:07.363499 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:07.364886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:07.368320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Returning 404 to user: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:07.369028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:07.370346 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d47d8256-d6b6-4189-b6ed-0e98d0c63760 tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 404 len: 111 microversion: 2.1 time: 0.091597 Sep 08 10:14:07.375709 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 127/215] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:07 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:07.384761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-92d12f4f-8915-4fca-9201-3aa312c1cdb7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:07.393712 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85b2af6a-bab7-402f-94f0-22faed582035 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.459411 Sep 08 10:14:07.395828 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 89/216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:06 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:07.419817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d12f4f-8915-4fca-9201-3aa312c1cdb7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:07.420757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d12f4f-8915-4fca-9201-3aa312c1cdb7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:07.422806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d12f4f-8915-4fca-9201-3aa312c1cdb7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:08.095794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:08.096399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:08.104304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:08.111565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:08.112023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:08.112766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:08.113223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:08.113645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:08.518825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:08.531332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9331564-5e15-4f73-be58-7e76b77ed83e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.437584 Sep 08 10:14:08.557985 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 90/217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:08 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:08.575258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:08.577002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:08.586371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:08.594392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:08.597319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:08.598280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:08.600262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:08.600875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:08.713430 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-92d12f4f-8915-4fca-9201-3aa312c1cdb7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 1.333238 Sep 08 10:14:08.716255 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 128/218] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:08.734672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d15847e-1235-491e-94df-d4a77cde6870 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:08.788826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d15847e-1235-491e-94df-d4a77cde6870 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.059048 Sep 08 10:14:08.789819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 129/219] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:08 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:08.809266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-770e4a0e-cd42-44ad-9581-85efc0a23e1e tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1430547206"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:08.814623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-770e4a0e-cd42-44ad-9581-85efc0a23e1e tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid bc1df61c-965c-4256-baa0-289d0aefb896 for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:08.847094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-770e4a0e-cd42-44ad-9581-85efc0a23e1e tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044011 Sep 08 10:14:08.849813 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 130/220] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:08.872956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bab5062b-a59b-4996-89fc-e4fe84013e07 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:08.903400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab5062b-a59b-4996-89fc-e4fe84013e07 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:08.906430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab5062b-a59b-4996-89fc-e4fe84013e07 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:08.906900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab5062b-a59b-4996-89fc-e4fe84013e07 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:09.117558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:09.132153 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-683e12fe-8c47-4a58-87b1-a914de617be4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.571679 Sep 08 10:14:09.153012 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 91/221] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:08 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:09.256957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bab5062b-a59b-4996-89fc-e4fe84013e07 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.399060 Sep 08 10:14:09.257589 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 131/222] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:08 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:09.270891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6d14b2b-9df9-40c4-8966-63cfcc9bdac5 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:09.288721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6d14b2b-9df9-40c4-8966-63cfcc9bdac5 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.022604 Sep 08 10:14:09.290524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 92/223] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:14:09 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:09.302425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4cd878c-e4ca-4faf-a7b7-71aca892c663 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:09.320644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4cd878c-e4ca-4faf-a7b7-71aca892c663 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:09.324052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4cd878c-e4ca-4faf-a7b7-71aca892c663 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:09.325972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4cd878c-e4ca-4faf-a7b7-71aca892c663 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:09.565344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:09.565910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:09.578284 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4cd878c-e4ca-4faf-a7b7-71aca892c663 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.279534 Sep 08 10:14:09.579535 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 132/224] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:09 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:09.579844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:09.583121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:09.583911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:09.584890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:09.585564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:09.598285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:09.608609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9281352f-61af-4ca9-88f2-5ddf1f2ab958 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:09.716203 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9281352f-61af-4ca9-88f2-5ddf1f2ab958 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.119898 Sep 08 10:14:09.717041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 133/225] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:09 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:14:09.754428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a76dd5b-18ec-40ad-8a93-a80c012272ae tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1018423432"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:09.781508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-9a76dd5b-18ec-40ad-8a93-a80c012272ae tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Generated uuid b85be3b1-dbf4-444c-b292-f469966ab51f for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:09.833811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a76dd5b-18ec-40ad-8a93-a80c012272ae tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.101530 Sep 08 10:14:09.835070 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 134/226] 10.222.0.59 () {62 vars in 1205 bytes} [Thu Sep 8 10:14:09 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:09.864271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bbd34903-0e31-4585-87fb-0ff5c3e390fe tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-383942822"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:10.093754 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bbd34903-0e31-4585-87fb-0ff5c3e390fe tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.245301 Sep 08 10:14:10.095880 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 135/227] 10.222.0.59 () {62 vars in 1210 bytes} [Thu Sep 8 10:14:09 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:10.105298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:10.108294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1eda8a60-a512-42ee-b6b2-d801884360dd tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:10.120473 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6cd52444-1e4e-4a4a-ba35-ebc8122b9071 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.559960 Sep 08 10:14:10.122879 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 93/228] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:09 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:10.129654 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1eda8a60-a512-42ee-b6b2-d801884360dd tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.025783 Sep 08 10:14:10.140034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 136/229] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Sep 8 10:14:10 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:10.146641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1cef8913-c3a8-4feb-b48b-412ffc9d7bc9 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:10.166339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:10.167920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:10.174494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cef8913-c3a8-4feb-b48b-412ffc9d7bc9 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:10.175625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cef8913-c3a8-4feb-b48b-412ffc9d7bc9 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:10.177228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cef8913-c3a8-4feb-b48b-412ffc9d7bc9 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:10.178516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:10.179011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:10.179500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:10.181384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:10.182390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:10.183251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:10.441727 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1cef8913-c3a8-4feb-b48b-412ffc9d7bc9 tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.300018 Sep 08 10:14:10.442335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 94/230] 10.222.0.59 () {62 vars in 1232 bytes} [Thu Sep 8 10:14:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:14:10.456106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48c839d9-72d3-4d03-a114-618b51d7d2cc tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:10.468483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c839d9-72d3-4d03-a114-618b51d7d2cc tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:10.469833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c839d9-72d3-4d03-a114-618b51d7d2cc tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:10.470473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c839d9-72d3-4d03-a114-618b51d7d2cc tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:10.500091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:10.512920 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc45a31f-f9ff-48ff-ba58-64d9ce0d0786 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.355988 Sep 08 10:14:10.513875 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 137/231] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:10 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:10.687627 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48c839d9-72d3-4d03-a114-618b51d7d2cc tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.236254 Sep 08 10:14:10.703118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5997a3de-8362-4dba-8acf-944bba1c3f9c tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:10.713128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 95/232] 10.222.0.59 () {62 vars in 1232 bytes} [Thu Sep 8 10:14:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:10.742647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5997a3de-8362-4dba-8acf-944bba1c3f9c tempest-AggregatesAdminTestV241-841148492 tempest-AggregatesAdminTestV241-841148492-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.043884 Sep 08 10:14:10.745375 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 138/233] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:14:10 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:10.783946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-866e919d-516c-478e-975d-d51c2f9bfcab tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1816934424"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:10.791211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-866e919d-516c-478e-975d-d51c2f9bfcab tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 70b386a5-4145-4ec9-8c17-e6c3f874325f for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:10.859831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-866e919d-516c-478e-975d-d51c2f9bfcab tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079663 Sep 08 10:14:10.861823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a8e02279-2f3c-4bb9-8a74-9bb4110da25d req-1a60cf76-26b0-4c14-9948-d7630737f3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0647d366-0477-45f6-91a8-84b1387168c5", "name": "network-vif-plugged", "status": "completed", "tag": "9c9f32e8-e2d6-4411-b6f8-7592a660caa0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:10.862449 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 96/234] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:10.883032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c93deab2-137b-47c0-bbe1-2c4068cc46d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:10.884146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a8e02279-2f3c-4bb9-8a74-9bb4110da25d req-1a60cf76-26b0-4c14-9948-d7630737f3dd service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:10.888907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a8e02279-2f3c-4bb9-8a74-9bb4110da25d req-1a60cf76-26b0-4c14-9948-d7630737f3dd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:10.889379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a8e02279-2f3c-4bb9-8a74-9bb4110da25d req-1a60cf76-26b0-4c14-9948-d7630737f3dd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:10.911010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c93deab2-137b-47c0-bbe1-2c4068cc46d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:10.911982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c93deab2-137b-47c0-bbe1-2c4068cc46d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:10.912723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c93deab2-137b-47c0-bbe1-2c4068cc46d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:10.918316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a8e02279-2f3c-4bb9-8a74-9bb4110da25d req-1a60cf76-26b0-4c14-9948-d7630737f3dd service nova] Creating event network-vif-plugged:9c9f32e8-e2d6-4411-b6f8-7592a660caa0 for instance 0647d366-0477-45f6-91a8-84b1387168c5 on n-h2-833090-19 Sep 08 10:14:10.933958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a8e02279-2f3c-4bb9-8a74-9bb4110da25d req-1a60cf76-26b0-4c14-9948-d7630737f3dd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073638 Sep 08 10:14:10.938626 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 139/235] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:14:11.151429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:11.152313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:11.161244 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c93deab2-137b-47c0-bbe1-2c4068cc46d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.291032 Sep 08 10:14:11.163091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 97/236] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:10 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:11.170436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:11.171647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:11.172778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:11.176220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:11.176918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:11.177599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:11.181789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8a6fc2f-b5c7-4636-91be-291f83cf57cb tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:11.203504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8a6fc2f-b5c7-4636-91be-291f83cf57cb tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.032270 Sep 08 10:14:11.204219 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 98/237] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:14:11 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:14:11.233342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9370beda-495a-40fe-9a47-b86053d4ba51 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:11.267306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9370beda-495a-40fe-9a47-b86053d4ba51 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:11.267399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9370beda-495a-40fe-9a47-b86053d4ba51 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:11.267846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9370beda-495a-40fe-9a47-b86053d4ba51 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:11.277111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:11.571493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9370beda-495a-40fe-9a47-b86053d4ba51 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.357281 Sep 08 10:14:11.572472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 99/238] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:11 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:11.582370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:11.584737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:11.590652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:11.601432 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-732816d9-f368-4d21-9db4-2203416a332b tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 0.455286 Sep 08 10:14:11.603755 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 140/239] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:11 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:11.612180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc9f4f88-db7e-4afb-9dc5-0b5665659ef4 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:11.624073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:11.626872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:11.630636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:11.634513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:11.638754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:11.640308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:11.644738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=8,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:11.671781 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc9f4f88-db7e-4afb-9dc5-0b5665659ef4 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.066150 Sep 08 10:14:11.673499 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 141/240] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:11 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:11.694000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6bec447c-4610-4b01-b945-db63bfe69595 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1501782146"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:11.706605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-6bec447c-4610-4b01-b945-db63bfe69595 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 9098339d-7afd-4945-b9e3-f1064e97d2af for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:11.744015 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6bec447c-4610-4b01-b945-db63bfe69595 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063168 Sep 08 10:14:11.746364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 142/241] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:11.766391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e4234f8-4147-4459-897a-9420a5ec2012 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:11.788031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e4234f8-4147-4459-897a-9420a5ec2012 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:11.788635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e4234f8-4147-4459-897a-9420a5ec2012 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:11.789326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e4234f8-4147-4459-897a-9420a5ec2012 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:12.018477 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e4234f8-4147-4459-897a-9420a5ec2012 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.261589 Sep 08 10:14:12.019195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 143/242] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:11 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:12.031861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eea8f6b1-af5a-4fb7-ade1-dce853e93b97 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:12.053920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eea8f6b1-af5a-4fb7-ade1-dce853e93b97 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:12.054427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eea8f6b1-af5a-4fb7-ade1-dce853e93b97 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:12.054864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eea8f6b1-af5a-4fb7-ade1-dce853e93b97 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:12.280001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eea8f6b1-af5a-4fb7-ade1-dce853e93b97 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.251609 Sep 08 10:14:12.284188 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 144/243] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:12 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:14:12.301348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64e32f53-e799-4430-8d86-c5d881b5a897 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.355986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64e32f53-e799-4430-8d86-c5d881b5a897 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059284 Sep 08 10:14:12.363201 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 145/244] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:12 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:12.372714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-285684dc-55df-4c53-a34e-bb633844ea71 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1160173385"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:12.382503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-285684dc-55df-4c53-a34e-bb633844ea71 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 6ba99f1e-9d03-43c2-b02c-52dccd9895a1 for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:12.422634 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-285684dc-55df-4c53-a34e-bb633844ea71 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057667 Sep 08 10:14:12.429257 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 146/245] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:12.442641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b8c5598-f5b4-47af-aa8f-485d0f21960d tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.494600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b8c5598-f5b4-47af-aa8f-485d0f21960d tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.055627 Sep 08 10:14:12.501911 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 147/246] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:12.510347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-894fab1f-a506-46eb-8e8f-e977cb198250 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.528416 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-894fab1f-a506-46eb-8e8f-e977cb198250 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-894fab1f-a506-46eb-8e8f-e977cb198250 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Request method failure captured: Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBHyl9mXWS6Ob8PF2Ob3RgtM89Pp_GREDvdY-GH4CHD1IC-nIKN9JlUL6dC9--o1GzIbpKhn9xxYrFLs5RoH15W-Cm25bQx2pmKiO8KY4wl22QGuu2B6Hw13aerMh93Xb7S4xpElsCAcdq612OPB_BHqCumjbvp3jQDJRqfxXEo-AI Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:12.532780 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_21eba7ac01a14e7d9a06d34eed410d72", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 01589d06a28b410eb922d46193d8bdad Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: exception: Aggregate 6 could not be found. Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6'} Sep 08 10:14:12.534401 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.535250 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 08 10:14:12.536847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.542412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-894fab1f-a506-46eb-8e8f-e977cb198250 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:12.544008 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-894fab1f-a506-46eb-8e8f-e977cb198250 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.037949 Sep 08 10:14:12.548154 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 148/247] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:14:12 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:12.558021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-755a44c4-8c8b-456c-a12b-ff45580311ea tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.575012 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-755a44c4-8c8b-456c-a12b-ff45580311ea tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-755a44c4-8c8b-456c-a12b-ff45580311ea tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Request method failure captured: Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBHyl9mXWS6Ob8PF2Ob3RgtM89Pp_GREDvdY-GH4CHD1IC-nIKN9JlUL6dC9--o1GzIbpKhn9xxYrFLs5RoH15W-Cm25bQx2pmKiO8KY4wl22QGuu2B6Hw13aerMh93Xb7S4xpElsCAcdq612OPB_BHqCumjbvp3jQDJRqfxXEo-AI Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:12.578988 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_21eba7ac01a14e7d9a06d34eed410d72", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 01589d06a28b410eb922d46193d8bdad Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: exception: Aggregate 6 could not be found. Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6'} Sep 08 10:14:12.580329 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:12.581193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.583118 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.584395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.584395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:12.584395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:12.584395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 08 10:14:12.584395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.587021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-755a44c4-8c8b-456c-a12b-ff45580311ea tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:12.588352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-755a44c4-8c8b-456c-a12b-ff45580311ea tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.037756 Sep 08 10:14:12.589113 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 149/248] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:12.602444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c8f1370-1118-4188-8513-5906ea8ecac7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2018515761", "name": "tempest-test_aggregate-993122707"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:12.609300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-4c8f1370-1118-4188-8513-5906ea8ecac7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 7e127a47-6041-4fd4-9c5e-6f3677f6d12a for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:12.643907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:12.659125 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83bb43f5-adf5-4f21-902f-cb11a19f0cd7 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 1.084971 Sep 08 10:14:12.659772 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 100/249] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:11 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:12.668420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.669041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:12.691699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:12.692193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:12.692630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:12.693335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:12.693783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:12.694207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:12.698358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c8f1370-1118-4188-8513-5906ea8ecac7 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.103124 Sep 08 10:14:12.712715 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 150/250] 10.222.0.59 () {60 vars in 1165 bytes} [Thu Sep 8 10:14:12 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:12.720883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7546f0d-adfd-4bda-a2e8-6374b5d8cd3f tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.777083 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7546f0d-adfd-4bda-a2e8-6374b5d8cd3f tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.062933 Sep 08 10:14:12.781794 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 151/251] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:12.786650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adbd4e98-2923-45fe-a6e1-373984d48cf9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.804038 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-adbd4e98-2923-45fe-a6e1-373984d48cf9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adbd4e98-2923-45fe-a6e1-373984d48cf9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Request method failure captured: Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBHyl9mXWS6Ob8PF2Ob3RgtM89Pp_GREDvdY-GH4CHD1IC-nIKN9JlUL6dC9--o1GzIbpKhn9xxYrFLs5RoH15W-Cm25bQx2pmKiO8KY4wl22QGuu2B6Hw13aerMh93Xb7S4xpElsCAcdq612OPB_BHqCumjbvp3jQDJRqfxXEo-AI Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:12.806226 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_21eba7ac01a14e7d9a06d34eed410d72", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 01589d06a28b410eb922d46193d8bdad Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: exception: Aggregate 7 could not be found. Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7'} Sep 08 10:14:12.807486 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.808269 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 08 10:14:12.809242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.810157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adbd4e98-2923-45fe-a6e1-373984d48cf9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:12.810157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-adbd4e98-2923-45fe-a6e1-373984d48cf9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.024667 Sep 08 10:14:12.810157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 152/252] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:14:12 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:12.825499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24ec2a32-1d5c-4282-9e8a-fd589c07eb58 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.840987 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-24ec2a32-1d5c-4282-9e8a-fd589c07eb58 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24ec2a32-1d5c-4282-9e8a-fd589c07eb58 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Request method failure captured: Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBHyl9mXWS6Ob8PF2Ob3RgtM89Pp_GREDvdY-GH4CHD1IC-nIKN9JlUL6dC9--o1GzIbpKhn9xxYrFLs5RoH15W-Cm25bQx2pmKiO8KY4wl22QGuu2B6Hw13aerMh93Xb7S4xpElsCAcdq612OPB_BHqCumjbvp3jQDJRqfxXEo-AI Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:12.842547 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/21eba7ac01a14e7d9a06d34eed410d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_21eba7ac01a14e7d9a06d34eed410d72", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 21eba7ac01a14e7d9a06d34eed410d72 Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1286223988 Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 01589d06a28b410eb922d46193d8bdad Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminTestJSON-1286223988-project-admin Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: exception: Aggregate 7 could not be found. Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7'} Sep 08 10:14:12.843678 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:12.844376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:12.845361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24ec2a32-1d5c-4282-9e8a-fd589c07eb58 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:12.846450 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-24ec2a32-1d5c-4282-9e8a-fd589c07eb58 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.028016 Sep 08 10:14:12.851421 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 153/253] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:12.856211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-edc2814e-ca89-430b-8e9e-b28541d6b7bc tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1368880609"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:12.860234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-edc2814e-ca89-430b-8e9e-b28541d6b7bc tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 6f978727-3a72-45d0-bc51-f74f15cae4b8 for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:12.891658 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-edc2814e-ca89-430b-8e9e-b28541d6b7bc tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037246 Sep 08 10:14:12.892326 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 154/254] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:12.905469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64bc92de-e13d-484c-9e97-8bfec8878973 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:12.915698 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64bc92de-e13d-484c-9e97-8bfec8878973 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.014973 Sep 08 10:14:12.916535 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 155/255] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:14:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:12.936201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-478b6dcc-2bab-46b3-b384-325cedb2ac91 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:12.987344 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-478b6dcc-2bab-46b3-b384-325cedb2ac91 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.060121 Sep 08 10:14:12.994677 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 156/256] 10.222.0.59 () {60 vars in 1191 bytes} [Thu Sep 8 10:14:12 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.013349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aba392bf-66a0-4de8-9a2c-7ec3fc8d92d1 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.042835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aba392bf-66a0-4de8-9a2c-7ec3fc8d92d1 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.037119 Sep 08 10:14:13.043446 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 157/257] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:14:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.066388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7267a5c-84c7-466c-9987-a4e375d77fbf tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.130606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7267a5c-84c7-466c-9987-a4e375d77fbf tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078034 Sep 08 10:14:13.132972 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 158/258] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:14:13.149576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc5942f9-3316-42f3-91fa-4a401666ff95 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2065636783", "availability_zone": "tempest-test_az-1657583879"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:13.153654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-bc5942f9-3316-42f3-91fa-4a401666ff95 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 1a972b0c-7a3b-41f5-abca-7d6a3940b0c4 for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:13.214184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc5942f9-3316-42f3-91fa-4a401666ff95 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.073554 Sep 08 10:14:13.223899 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 159/259] 10.222.0.59 () {60 vars in 1165 bytes} [Thu Sep 8 10:14:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.229847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1eff222f-455b-492c-9aa4-f0f69634f177 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2065636783_new", "availability_zone": "tempest-test_az-1657583879_new"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:13.300840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eff222f-455b-492c-9aa4-f0f69634f177 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:13.302538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eff222f-455b-492c-9aa4-f0f69634f177 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:13.302987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eff222f-455b-492c-9aa4-f0f69634f177 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:13.392638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1eff222f-455b-492c-9aa4-f0f69634f177 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.165809 Sep 08 10:14:13.394157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 160/260] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:14:13 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.412664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca1067b5-e869-453b-beee-7009921a72cb tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.454241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca1067b5-e869-453b-beee-7009921a72cb tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.046362 Sep 08 10:14:13.463094 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 161/261] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:14:13 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.481708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48fc1cda-ec84-4812-9191-45fc3a2c35a9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.514262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=11,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:13.566460 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48fc1cda-ec84-4812-9191-45fc3a2c35a9 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.101946 Sep 08 10:14:13.572999 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 162/262] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:13 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:13.578288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a190ce5f-3f6a-4459-a97e-c42828aab9d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-865650652"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:13.584138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-a190ce5f-3f6a-4459-a97e-c42828aab9d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Generated uuid 5394a13c-35c1-4bae-9871-9a7f108ee0d8 for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:13.629259 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a190ce5f-3f6a-4459-a97e-c42828aab9d2 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053034 Sep 08 10:14:13.639735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 163/263] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.644625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9eb7bdc0-e194-485c-a672-0b948ef49c3e tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.653427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9eb7bdc0-e194-485c-a672-0b948ef49c3e tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.012547 Sep 08 10:14:13.654001 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 164/264] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:14:13 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:13.665461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20fc77de-f312-46ef-a4ce-10cb68390b50 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.710417 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20fc77de-f312-46ef-a4ce-10cb68390b50 tempest-AggregatesAdminTestJSON-1286223988 tempest-AggregatesAdminTestJSON-1286223988-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.048524 Sep 08 10:14:13.711266 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 165/265] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:13 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:14:13.719445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.720086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:13.731930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:13.732420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:13.732846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:13.733559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:13.734004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:13.734421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:13.895888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:13.937758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-809aa339-24eb-4716-8a7e-1004aeb8c993 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1319 microversion: 2.1 time: 1.276928 Sep 08 10:14:13.949761 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 101/266] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:12 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1319 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:13.968740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:13.973029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:13.994936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:13.997755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:13.998612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:13.999364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:13.999854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:14.000455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:14.044745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] HTTP exception thrown: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Request method failure captured: Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da HTTP/1.1 Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBFsLpaEnTVd8TIWBwJgGHWmiROMTS4yPxBiVLSwIiI-XrtRYbwQ5DnrstluWGni-MIOypwbKO2b3HlKgcEj4wht32Ux8-KxbjR4Y11G4GkGqbXsKB6AkkXKUImANlQ5fixJv_A3IlSNBqvsd10qYDyGWj_YsHrZBn9tVJ1P5gIHRs Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f20f27a838b04da2b30d045d70a7e6e7 Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:14.047869 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f20f27a838b04da2b30d045d70a7e6e7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f20f27a838b04da2b30d045d70a7e6e7 Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminTestJSON-1612576123-project Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 826be1a3be064b87a370115bce01ab2c Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminTestJSON-1612576123-project Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.049043 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3e5fd918-594b-49f9-8e98-56e94162f1da'} Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:14.049809 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.080802 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.082625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Returning 404 to user: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:14.082625 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e59ffa6e-82e8-4662-9ddf-6b6cbe18abfd tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 404 len: 111 microversion: 2.1 time: 0.105681 Sep 08 10:14:14.082625 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 102/267] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:14:13 2022] DELETE /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:14.087487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:14.087487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] [instance: 3e5fd918-594b-49f9-8e98-56e94162f1da] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:14.107687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:14.125589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:14.126197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:14.127031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:14.127601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:14.128097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:14.161212 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] HTTP exception thrown: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Request method failure captured: Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da HTTP/1.1 Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBFsLpaEnTVd8TIWBwJgGHWmiROMTS4yPxBiVLSwIiI-XrtRYbwQ5DnrstluWGni-MIOypwbKO2b3HlKgcEj4wht32Ux8-KxbjR4Y11G4GkGqbXsKB6AkkXKUImANlQ5fixJv_A3IlSNBqvsd10qYDyGWj_YsHrZBn9tVJ1P5gIHRs Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f20f27a838b04da2b30d045d70a7e6e7 Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:14.172174 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f20f27a838b04da2b30d045d70a7e6e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f20f27a838b04da2b30d045d70a7e6e7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f20f27a838b04da2b30d045d70a7e6e7 Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1612576123 Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminTestJSON-1612576123-project Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 826be1a3be064b87a370115bce01ab2c Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminTestJSON-1612576123-project Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.173442 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3e5fd918-594b-49f9-8e98-56e94162f1da'} Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:14.174094 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. Sep 08 10:14:14.175130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:14.177719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] Returning 404 to user: Instance 3e5fd918-594b-49f9-8e98-56e94162f1da could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:14.178589 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7dd26c57-0405-46bf-9fef-945f1cc793bf tempest-AggregatesAdminTestJSON-1612576123 tempest-AggregatesAdminTestJSON-1612576123-project] 10.222.0.59 "GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da" status: 404 len: 111 microversion: 2.1 time: 0.105695 Sep 08 10:14:14.179162 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 103/268] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:14 2022] GET /compute/v2.1/servers/3e5fd918-594b-49f9-8e98-56e94162f1da => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:14.652745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:14.660785 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3169ff1c-1aa0-4d24-a601-6c30289308ef tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.945001 Sep 08 10:14:14.665253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 166/269] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:13 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:14.718210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:14.977914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:14.979015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:14.981707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:14.999119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:14.999660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:15.003519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:15.004586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:15.006612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:15.008275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:15.594240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:15.603194 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-53245726-1ceb-49d3-946a-66aa49dca92a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1469 microversion: 2.1 time: 0.630948 Sep 08 10:14:15.603808 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 167/270] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:14 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1469 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:15.611475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ce366cb2-dd68-477b-883e-0be2eeb27ed4 req-a6ec703e-f3cc-41e9-8af7-e61d7ddf8322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2a9804-8f7b-4e91-99bc-7f41289f8f86", "name": "network-vif-plugged", "status": "completed", "tag": "5b81aa87-ab86-4a5e-8508-7e75337c565e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:15.625523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ce366cb2-dd68-477b-883e-0be2eeb27ed4 req-a6ec703e-f3cc-41e9-8af7-e61d7ddf8322 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:15.626454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ce366cb2-dd68-477b-883e-0be2eeb27ed4 req-a6ec703e-f3cc-41e9-8af7-e61d7ddf8322 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:15.631392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ce366cb2-dd68-477b-883e-0be2eeb27ed4 req-a6ec703e-f3cc-41e9-8af7-e61d7ddf8322 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:15.654549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:15.660264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1055035279", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:15.672512 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ce366cb2-dd68-477b-883e-0be2eeb27ed4 req-a6ec703e-f3cc-41e9-8af7-e61d7ddf8322 service nova] Creating event network-vif-plugged:5b81aa87-ab86-4a5e-8508-7e75337c565e for instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 on n-h2-833090-19 Sep 08 10:14:15.689283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ce366cb2-dd68-477b-883e-0be2eeb27ed4 req-a6ec703e-f3cc-41e9-8af7-e61d7ddf8322 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081081 Sep 08 10:14:15.694666 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 168/271] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:15.787566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:15.962473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:15.964036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:15.979221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:15.981470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:15.983250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:15.986562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:15.987195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:15.987852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:16.068760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:14:16.420240 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55c0047f-c4dc-42c9-972a-9b23a0e58b30 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] 10.222.0.59 "DELETE /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 204 len: 0 microversion: 2.1 time: 0.717500 Sep 08 10:14:16.427254 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 169/272] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:14:15 2022] DELETE /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:14:16.462180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:16.462180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:16.469203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:16.469739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:16.475710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:16.478029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:16.478505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:16.478928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:16.590934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:16.591356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:16.591854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:16.595087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:16.595087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:16.614970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:16.616759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:16.618146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:16.621175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:16.622361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:16.623423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:16.673668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Getting quotas for project cbb286972c294412b02697600bf9e63d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:16.681214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:UPDATE=6,nova_api:DELETE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:16.691404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Getting quotas for user f7a5e1612ec14bf3a091d7717562c006 and project cbb286972c294412b02697600bf9e63d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:16.728737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:16.737194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:16.852306 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a4abef2-6fb2-4a27-933e-fdf802610d95 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.139357 Sep 08 10:14:16.864618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 104/273] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:14:16.871712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:16.872539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:16.880646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:16.881559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:16.882166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:16.883751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:16.884349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:16.884955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:17.288109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:17.314965 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5543a496-2433-4cc9-874b-638aa1425f0f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.888154 Sep 08 10:14:17.315875 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 170/274] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:16 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:17.347087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-399958179", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:17.367902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:17.380027 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b1396d43-a486-4ee2-8ab7-4365876b86e2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1475 microversion: 2.1 time: 0.512524 Sep 08 10:14:17.380920 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 105/275] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:16 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1475 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:17.429139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:18.344413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:18.346005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:18.361443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:18.362317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:18.362910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:18.363866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:18.364500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:18.368208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:18.830534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:18.847130 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d161974f-f3c6-4e9d-a350-cedcbc03372d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1319 microversion: 2.1 time: 0.501228 Sep 08 10:14:18.849162 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 106/276] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:18 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:18.864134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:18.866367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:18.883747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:18.904768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:18.907606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:18.911862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:18.914517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:18.915527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:19.027907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:19.028453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:19.028865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:19.029438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:19.030021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:19.049195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:19.050002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:19.051808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:19.052859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:19.055441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:19.056297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:19.155611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Getting quotas for project cbb286972c294412b02697600bf9e63d. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:19.167792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Getting quotas for user f7a5e1612ec14bf3a091d7717562c006 and project cbb286972c294412b02697600bf9e63d. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:19.218005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:19.220419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:19.398845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5dee3e1-b559-49fb-8ea3-22bdb6d09d94 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069128 Sep 08 10:14:19.401968 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 171/277] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:14:19.425887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e127ddc-88fe-4ceb-8ee9-fce3d81ab8ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:19.427722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9e127ddc-88fe-4ceb-8ee9-fce3d81ab8ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:19.758580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9e127ddc-88fe-4ceb-8ee9-fce3d81ab8ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:19.817809 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e127ddc-88fe-4ceb-8ee9-fce3d81ab8ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1213 microversion: 2.1 time: 0.409933 Sep 08 10:14:19.820793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 172/278] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:19 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1213 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:19.876223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:19.877104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:19.887764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:19.889567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:19.892704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:19.895219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:19.898007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:19.901937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:20.664738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:20.703796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80c4c818-08d0-4b51-b530-0bd613d67064 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1475 microversion: 2.1 time: 1.851676 Sep 08 10:14:20.706760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 107/279] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:18 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1475 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:20.846206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:20.856396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:20.857354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:20.863014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19c9f058-4b93-4b6b-a2d3-893b17db1a77 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1468 microversion: 2.1 time: 0.991398 Sep 08 10:14:20.868830 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 173/280] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:19 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1468 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:20.925928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:20.933037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:20.934045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:20.938856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:20.940726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:20.946397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:21.521968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:21.544627 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6224923-3946-45d5-a148-42290cee5f7b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1217 microversion: 2.1 time: 0.702915 Sep 08 10:14:21.567853 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 108/281] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:20 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1217 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:21.742872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:21.743834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:21.750328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:21.751003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:21.751449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:21.752564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:21.753022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:21.753447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:21.879388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-814264543", "block_migration": true, "disk_over_commit": false}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:21.886489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:21.921517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:21.922051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:21.922506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:21.923282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:21.925494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:21.926273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:22.778263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:22.799004 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ada7a42-bd4f-4513-8f30-efc2f1c753d5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1475 microversion: 2.1 time: 1.066176 Sep 08 10:14:22.813553 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 109/282] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:21 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1475 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:22.831058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:22.834975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:22.854284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:22.862410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:22.863149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:22.864354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:22.869245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:22.870142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:23.143389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lazy-loading 'flavor' on Instance uuid 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:14:23.257716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:23.268833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9bbd8850-8bd5-4538-ae8e-573c33e82e42 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1271 microversion: 2.1 time: 0.452148 Sep 08 10:14:23.271518 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 110/283] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:22 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1271 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:23.393830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Going to try to live migrate instance to tempest-host-814264543 {{(pid=122457) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:14:23.423492 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] HTTP exception thrown: Compute host tempest-host-814264543 could not be found. Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Request method failure captured: Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86/action HTTP/1.1 Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 106 Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBTuUVQ12wYpshx75Pkzdymriodh20Mxj6JNXkV7JNVDh-9af1BOM0dOhm7U7_DPCSVDRxTig6ykftjMt1kWsSX59bpyCeWaQMuEMJrY-Lwm_d3ddYims611lEX-CgXOri-LjoPai2EtPFhAdug8uq4PQ8rDCjzprHmJe32M-iA5EU Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 451aac3d2b9e4cbda945d201ee015ecc Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-LiveMigrationNegativeTest-779015263 Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:23.427491 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/451aac3d2b9e4cbda945d201ee015ecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/451aac3d2b9e4cbda945d201ee015ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/451aac3d2b9e4cbda945d201ee015ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_451aac3d2b9e4cbda945d201ee015ecc", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-LiveMigrationNegativeTest-779015263 Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 451aac3d2b9e4cbda945d201ee015ecc Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-779015263 Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-LiveMigrationNegativeTest-779015263-project-admin Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: c426848ae55b4da79c8f7ce17e78efb0 Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-LiveMigrationNegativeTest-779015263-project-admin Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: {"os-migrateLive": {"host": "tempest-host-814264543", "block_migration": true, "disk_over_commit": false}} Sep 08 10:14:23.430554 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: exception: Compute host tempest-host-814264543 could not be found. Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '4a2a9804-8f7b-4e91-99bc-7f41289f8f86', 'body': {'os-migrateLive': {'host': 'tempest-host-814264543', 'block_migration': True, 'disk_over_commit': False}}} Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:14:23.431435 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-814264543 could not be found. Sep 08 10:14:23.433067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-814264543 could not be found. Sep 08 10:14:23.434580 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-814264543 could not be found. Sep 08 10:14:23.435963 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:23.442760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Returning 400 to user: Compute host tempest-host-814264543 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:23.444359 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-100959ae-5ac8-47cb-ae96-0a32405fcdab tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86/action" status: 400 len: 99 microversion: 2.1 time: 2.554101 Sep 08 10:14:23.460196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 174/284] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Sep 8 10:14:20 2022] POST /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86/action => generated 99 bytes in 2561 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:14:23.461035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:23.461406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:23.476825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:23.477504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:23.478072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:23.478934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:23.480795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:23.481727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.164522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:24.170925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.171590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.176038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.177643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.178760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.180472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.228698 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b105a8c-3901-446e-9cae-42aa14e8e274 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.472471 Sep 08 10:14:24.229965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 175/285] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:14:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:24.252063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:24.253287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:24.272586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.274597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.277700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.278525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.279004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.279447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.371754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:24.386257 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c99921ab-43a7-4b09-9025-a21fbeb01285 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1468 microversion: 2.1 time: 0.927327 Sep 08 10:14:24.399489 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 111/286] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:23 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1468 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:24.412729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-43fb41f4-b4e7-49ad-971d-84ddb93fc85d req-791235ba-43fc-4810-b56e-f0fe096d1fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0647d366-0477-45f6-91a8-84b1387168c5", "name": "network-vif-deleted", "tag": "9c9f32e8-e2d6-4411-b6f8-7592a660caa0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:24.441551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43fb41f4-b4e7-49ad-971d-84ddb93fc85d req-791235ba-43fc-4810-b56e-f0fe096d1fc8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.442329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43fb41f4-b4e7-49ad-971d-84ddb93fc85d req-791235ba-43fc-4810-b56e-f0fe096d1fc8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.447045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43fb41f4-b4e7-49ad-971d-84ddb93fc85d req-791235ba-43fc-4810-b56e-f0fe096d1fc8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.477436 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-43fb41f4-b4e7-49ad-971d-84ddb93fc85d req-791235ba-43fc-4810-b56e-f0fe096d1fc8 service nova] Creating event network-vif-deleted:9c9f32e8-e2d6-4411-b6f8-7592a660caa0 for instance 0647d366-0477-45f6-91a8-84b1387168c5 on n-h2-833090-19 Sep 08 10:14:24.492241 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-43fb41f4-b4e7-49ad-971d-84ddb93fc85d req-791235ba-43fc-4810-b56e-f0fe096d1fc8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097804 Sep 08 10:14:24.494194 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 112/287] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:24.501664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:24.508941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7acae5c-d425-41b4-98c9-02f927ba4338 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1862474301"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:24.518546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-d7acae5c-d425-41b4-98c9-02f927ba4338 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 69660793-722b-4ddb-a08c-f25edb10d6b7 for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:24.526204 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57f7647d-b193-433a-b44c-f94f88347f80 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 200 len: 1304 microversion: 2.1 time: 0.291800 Sep 08 10:14:24.546973 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 176/288] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:24 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 1304 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:24.559317 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7acae5c-d425-41b4-98c9-02f927ba4338 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063719 Sep 08 10:14:24.560343 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 113/289] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:24.572809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:24.573521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:24.588620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4023f0bc-b51d-48f1-bbb3-e8e688e81fe6 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:24.596585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.597087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.597545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.598256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.598716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.609136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.617191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4023f0bc-b51d-48f1-bbb3-e8e688e81fe6 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:24.617811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4023f0bc-b51d-48f1-bbb3-e8e688e81fe6 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:24.621548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4023f0bc-b51d-48f1-bbb3-e8e688e81fe6 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:24.854532 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4023f0bc-b51d-48f1-bbb3-e8e688e81fe6 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.279572 Sep 08 10:14:24.861654 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 114/290] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:24.864539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-467503750", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:24.967566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:24.981545 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-358db766-b03b-4997-a797-247b7466f26b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1271 microversion: 2.1 time: 0.433133 Sep 08 10:14:24.991559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 177/291] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:24 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1271 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:24.993476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:25.010613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:25.026899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:25.030508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:25.031493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:25.084535 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-833090-19. Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 40 Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:25.173834 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: {"add_host": {"host": "n-h1-833090-19"}} Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:25.175692 n-d-833090-19 devstack@n-api.service[122457]: exception: Aggregate 11 already has host n-h1-833090-19. Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-833090-19'}}} Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:14:25.176467 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-833090-19-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 10:14:25.177524 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 10:14:25.178553 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:14:25.181936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-833090-19-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 10, 14, 25, 69188), 'updated_at': None, 'host': 'n-h1-833090-19', 'aggregate_id': 11}] Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.183588 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-833090-19. Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.191721 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-833090-19. Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:25.195605 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:25.198252 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-833090-19. Sep 08 10:14:25.198252 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.198252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-833090-19. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:25.198252 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44b2efaa-504b-4ff8-bb85-f1842ec425bf tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.203123 Sep 08 10:14:25.204799 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 178/292] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 221 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 08 10:14:25.212123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce0d696d-03ed-484d-bf74-995d1b5f763b tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:25.229681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce0d696d-03ed-484d-bf74-995d1b5f763b tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:25.230554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce0d696d-03ed-484d-bf74-995d1b5f763b tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:25.231219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce0d696d-03ed-484d-bf74-995d1b5f763b tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:25.399720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce0d696d-03ed-484d-bf74-995d1b5f763b tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.193129 Sep 08 10:14:25.409878 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 179/293] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:25.422796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c9f7544-7091-419f-a5f4-d6d7e121cc70 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:25.466518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c9f7544-7091-419f-a5f4-d6d7e121cc70 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.054766 Sep 08 10:14:25.467105 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 180/294] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:25 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:25.478104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d947e828-a177-4751-9e25-8cfef048b726 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-61014933"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:25.481753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-d947e828-a177-4751-9e25-8cfef048b726 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 1db84dc9-89a3-4c49-b14b-a8a054908285 for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:25.533241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d947e828-a177-4751-9e25-8cfef048b726 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059450 Sep 08 10:14:25.540915 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 181/295] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:14:25.756625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:25.757759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:25.758059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:25.758707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:25.759334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:25.777813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:25.778672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:25.779313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:25.780293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:25.788010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:25.788822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:25.827911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5c78221-f0ce-4489-8a59-d5fbc76056fb tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:25.829725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Getting quotas for project 0eeb1fcfc0f54224beb031df87cb2ac5. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:25.831451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5c78221-f0ce-4489-8a59-d5fbc76056fb tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c103f38ad160496596468ccb991d1b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e571ed0954a9b825bcb25ed959c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5c78221-f0ce-4489-8a59-d5fbc76056fb tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Request method failure captured: Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 40 Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcB-aktH1xDXTaWfuQf915WZLngsCv2IFiho9Gtjw1M7LXBYcap4Y2mfltMM8NYblRUEbOsMsJ_gZM_VP0KCqIbE0-A_QoD9cE-gXeIsWijsJAxURVlE_ACew87S7yAMeFTl8VcyI8rhtWxNydjCeOSVYdDnm_-swT1YGQFuXrhBGvg Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:14:25.833085 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b9e571ed0954a9b825bcb25ed959c2a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: c103f38ad160496596468ccb991d1b93 Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: {"add_host": {"host": "n-h1-833090-19"}} Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:25.834290 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-833090-19'}}} Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:25.835019 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 10:14:25.836228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.837228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5c78221-f0ce-4489-8a59-d5fbc76056fb tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:25.837228 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5c78221-f0ce-4489-8a59-d5fbc76056fb tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] 10.222.0.59 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.292373 Sep 08 10:14:25.841142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Getting quotas for user 9a2f11fc7fc6430fadcfd3e0749a1053 and project 0eeb1fcfc0f54224beb031df87cb2ac5. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:25.845085 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 182/296] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:25 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 303 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:14:25.854676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:25.855419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:25.856231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:25.859607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:25.874174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:25.874984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:25.875447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:25.883337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:25.884035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:25.884487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:25.922278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] HTTP exception thrown: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Request method failure captured: Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 HTTP/1.1 Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBPg58cJCKUOz9EwJSVl4d4fvVf1cqV3rKNnSDhNDRztndZw2JVQ-TIF3KrfrJe_b2rVdfXhaPbas51YXLynNOWj5zesmlAgg7gvreTns5j4GowfGr3hEJQ-Y8rSn6GDG59CQk5DUNWUE1ELLHnFvewWPmTkIiy-TdLtuZZbx-wIfE Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:14:25.930263 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d09cccc2ead4beab8ef6098a558b70b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: efbef3c3fa284cc687b1b482efcf27b2 Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:14:25.931734 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0647d366-0477-45f6-91a8-84b1387168c5'} Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:25.932563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:14:25.933843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:25.936017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Returning 404 to user: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:25.937486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5f1849fc-fd47-4329-ae60-036acfc2bd19 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 404 len: 111 microversion: 2.1 time: 0.090603 Sep 08 10:14:25.941160 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 183/297] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:25 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:25.944076 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cab0158-e2b7-499a-b3e2-2de8f1028dfe tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087282 Sep 08 10:14:25.947005 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 115/298] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:14:25.949403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d50642cf-7421-4446-a4b1-889ebb447e6a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:25.962300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6d6d54e-1562-4219-b631-5c3bde628d87 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:25.963258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6d6d54e-1562-4219-b631-5c3bde628d87 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:26.052618 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d50642cf-7421-4446-a4b1-889ebb447e6a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.108252 Sep 08 10:14:26.057016 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 184/299] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:26.067740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:26.071005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:26.090563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:26.092438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:26.093320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:26.097183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:26.104817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:26.107091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:26.342324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6d6d54e-1562-4219-b631-5c3bde628d87 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:26.357779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6d6d54e-1562-4219-b631-5c3bde628d87 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1218 microversion: 2.1 time: 0.398311 Sep 08 10:14:26.360909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:26.367730 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 116/300] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:25 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:26.373781 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-927f833f-bd65-4eea-84da-d794bdc3c84d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1271 microversion: 2.1 time: 0.314610 Sep 08 10:14:26.387490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f04b8a5-ea2f-4af0-8b16-fd3b332c50ee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-592013239"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.388007 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 185/301] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:26 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1271 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:26.395924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-126963491", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.401036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-5f04b8a5-ea2f-4af0-8b16-fd3b332c50ee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid fbb093d0-4781-46ae-a2ce-827d6fc82ec1 for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:26.511283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f04b8a5-ea2f-4af0-8b16-fd3b332c50ee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.140522 Sep 08 10:14:26.520851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 117/302] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:26.523716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:26.530716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1598093143"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.563115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:26.563634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:26.568193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:26.594114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:26.594610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:26.595042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:26.612050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1598093143 could not be found. Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 58 Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:14:26.615079 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: {"add_host": {"host": "tempest-nonexist_host-1598093143"}} Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:26.617095 n-d-833090-19 devstack@n-api.service[122456]: exception: Compute host tempest-nonexist_host-1598093143 could not be found. Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1598093143'}}} Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1598093143' is not mapped to any cell Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.618211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 08 10:14:26.620295 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1598093143 could not be found. Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1598093143 could not be found. Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.621622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1598093143 could not be found. Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1598093143 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:26.623025 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd2ec04b-862b-464d-b676-d39162cb6e1c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.094644 Sep 08 10:14:26.624799 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 118/303] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:26.633044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d50f926-fbe8-40a6-8b3f-b3223343d710 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:26.682340 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d50f926-fbe8-40a6-8b3f-b3223343d710 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.056415 Sep 08 10:14:26.683200 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 119/304] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:26 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:26.692435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-997d1a72-b333-4205-bf08-a1ba73d5f437 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-997d1a72-b333-4205-bf08-a1ba73d5f437 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 283 Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:14:26.702120 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.703647 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:14:26.705405 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:26.706231 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.707586 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.708796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:14:26.708796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:14:26.708796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:14:26.708796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.709102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-997d1a72-b333-4205-bf08-a1ba73d5f437 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:26.709893 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-997d1a72-b333-4205-bf08-a1ba73d5f437 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021320 Sep 08 10:14:26.710672 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 120/305] 10.222.0.59 () {60 vars in 1165 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:14:26.725295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74b4735e-3e86-4330-928a-7b4cc122aacd tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74b4735e-3e86-4330-928a-7b4cc122aacd tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 27 Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:14:26.729974 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: {"aggregate": {"name": ""}} Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:26.731925 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '' Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:26.732715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:14:26.734882 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.736683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74b4735e-3e86-4330-928a-7b4cc122aacd tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:26.736683 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74b4735e-3e86-4330-928a-7b4cc122aacd tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015002 Sep 08 10:14:26.740940 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 121/306] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:14:26.750880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fc4792e-f6d9-4af2-ad39-1c527de8689f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1643678544"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.762213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9fc4792e-f6d9-4af2-ad39-1c527de8689f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c103f38ad160496596468ccb991d1b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e571ed0954a9b825bcb25ed959c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fc4792e-f6d9-4af2-ad39-1c527de8689f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Request method failure captured: Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 60 Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB-aktH1xDXTaWfuQf915WZLngsCv2IFiho9Gtjw1M7LXBYcap4Y2mfltMM8NYblRUEbOsMsJ_gZM_VP0KCqIbE0-A_QoD9cE-gXeIsWijsJAxURVlE_ACew87S7yAMeFTl8VcyI8rhtWxNydjCeOSVYdDnm_-swT1YGQFuXrhBGvg Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:26.763881 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b9e571ed0954a9b825bcb25ed959c2a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c103f38ad160496596468ccb991d1b93 Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: {"aggregate": {"name": "tempest-test_aggregate-1643678544"}} Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:26.765361 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1643678544'}}} Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:26.766147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:26.767898 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 10:14:26.769830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.769830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fc4792e-f6d9-4af2-ad39-1c527de8689f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:26.769830 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9fc4792e-f6d9-4af2-ad39-1c527de8689f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.022677 Sep 08 10:14:26.775478 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 122/307] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:26.784272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9eb45a8-63ad-4095-b99d-5426d7f92b18 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1405828291"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.789018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-a9eb45a8-63ad-4095-b99d-5426d7f92b18 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 70223f2c-5f96-4d50-836f-cef80b303011 for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:26.871031 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9eb45a8-63ad-4095-b99d-5426d7f92b18 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.088627 Sep 08 10:14:26.871715 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 123/308] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:26.904442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10ff3307-ffff-4e08-842c-6b5be00ec9e3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1405828291"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:26.922060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-10ff3307-ffff-4e08-842c-6b5be00ec9e3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 2ee6c3a7-2230-4ae2-aaeb-ebaebbde6fc0 for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:26.922923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:26.923635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:26.924811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:26.925373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:26.926079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:26.930859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:26.939334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:26.940082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:26.941488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:26.943060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:26.944024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:26.945470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:26.967826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-10ff3307-ffff-4e08-842c-6b5be00ec9e3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1405828291 already exists. Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10ff3307-ffff-4e08-842c-6b5be00ec9e3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 60 Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:14:26.980993 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: {"aggregate": {"name": "tempest-test_aggregate-1405828291"}} Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:26.982263 n-d-833090-19 devstack@n-api.service[122456]: exception: Aggregate tempest-test_aggregate-1405828291 already exists. Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1405828291'}}} Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 08 10:14:26.983051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1405828291 already exists. Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:26.984079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1405828291 already exists. Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1405828291 already exists. Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:26.985129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10ff3307-ffff-4e08-842c-6b5be00ec9e3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1405828291 already exists. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:26.985833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10ff3307-ffff-4e08-842c-6b5be00ec9e3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.102945 Sep 08 10:14:26.986601 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 124/309] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:14:27.004819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04eacb4b-e953-44c7-9387-a43587341787 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:27.024592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Getting quotas for project 4d09cccc2ead4beab8ef6098a558b70b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:27.035297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Getting quotas for user efbef3c3fa284cc687b1b482efcf27b2 and project 4d09cccc2ead4beab8ef6098a558b70b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:27.067666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04eacb4b-e953-44c7-9387-a43587341787 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.075200 Sep 08 10:14:27.068612 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 125/310] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:26 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:27.070593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:27.077443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6d2f828-6d09-4673-8ed7-cdf502f77de5 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-109316185"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:27.081375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:27.087134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-c6d2f828-6d09-4673-8ed7-cdf502f77de5 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid d013ede7-384f-48fe-87b4-797c4abb058f for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:27.128063 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6d2f828-6d09-4673-8ed7-cdf502f77de5 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054010 Sep 08 10:14:27.131242 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 126/311] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:14:27.149677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-668c8473-a3be-4af2-9332-24510b17399c tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:27.158643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-668c8473-a3be-4af2-9332-24510b17399c tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c103f38ad160496596468ccb991d1b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e571ed0954a9b825bcb25ed959c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-668c8473-a3be-4af2-9332-24510b17399c tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Request method failure captured: Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB-aktH1xDXTaWfuQf915WZLngsCv2IFiho9Gtjw1M7LXBYcap4Y2mfltMM8NYblRUEbOsMsJ_gZM_VP0KCqIbE0-A_QoD9cE-gXeIsWijsJAxURVlE_ACew87S7yAMeFTl8VcyI8rhtWxNydjCeOSVYdDnm_-swT1YGQFuXrhBGvg Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:27.160363 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b9e571ed0954a9b825bcb25ed959c2a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c103f38ad160496596468ccb991d1b93 Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 10:14:27.161490 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '15'} Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:27.162134 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:27.163152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-668c8473-a3be-4af2-9332-24510b17399c tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:27.166005 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-668c8473-a3be-4af2-9332-24510b17399c tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.023196 Sep 08 10:14:27.168422 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 127/312] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:14:27.224081 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a425a22-daf2-4fb8-ad25-94f2b750364f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834581 Sep 08 10:14:27.224733 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 186/313] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:14:27.273156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-823fd359-17ac-488c-9dd4-7c2fcf0f7d31 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:27.273796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-823fd359-17ac-488c-9dd4-7c2fcf0f7d31 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:27.719288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b27bbfd2-dac7-44b9-a251-797c81aa3dec tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:27.774176 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b27bbfd2-dac7-44b9-a251-797c81aa3dec tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.601730 Sep 08 10:14:27.776238 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 128/314] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 10:14:27.784710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:27.787534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:27.803000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:27.803000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:27.803000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:27.803337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:27.803662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:27.809885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:27.974405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-823fd359-17ac-488c-9dd4-7c2fcf0f7d31 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:27.985232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-823fd359-17ac-488c-9dd4-7c2fcf0f7d31 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1219 microversion: 2.1 time: 0.748670 Sep 08 10:14:27.989159 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 187/315] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:27 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1219 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:28.004317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:28.004939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:28.027261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:28.028040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:28.028707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:28.029582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:28.030043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:28.030466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:28.286738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:28.305931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5387a10d-08da-4fd5-8b89-591c5cf8c4d4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1270 microversion: 2.1 time: 0.528171 Sep 08 10:14:28.322046 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 129/316] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:27 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1270 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:28.340852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd692016-de07-4220-8cdd-78e5f049b411 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:28.409583 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-bd692016-de07-4220-8cdd-78e5f049b411 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd692016-de07-4220-8cdd-78e5f049b411 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:14:28.423665 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: exception: Aggregate -1 could not be found. Sep 08 10:14:28.424905 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '-1'} Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:14:28.425537 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.426536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.430387 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.430387 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.430387 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:28.430387 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:28.430387 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 08 10:14:28.430387 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.432752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd692016-de07-4220-8cdd-78e5f049b411 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:28.434998 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd692016-de07-4220-8cdd-78e5f049b411 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.107753 Sep 08 10:14:28.437500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 130/317] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:28 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:28.457984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fbcfb5d3-7468-4f57-885d-c93af8eaa9ed tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1337752067"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:28.482549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-fbcfb5d3-7468-4f57-885d-c93af8eaa9ed tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 3828927b-cec4-4af2-a297-1a5c6445179e for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:28.528831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fbcfb5d3-7468-4f57-885d-c93af8eaa9ed tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.085558 Sep 08 10:14:28.531614 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 131/318] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:28.546441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-312929a3-5814-4036-bb69-460129cc0a1f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:28.549571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-312929a3-5814-4036-bb69-460129cc0a1f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c103f38ad160496596468ccb991d1b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e571ed0954a9b825bcb25ed959c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-312929a3-5814-4036-bb69-460129cc0a1f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Request method failure captured: Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB-aktH1xDXTaWfuQf915WZLngsCv2IFiho9Gtjw1M7LXBYcap4Y2mfltMM8NYblRUEbOsMsJ_gZM_VP0KCqIbE0-A_QoD9cE-gXeIsWijsJAxURVlE_ACew87S7yAMeFTl8VcyI8rhtWxNydjCeOSVYdDnm_-swT1YGQFuXrhBGvg Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:28.554407 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b9e571ed0954a9b825bcb25ed959c2a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c103f38ad160496596468ccb991d1b93 Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 10:14:28.556045 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '16'} Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:28.556868 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 10:14:28.558147 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.561138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-312929a3-5814-4036-bb69-460129cc0a1f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:28.563309 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-312929a3-5814-4036-bb69-460129cc0a1f tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] 10.222.0.59 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025671 Sep 08 10:14:28.567545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 132/319] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:28.576460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9499c661-b9e0-4313-804b-847c89031216 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:28.588335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=12,nova_api:DELETE=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:28.641001 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9499c661-b9e0-4313-804b-847c89031216 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.071457 Sep 08 10:14:28.642410 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 133/320] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:28 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:28.660279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d4235a09-af67-4e27-8017-0fb8d0e59e7c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:28.671327 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d4235a09-af67-4e27-8017-0fb8d0e59e7c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d4235a09-af67-4e27-8017-0fb8d0e59e7c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:14:28.674285 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: exception: Aggregate -1 could not be found. Sep 08 10:14:28.675453 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '-1'} Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.676618 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 08 10:14:28.677715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.682595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d4235a09-af67-4e27-8017-0fb8d0e59e7c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:28.683517 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d4235a09-af67-4e27-8017-0fb8d0e59e7c tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034642 Sep 08 10:14:28.685025 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 134/321] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:14:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:28.695685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f240afd9-96d9-4f33-8d3d-91b19131786d tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:28.697526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f240afd9-96d9-4f33-8d3d-91b19131786d tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c103f38ad160496596468ccb991d1b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e571ed0954a9b825bcb25ed959c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f240afd9-96d9-4f33-8d3d-91b19131786d tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Request method failure captured: Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB-aktH1xDXTaWfuQf915WZLngsCv2IFiho9Gtjw1M7LXBYcap4Y2mfltMM8NYblRUEbOsMsJ_gZM_VP0KCqIbE0-A_QoD9cE-gXeIsWijsJAxURVlE_ACew87S7yAMeFTl8VcyI8rhtWxNydjCeOSVYdDnm_-swT1YGQFuXrhBGvg Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:14:28.699644 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b9e571ed0954a9b825bcb25ed959c2a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c103f38ad160496596468ccb991d1b93 Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 10:14:28.701124 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:28.701964 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 10:14:28.703247 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:14:28.706908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f240afd9-96d9-4f33-8d3d-91b19131786d tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:28.707959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f240afd9-96d9-4f33-8d3d-91b19131786d tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017452 Sep 08 10:14:28.708945 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 135/322] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:14:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:14:28.728752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a325cb9-d6b0-4be1-a43a-17528fd1d29a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1853040092"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:28.734691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-8a325cb9-d6b0-4be1-a43a-17528fd1d29a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 5da116cc-2e39-4857-8e5f-13053ad0bfef for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:28.774027 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a325cb9-d6b0-4be1-a43a-17528fd1d29a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052573 Sep 08 10:14:28.781795 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 136/323] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:28.792671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ee6033f-6213-47e0-a9f2-3e83812dc62a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:28.820624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ee6033f-6213-47e0-a9f2-3e83812dc62a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:28.821629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ee6033f-6213-47e0-a9f2-3e83812dc62a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:28.822883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ee6033f-6213-47e0-a9f2-3e83812dc62a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:29.111055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ee6033f-6213-47e0-a9f2-3e83812dc62a tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.327649 Sep 08 10:14:29.112950 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 137/324] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:28 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:14:29.121182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:29.122827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:29.131499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:29.132755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:29.133414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:29.134562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:29.135219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:29.136330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:29.295724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:29.309748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5eab6526-11be-4a02-b205-ef8bfb6da922 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 1.319318 Sep 08 10:14:29.310827 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 188/325] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:27 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:29.320203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14abceeb-3e26-4287-8519-b25cd6b8124e tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:29.324871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14abceeb-3e26-4287-8519-b25cd6b8124e tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c103f38ad160496596468ccb991d1b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e571ed0954a9b825bcb25ed959c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14abceeb-3e26-4287-8519-b25cd6b8124e tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Request method failure captured: Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 43 Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcB-aktH1xDXTaWfuQf915WZLngsCv2IFiho9Gtjw1M7LXBYcap4Y2mfltMM8NYblRUEbOsMsJ_gZM_VP0KCqIbE0-A_QoD9cE-gXeIsWijsJAxURVlE_ACew87S7yAMeFTl8VcyI8rhtWxNydjCeOSVYdDnm_-swT1YGQFuXrhBGvg Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:14:29.328946 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b9e571ed0954a9b825bcb25ed959c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b9e571ed0954a9b825bcb25ed959c2a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5b9e571ed0954a9b825bcb25ed959c2a Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536 Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: c103f38ad160496596468ccb991d1b93 Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1366365536-project Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: {"remove_host": {"host": "n-h1-833090-19"}} Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:29.330176 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-833090-19'}}} Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:29.330864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 10:14:29.331884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:29.332866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14abceeb-3e26-4287-8519-b25cd6b8124e tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:29.332866 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14abceeb-3e26-4287-8519-b25cd6b8124e tempest-AggregatesAdminNegativeTestJSON-1366365536 tempest-AggregatesAdminNegativeTestJSON-1366365536-project] 10.222.0.59 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018649 Sep 08 10:14:29.332866 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 189/326] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:14:29.339672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:29.340367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:29.357824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:29.358558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:29.360380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:29.361509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:29.362220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:29.362879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:29.606266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:29.615032 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f551f96c-de26-433d-b558-ef4df3b20122 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1271 microversion: 2.1 time: 0.500721 Sep 08 10:14:29.618742 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 138/327] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:29 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1271 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:29.634546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d836dc2b-85ee-4dbc-89ad-1bde569eabee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:29.664380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d836dc2b-85ee-4dbc-89ad-1bde569eabee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:29.665252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d836dc2b-85ee-4dbc-89ad-1bde569eabee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:29.673824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d836dc2b-85ee-4dbc-89ad-1bde569eabee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:29.767442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:29.778610 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a8963bf9-6646-4bed-8d8d-d8e3911e25de tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1276 microversion: 2.1 time: 0.445796 Sep 08 10:14:29.788362 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 190/328] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:29 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:29.902884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d836dc2b-85ee-4dbc-89ad-1bde569eabee tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.279475 Sep 08 10:14:29.903518 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 139/329] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:29.915929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83aed757-8534-4744-97fb-072ed0525bc5 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:29.956765 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83aed757-8534-4744-97fb-072ed0525bc5 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.045046 Sep 08 10:14:29.958287 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 191/330] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:29 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:29.967327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02997536-6cba-428c-90b4-68b025e961a0 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-896188511"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:29.971120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.aggregate [None req-02997536-6cba-428c-90b4-68b025e961a0 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Generated uuid 8f75db35-90af-4b8a-b922-7714aa090322 for aggregate {{(pid=122456) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:14:30.011731 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02997536-6cba-428c-90b4-68b025e961a0 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048561 Sep 08 10:14:30.012856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 140/331] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:14:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:30.027221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:30.053631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:30.054314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:30.055709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:30.070981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:30.076254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:30.076930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:30.101803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.compute.aggregates [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 08 10:14:30.102376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Request method failure captured: Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 42 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcB_TvuMUOMWATJMY-nRzCXGWAWUvJu_bmk4mTN0xkhoq9hdy2VtpUBYTzOLeUsPrNrHmVUzP-ztDPOj86IPIL8-ieFkpYW_Dzads2fATIhRh9eZFxyM-IHJEMWRtWfo0dMpqe6bKjiRnbahh4QTkseUVTPTJjGSkBEcFumXdPQTeuQ Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:14:30.107988 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbad9b2766e94599bb7061ac7fb38591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbad9b2766e94599bb7061ac7fb38591", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cbad9b2766e94599bb7061ac7fb38591 Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-905413185 Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 90732d008a034ef79bc9547beb0d1cec Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: {"remove_host": {"host": "nonexist_host"}} Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:14:30.109512 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 08 10:14:30.110264 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 08 10:14:30.111737 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.113026 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-205751ea-1556-4f95-b36e-1e013c3894d3 tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.087934 Sep 08 10:14:30.114569 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 192/332] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:14:30 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:14:30.120025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a0bc46e-7982-468b-9b6f-b67b4a4fb09e tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:30.151812 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a0bc46e-7982-468b-9b6f-b67b4a4fb09e tempest-AggregatesAdminNegativeTestJSON-905413185 tempest-AggregatesAdminNegativeTestJSON-905413185-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.035972 Sep 08 10:14:30.154587 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 141/333] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:30 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:14:30.336997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:30.338362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:30.356476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:30.358543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:30.361406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:30.364457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:30.365247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:30.367959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:30.642389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:30.643021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:30.659248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:30.659449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:30.659821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:30.661599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:30.662278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:30.663415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:31.313403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:31.325323 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1fdd5336-3e3e-4cee-8a37-0527a5e452f5 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1277 microversion: 2.1 time: 0.686933 Sep 08 10:14:31.351273 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 142/334] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:30 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1277 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:31.397004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:31.401798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:31.427795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:31.430173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:31.431553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:31.433513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:31.434387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:31.438655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:31.451045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:31.729742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:31.739529 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70f73536-4c8e-4e8e-8012-a228dcdc3e03 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1276 microversion: 2.1 time: 0.386749 Sep 08 10:14:31.743844 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 143/335] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:31 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1276 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:31.899921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:31.926539 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbb5e550-3868-4866-b30a-c8824961a454 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 1.591306 Sep 08 10:14:31.947174 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 193/336] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:30 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:32.356058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:32.357304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:32.364311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:32.374549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:32.392157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:32.393257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:32.394108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:32.397557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:32.469707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-240528988", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "a201f7b1-2b10-4321-b5d2-383c4b92fcf0"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:32.675072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] validate_networks() for [('a201f7b1-2b10-4321-b5d2-383c4b92fcf0', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:32.724676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:32.769812 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5f6a1d7-b3f4-495f-8b6f-9401454e5bd3 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1277 microversion: 2.1 time: 0.417458 Sep 08 10:14:32.776980 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 194/337] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:32 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1277 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:32.783160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:32.784027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:32.815945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:32.817609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:32.819753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:32.821427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:32.822424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:32.823302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:33.523872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:33.529147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:33.544641 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78368085-8502-4c77-82a3-f406627b7be1 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1276 microversion: 2.1 time: 0.761122 Sep 08 10:14:33.555838 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 195/338] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:32 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1276 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:33.560987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:33.561598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:33.584743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:33.585238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:33.585875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:33.586743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:33.587344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:33.588328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:34.823126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:34.840095 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0237eb7d-8b87-4725-9a27-36f09e4b0903 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 1.283086 Sep 08 10:14:34.840685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 196/339] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:33 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:34.847749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6b6dcecb-cabc-454e-b977-1a2c386980b8 req-c5000dca-1bdc-4314-896f-396379b08d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d242c4-0703-440b-a09e-e0b93a5dd086", "tag": "06750d27-6888-4a9f-8d43-37eec362ecfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:34.875065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6b6dcecb-cabc-454e-b977-1a2c386980b8 req-c5000dca-1bdc-4314-896f-396379b08d9e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:34.882335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6b6dcecb-cabc-454e-b977-1a2c386980b8 req-c5000dca-1bdc-4314-896f-396379b08d9e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:34.884068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6b6dcecb-cabc-454e-b977-1a2c386980b8 req-c5000dca-1bdc-4314-896f-396379b08d9e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:34.912458 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6b6dcecb-cabc-454e-b977-1a2c386980b8 req-c5000dca-1bdc-4314-896f-396379b08d9e service nova] Creating event network-changed:06750d27-6888-4a9f-8d43-37eec362ecfd for instance f2d242c4-0703-440b-a09e-e0b93a5dd086 on n-h1-833090-19 Sep 08 10:14:34.921139 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6b6dcecb-cabc-454e-b977-1a2c386980b8 req-c5000dca-1bdc-4314-896f-396379b08d9e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078669 Sep 08 10:14:34.922465 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 197/340] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:35.226092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8cdd30f5-ca87-4dca-8ba3-4d7d27c05fde tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Action: 'create', calling method: .version_select at 0x7f23517f9700>, body: {"keypair": {"name": "tempest-keypair-1977528800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrtuf9DOm+NS1IcPs2zsWWfXbIq0Ca4XvnJLpcgjIk+r91C44xRlxKelY9Rqiwe7q8My1SQMrTaEtTAcGZmqHQms9cp/NF0+KFS1qY+Atq0MiBPrHB4HcD4rTPH6At+xg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:35.263390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-8cdd30f5-ca87-4dca-8ba3-4d7d27c05fde tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Getting quotas for project d4a6efff1d8d4870a2eaf4402c6bf57e. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:35.269491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-8cdd30f5-ca87-4dca-8ba3-4d7d27c05fde tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Getting quotas for user 85eda5dbb3ca4158b10c4a89a1c62386 and project d4a6efff1d8d4870a2eaf4402c6bf57e. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:35.301772 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8cdd30f5-ca87-4dca-8ba3-4d7d27c05fde tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.377705 Sep 08 10:14:35.302805 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 198/341] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:14:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:35.309687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:35.313467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:35.335190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:35.335967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:35.336576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:35.338761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:35.339449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:35.339922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:35.562648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:35.582803 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d234b7bc-327e-42bb-81b7-af717d8ce095 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1277 microversion: 2.1 time: 0.277995 Sep 08 10:14:35.605335 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 199/342] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:35 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:35.613300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:35.614186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:35.648367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:35.648864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:35.649306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:35.650018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:35.650476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:35.650903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:36.349994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:36.593898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:36.634448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:36.646266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c28ec0e-4f93-4cd0-a56c-314ca0a0a0bb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 1.039575 Sep 08 10:14:36.650490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 200/343] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:35 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:36.659397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:36.665014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:36.669257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:36.669929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:36.673829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:36.674382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:36.676207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:36.681375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:36.684428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:36.685130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:36.686331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:36.688154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:36.689971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:36.714282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:36.721453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:36.722496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:36.724487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:36.726254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:36.726944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:36.769337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:36.790163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for user 448b7c1cb3eb4b63a427a3d7b7d6eb13 and project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:36.841866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:36.852379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:37.013724 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-53943253-853c-49f8-94a0-d1d42a17c4e3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 5.105262 Sep 08 10:14:37.026220 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 144/344] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 5118 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:14:37.046311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:37.047285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:37.070243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:37.071181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:37.073477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:37.074697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:37.076471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:37.077123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:37.687812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:37.699931 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61134e8b-764c-4349-b90b-d054aafd5e76 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 1.044530 Sep 08 10:14:37.705053 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 201/345] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:36 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:37.715817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9adb51c-ebd8-4403-b93f-c4a975e0fa3d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:37.718346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9adb51c-ebd8-4403-b93f-c4a975e0fa3d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:37.885526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9adb51c-ebd8-4403-b93f-c4a975e0fa3d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:37.899288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9adb51c-ebd8-4403-b93f-c4a975e0fa3d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:37.905311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9adb51c-ebd8-4403-b93f-c4a975e0fa3d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:37.907700 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9adb51c-ebd8-4403-b93f-c4a975e0fa3d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1261 microversion: 2.25 time: 0.199821 Sep 08 10:14:37.910954 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 202/346] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:37 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1261 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:37.921572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-676eb428-7629-4fc6-9f3a-edad62d5dc13 req-074693ac-7b23-479d-9d93-8788b696dd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709e738b-2bf5-4fcc-90d0-9f9465312e0a", "tag": "96c475c3-2bcf-4c72-95b3-c1adbec45357"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:37.949039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-676eb428-7629-4fc6-9f3a-edad62d5dc13 req-074693ac-7b23-479d-9d93-8788b696dd7c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:37.951111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-676eb428-7629-4fc6-9f3a-edad62d5dc13 req-074693ac-7b23-479d-9d93-8788b696dd7c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:37.951741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-676eb428-7629-4fc6-9f3a-edad62d5dc13 req-074693ac-7b23-479d-9d93-8788b696dd7c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:37.982158 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-676eb428-7629-4fc6-9f3a-edad62d5dc13 req-074693ac-7b23-479d-9d93-8788b696dd7c service nova] Creating event network-changed:96c475c3-2bcf-4c72-95b3-c1adbec45357 for instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a on n-h1-833090-19 Sep 08 10:14:37.995386 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-676eb428-7629-4fc6-9f3a-edad62d5dc13 req-074693ac-7b23-479d-9d93-8788b696dd7c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081639 Sep 08 10:14:37.997181 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 203/347] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:38.012236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:38.013485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:38.033500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:38.037093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:38.038005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:38.038747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:38.039206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:38.039669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:38.336184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:38.346076 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38a8fbf2-8438-4b63-9f3a-fc29eed03153 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 1.318019 Sep 08 10:14:38.350900 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 145/348] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:37 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:38.727144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:38.728822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:38.735878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:38.736659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:38.737121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:38.738085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:38.738576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:38.739258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:38.861603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:38.875398 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e187731-6115-445e-8e11-187d72a6da4d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 0.874469 Sep 08 10:14:38.876179 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 204/349] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:37 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:39.131372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e2ecdfe0-69c8-425e-a2ad-1bdcbb74124a tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-412665496", "id": 2128023009, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:39.170631 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e2ecdfe0-69c8-425e-a2ad-1bdcbb74124a tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.293167 Sep 08 10:14:39.176350 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 205/350] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:14:38 2022] POST /compute/v2.1/flavors => generated 467 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:39.192244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:39.194185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:39.228833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:39.229672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:39.230350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:39.232875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:39.233568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:39.234342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:39.570089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:39.574838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:39.637932 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a363300d-48e6-4dfd-a641-9e9330f1c8e4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 0.915435 Sep 08 10:14:39.659042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:39.660903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:39.666741 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 146/351] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:38 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:39.670559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-47946bdf-be37-4398-8709-d4c00544138a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1331 microversion: 2.25 time: 0.484481 Sep 08 10:14:39.671308 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 206/352] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:39 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1331 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:39.682712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:39.685253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:39.704466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:39.705146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:39.707455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:39.708772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:39.711346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:39.712027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:39.954401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84dc5c66-01ef-4224-a899-1bd35308b2a4 tempest-FlavorsV261TestJSON-2120286379 tempest-FlavorsV261TestJSON-2120286379-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:39.978532 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84dc5c66-01ef-4224-a899-1bd35308b2a4 tempest-FlavorsV261TestJSON-2120286379 tempest-FlavorsV261TestJSON-2120286379-project] 10.222.0.59 "GET /compute/v2.1/flavors/2128023009" status: 200 len: 467 microversion: 2.61 time: 0.310138 Sep 08 10:14:39.983281 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 147/353] 10.222.0.59 () {60 vars in 1199 bytes} [Thu Sep 8 10:14:39 2022] GET /compute/v2.1/flavors/2128023009 => generated 467 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:39.998221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:40.001336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:40.011301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:40.012054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:40.015207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:40.017576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:40.018629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:40.020676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:40.064256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:40.449830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:40.458196 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ccdc757-5856-4313-a8d8-dbbca0ced6ca tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.785290 Sep 08 10:14:40.462585 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 207/354] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:39 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:40.476245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-678bea0c-fe2c-496e-a372-6a378a6f2f1b tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] Action: 'update', calling method: .version_select at 0x7f2353068670>, body: {"flavor": {"description": "new"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:40.539981 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-678bea0c-fe2c-496e-a372-6a378a6f2f1b tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] 10.222.0.59 "PUT /compute/v2.1/flavors/2128023009" status: 200 len: 468 microversion: 2.61 time: 0.073800 Sep 08 10:14:40.541188 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 208/355] 10.222.0.59 () {62 vars in 1219 bytes} [Thu Sep 8 10:14:40 2022] PUT /compute/v2.1/flavors/2128023009 => generated 468 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:14:40.557263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-afe05872-df34-4748-9972-9b45b9f78591 req-e3ece6b6-e0ea-485e-89d5-8eb5baf8e16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55f9f97-6a5f-4457-a6dc-cd5019aff1a8", "tag": "2bb4f0a1-dd4b-4d46-a9d3-ca60797a5700"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:40.567872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-afe05872-df34-4748-9972-9b45b9f78591 req-e3ece6b6-e0ea-485e-89d5-8eb5baf8e16c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:40.569195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-afe05872-df34-4748-9972-9b45b9f78591 req-e3ece6b6-e0ea-485e-89d5-8eb5baf8e16c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:40.569810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-afe05872-df34-4748-9972-9b45b9f78591 req-e3ece6b6-e0ea-485e-89d5-8eb5baf8e16c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:40.582105 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-afe05872-df34-4748-9972-9b45b9f78591 req-e3ece6b6-e0ea-485e-89d5-8eb5baf8e16c service nova] Creating event network-changed:2bb4f0a1-dd4b-4d46-a9d3-ca60797a5700 for instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 on n-h2-833090-19 Sep 08 10:14:40.587514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-afe05872-df34-4748-9972-9b45b9f78591 req-e3ece6b6-e0ea-485e-89d5-8eb5baf8e16c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035287 Sep 08 10:14:40.588639 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 209/356] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:40.594356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20eb8092-f96d-4608-a14b-07e82b347cae tempest-FlavorsV261TestJSON-2120286379 tempest-FlavorsV261TestJSON-2120286379-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:40.620489 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20eb8092-f96d-4608-a14b-07e82b347cae tempest-FlavorsV261TestJSON-2120286379 tempest-FlavorsV261TestJSON-2120286379-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.030435 Sep 08 10:14:40.635721 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 210/357] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:14:40 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:40.643310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f94eb79c-2f73-41b7-9835-3948d2963253 tempest-FlavorsV261TestJSON-2120286379 tempest-FlavorsV261TestJSON-2120286379-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:40.666113 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f94eb79c-2f73-41b7-9835-3948d2963253 tempest-FlavorsV261TestJSON-2120286379 tempest-FlavorsV261TestJSON-2120286379-project] 10.222.0.59 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.026712 Sep 08 10:14:40.667146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 211/358] 10.222.0.59 () {60 vars in 1166 bytes} [Thu Sep 8 10:14:40 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:14:40.692644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:40.694168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:40.702123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:40.702856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:40.703644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:40.704513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:40.705167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:40.705745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:41.184406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:41.198293 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-504044fa-b92a-4dbd-8465-d57785630bf4 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 1.213593 Sep 08 10:14:41.201235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 148/359] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:39 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:41.211519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-56993d41-602d-4079-8082-47726debaf25 tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:41.262050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-56993d41-602d-4079-8082-47726debaf25 tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/2128023009" status: 202 len: 0 microversion: 2.61 time: 0.059220 Sep 08 10:14:41.263868 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 149/360] 10.222.0.59 () {60 vars in 1202 bytes} [Thu Sep 8 10:14:41 2022] DELETE /compute/v2.1/flavors/2128023009 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:14:41.277689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:41.281289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:41.310183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:41.310902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:41.312334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:41.314094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:41.315663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:41.316331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:41.468234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:41.484281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:41.489898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:41.492169 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ef20d5c-fe66-4ece-8cde-e94d6e43ee56 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1319 microversion: 2.25 time: 0.226848 Sep 08 10:14:41.498262 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 150/361] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:41 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:41.509756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e57a1d7-5d20-4e06-ad46-358dac30162e tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:41.515962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:41.527990 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-855420a2-d1a5-4711-9f8d-924a9ddd7fa9 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 0.839731 Sep 08 10:14:41.536936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 212/362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:40 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:41.550879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:41.551533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:41.565600 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e57a1d7-5d20-4e06-ad46-358dac30162e tempest-FlavorsV261TestJSON-1636231389 tempest-FlavorsV261TestJSON-1636231389-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.065960 Sep 08 10:14:41.567217 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 151/363] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:14:41 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:41.581485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:41.584650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:41.585106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:41.586968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:41.587720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:41.587878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:42.084072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:42.096272 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d2d6045-e3b8-4ab4-b571-aa8542e84551 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.558037 Sep 08 10:14:42.098161 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 213/364] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:41 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:42.230047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:42.232388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:42.263737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:42.266044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:42.267212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:42.272224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:42.273051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:42.275220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:42.528557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:42.529990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:42.542829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:42.543328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:42.543803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:42.544525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:42.545787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:42.548135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.169706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:43.182294 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-19b82250-1c61-4767-a598-8a45fdc5148d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 0.957069 Sep 08 10:14:43.185010 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 152/365] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:42 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:43.211967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:43.213554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:43.231877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:43.232517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:43.235611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.241388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:43.241961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:43.242667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.289514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:43.304042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:43.312591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:43.326493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80065233-fc96-4107-a3f6-c8437c0ec60a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.794298 Sep 08 10:14:43.329650 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 214/366] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:42 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:43.338551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f10e01f5-320a-46bd-bcf5-583d8d20706e req-294751a0-515e-4c54-9758-5ced871b1f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0a2f27-5638-49bf-829c-66a19e7c79e1", "tag": "5f5c5354-1303-46f6-bc97-339054492e4d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:43.375609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f10e01f5-320a-46bd-bcf5-583d8d20706e req-294751a0-515e-4c54-9758-5ced871b1f86 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:43.376415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f10e01f5-320a-46bd-bcf5-583d8d20706e req-294751a0-515e-4c54-9758-5ced871b1f86 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:43.377336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f10e01f5-320a-46bd-bcf5-583d8d20706e req-294751a0-515e-4c54-9758-5ced871b1f86 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.411084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f10e01f5-320a-46bd-bcf5-583d8d20706e req-294751a0-515e-4c54-9758-5ced871b1f86 service nova] Creating event network-changed:5f5c5354-1303-46f6-bc97-339054492e4d for instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 on n-h2-833090-19 Sep 08 10:14:43.420273 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f10e01f5-320a-46bd-bcf5-583d8d20706e req-294751a0-515e-4c54-9758-5ced871b1f86 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089095 Sep 08 10:14:43.421223 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 215/367] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:43.431911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-34cf32fc-5a27-451b-b38a-fc24e8b64313 req-c6b880eb-2638-4ca0-8b1c-63c1b54015b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d242c4-0703-440b-a09e-e0b93a5dd086", "name": "network-vif-plugged", "status": "completed", "tag": "06750d27-6888-4a9f-8d43-37eec362ecfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:43.452108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-34cf32fc-5a27-451b-b38a-fc24e8b64313 req-c6b880eb-2638-4ca0-8b1c-63c1b54015b1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:43.453717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-34cf32fc-5a27-451b-b38a-fc24e8b64313 req-c6b880eb-2638-4ca0-8b1c-63c1b54015b1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:43.454363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-34cf32fc-5a27-451b-b38a-fc24e8b64313 req-c6b880eb-2638-4ca0-8b1c-63c1b54015b1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.477413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-34cf32fc-5a27-451b-b38a-fc24e8b64313 req-c6b880eb-2638-4ca0-8b1c-63c1b54015b1 service nova] Creating event network-vif-plugged:06750d27-6888-4a9f-8d43-37eec362ecfd for instance f2d242c4-0703-440b-a09e-e0b93a5dd086 on n-h1-833090-19 Sep 08 10:14:43.483289 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-34cf32fc-5a27-451b-b38a-fc24e8b64313 req-c6b880eb-2638-4ca0-8b1c-63c1b54015b1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060331 Sep 08 10:14:43.485240 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 216/368] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:43.491938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:43.504653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:43.564577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:43.575950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:43.579508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.582687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:43.583359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:43.584756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:43.602622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:43.616095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6c3ac69-e3b1-42a5-80a7-7554b548b444 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 0.429058 Sep 08 10:14:43.616715 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 153/369] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:43 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:43.889642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:43.902603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-485d3863-2e57-402e-8ba6-f95d6884c5a2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.415705 Sep 08 10:14:43.923077 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 217/370] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:43 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:43.957783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-131742042", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4292d5c7-f384-4ff2-99f6-6890bfefc9ef"}], "security_groups": [{"name": "tempest-securitygroup--2141628199"}], "key_name": "tempest-keypair-1977528800", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:44.211166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:44.211888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:44.225837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] validate_networks() for [('4292d5c7-f384-4ff2-99f6-6890bfefc9ef', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:44.226113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:44.228131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:44.231942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:44.235124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:44.237645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:44.238399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:44.715387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:44.732110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7680fe39-1c2a-4ef3-8d9e-2a43faf92876 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 0.526245 Sep 08 10:14:44.744631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 218/371] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:44 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:44.759055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:44.760040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:44.766075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:44.767862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:44.768655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:44.769325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:44.770386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:44.771116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:44.771856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:45.394978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:45.404158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:45.417486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:45.419066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b92111b4-a2b7-435c-9f0d-283e9de153c7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.673146 Sep 08 10:14:45.420132 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 219/372] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:44 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:45.424855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:45.432903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:45.450628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:45.451293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:45.457582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:45.459609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:45.460255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:45.460849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:45.996141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:46.007056 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1238d7a2-00f2-43aa-9548-f265c55cd212 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 0.582823 Sep 08 10:14:46.008088 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 220/373] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:45 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:46.012802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:46.013410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:46.027625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.028107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.028892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.029819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.030503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.031134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.549238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:46.556474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:46.563705 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f0314dd-cfd0-47af-8e93-3a3abfd587dc tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.554411 Sep 08 10:14:46.569600 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 221/374] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:46 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:46.582601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5ed2b33d-6146-488d-85f4-746ca357e369 req-39713b96-a51e-4d61-9b1c-77386ead574b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a", "tag": "001f665d-26c6-43c2-8aa9-ae7333f08bcb"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:46.582821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:46.583248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:46.583714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:46.584925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:46.585524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:46.602258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.605783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.606926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.610383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.611174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.612886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.616370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ed2b33d-6146-488d-85f4-746ca357e369 req-39713b96-a51e-4d61-9b1c-77386ead574b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.624184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ed2b33d-6146-488d-85f4-746ca357e369 req-39713b96-a51e-4d61-9b1c-77386ead574b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.624787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ed2b33d-6146-488d-85f4-746ca357e369 req-39713b96-a51e-4d61-9b1c-77386ead574b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.653512 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5ed2b33d-6146-488d-85f4-746ca357e369 req-39713b96-a51e-4d61-9b1c-77386ead574b service nova] Creating event network-changed:001f665d-26c6-43c2-8aa9-ae7333f08bcb for instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a on n-h1-833090-19 Sep 08 10:14:46.659331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Getting quotas for project d4a6efff1d8d4870a2eaf4402c6bf57e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:46.673950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5ed2b33d-6146-488d-85f4-746ca357e369 req-39713b96-a51e-4d61-9b1c-77386ead574b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102586 Sep 08 10:14:46.674744 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 222/375] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:46.676335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Getting quotas for user 85eda5dbb3ca4158b10c4a89a1c62386 and project d4a6efff1d8d4870a2eaf4402c6bf57e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:46.680650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-66f2e57b-5df6-4707-a186-2835012c7c0f req-06fa3d6d-11d8-4cef-8edb-e207efd06e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709e738b-2bf5-4fcc-90d0-9f9465312e0a", "name": "network-vif-plugged", "status": "completed", "tag": "96c475c3-2bcf-4c72-95b3-c1adbec45357"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:46.715688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-66f2e57b-5df6-4707-a186-2835012c7c0f req-06fa3d6d-11d8-4cef-8edb-e207efd06e27 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.724150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-66f2e57b-5df6-4707-a186-2835012c7c0f req-06fa3d6d-11d8-4cef-8edb-e207efd06e27 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.725247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-66f2e57b-5df6-4707-a186-2835012c7c0f req-06fa3d6d-11d8-4cef-8edb-e207efd06e27 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.729156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:46.733590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:46.754819 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-66f2e57b-5df6-4707-a186-2835012c7c0f req-06fa3d6d-11d8-4cef-8edb-e207efd06e27 service nova] Creating event network-vif-plugged:96c475c3-2bcf-4c72-95b3-c1adbec45357 for instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a on n-h1-833090-19 Sep 08 10:14:46.767423 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-66f2e57b-5df6-4707-a186-2835012c7c0f req-06fa3d6d-11d8-4cef-8edb-e207efd06e27 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091019 Sep 08 10:14:46.768196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 223/376] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:46.788243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:46.794579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:46.823859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.824541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.825062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.826350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.828889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.829432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.887479 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36e545b4-5b7f-4711-82ae-947409cdc9ac tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.934665 Sep 08 10:14:46.889851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 154/377] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:14:46.925072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:46.925816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:46.966950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=9 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:46.970475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.977149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.977614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:46.985035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:46.988098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:46.988586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:47.606330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:47.647323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:47.653628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:47.655867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fded9c00-00f3-4494-9c24-2830d96343d0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.764075 Sep 08 10:14:47.659146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 155/378] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:46 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:47.691265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddc5de5d-ff09-4929-8476-70d64d223d11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:47.694529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ddc5de5d-ff09-4929-8476-70d64d223d11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:47.700444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:47.709174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b906bbf-294a-49f0-b070-01c56bb29e2b tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 0.939023 Sep 08 10:14:47.723424 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 224/379] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:46 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:47.750704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:47.751676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:47.758289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:47.761770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:47.763087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:47.765320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:47.768267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:47.771252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:47.859275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ddc5de5d-ff09-4929-8476-70d64d223d11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:47.869254 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ddc5de5d-ff09-4929-8476-70d64d223d11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1241 microversion: 2.1 time: 0.207817 Sep 08 10:14:47.872098 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 156/380] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:47 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1241 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:47.884817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:47.885539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:47.892565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=22 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:47.900284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:47.906562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:47.907312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:47.908577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:47.909250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:47.909904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:48.175077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:48.184895 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11c51909-4469-47b6-a1af-a88f96d6c0bf tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1313 microversion: 2.1 time: 0.459395 Sep 08 10:14:48.188100 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 225/381] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:47 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:48.232399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:48.241058 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4cff64c-cb46-423d-bae3-aab6f84a3d8e tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.366693 Sep 08 10:14:48.262227 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 157/382] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:47 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:48.693942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:48.695145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:48.714675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:48.716635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:48.719778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:48.722380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:48.723089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:48.726124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:48.736612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:48.737469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:48.758675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:48.759751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:48.762446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:48.765007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:48.767346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:48.768821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:49.508321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:49.541302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:49.542876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:49.555709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b22ca660-f825-4fe6-bc79-66448c68c512 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.867614 Sep 08 10:14:49.587488 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 226/383] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:48 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:14:49.598147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:49.600799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:49.626773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:49.630337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:49.631323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:49.634862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:49.635829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:49.637012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:49.769476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:49.778438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-71138115-0eaf-4f10-a42a-ca5cd2abb01d tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 1.046075 Sep 08 10:14:49.779038 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 158/384] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:48 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:49.795827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:49.803838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:49.824829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:49.825203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:49.825650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:49.826375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:49.826890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:49.827238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:49.886673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:49.900195 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2532e83f-3334-4b12-ab5d-c8122e5b6754 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1301 microversion: 2.1 time: 0.327646 Sep 08 10:14:49.915486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 227/385] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:49 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1301 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:49.916027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:49.916908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:49.931497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:49.935790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:49.935790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:49.935790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:49.935790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:49.937153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.263533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:50.275591 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6bc2f2d9-09c3-45e4-8ce3-6756f7a556c6 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.370419 Sep 08 10:14:50.276188 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 228/386] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:49 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:50.305281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:50.329795 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26ceec80-0982-454c-92d3-7c68f7b5a4f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1463 microversion: 2.1 time: 0.543694 Sep 08 10:14:50.334392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 159/387] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:49 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1463 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:50.360546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:50.361398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:50.378540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.379039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.379490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.380784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.381240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.381660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.589444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351832a60>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:50.599242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.599987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.601092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.602110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.602902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.603502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.642141 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00847c45-9adb-4915-9f22-445b30720c16 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.348415 Sep 08 10:14:50.652543 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 229/388] 10.222.0.59 () {58 vars in 1128 bytes} [Thu Sep 8 10:14:50 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:50.659903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-845ab89c-52ef-4dd1-8cfa-82d022b11ca3 req-a88c8af5-5ddd-49bd-bed3-4626f303e7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55f9f97-6a5f-4457-a6dc-cd5019aff1a8", "name": "network-vif-plugged", "status": "completed", "tag": "2bb4f0a1-dd4b-4d46-a9d3-ca60797a5700"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:50.675328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-845ab89c-52ef-4dd1-8cfa-82d022b11ca3 req-a88c8af5-5ddd-49bd-bed3-4626f303e7d2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.676120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-845ab89c-52ef-4dd1-8cfa-82d022b11ca3 req-a88c8af5-5ddd-49bd-bed3-4626f303e7d2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.676696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-845ab89c-52ef-4dd1-8cfa-82d022b11ca3 req-a88c8af5-5ddd-49bd-bed3-4626f303e7d2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.691728 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-845ab89c-52ef-4dd1-8cfa-82d022b11ca3 req-a88c8af5-5ddd-49bd-bed3-4626f303e7d2 service nova] Creating event network-vif-plugged:2bb4f0a1-dd4b-4d46-a9d3-ca60797a5700 for instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 on n-h2-833090-19 Sep 08 10:14:50.699233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-845ab89c-52ef-4dd1-8cfa-82d022b11ca3 req-a88c8af5-5ddd-49bd-bed3-4626f303e7d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043197 Sep 08 10:14:50.700545 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 230/389] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:50.707375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:50.708437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:50.715350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.716082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.716730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.717585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.718858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.719559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.917667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:50.929959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-754525aa-81f9-43fe-8342-e7db373c66fa tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1463 microversion: 2.1 time: 0.574008 Sep 08 10:14:50.931932 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 160/390] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:50 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1463 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:50.938396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351c6ba60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:50.944898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.945862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.946607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.947682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:50.949866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:50.950738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:50.994105 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89ad3ae3-6ec9-4bf9-af93-31953793f02f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.060306 Sep 08 10:14:50.997079 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 161/391] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Sep 8 10:14:50 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:51.004902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.005880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:51.013593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.014420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.015573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.016921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.017588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.018253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.153764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:51.163116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:51.164638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:51.165851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f3e36232-7f22-4ef7-9c68-3c873d41ea93 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.463323 Sep 08 10:14:51.180781 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 231/392] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:50 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:51.187483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.188123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:51.194525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.195031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.195487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.196237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.196697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.197131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.236419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:51.247999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ccc75fea-e78b-4a57-86e0-8505b6b51cdb tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 0.248616 Sep 08 10:14:51.249266 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 162/393] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:50 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:51.254217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351e124c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.258948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.259911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.260599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.261587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.262292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.262936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.276806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:51.290962 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7925dd5-71b8-4c0c-93f4-a48628d76d16 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1299 microversion: 2.1 time: 0.108539 Sep 08 10:14:51.291644 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 232/394] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:51.296758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51300a26-9dc9-40b4-8ae0-9e4b2e9082bc tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.045982 Sep 08 10:14:51.305693 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 163/395] 10.222.0.59 () {58 vars in 1145 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:14:51.306263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1204484628", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f2d242c4-0703-440b-a09e-e0b93a5dd086"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:51.311386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.312411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:51.320136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.321009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.321666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.322629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.323420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.324145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.380404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:14:51.746897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:51.763025 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df4116b8-3e0b-4bf6-985f-6095b27ca57a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.449502 Sep 08 10:14:51.763707 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 164/396] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:51.780069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:14:51.780069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:14:51.780069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:14:51.780069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:14:51.780069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:14:51.785625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.786553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.787326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351e9daf0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.787562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.789476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.790333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.790950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.792209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.792910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.793571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.794476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.795099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.795931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.817843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Getting quotas for project cbb286972c294412b02697600bf9e63d. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:14:51.825959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Getting quotas for user f7a5e1612ec14bf3a091d7717562c006 and project cbb286972c294412b02697600bf9e63d. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:14:51.827547 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-958475f4-0373-42c2-99d3-2b78431d06b5 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.044957 Sep 08 10:14:51.828752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 165/397] 10.222.0.59 () {58 vars in 1128 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:51.843519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351d5d040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.850617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.855784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.856477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.858700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.858700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.858700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.859769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:14:51.867186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:14:51.922167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e0441b87-fe2f-45cf-a52a-266046cb5d20 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.082291 Sep 08 10:14:51.933795 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 166/398] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:51.940024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351e3adc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.949602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.950208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.951444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.952595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:51.953418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:51.954096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:51.962603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83adac26-180c-4238-82a2-7fe3c5209b55 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669512 Sep 08 10:14:51.970894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 233/399] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:14:51.984203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ba29842-472d-4061-bc0b-d2a1c7a8ab16 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:51.985277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ba29842-472d-4061-bc0b-d2a1c7a8ab16 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:52.029521 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0afe1f74-3cdc-4c26-a897-9c6eee16b7e4 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.092840 Sep 08 10:14:52.040247 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 167/400] 10.222.0.59 () {58 vars in 1128 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:52.053184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f23534ccb80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:52.071603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.072570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.073984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.093020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ba29842-472d-4061-bc0b-d2a1c7a8ab16 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:52.102014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ba29842-472d-4061-bc0b-d2a1c7a8ab16 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1214 microversion: 2.1 time: 0.123685 Sep 08 10:14:52.105531 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 234/401] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:51 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:52.123300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.123824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.124555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.142263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:52.180202 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20e9989e-1250-4ccb-b523-10c1cdfe326f tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-h1-833090-19" status: 200 len: 603 microversion: 2.1 time: 0.138601 Sep 08 10:14:52.181109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 168/402] 10.222.0.59 () {58 vars in 1173 bytes} [Thu Sep 8 10:14:52 2022] GET /compute/v2.1/os-hosts/n-h1-833090-19 => generated 603 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:52.191157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:52.192110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:52.205216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.207178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Calling method '.version_select at 0x7f2351e9df70>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:52.207791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.208873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.211069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.212124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.213394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.225803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.226673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.229444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.246934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.247592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.248121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.313914 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c6d5387-4d38-4f39-8734-03793e315670 tempest-HostsAdminTestJSON-1750365475 tempest-HostsAdminTestJSON-1750365475-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hosts/n-h2-833090-19" status: 200 len: 735 microversion: 2.1 time: 0.115262 Sep 08 10:14:52.315736 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 169/403] 10.222.0.59 () {58 vars in 1173 bytes} [Thu Sep 8 10:14:52 2022] GET /compute/v2.1/os-hosts/n-h2-833090-19 => generated 735 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:52.334144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:52.334807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:52.346001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.348955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.349618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.350502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.350965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.351448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.452899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:52.470261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:52.472546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:52.474195 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f2d9a9e6-bb9e-471e-b6fe-abcc8b98ccb8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.287562 Sep 08 10:14:52.475359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 235/404] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:52 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:52.495086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:52.495756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:52.504176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.506499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.512093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.513291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.516215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.516899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.717900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:52.727011 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4d3fb2d-8580-48ee-92f4-a3631311665f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1299 microversion: 2.1 time: 0.249672 Sep 08 10:14:52.746577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 236/405] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:52 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:52.786318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:52.786936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:52.805972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:52.814393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.814908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.815408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:52.818529 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-978c4e55-0439-494a-a8aa-60446ab1e18f tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1318 microversion: 2.1 time: 0.495409 Sep 08 10:14:52.819200 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 170/406] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:52 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:52.822144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:52.822706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:52.823176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.066182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:53.074718 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ddc1046f-f324-47c8-85fb-0bcac8c84323 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.292320 Sep 08 10:14:53.075331 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 237/407] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:52 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:53.131339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:53.133284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:53.141278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.142057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.142539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.143312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.144120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.144644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.483080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:53.502445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:53.503755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:53.510179 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3d86451-6fbb-4dda-aa78-0fa8f62c3721 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1210 microversion: 2.1 time: 0.368024 Sep 08 10:14:53.510724 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 171/408] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:53 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1210 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:53.518855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.519435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.520251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.521565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.523069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.523933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.759262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:53.759943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:53.779317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.779843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.780479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.786110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:53.791038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.797425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:53.799667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.799802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.819993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:53.827826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-47d3f865-ef03-4c40-97d7-dbab3951e9b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.330217 Sep 08 10:14:53.847479 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 238/409] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:53 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:14:53.859707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:53.862826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:53.885787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.886537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.887171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:53.888074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:53.892013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:53.900089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:54.294784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:54.312251 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5b1745a-3403-4029-9aef-3f37001533f9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.557699 Sep 08 10:14:54.327680 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 172/410] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:53 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:54.335894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:54.337687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:54.358179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:54.359715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:54.360322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:54.365603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:54.368394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:54.369915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:54.744671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:54.763768 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4dae071-e2c8-4696-a88d-4888f30c8c3e tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1467 microversion: 2.1 time: 0.914777 Sep 08 10:14:54.764376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 239/411] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:53 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1467 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:54.786723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:54.787372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:54.802033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:54.807235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:54.809009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:54.809927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:54.815907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:54.820466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:54.893500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:54.905631 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6144756-5665-4631-a004-b486ccb850f2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.576561 Sep 08 10:14:54.918990 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 173/412] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:54 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:54.925366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:54.925747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:54.967835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:54.968331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:54.968765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:54.973475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:54.974139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:54.974603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.039194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:55.062209 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-30b53d59-1300-4956-95fc-d62e4632f9bc tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1272 microversion: 2.1 time: 0.294285 Sep 08 10:14:55.064201 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 240/413] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:54 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:55.076963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:55.077941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:55.092632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.094698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.095398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.099428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.100210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.101144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.153394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lazy-loading 'flavor' on Instance uuid f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:14:55.372544 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3c762c6-764f-4085-afc4-57119b4f14a6 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8/action" status: 202 len: 0 microversion: 2.1 time: 0.460527 Sep 08 10:14:55.383735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 174/414] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:14:54 2022] POST /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:14:55.400420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:55.401266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:55.419578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.420434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.421353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.422173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.422736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.423268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.628627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:55.638471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:55.647643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:55.649191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb023f88-24a1-419f-92e1-865b0e2bedcd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.582489 Sep 08 10:14:55.650293 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 241/415] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:55 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:55.670857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:55.672037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:55.688832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.689551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.689988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.690702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.691148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.692199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.893378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:55.902873 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dbdb25ff-b1c8-43db-be2e-c018b0abdf56 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.517457 Sep 08 10:14:55.916286 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 175/416] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:55 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:55.938269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-135b5d7c-7b22-4d08-8c73-1f456fcae512 req-992e3a1c-5e1d-4fa4-be29-9f16514d6d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0a2f27-5638-49bf-829c-66a19e7c79e1", "name": "network-vif-plugged", "status": "completed", "tag": "5f5c5354-1303-46f6-bc97-339054492e4d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:55.950929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-135b5d7c-7b22-4d08-8c73-1f456fcae512 req-992e3a1c-5e1d-4fa4-be29-9f16514d6d57 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.951529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-135b5d7c-7b22-4d08-8c73-1f456fcae512 req-992e3a1c-5e1d-4fa4-be29-9f16514d6d57 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.952150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-135b5d7c-7b22-4d08-8c73-1f456fcae512 req-992e3a1c-5e1d-4fa4-be29-9f16514d6d57 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.965555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-135b5d7c-7b22-4d08-8c73-1f456fcae512 req-992e3a1c-5e1d-4fa4-be29-9f16514d6d57 service nova] Creating event network-vif-plugged:5f5c5354-1303-46f6-bc97-339054492e4d for instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 on n-h2-833090-19 Sep 08 10:14:55.971097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-135b5d7c-7b22-4d08-8c73-1f456fcae512 req-992e3a1c-5e1d-4fa4-be29-9f16514d6d57 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040620 Sep 08 10:14:55.972332 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 176/417] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:55.979359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:55.980404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:55.987835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.988676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.989382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:55.990489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:55.991106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:55.991978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.108239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:56.115521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:56.120056 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ed05c3c-a792-4348-baf4-a022305bf0ee tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1475 microversion: 2.1 time: 0.468260 Sep 08 10:14:56.120646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 242/418] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:55 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1475 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:56.155794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:56.156415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:56.164160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.164923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.165517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.166387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.167003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.167968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.315446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:56.327527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aca05ba4-2d4b-4ff9-ae91-c4124d35b5bb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.353598 Sep 08 10:14:56.347819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 177/419] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:55 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:56.357631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b26d611c-031c-42c4-8c38-462e237c3b52 req-277d9960-383f-4db9-9b5f-63337d1b3c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a87449-ea1f-432b-988d-b8a9ac85c7de", "tag": "d15f0a36-3cb2-4865-b261-767233c6a5a5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:56.384137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b26d611c-031c-42c4-8c38-462e237c3b52 req-277d9960-383f-4db9-9b5f-63337d1b3c98 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.384787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b26d611c-031c-42c4-8c38-462e237c3b52 req-277d9960-383f-4db9-9b5f-63337d1b3c98 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.385033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b26d611c-031c-42c4-8c38-462e237c3b52 req-277d9960-383f-4db9-9b5f-63337d1b3c98 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.402446 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b26d611c-031c-42c4-8c38-462e237c3b52 req-277d9960-383f-4db9-9b5f-63337d1b3c98 service nova] Creating event network-changed:d15f0a36-3cb2-4865-b261-767233c6a5a5 for instance a9a87449-ea1f-432b-988d-b8a9ac85c7de on n-h2-833090-19 Sep 08 10:14:56.421389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b26d611c-031c-42c4-8c38-462e237c3b52 req-277d9960-383f-4db9-9b5f-63337d1b3c98 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071966 Sep 08 10:14:56.422371 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 178/420] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:56.611073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:56.626749 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6633fc33-6551-483a-8f5d-2087b6f345b6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.485717 Sep 08 10:14:56.628710 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 243/421] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:56 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:56.682390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:56.683229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:56.692531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.698979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.699856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.702267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.703096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.709387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.942956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:56.943955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:56.963915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.964848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.965543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:56.966758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:56.967844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:56.968827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.042117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:57.052652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:57.054815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:57.056286 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-541296df-c22d-4655-b994-c2953cf8380f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.378994 Sep 08 10:14:57.058168 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 179/422] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:56 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:57.147389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:57.148433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:57.171568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.172466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.176403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.178629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.180068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.185424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.399582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:57.408485 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-235f585c-028f-4fc0-8a87-ca415a513eef tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.469697 Sep 08 10:14:57.415175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 244/423] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:56 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:57.423868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:57.427477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:57.446267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.449391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.451679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.454022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.459719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.460855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.785121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:57.798383 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b34bfe7e-7413-48e6-8d8c-0751e1551f50 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1458 microversion: 2.1 time: 0.652115 Sep 08 10:14:57.799277 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 180/424] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:57 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1458 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:14:57.811219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:57.818953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:57.830112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.830112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.833275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.834031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.834508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.834953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.852704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:57.868222 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0699cad-a3c0-46f7-b7d3-ddab7fa9a9d0 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1319 microversion: 2.1 time: 0.451235 Sep 08 10:14:57.869543 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 245/425] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:57 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:57.877607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:57.878537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:57.891452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.893628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.894446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.895605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:57.896276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:57.897364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:57.954577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:14:58.369987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:58.395985 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-088f5508-9b1a-4a64-9d66-cfb5baa862ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.594064 Sep 08 10:14:58.399102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 181/426] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:57 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:58.410280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:58.413230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:58.429668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:58.431565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:58.433112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:58.435632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:58.436299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:58.438083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:59.005715 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87f977b6-bdd6-4573-985e-bd79ed6bf27c tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1611 microversion: 2.1 time: 1.134285 Sep 08 10:14:59.020475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 246/427] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:57 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1611 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:14:59.020475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f24abf09-a2f6-4369-9b1d-d474f6b288ed req-5709292e-f6f6-4010-bea3-31149faec0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a", "name": "network-vif-plugged", "status": "completed", "tag": "001f665d-26c6-43c2-8aa9-ae7333f08bcb"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:14:59.065806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f24abf09-a2f6-4369-9b1d-d474f6b288ed req-5709292e-f6f6-4010-bea3-31149faec0fa service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:59.067504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f24abf09-a2f6-4369-9b1d-d474f6b288ed req-5709292e-f6f6-4010-bea3-31149faec0fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:59.068851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f24abf09-a2f6-4369-9b1d-d474f6b288ed req-5709292e-f6f6-4010-bea3-31149faec0fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:59.102447 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f24abf09-a2f6-4369-9b1d-d474f6b288ed req-5709292e-f6f6-4010-bea3-31149faec0fa service nova] Creating event network-vif-plugged:001f665d-26c6-43c2-8aa9-ae7333f08bcb for instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a on n-h1-833090-19 Sep 08 10:14:59.119108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f24abf09-a2f6-4369-9b1d-d474f6b288ed req-5709292e-f6f6-4010-bea3-31149faec0fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108861 Sep 08 10:14:59.119760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 247/428] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:14:59.126160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:59.137270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:59.139977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:59.140728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:59.143583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:14:59.151165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee58103b-6b5c-46bb-964b-c178de392c89 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.750489 Sep 08 10:14:59.156956 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 182/429] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:14:58 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:14:59.162468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:14:59.164530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:59.165154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:59.165464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:59.166716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:59.171454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:59.173815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:59.174790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:14:59.193600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:59.201353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:59.203444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:14:59.205599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:14:59.206221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:14:59.208982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.040748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:00.048785 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-44ccf689-ccfd-4220-be8e-0fb989ed08ea tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1469 microversion: 2.1 time: 0.890574 Sep 08 10:15:00.054133 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 183/430] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:59 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1469 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:00.058834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:00.070798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:00.080648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.081143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.081567 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca0e711d-1c9a-419b-aaa0-c95e89c76915 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.959786 Sep 08 10:15:00.081721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.082331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.083275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.083718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.096994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 248/431] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:14:59 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:00.109226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:00.110127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4851f780-80d8-4917-b420-22a4f8e2ad80 tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.054745 Sep 08 10:15:00.110408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:00.111052 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 184/432] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:15:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:00.123798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b9eb3e5f-7d2b-46bb-b527-32d52f00e8df req-01ec08eb-2ca3-49b1-8d10-a4e581fcdb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb738fed-0ef2-44df-b2cf-44ea224180b9", "tag": "0ed4c5fb-51cd-471f-a184-9b79c88dd5a2"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:00.128448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.128950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.133021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.133822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.134447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.134890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.142684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b9eb3e5f-7d2b-46bb-b527-32d52f00e8df req-01ec08eb-2ca3-49b1-8d10-a4e581fcdb03 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.144026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b9eb3e5f-7d2b-46bb-b527-32d52f00e8df req-01ec08eb-2ca3-49b1-8d10-a4e581fcdb03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.144697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b9eb3e5f-7d2b-46bb-b527-32d52f00e8df req-01ec08eb-2ca3-49b1-8d10-a4e581fcdb03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.158345 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b9eb3e5f-7d2b-46bb-b527-32d52f00e8df req-01ec08eb-2ca3-49b1-8d10-a4e581fcdb03 service nova] Creating event network-changed:0ed4c5fb-51cd-471f-a184-9b79c88dd5a2 for instance bb738fed-0ef2-44df-b2cf-44ea224180b9 on n-h1-833090-19 Sep 08 10:15:00.166392 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b9eb3e5f-7d2b-46bb-b527-32d52f00e8df req-01ec08eb-2ca3-49b1-8d10-a4e581fcdb03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053912 Sep 08 10:15:00.174399 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 185/433] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:00.180694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:00.186721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:00.197133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.197632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.198071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.198779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.199229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.200236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.206650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:00.354271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59d1a9b2-5bbd-4b2f-819b-d1d121fd94c6 tempest-DeleteServersAdminTestJSON-307138709 tempest-DeleteServersAdminTestJSON-307138709-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1/action" status: 202 len: 0 microversion: 2.1 time: 0.178270 Sep 08 10:15:00.355056 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 186/434] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:00 2022] POST /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:15:00.360345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-19", "block_migration": true, "disk_over_commit": false}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:00.363390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:00.374490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.390019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.390686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.391650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.392115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.392542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.509470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Lazy-loading 'flavor' on Instance uuid f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:00.525761 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 while it is in vm_state suspended Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Request method failure captured: Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8/action HTTP/1.1 Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 98 Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBTuUVQ12wYpshx75Pkzdymriodh20Mxj6JNXkV7JNVDh-9af1BOM0dOhm7U7_DPCSVDRxTig6ykftjMt1kWsSX59bpyCeWaQMuEMJrY-Lwm_d3ddYims611lEX-CgXOri-LjoPai2EtPFhAdug8uq4PQ8rDCjzprHmJe32M-iA5EU Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 451aac3d2b9e4cbda945d201ee015ecc Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveMigrationNegativeTest-779015263 Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:15:00.529189 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/451aac3d2b9e4cbda945d201ee015ecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/451aac3d2b9e4cbda945d201ee015ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/451aac3d2b9e4cbda945d201ee015ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_451aac3d2b9e4cbda945d201ee015ecc", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveMigrationNegativeTest-779015263 Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 451aac3d2b9e4cbda945d201ee015ecc Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-779015263 Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveMigrationNegativeTest-779015263-project-admin Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c426848ae55b4da79c8f7ce17e78efb0 Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveMigrationNegativeTest-779015263-project-admin Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: {"os-migrateLive": {"host": "n-h1-833090-19", "block_migration": true, "disk_over_commit": false}} Sep 08 10:15:00.530688 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'os-migrateLive' instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 while it is in vm_state suspended Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f55f9f97-6a5f-4457-a6dc-cd5019aff1a8', 'body': {'os-migrateLive': {'host': 'n-h1-833090-19', 'block_migration': True, 'disk_over_commit': False}}} Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 10:15:00.531448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:15:00.532691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 while it is in vm_state suspended Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 while it is in vm_state suspended Sep 08 10:15:00.534160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:00.536828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 while it is in vm_state suspended {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:00.537949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48422818-792d-4c99-9f4c-9da5c18ef07b tempest-LiveMigrationNegativeTest-779015263 tempest-LiveMigrationNegativeTest-779015263-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8/action" status: 409 len: 155 microversion: 2.1 time: 0.181924 Sep 08 10:15:00.539260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 187/435] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:00 2022] POST /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8/action => generated 155 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:15:00.590569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:00.600906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ac65e6f-8f9c-4dfc-a2b1-4d47646d111a tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.502365 Sep 08 10:15:00.601499 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 249/436] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:00 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:00.633218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:00.636541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:00.652717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.666393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.666964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.667773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.668659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.668659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.850049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Calling method '.version_select at 0x7f2351bd0a60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:00.852955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.853721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.854336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.880481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.881265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.881983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.926625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.927224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.931129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.949124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4388d3be-d005-4419-8c4f-2d72a2ecb823 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.408108 Sep 08 10:15:00.957915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 188/437] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:15:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:00.967630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:00.968250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:00.992206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.992695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.993126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:00.993851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:00.994298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:00.994716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.055667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.056843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.057435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.058192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lazy-loading 'fault' on Instance uuid 3a0a2f27-5638-49bf-829c-66a19e7c79e1 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:01.297651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:01.320689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:01.323570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:01.326202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bef44a77-05ac-48df-9b43-d9387a34101e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1361 microversion: 2.25 time: 0.715842 Sep 08 10:15:01.328561 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 250/438] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:00 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1361 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:01.335807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.336652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:01.345341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.348389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.351219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.352476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.355218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.355924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.403125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:15:01.426984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:01.438039 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-219d4718-1a48-402e-a559-bd85ae08437a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1452 microversion: 2.1 time: 0.479001 Sep 08 10:15:01.441866 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 189/439] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:00 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1452 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:01.459319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Calling method '.version_select at 0x7f2351c6b5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.461366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.462043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.462701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.487737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.489077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.490009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.532935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.533814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.535238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.550343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-562910aa-9f93-46fd-97e2-0fcfb1cb16d6 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/n-h1-833090-19/servers" status: 200 len: 434 microversion: 2.1 time: 0.106114 Sep 08 10:15:01.552699 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 190/440] 10.222.0.59 () {58 vars in 1215 bytes} [Thu Sep 8 10:15:01 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-19/servers => generated 434 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:01.565110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64e446ce-c7a8-47a2-a680-49ea1973c6dd tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 204 len: 0 microversion: 2.1 time: 0.234452 Sep 08 10:15:01.565726 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 251/441] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:15:01 2022] DELETE /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:15:01.572448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.577768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:01.592016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.592615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.593002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.593806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.594234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.594664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.724097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3599ba5-b63c-4678-a19c-09a78feaf0de tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.733158 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3599ba5-b63c-4678-a19c-09a78feaf0de tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.179144 Sep 08 10:15:01.733896 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 191/442] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:15:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:01.738686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.739303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:01.749883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.750561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.753485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.754488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.755105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.760123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.787356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:15:01.800803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:01.845920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:01.860355 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5d78732-4f77-47ca-8833-3476ec79d048 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.290044 Sep 08 10:15:01.861286 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 252/443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:01 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:01.872045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Calling method '.version_select at 0x7f23518423a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.881716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.882700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.883816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.907129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:01.920156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.921233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.923487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.932754 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a6b4271-13d3-4614-8b94-9a735f65167f tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 204 len: 0 microversion: 2.1 time: 0.196910 Sep 08 10:15:01.938119 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 192/444] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:15:01 2022] DELETE /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:15:01.949848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.951321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.951845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.952788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:01.954751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.969579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.969974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.970972 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-245134d9-f61e-4427-9605-7dad5cf56f9a tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105355 Sep 08 10:15:01.977943 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 253/445] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:15:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:01.980119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.985589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:01.986545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:01.987694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:01.992289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:01.992909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:02.010743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.011248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.011728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.012438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.012887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.013310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.097329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:02.241968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:02.251102 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61fb62ff-23bd-444b-b65e-4dd3bf0c12ef tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.271347 Sep 08 10:15:02.267496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 254/446] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:01 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:02.334975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3484579a-f872-4368-901f-40eafe2ad371 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1661813568", "id": 823216011, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:02.361447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:02.365303 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3484579a-f872-4368-901f-40eafe2ad371 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.095616 Sep 08 10:15:02.366526 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 255/447] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:15:02 2022] POST /compute/v2.1/flavors => generated 422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:02.372219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:02.373362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:02.382314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.383103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.383762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.385431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.386637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.387238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.427892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.428753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.429419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.430032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lazy-loading 'fault' on Instance uuid 3a0a2f27-5638-49bf-829c-66a19e7c79e1 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:02.482672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:02.493352 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e4157427-a65e-4069-85af-6e088900da42 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1464 microversion: 2.1 time: 0.556749 Sep 08 10:15:02.503746 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 193/448] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:01 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1464 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:02.510422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Calling method '.version_select at 0x7f2351b69820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:02.512633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.513487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.514349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.537781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.538599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.539111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.547096 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f9637712-a7f0-4fd0-b41c-10b157f0bf62 tempest-HypervisorAdminUnderV252Test-621381435 tempest-HypervisorAdminUnderV252Test-621381435-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/n-h1-833090-19/search" status: 200 len: 105 microversion: 2.1 time: 0.041381 Sep 08 10:15:02.548357 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 194/449] 10.222.0.59 () {58 vars in 1212 bytes} [Thu Sep 8 10:15:02 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-19/search => generated 105 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:02.577859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:02.579922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:02.592766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.593515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.594237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.595136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.595783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.596369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.688065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:02.703382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a5555c5-c0d1-4c5d-8279-40e99473d7ae tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1458 microversion: 2.1 time: 0.335371 Sep 08 10:15:02.704821 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 256/450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:02 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1458 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:02.711398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8cef24f6-631c-4514-bfb8-44080b21ce23 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:02.720046 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8cef24f6-631c-4514-bfb8-44080b21ce23 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012522 Sep 08 10:15:02.721087 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 257/451] 10.222.0.59 () {58 vars in 1182 bytes} [Thu Sep 8 10:15:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:02.759204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a781b048-63ac-4162-a813-4dca37308529 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-865084336", "id": 2024664494, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:02.789012 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a781b048-63ac-4162-a813-4dca37308529 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.036186 Sep 08 10:15:02.790280 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 258/452] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:15:02 2022] POST /compute/v2.1/flavors => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:02.801752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e05c17ab-e823-4b55-bb6a-e60232f7c192 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:02.810133 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e05c17ab-e823-4b55-bb6a-e60232f7c192 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012042 Sep 08 10:15:02.821440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 259/453] 10.222.0.59 () {58 vars in 1182 bytes} [Thu Sep 8 10:15:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:02.831705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0aaf8eda-e194-4342-a236-6a2f0eacfb61 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Action: 'create', calling method: .version_select at 0x7f23518598b0>, body: {"keypair": {"name": "tempest-keypair-401213841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/KbN/Bt1qxKciZK0lZYgr6ZbvLVd163KxnnXK2W7GvCR8yTygOcq3Ca+bsfeD4uk4WtsUDB+4lGwQINhxuQVdbK6AhYEfu5qDZlr8UOh6xcCxISfY0919YpjCNlZWaQw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:02.854844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0aaf8eda-e194-4342-a236-6a2f0eacfb61 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Getting quotas for project f866078f90e94d6ea0a7d681334f2bfe. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:02.862430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0aaf8eda-e194-4342-a236-6a2f0eacfb61 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Getting quotas for user 1d06be3d5e0c41aaa44598ee5f9cd4a2 and project f866078f90e94d6ea0a7d681334f2bfe. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:02.930295 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0aaf8eda-e194-4342-a236-6a2f0eacfb61 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107315 Sep 08 10:15:02.931282 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 260/454] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:15:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:02.936639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:02.949570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:02.961384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.962080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.962705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:02.978461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:02.979057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:02.979528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:03.629815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:03.649516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:03.650990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:03.652221 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-380b0835-357c-4ea7-b946-bdfaeac3949c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1558 microversion: 2.25 time: 1.102780 Sep 08 10:15:03.652967 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 195/455] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:02 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1558 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:03.675153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:03.678459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:03.679084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:03.687998 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6204e00d-fce0-44d1-8973-40a7c0302ee1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.753194 Sep 08 10:15:03.691089 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 261/456] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:02 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:03.695801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:03.696303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:03.696745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:03.697551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:03.698020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:03.698453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:03.713721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:03.714484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:03.720515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:03.721005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:03.721442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:03.722155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:03.723881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:03.725762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.193567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:04.209592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:04.213851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5cd96ad1-55ae-47c8-851c-7058851bb497 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1464 microversion: 2.1 time: 0.520793 Sep 08 10:15:04.214435 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 262/457] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:03 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1464 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:04.232496 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35764657-6f31-422c-abfc-4c41757e435b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.557201 Sep 08 10:15:04.234800 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 196/458] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:03 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:04.251248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:04.255735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:04.264721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.265734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.268063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.269118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.270583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.276239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.357501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.357994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.358429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.358881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lazy-loading 'fault' on Instance uuid 3a0a2f27-5638-49bf-829c-66a19e7c79e1 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:04.805093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:04.806310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:04.819637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.824519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.825686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.828205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.829212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.829875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.836820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:04.927004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:04.939371 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be1435b6-65e4-45d3-ba7a-7f710a745b16 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1458 microversion: 2.1 time: 0.702965 Sep 08 10:15:04.953672 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 197/459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:04 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1458 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:04.957605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:04.958726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:04.970904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.971704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.973205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:04.976838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:04.977721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:04.980049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.257327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:05.337114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8006c0fb-d7f6-4eef-badd-c40657166787 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 2052 microversion: 2.25 time: 1.121397 Sep 08 10:15:05.338501 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 263/460] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:04 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 2052 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:05.345146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:05.346117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:05.354380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:05.355270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:05.356146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:05.356996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.358991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:05.359630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:05.360554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.375876 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-336f4740-7f47-4b11-826a-1fcc6a4aa5e6 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.430689 Sep 08 10:15:05.381642 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 198/461] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:04 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:05.398736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:05.404183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:05.423280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:05.424301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:05.424935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.426324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:05.426931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:05.429119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.665016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:05.676661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:05.682129 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f618db87-865f-4178-833c-94343f4f2fc5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.285881 Sep 08 10:15:05.687672 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 199/462] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:05 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:05.690739 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-600521e2-917c-423a-8cee-40f6ec6128ea tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1464 microversion: 2.1 time: 0.349659 Sep 08 10:15:05.691885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 264/463] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:05 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:05.695675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:05.696561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:05.703718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:05.704435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:05.706246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.707885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:05.708706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:05.709384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:05.720083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-944283524", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "2024664494", "adminPass": "***", "networks": [{"uuid": "f7c6d110-3293-4188-afce-fe7df0ee82de"}], "security_groups": [{"name": "tempest-securitygroup--321215783"}], "key_name": "tempest-keypair-401213841", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:05.860956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:06.182034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] validate_networks() for [('f7c6d110-3293-4188-afce-fe7df0ee82de', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:15:06.532972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:06.739080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b3db33a6-ad94-4f6f-a944-e421dc6ac7ad tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 2052 microversion: 2.25 time: 1.041909 Sep 08 10:15:06.740232 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 200/464] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:05 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 2052 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:06.756892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:06.760419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:06.789534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:06.790123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:06.791408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:06.797990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:06.805522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:06.810399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:06.923039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:06.925293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:06.925991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:06.928634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lazy-loading 'fault' on Instance uuid 3a0a2f27-5638-49bf-829c-66a19e7c79e1 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:07.460495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:07.463058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:07.463559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:07.464438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:07.464438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:07.464758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:07.472215 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-322c9f34-e534-4865-b1a7-e8134cd0bacb tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1458 microversion: 2.1 time: 0.724133 Sep 08 10:15:07.472865 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 201/465] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:06 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1458 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:07.489403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.490254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.490852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.492115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.492788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.493399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.506562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:07.507173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:07.536458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Getting quotas for project f866078f90e94d6ea0a7d681334f2bfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:07.543114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Getting quotas for user 1d06be3d5e0c41aaa44598ee5f9cd4a2 and project f866078f90e94d6ea0a7d681334f2bfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:07.544601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.549397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.549856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.551124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.552228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.552630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.582721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:15:07.585739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:15:07.695624 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-908dd1b5-dc94-488d-a475-1a44d5d87519 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.976151 Sep 08 10:15:07.703377 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 265/466] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:15:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:15:07.713515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:07.714496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:07.758457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.761223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.768147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.773932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.775339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.776555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.892511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:07.908358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9b18e82-d291-4fe7-a75a-88705522aa3b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.409611 Sep 08 10:15:07.927530 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 202/467] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:07 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:07.942856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:07.943495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:07.964718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.965206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.965759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:07.966365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:07.966819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:07.973268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:08.344347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:08.369309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7d7a9cf-e6e4-4a2b-bde5-ba757b410fb4 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.664503 Sep 08 10:15:08.371159 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 266/468] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:07 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:08.377178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:08.391974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:08.411233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:08.412958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:08.416616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:08.424326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:08.440066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:08.525461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab9dc1af-9de5-427c-b7a2-b3c895ecc201 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.151711 Sep 08 10:15:08.534193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 267/469] 10.222.0.59 () {60 vars in 1217 bytes} [Thu Sep 8 10:15:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:08.549231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7dc08986-453a-4361-823f-6b258a50f1ef tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:08.550423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7dc08986-453a-4361-823f-6b258a50f1ef tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:08.778764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7dc08986-453a-4361-823f-6b258a50f1ef tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:08.789150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:08.803551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7dc08986-453a-4361-823f-6b258a50f1ef tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1263 microversion: 2.1 time: 0.263180 Sep 08 10:15:08.807359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 268/470] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:08 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1263 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:08.821781 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5650970-25f4-4a0d-80da-1405382a2a99 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1464 microversion: 2.1 time: 0.892447 Sep 08 10:15:08.830177 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 203/471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:07 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1464 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:08.841896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6a77c023-a7bb-483b-8aae-6123dc5a0fc7 req-c0dd3c83-edd4-4c89-9692-a55dbd702163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb738fed-0ef2-44df-b2cf-44ea224180b9", "name": "network-vif-plugged", "status": "completed", "tag": "0ed4c5fb-51cd-471f-a184-9b79c88dd5a2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:08.873463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6a77c023-a7bb-483b-8aae-6123dc5a0fc7 req-c0dd3c83-edd4-4c89-9692-a55dbd702163 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:08.874252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6a77c023-a7bb-483b-8aae-6123dc5a0fc7 req-c0dd3c83-edd4-4c89-9692-a55dbd702163 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:08.874906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6a77c023-a7bb-483b-8aae-6123dc5a0fc7 req-c0dd3c83-edd4-4c89-9692-a55dbd702163 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:08.887685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6a77c023-a7bb-483b-8aae-6123dc5a0fc7 req-c0dd3c83-edd4-4c89-9692-a55dbd702163 service nova] Creating event network-vif-plugged:0ed4c5fb-51cd-471f-a184-9b79c88dd5a2 for instance bb738fed-0ef2-44df-b2cf-44ea224180b9 on n-h1-833090-19 Sep 08 10:15:08.894207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6a77c023-a7bb-483b-8aae-6123dc5a0fc7 req-c0dd3c83-edd4-4c89-9692-a55dbd702163 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069690 Sep 08 10:15:08.895877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 269/472] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:08.903346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:08.919409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:08.927162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:08.927947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:08.928545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:08.929413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:08.930016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:08.930589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.087402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.095063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.096141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.096748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lazy-loading 'fault' on Instance uuid 3a0a2f27-5638-49bf-829c-66a19e7c79e1 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:09.230657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Calling method '.version_select at 0x7f2351a6c790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:09.239266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.240145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.241497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.252927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbef3c3fa284cc687b1b482efcf27b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d09cccc2ead4beab8ef6098a558b70b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:09.286325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-945af3d7-16f3-4f53-a7b7-bf621b6628b2 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 200 len: 1309 microversion: 2.1 time: 0.389070 Sep 08 10:15:09.292541 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 270/473] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:08 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:09.310003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-19", "block_migration": "auto"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:09.314560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:09.335114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.337706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.338346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.341750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.344574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.345672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.347901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.348697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.350250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.400830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.401826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.402287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.423205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'flavor' on Instance uuid abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:09.431166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.431939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.433996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.454950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Going to try to live migrate instance to n-h2-833090-19 {{(pid=122457) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:15:09.479800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.480556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.482360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.492006 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4fb65a51-66c7-4887-be9b-7ab1513b4121 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2235 microversion: 2.53 time: 0.659125 Sep 08 10:15:09.504930 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 204/474] 10.222.0.59 () {60 vars in 1243 bytes} [Thu Sep 8 10:15:08 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2235 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:09.516548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-e4ca13c8-6dba-4718-95a5-1a5f4b73743a req-ac32c390-b268-48ce-8e98-c4f942d1e154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0a2f27-5638-49bf-829c-66a19e7c79e1", "name": "network-vif-deleted", "tag": "5f5c5354-1303-46f6-bc97-339054492e4d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:09.541843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e4ca13c8-6dba-4718-95a5-1a5f4b73743a req-ac32c390-b268-48ce-8e98-c4f942d1e154 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.547115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e4ca13c8-6dba-4718-95a5-1a5f4b73743a req-ac32c390-b268-48ce-8e98-c4f942d1e154 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.548027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e4ca13c8-6dba-4718-95a5-1a5f4b73743a req-ac32c390-b268-48ce-8e98-c4f942d1e154 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.570633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-e4ca13c8-6dba-4718-95a5-1a5f4b73743a req-ac32c390-b268-48ce-8e98-c4f942d1e154 service nova] Creating event network-vif-deleted:5f5c5354-1303-46f6-bc97-339054492e4d for instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 on n-h2-833090-19 Sep 08 10:15:09.586157 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-e4ca13c8-6dba-4718-95a5-1a5f4b73743a req-ac32c390-b268-48ce-8e98-c4f942d1e154 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079103 Sep 08 10:15:09.587444 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 205/475] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:09.594648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:09.595830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:09.611496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.614092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.614688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.616666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.618483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.618914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.876239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:09.889754 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63875621-777c-4dc1-927f-6caec55d3822 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.300853 Sep 08 10:15:09.890620 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 206/476] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:09 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:09.895645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:09.896571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:09.915187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.917097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.917661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:09.918653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:09.921374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:09.921897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.093772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=16 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:10.171872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:10.187786 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f028a73-2ca0-43b3-a70d-0873818638c8 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1314 microversion: 2.1 time: 0.295812 Sep 08 10:15:10.188470 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 207/477] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:09 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:10.192940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Calling method '.version_select at 0x7f2351aecdc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.197269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.197919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.198508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.214164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.214653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.215260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.244614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.245398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.246067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.256873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.257633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.258280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.288122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.288612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.289053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.295663 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-867b8f46-4932-48e5-8cc5-7cc7eff51bdb tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 846 microversion: 2.53 time: 0.106247 Sep 08 10:15:10.296237 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 208/478] 10.222.0.59 () {60 vars in 1222 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 846 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:10.312094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.312781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:10.321475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.322090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.322599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.323439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.323938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.324725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.394638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:10.403329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-615e6e85-8682-4159-a72b-b4d060c4aec3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1259 microversion: 2.1 time: 0.105958 Sep 08 10:15:10.403960 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 209/479] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1259 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:10.408704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.409319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:10.416824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.417528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.417752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.418609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.419068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.419510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.465916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.466454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.466864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.467439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lazy-loading 'fault' on Instance uuid f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:10.519919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:10.535732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b67332e-9287-486d-b911-7e5b530152d8 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 200 len: 1308 microversion: 2.1 time: 0.129997 Sep 08 10:15:10.562356 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 210/480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:10.612201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Calling method '.version_select at 0x7f2351ad7160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.634246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.635395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.639729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.685970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.686846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.687563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.695034 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eef612aa-2287-4f2f-b991-b8fba230e9a9 tempest-HypervisorAdminV253TestBase-1590313924 tempest-HypervisorAdminV253TestBase-1590313924-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/230ae072-1aca-41b2-9c5c-7ddba2579f88" status: 200 len: 794 microversion: 2.53 time: 0.120579 Sep 08 10:15:10.696492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 211/481] 10.222.0.59 () {60 vars in 1298 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/os-hypervisors/230ae072-1aca-41b2-9c5c-7ddba2579f88 => generated 794 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:10.702451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.703418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:10.713549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.714735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.715858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.717848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.718682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.719726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.736504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] HTTP exception thrown: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Request method failure captured: Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 HTTP/1.1 Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPg58cJCKUOz9EwJSVl4d4fvVf1cqV3rKNnSDhNDRztndZw2JVQ-TIF3KrfrJe_b2rVdfXhaPbas51YXLynNOWj5zesmlAgg7gvreTns5j4GowfGr3hEJQ-Y8rSn6GDG59CQk5DUNWUE1ELLHnFvewWPmTkIiy-TdLtuZZbx-wIfE Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:10.738751 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d09cccc2ead4beab8ef6098a558b70b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: efbef3c3fa284cc687b1b482efcf27b2 Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.740078 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3a0a2f27-5638-49bf-829c-66a19e7c79e1'} Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:10.740812 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.742199 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.745339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Returning 404 to user: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:10.746425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1561216b-6702-4b51-9709-c01bc1ead88d tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 404 len: 111 microversion: 2.1 time: 0.048637 Sep 08 10:15:10.747273 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 212/482] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:10.768509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.770215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:10.785800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.786683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.788027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.790371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.791872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.793354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.846165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] HTTP exception thrown: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Request method failure captured: Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 HTTP/1.1 Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPg58cJCKUOz9EwJSVl4d4fvVf1cqV3rKNnSDhNDRztndZw2JVQ-TIF3KrfrJe_b2rVdfXhaPbas51YXLynNOWj5zesmlAgg7gvreTns5j4GowfGr3hEJQ-Y8rSn6GDG59CQk5DUNWUE1ELLHnFvewWPmTkIiy-TdLtuZZbx-wIfE Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:10.852884 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d09cccc2ead4beab8ef6098a558b70b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: efbef3c3fa284cc687b1b482efcf27b2 Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.854209 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3a0a2f27-5638-49bf-829c-66a19e7c79e1'} Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:10.854999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.856771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.858016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Returning 404 to user: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:10.858016 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6a3a618-e3be-49a5-baeb-5c50f29c9ec7 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 404 len: 111 microversion: 2.1 time: 0.095628 Sep 08 10:15:10.860050 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 213/483] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:15:10 2022] DELETE /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:15:10.881257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.883665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 3a0a2f27-5638-49bf-829c-66a19e7c79e1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:10.902319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.903370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.905239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.906243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.910273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.911054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.955920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] HTTP exception thrown: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Request method failure captured: Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 HTTP/1.1 Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPg58cJCKUOz9EwJSVl4d4fvVf1cqV3rKNnSDhNDRztndZw2JVQ-TIF3KrfrJe_b2rVdfXhaPbas51YXLynNOWj5zesmlAgg7gvreTns5j4GowfGr3hEJQ-Y8rSn6GDG59CQk5DUNWUE1ELLHnFvewWPmTkIiy-TdLtuZZbx-wIfE Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:10.958610 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d09cccc2ead4beab8ef6098a558b70b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: efbef3c3fa284cc687b1b482efcf27b2 Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.960143 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3a0a2f27-5638-49bf-829c-66a19e7c79e1'} Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:10.960817 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. Sep 08 10:15:10.961935 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:10.964207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Returning 404 to user: Instance 3a0a2f27-5638-49bf-829c-66a19e7c79e1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:10.964207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af8455fb-a2b6-4aa8-bbf6-d163847adb4a tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1" status: 404 len: 111 microversion: 2.1 time: 0.098814 Sep 08 10:15:10.964207 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 214/484] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/servers/3a0a2f27-5638-49bf-829c-66a19e7c79e1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:10.968869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:10.969929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:10.980879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.981198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.981645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:10.982459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:10.983002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:10.983415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.232206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:11.249560 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e7eb254c-2125-435e-b7b7-947987e67d7d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.284984 Sep 08 10:15:11.255516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 215/485] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:10 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:11.268413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:11.271319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:11.281230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.282027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.282470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.283291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.283685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.284468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.290714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:11.303551 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] HTTP exception thrown: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Request method failure captured: Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 HTTP/1.1 Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPg58cJCKUOz9EwJSVl4d4fvVf1cqV3rKNnSDhNDRztndZw2JVQ-TIF3KrfrJe_b2rVdfXhaPbas51YXLynNOWj5zesmlAgg7gvreTns5j4GowfGr3hEJQ-Y8rSn6GDG59CQk5DUNWUE1ELLHnFvewWPmTkIiy-TdLtuZZbx-wIfE Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:11.306221 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d09cccc2ead4beab8ef6098a558b70b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: efbef3c3fa284cc687b1b482efcf27b2 Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.307659 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '0647d366-0477-45f6-91a8-84b1387168c5'} Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:11.308359 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.309484 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.310583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Returning 404 to user: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:11.310583 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e0f20c32-21cc-461b-b8d0-f0998ada629c tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 404 len: 111 microversion: 2.1 time: 0.054835 Sep 08 10:15:11.312244 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 216/486] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:15:11 2022] DELETE /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:11.319056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:11.319661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:11.328615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.329163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.330075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.330314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.330760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.331226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.609963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:11.624988 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd234300-0063-4abe-aaf8-a5696d894846 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1464 microversion: 2.1 time: 0.311903 Sep 08 10:15:11.627147 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 217/487] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:11 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1464 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:11.645700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:11.646536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] [instance: 0647d366-0477-45f6-91a8-84b1387168c5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:11.675739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.681147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.685291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.690637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.693339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.694280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.737165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] HTTP exception thrown: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Request method failure captured: Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 HTTP/1.1 Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBPg58cJCKUOz9EwJSVl4d4fvVf1cqV3rKNnSDhNDRztndZw2JVQ-TIF3KrfrJe_b2rVdfXhaPbas51YXLynNOWj5zesmlAgg7gvreTns5j4GowfGr3hEJQ-Y8rSn6GDG59CQk5DUNWUE1ELLHnFvewWPmTkIiy-TdLtuZZbx-wIfE Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:11.741882 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4d09cccc2ead4beab8ef6098a558b70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4d09cccc2ead4beab8ef6098a558b70b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 4d09cccc2ead4beab8ef6098a558b70b Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-393433946 Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: efbef3c3fa284cc687b1b482efcf27b2 Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersAdminTestJSON-393433946-project Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.743098 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '0647d366-0477-45f6-91a8-84b1387168c5'} Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:11.743805 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. Sep 08 10:15:11.744932 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:11.745939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] Returning 404 to user: Instance 0647d366-0477-45f6-91a8-84b1387168c5 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:11.745939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-631b7c16-90e7-409f-8cac-fec8f3790ca8 tempest-DeleteServersAdminTestJSON-393433946 tempest-DeleteServersAdminTestJSON-393433946-project] 10.222.0.59 "GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5" status: 404 len: 111 microversion: 2.1 time: 0.111502 Sep 08 10:15:11.751573 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 218/488] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:11 2022] GET /compute/v2.1/servers/0647d366-0477-45f6-91a8-84b1387168c5 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:11.764762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:11.765648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:11.782424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.782424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.782424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:11.782424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:11.782849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:11.782849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.093748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:12.102174 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2999a7a9-da8d-41e1-a6a2-cea5b9c43919 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1323 microversion: 2.1 time: 0.348697 Sep 08 10:15:12.102738 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 219/489] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:11 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:12.115045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:12.115691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: f55f9f97-6a5f-4457-a6dc-cd5019aff1a8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:12.134148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:12.134655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:12.135097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.139806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:12.140278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:12.140921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.166655 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] HTTP exception thrown: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 could not be found. Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Request method failure captured: Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 HTTP/1.1 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBQ281SbsRFHUfLdDO-PqUcDgb2jZCQxjQIq0TRhWjwchCATcLuYnTIi99rw6BuR20ewTDhLs836aO416z3W_yKvow8J9BK98VovYbeHF2DlF5axZg2QPYmJ7jl0i_M9xBtG2MGF-53bkV_wQ4ukl_cMkGyRFSToGKkuCsPqsQkH_8 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0eeb1fcfc0f54224beb031df87cb2ac5 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveMigrationNegativeTest-945965583 Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:12.168216 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0eeb1fcfc0f54224beb031df87cb2ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0eeb1fcfc0f54224beb031df87cb2ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0eeb1fcfc0f54224beb031df87cb2ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0eeb1fcfc0f54224beb031df87cb2ac5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveMigrationNegativeTest-945965583 Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0eeb1fcfc0f54224beb031df87cb2ac5 Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-945965583 Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveMigrationNegativeTest-945965583-project Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9a2f11fc7fc6430fadcfd3e0749a1053 Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveMigrationNegativeTest-945965583-project Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 could not be found. Sep 08 10:15:12.169458 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f55f9f97-6a5f-4457-a6dc-cd5019aff1a8'} Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 could not be found. Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:12.170165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 could not be found. Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 could not be found. Sep 08 10:15:12.171299 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:12.172304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Returning 404 to user: Instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:12.176569 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b264fac-16d3-4e07-9347-e57abde25303 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8" status: 404 len: 111 microversion: 2.1 time: 0.065959 Sep 08 10:15:12.180685 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 220/490] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:12 2022] GET /compute/v2.1/servers/f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:12.192691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b07f1c0c-d039-4989-b5d9-1e40fbfb0671 req-71ac7ff3-ced3-494c-853e-18aa5864cee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55f9f97-6a5f-4457-a6dc-cd5019aff1a8", "name": "network-vif-deleted", "tag": "2bb4f0a1-dd4b-4d46-a9d3-ca60797a5700"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:12.218271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b07f1c0c-d039-4989-b5d9-1e40fbfb0671 req-71ac7ff3-ced3-494c-853e-18aa5864cee2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:12.218424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b07f1c0c-d039-4989-b5d9-1e40fbfb0671 req-71ac7ff3-ced3-494c-853e-18aa5864cee2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:12.219349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b07f1c0c-d039-4989-b5d9-1e40fbfb0671 req-71ac7ff3-ced3-494c-853e-18aa5864cee2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.241342 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b07f1c0c-d039-4989-b5d9-1e40fbfb0671 req-71ac7ff3-ced3-494c-853e-18aa5864cee2 service nova] Creating event network-vif-deleted:2bb4f0a1-dd4b-4d46-a9d3-ca60797a5700 for instance f55f9f97-6a5f-4457-a6dc-cd5019aff1a8 on n-h2-833090-19 Sep 08 10:15:12.248303 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b07f1c0c-d039-4989-b5d9-1e40fbfb0671 req-71ac7ff3-ced3-494c-853e-18aa5864cee2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065267 Sep 08 10:15:12.249743 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 221/491] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:12.654255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:12.671075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'deleted': False, 'project_id': '84ce811e5044478d801665f1a075d04c'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:12.688742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:12.689756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:12.690427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.691631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:12.692333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:12.693005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.870147 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2deaa81d-aa82-4664-a826-e9bef195083b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.618771 Sep 08 10:15:12.877545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 222/492] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:15:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:12.915664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c1cdd1c3-062a-41b6-b985-7d3e27cfa655 req-dfaae541-083f-40b1-ae31-e6e608a7701e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a87449-ea1f-432b-988d-b8a9ac85c7de", "name": "network-vif-plugged", "status": "completed", "tag": "d15f0a36-3cb2-4865-b261-767233c6a5a5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:12.942092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c1cdd1c3-062a-41b6-b985-7d3e27cfa655 req-dfaae541-083f-40b1-ae31-e6e608a7701e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:12.943686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c1cdd1c3-062a-41b6-b985-7d3e27cfa655 req-dfaae541-083f-40b1-ae31-e6e608a7701e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:12.944278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c1cdd1c3-062a-41b6-b985-7d3e27cfa655 req-dfaae541-083f-40b1-ae31-e6e608a7701e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:12.968463 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c1cdd1c3-062a-41b6-b985-7d3e27cfa655 req-dfaae541-083f-40b1-ae31-e6e608a7701e service nova] Creating event network-vif-plugged:d15f0a36-3cb2-4865-b261-767233c6a5a5 for instance a9a87449-ea1f-432b-988d-b8a9ac85c7de on n-h2-833090-19 Sep 08 10:15:12.975099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c1cdd1c3-062a-41b6-b985-7d3e27cfa655 req-dfaae541-083f-40b1-ae31-e6e608a7701e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102590 Sep 08 10:15:12.981260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 223/493] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:12.989639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:12.990564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:12.999499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.000285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.001710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.002788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.004051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.008745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.113899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:15:13.292240 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cab5eaaf-9586-475b-8e8d-7fca46398c26 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 204 len: 0 microversion: 2.1 time: 0.308841 Sep 08 10:15:13.296019 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 224/494] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:15:12 2022] DELETE /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:15:13.306243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:13.306243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:13.311243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.314105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.314622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.318078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.319452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.320481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.476937 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-86f1e5eb-d636-4175-a9b9-ad336bf5921a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a/action" status: 202 len: 0 microversion: 2.25 time: 4.182580 Sep 08 10:15:13.484128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 271/495] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:15:09 2022] POST /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a/action => generated 0 bytes in 4190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:15:13.491785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:13.506263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'deleted': False} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:13.556016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.563516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.564207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.568257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.569935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.576842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.669916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:13.682292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-47aede22-3666-4c3f-8101-827d8caea26c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1367 microversion: 2.1 time: 0.383344 Sep 08 10:15:13.684260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 225/496] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:13 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:13.703069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:13.708633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:13.722558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.723069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.726164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.739084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:13.740425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:13.741131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:13.870841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:15:14.077379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:14.120718 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5961d8d-47bb-4e04-8198-c15c27eda9b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1321 microversion: 2.1 time: 0.433151 Sep 08 10:15:14.155304 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 226/497] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:13 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:14.170806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:14.171408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:14.209258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:14.261582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:14.262091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:14.262534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:14.263310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:14.263747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:14.264183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:14.372419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:14.382343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:14.383275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:15.477220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:15.486210 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1298482-90a1-40ed-80ab-e439f2a518f2 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1474 microversion: 2.1 time: 1.326600 Sep 08 10:15:15.491101 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 227/498] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:14 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1474 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:15.504639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:15.505487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:15.518758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:15.526998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:15.527855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:15.533046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:15.534930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:15.535812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:16.620453 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f9e7b3e8-ed0f-4b67-b74f-dea9a7428800 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11163 microversion: 2.1 time: 3.134676 Sep 08 10:15:16.640122 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 272/499] 10.222.0.59 () {58 vars in 1171 bytes} [Thu Sep 8 10:15:13 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11163 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:16.666377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:16.667005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:16.680425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:16.680930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:16.681379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:16.682086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:16.682536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:16.687120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:16.935555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:16.954886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:16.961745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:16.963804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-327e264a-da21-4c6a-96e2-1c58065f94c6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 1.471117 Sep 08 10:15:16.965719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 228/500] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:15 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:16.993792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:16.995244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:17.023103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:17.023487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:17.023924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:17.024635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:17.025089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:17.025514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:17.431477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:17.449549 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea53181a-4ce2-44a1-bd67-8fd328e109bb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1556 microversion: 2.1 time: 0.807360 Sep 08 10:15:17.450660 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 273/501] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:16 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1556 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:17.489171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3c571341-defa-489a-9abd-cafb182d3a84 req-d37d3da9-95b9-4c53-95ac-d196b9096060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5fe548-8e50-4c79-bfd8-ec2369cd4719", "tag": "75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:17.502647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c571341-defa-489a-9abd-cafb182d3a84 req-d37d3da9-95b9-4c53-95ac-d196b9096060 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:17.503846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c571341-defa-489a-9abd-cafb182d3a84 req-d37d3da9-95b9-4c53-95ac-d196b9096060 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:17.504462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c571341-defa-489a-9abd-cafb182d3a84 req-d37d3da9-95b9-4c53-95ac-d196b9096060 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:17.532551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3c571341-defa-489a-9abd-cafb182d3a84 req-d37d3da9-95b9-4c53-95ac-d196b9096060 service nova] Creating event network-changed:75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28 for instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 on n-h2-833090-19 Sep 08 10:15:17.540632 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3c571341-defa-489a-9abd-cafb182d3a84 req-d37d3da9-95b9-4c53-95ac-d196b9096060 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076288 Sep 08 10:15:17.541948 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 274/502] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:17.549524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:17.550779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:17.575691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:17.577482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:17.578125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:17.579051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:17.579719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:17.580328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.153100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:18.187234 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b88246ad-322b-41f1-9d99-6245de4f2a61 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1432 microversion: 2.1 time: 0.642419 Sep 08 10:15:18.201763 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 275/503] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:17 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1432 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:18.227993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:18.233820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:18.243898 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-131283be-386b-4583-bd0a-86b4a267636a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 1.270204 Sep 08 10:15:18.259881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'deleted': False, 'project_id': '84ce811e5044478d801665f1a075d04c'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:18.260863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 229/504] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:16 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:18.267450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:18.267976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:18.289857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.290587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.291188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.291738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.292259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.292437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.292704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.293192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.293503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.293933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.294048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.294379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.505581 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-469b089e-8ed0-4641-9d53-5f06b3dfb0c1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.243458 Sep 08 10:15:18.512522 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 230/505] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:15:18 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:18.521831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:18.522752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:18.534478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.535251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.536016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.552469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.553350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.554121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.590024 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9d8d4d8c-2151-43ed-b843-4d2886200752 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?tenant_id=cbb286972c294412b02697600bf9e63d" status: 200 len: 15 microversion: 2.1 time: 0.386737 Sep 08 10:15:18.590661 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 276/506] 10.222.0.59 () {58 vars in 1231 bytes} [Thu Sep 8 10:15:18 2022] GET /compute/v2.1/servers/detail?tenant_id=cbb286972c294412b02697600bf9e63d => generated 15 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:18.807053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Action: 'update', calling method: .version_select at 0x7f2351713e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:18.907761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:18.919157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:18.925763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:18.927052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f390b450-6722-4cf0-859a-f121543f1ff6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.413177 Sep 08 10:15:18.927663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 231/507] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:18 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:18.941074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:18.954994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'tenant_id': 'cbb286972c294412b02697600bf9e63d', 'deleted': False} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:18.979161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.981617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.982784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:18.985313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:18.986017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:18.986645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.054063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:15:19.227409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.227963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.232015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.235318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.236595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.237802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.281128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.282619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.283419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.325498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7f58564-7931-428e-8989-8c80375cbb1a tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53" status: 200 len: 148 microversion: 2.57 time: 0.714271 Sep 08 10:15:19.328606 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 277/508] 10.222.0.59 () {62 vars in 1303 bytes} [Thu Sep 8 10:15:18 2022] PUT /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53 => generated 148 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:19.337997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:19.338937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:19.342920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:19.347876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.348490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.349163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.351114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.351935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.352575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.394462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.395293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.395954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.396614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lazy-loading 'fault' on Instance uuid 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:19.478482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:19.492260 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a3722b1-b5fc-4dfd-8a9e-fbda2310859a tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1309 microversion: 2.1 time: 0.158042 Sep 08 10:15:19.508313 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 278/509] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:19 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:19.510389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4430ee3a-bbc1-4990-9c61-8283643123d1 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cbb286972c294412b02697600bf9e63d" status: 200 len: 4832 microversion: 2.1 time: 0.581569 Sep 08 10:15:19.511235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 232/510] 10.222.0.59 () {58 vars in 1257 bytes} [Thu Sep 8 10:15:18 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cbb286972c294412b02697600bf9e63d => generated 4832 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:19.515241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:19.515878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:19.517608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Calling method '.version_select at 0x7f2352009040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:19.525134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.525761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.526261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.526983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.527493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.530362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.730714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:19.746541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07a87d84-7991-470f-834f-a7fd2477e77f tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 0.236740 Sep 08 10:15:19.751965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 279/511] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:19 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:19.757860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:19.789769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'tenant_id': '84ce811e5044478d801665f1a075d04c', 'deleted': False} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:19.811355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.816030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.818996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.820151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.820895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.821877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.904624 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4d06512b-70ab-4359-80c0-9cd7e0f2af3b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=84ce811e5044478d801665f1a075d04c" status: 200 len: 15 microversion: 2.1 time: 0.148604 Sep 08 10:15:19.906273 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 280/512] 10.222.0.59 () {58 vars in 1257 bytes} [Thu Sep 8 10:15:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=84ce811e5044478d801665f1a075d04c => generated 15 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:19.936533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-01454fba-32e0-4730-9a17-dc616730d356 req-2bb3545f-5836-412a-84b4-314aceb4282e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2a9804-8f7b-4e91-99bc-7f41289f8f86", "name": "network-vif-deleted", "tag": "5b81aa87-ab86-4a5e-8508-7e75337c565e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:19.958827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-01454fba-32e0-4730-9a17-dc616730d356 req-2bb3545f-5836-412a-84b4-314aceb4282e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.963938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-01454fba-32e0-4730-9a17-dc616730d356 req-2bb3545f-5836-412a-84b4-314aceb4282e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.965490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-01454fba-32e0-4730-9a17-dc616730d356 req-2bb3545f-5836-412a-84b4-314aceb4282e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.986901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.988087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.988864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.989838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:19.990750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:19.991399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:19.996606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-01454fba-32e0-4730-9a17-dc616730d356 req-2bb3545f-5836-412a-84b4-314aceb4282e service nova] Creating event network-vif-deleted:5b81aa87-ab86-4a5e-8508-7e75337c565e for instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 on n-h2-833090-19 Sep 08 10:15:20.011453 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-01454fba-32e0-4730-9a17-dc616730d356 req-2bb3545f-5836-412a-84b4-314aceb4282e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085046 Sep 08 10:15:20.014083 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 281/513] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:20.026350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0de13122-f5b8-4dcc-bd7a-d49af3f9947f tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:20.038788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a4e7aaf9-fd7b-4f98-903e-e4f62e2991ca tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53/detail" status: 200 len: 463 microversion: 2.57 time: 0.526066 Sep 08 10:15:20.040091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 233/514] 10.222.0.59 () {60 vars in 1304 bytes} [Thu Sep 8 10:15:19 2022] GET /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53/detail => generated 463 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:20.050719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:20.055040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:20.057848 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0de13122-f5b8-4dcc-bd7a-d49af3f9947f tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.042326 Sep 08 10:15:20.075505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 282/515] 10.222.0.59 () {58 vars in 1189 bytes} [Thu Sep 8 10:15:20 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:20.091168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.092063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.093020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.094282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.095151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.095976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.098678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:20.106425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:20.139345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.140138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.143918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.144686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.154434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.157598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.206024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:20.346380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-effea5ba-fe2c-4ccc-af6d-23afdc59a0d9 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 0 microversion: 2.1 time: 0.260497 Sep 08 10:15:20.347383 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 283/516] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:20 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:15:20.355290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:20.368388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:20.369766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'cbb286972c294412b02697600bf9e63d'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:20.381477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.382329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.383133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.384241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.385080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.385737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.552879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:15:20.647221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2df89d09-54e1-4871-87ad-b0a63b86aeea tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.295810 Sep 08 10:15:20.653047 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 284/517] 10.222.0.59 () {58 vars in 1150 bytes} [Thu Sep 8 10:15:20 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:15:20.659294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Action: 'update', calling method: .version_select at 0x7f235161eb80>, body: {"quota_set": {"ram": "2048"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:20.783455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.784817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.784925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.785667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.786115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.786534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.869501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.869994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.870423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.876031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.876686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.877367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.959244 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3b7ba3b-e586-49c5-b289-1a383c56d354 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53?user_id=b589dd44992b4f92b45effe13892a557" status: 200 len: 148 microversion: 2.57 time: 0.304895 Sep 08 10:15:20.967290 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 285/518] 10.222.0.59 () {62 vars in 1384 bytes} [Thu Sep 8 10:15:20 2022] PUT /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53?user_id=b589dd44992b4f92b45effe13892a557 => generated 148 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:20.967709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:20.973904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:20.974709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:20.977793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:20.982088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.983288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.983929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.984168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:20.984907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:20.985554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:20.986245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:20.990305 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84406298-a420-489e-940f-0d79866a92b3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.945221 Sep 08 10:15:21.003514 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 234/519] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:20 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:21.003514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:21.003514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:21.026505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.027213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.027774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:21.028465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.029032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.029564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:21.050734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.052135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.052752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:21.053405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lazy-loading 'fault' on Instance uuid 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:21.058083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:21.173917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2f11fc7fc6430fadcfd3e0749a1053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eeb1fcfc0f54224beb031df87cb2ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:21.188986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec7a5d34-8a5b-4f24-8ad1-a8004ab26967 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 200 len: 1309 microversion: 2.1 time: 0.218466 Sep 08 10:15:21.191369 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 286/520] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:20 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:21.203684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:21.207144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:21.232972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c57753b-a604-4e0e-8b4e-702826e6ca64 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 0 microversion: 2.1 time: 0.237904 Sep 08 10:15:21.238763 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 235/521] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:20 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:15:21.256262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.257755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.258237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:21.261484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.261979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.262422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:21.269699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-30a4f2fd-a0db-4138-b5b3-4716d801c825 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] Calling method '.version_select at 0x7f23518ac5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:21.406853 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-30a4f2fd-a0db-4138-b5b3-4716d801c825 tempest-QuotasAdminTestV257-27418154 tempest-QuotasAdminTestV257-27418154-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53?user_id=b589dd44992b4f92b45effe13892a557" status: 200 len: 190 microversion: 2.57 time: 0.167757 Sep 08 10:15:21.408466 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 236/522] 10.222.0.59 () {60 vars in 1364 bytes} [Thu Sep 8 10:15:21 2022] GET /compute/v2.1/os-quota-sets/347cd838667d4bdf9893af459f10ea53?user_id=b589dd44992b4f92b45effe13892a557 => generated 190 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:15:21.420806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:21.426574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:21.441627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.442932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.445220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:21.448264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:21.450704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:21.451399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:22.035281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e87d7300-e59b-40a2-9c13-4bd22d21fbf8 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1616 microversion: 2.1 time: 0.622287 Sep 08 10:15:22.049799 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 237/523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:21 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1616 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:22.071736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:22.074346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:22.096645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:22.098801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:22.100013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:22.102992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:22.105768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:22.106558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:22.576563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:22.594027 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5c6ee266-4a36-42ee-bdef-5ebf891215e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 1.398060 Sep 08 10:15:22.595333 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 287/524] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:21 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:22.604578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:22.605912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:22.619810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:22.623737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:22.624551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:22.626396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:22.634679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:22.645408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.138403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:23.153126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:23.154958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:23.157258 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a3646fd8-7436-4132-bfb9-61db353e7c5d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 1.105983 Sep 08 10:15:23.161632 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 238/525] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:22 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:23.181680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:23.184288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] [instance: 4a2a9804-8f7b-4e91-99bc-7f41289f8f86] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:23.201721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.202434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.203045 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52e0d8e3-4390-47c9-86a4-9bbc7bc6c655 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1616 microversion: 2.1 time: 0.602412 Sep 08 10:15:23.204458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.205387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.205760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 288/526] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:22 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1616 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:23.207855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.209264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.222104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3b9f569a-04c7-4fb2-9aa5-ae5557dfa4e9 req-19b1069e-82ff-4862-9c05-0aecbe42077f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a87449-ea1f-432b-988d-b8a9ac85c7de", "tag": "d15f0a36-3cb2-4865-b261-767233c6a5a5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:23.245430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] HTTP exception thrown: Instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 could not be found. Sep 08 10:15:23.246470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3b9f569a-04c7-4fb2-9aa5-ae5557dfa4e9 req-19b1069e-82ff-4862-9c05-0aecbe42077f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.246949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3b9f569a-04c7-4fb2-9aa5-ae5557dfa4e9 req-19b1069e-82ff-4862-9c05-0aecbe42077f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.247374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3b9f569a-04c7-4fb2-9aa5-ae5557dfa4e9 req-19b1069e-82ff-4862-9c05-0aecbe42077f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Request method failure captured: Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 HTTP/1.1 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBQ281SbsRFHUfLdDO-PqUcDgb2jZCQxjQIq0TRhWjwchCATcLuYnTIi99rw6BuR20ewTDhLs836aO416z3W_yKvow8J9BK98VovYbeHF2DlF5axZg2QPYmJ7jl0i_M9xBtG2MGF-53bkV_wQ4ukl_cMkGyRFSToGKkuCsPqsQkH_8 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0eeb1fcfc0f54224beb031df87cb2ac5 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveMigrationNegativeTest-945965583 Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:23.247992 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0eeb1fcfc0f54224beb031df87cb2ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0eeb1fcfc0f54224beb031df87cb2ac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0eeb1fcfc0f54224beb031df87cb2ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0eeb1fcfc0f54224beb031df87cb2ac5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveMigrationNegativeTest-945965583 Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0eeb1fcfc0f54224beb031df87cb2ac5 Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-945965583 Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveMigrationNegativeTest-945965583-project Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9a2f11fc7fc6430fadcfd3e0749a1053 Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveMigrationNegativeTest-945965583-project Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 could not be found. Sep 08 10:15:23.249579 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '4a2a9804-8f7b-4e91-99bc-7f41289f8f86'} Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 could not be found. Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:23.250274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 could not be found. Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 could not be found. Sep 08 10:15:23.251574 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:23.254364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] Returning 404 to user: Instance 4a2a9804-8f7b-4e91-99bc-7f41289f8f86 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:23.255406 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6af6b420-f384-4b19-b0f8-5129521322c6 tempest-LiveMigrationNegativeTest-945965583 tempest-LiveMigrationNegativeTest-945965583-project] 10.222.0.59 "GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86" status: 404 len: 111 microversion: 2.1 time: 0.092513 Sep 08 10:15:23.259516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 239/527] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:23 2022] GET /compute/v2.1/servers/4a2a9804-8f7b-4e91-99bc-7f41289f8f86 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:23.265733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:23.269371 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3b9f569a-04c7-4fb2-9aa5-ae5557dfa4e9 req-19b1069e-82ff-4862-9c05-0aecbe42077f service nova] Creating event network-changed:d15f0a36-3cb2-4865-b261-767233c6a5a5 for instance a9a87449-ea1f-432b-988d-b8a9ac85c7de on n-h2-833090-19 Sep 08 10:15:23.273064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'host': 'n-h1-833090-19', 'deleted': False} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:23.278060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.278831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.279454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.280489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.281167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.281807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.284712 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3b9f569a-04c7-4fb2-9aa5-ae5557dfa4e9 req-19b1069e-82ff-4862-9c05-0aecbe42077f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076849 Sep 08 10:15:23.287856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 289/528] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:23.404045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:15:23.468184 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf5d5528-26b5-4ff6-afe1-03dbc827537b tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers?host=n-h1-833090-19&all_tenants=1" status: 200 len: 1325 microversion: 2.1 time: 0.207186 Sep 08 10:15:23.469149 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 240/529] 10.222.0.59 () {58 vars in 1192 bytes} [Thu Sep 8 10:15:23 2022] GET /compute/v2.1/servers?host=n-h1-833090-19&all_tenants=1 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:23.488579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:23.495348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:15:23.514825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.515317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.515785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.516641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.517090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.517517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.624669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:23.625721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:23.637869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.640123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.642033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.644396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.646382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.651508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.807061 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7a18eb9-85ef-4818-8650-5bde7bf47a47 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.321455 Sep 08 10:15:23.807061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 290/530] 10.222.0.59 () {58 vars in 1196 bytes} [Thu Sep 8 10:15:23 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:23.824105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:23.826774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:23.843439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.847155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.848434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:23.850383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:23.851625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:23.852559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.029396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e9edc64-4168-4fa6-aa66-6153e587cda0 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 0 microversion: 2.1 time: 0.213744 Sep 08 10:15:24.032491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 291/531] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:23 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:15:24.068669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:24.071441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:24.090497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.091097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.091581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.092333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.092789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.093211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.185724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:24.200084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51aad89c-5791-4475-b1a5-23c10c6bcc4a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 0.579237 Sep 08 10:15:24.200872 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 241/532] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:23 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:24.211138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:24.211784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:24.249926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.250193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.250436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.251159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.251649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.252084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.295828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:24.296607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:24.297422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:24.298388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:24.299948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:24.431332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:24.443120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.446460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.447154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.449257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.449896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.450511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.519756 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4d553bf-edd7-4c40-a003-201acaea08ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 1067 microversion: 2.1 time: 0.480785 Sep 08 10:15:24.520430 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 292/533] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:24 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 1067 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:15:24.542883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:24.543932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:24.574706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.579899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.585169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:24.587379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:24.592259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:24.597809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:25.573847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:25.582462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:25.597552 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15b3c02f-37e0-47c4-9ed2-cd09169906cb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 1.060013 Sep 08 10:15:25.600802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:25.602599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:25.602879 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 293/534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:24 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:25.605106 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a7d6fa83-6c96-465f-bc4b-17684237785f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 1.403074 Sep 08 10:15:25.606513 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 242/535] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:24 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:25.636677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a", "name": "network-vif-unplugged", "status": "completed", "tag": "001f665d-26c6-43c2-8aa9-ae7333f08bcb"}, {"name": "network-changed", "server_uuid": "abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a", "tag": "001f665d-26c6-43c2-8aa9-ae7333f08bcb"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:25.637227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:25.645311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:25.662165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:25.663995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:25.665862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:25.666725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:25.668101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:25.669933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:25.670288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:25.670861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:25.672728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:25.702534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] Creating event network-vif-unplugged:001f665d-26c6-43c2-8aa9-ae7333f08bcb for instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a on n-h1-833090-19 Sep 08 10:15:25.706971 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] Creating event network-changed:001f665d-26c6-43c2-8aa9-ae7333f08bcb for instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a on n-h1-833090-19 Sep 08 10:15:25.718641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-71928b53-ef89-492f-9d75-64bafbd689c2 req-c3481b20-6f73-4692-be4c-34472d11d102 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.110479 Sep 08 10:15:25.726542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 243/536] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:26.282506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:26.314321 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4cd1e549-e951-452b-99b6-f396b7cae4b2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 0.709994 Sep 08 10:15:26.316642 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 294/537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:25 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:26.360090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7b2d36d7-4ac1-4b78-98bd-9dc0fbaa2c50 req-7dd2a3ea-9342-4213-b802-3a3d2941edee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5fe548-8e50-4c79-bfd8-ec2369cd4719", "name": "network-vif-plugged", "status": "completed", "tag": "75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:26.472792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7b2d36d7-4ac1-4b78-98bd-9dc0fbaa2c50 req-7dd2a3ea-9342-4213-b802-3a3d2941edee service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:26.495195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7b2d36d7-4ac1-4b78-98bd-9dc0fbaa2c50 req-7dd2a3ea-9342-4213-b802-3a3d2941edee service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:26.498424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7b2d36d7-4ac1-4b78-98bd-9dc0fbaa2c50 req-7dd2a3ea-9342-4213-b802-3a3d2941edee service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:26.547277 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7b2d36d7-4ac1-4b78-98bd-9dc0fbaa2c50 req-7dd2a3ea-9342-4213-b802-3a3d2941edee service nova] Creating event network-vif-plugged:75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28 for instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 on n-h2-833090-19 Sep 08 10:15:26.582460 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7b2d36d7-4ac1-4b78-98bd-9dc0fbaa2c50 req-7dd2a3ea-9342-4213-b802-3a3d2941edee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228239 Sep 08 10:15:26.594913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 244/538] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:26.624635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:26.627939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:26.671132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:26.676834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:26.685911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:26.686412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:26.686857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:26.694189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:26.694809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:26.695270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:26.703597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:26.704333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:26.704772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:26.712952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:26.713472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:26.713919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:27.434795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:27.445217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:27.463205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:27.465888 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5b2f474a-5621-450b-9a1a-81852e7b8895 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.827188 Sep 08 10:15:27.469191 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 245/539] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:26 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:27.477782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:27.517859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:27.520253 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b650161-1d1e-452d-ad63-b17ff8932702 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 0.894621 Sep 08 10:15:27.520637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:27.538806 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 295/540] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:26 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:27.555070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:27.555593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:27.558155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:27.559124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:27.560934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:27.561548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:27.988883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:28.010063 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39dd8c29-644a-4c6d-adc5-98773701a9d8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 0.535753 Sep 08 10:15:28.010720 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 246/541] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:27 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:28.497032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:28.497709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:28.512291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:28.512788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:28.513219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:28.513930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:28.514377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:28.514801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:28.550526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:28.551782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:28.559370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:28.565384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:28.567130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:28.568064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:28.572184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:28.572823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:28.612613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:29.492685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:29.502239 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34f19355-ac4e-4d7c-8f5e-d4beb215be51 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 0.955185 Sep 08 10:15:29.507291 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 247/542] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:28 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:29.514178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:29.514932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:29.521756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:29.522549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:29.523322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:29.528583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:29.533686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:29.534363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:29.586748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:29.600688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:29.602176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:29.603350 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59c3b5e3-78a1-4b7e-be3c-1a56d7f77812 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 1.110558 Sep 08 10:15:29.603946 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 296/543] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:28 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:29.845572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:29.855096 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f126c29-a8b4-495a-9922-1e15ebbf96db tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1388 microversion: 2.1 time: 0.346190 Sep 08 10:15:29.858410 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 248/544] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:29 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1388 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:30.056920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-539393090", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:30.159980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:15:30.534825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:30.536265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:30.550441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:30.552580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:30.553397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:30.557812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:30.559270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:30.560848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:30.697360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:30.698479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:30.699157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:30.699791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:30.700422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:30.718162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:30.718966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:30.720043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:30.724418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:30.725166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:30.725799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:30.765053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:30.779028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for user 5f96685045b340b2a978ece9dd591640 and project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:30.807931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:15:30.816456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:15:30.918425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4bea67ba-09c3-4813-b191-a41a45048d46 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309621 Sep 08 10:15:30.919807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 297/545] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:15:30.930544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:30.935148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:30.952350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:30.953721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:30.954417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:30.956507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:30.957459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:30.958454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:31.400033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:31.552888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:31.575947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a67ad2bc-89f2-4970-8aae-9b9d3f9855be tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 1.045477 Sep 08 10:15:31.578433 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 249/546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:30 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:31.587660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:31.588613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:31.604109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:31.605101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:31.605992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:31.607763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:31.608820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:31.609881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.276282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:32.321361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:32.328609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:32.329301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:32.335795 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64d1b01e-a8e2-43a5-86bf-0400c92d0f0f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 1.411589 Sep 08 10:15:32.339015 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 298/547] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:30 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:32.355858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:32.356480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:32.370331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.370703 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fae7a688-3d59-4038-a719-6ec3cd1b0a8c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1587 microversion: 2.1 time: 0.788286 Sep 08 10:15:32.371256 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 250/548] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:31 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1587 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:32.373668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.374344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.377020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.378172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.380032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.586423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:32.597540 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-084d9a3e-929d-4c49-855d-a0ade2ea6d54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1264 microversion: 2.1 time: 0.256504 Sep 08 10:15:32.613326 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 299/549] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:32 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:32.626179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:32.628736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:32.643835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.645563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.646238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.647679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.648782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.649858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.728737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:32.732715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.733459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.734096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.735136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.735852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.736441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.792539 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be3d24e3-1c30-4cc3-88dd-63cf1de4d123 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.419638 Sep 08 10:15:32.793370 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 251/550] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:15:32 2022] GET /compute/v2.1/os-services => generated 949 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:32.799348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:32.800771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:32.807925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.808786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.809525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:32.810471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:32.811314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:32.811929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.393722 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd306ca7-11fd-44fd-8945-f7f6f604de07 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.778478 Sep 08 10:15:33.394608 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 300/551] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:15:32 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719/os-interface => generated 284 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:33.402071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:33.413285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:33.414716 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b89e636-8743-4cf3-9c6f-22f229c367ed tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 0.619772 Sep 08 10:15:33.417408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 252/552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:32 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:33.427883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:33.428492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:33.442767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.447447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.447962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.448389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.449086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.449532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.449951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.460419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.460419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.461236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.461731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.462175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.497368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=24 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:33.525540 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0944774a-d2fd-4d35-9665-edf0e5e5d646 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.129827 Sep 08 10:15:33.526235 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 301/553] 10.222.0.59 () {58 vars in 1170 bytes} [Thu Sep 8 10:15:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:33.551875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:33.555941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.556254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.556849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.558031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.558844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.560153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.634664 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec17691d-ca3c-4ef6-9f64-162d516affb7 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.087254 Sep 08 10:15:33.649083 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 302/554] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:15:33 2022] GET /compute/v2.1/os-services => generated 949 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:33.657655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:33.658865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:33.678718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.679246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.679817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.680428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.680933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.683229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.877192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:33.892893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4496e607-7ed5-407d-a6e1-c66b8d92ea03 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1270 microversion: 2.1 time: 0.239188 Sep 08 10:15:33.894852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 303/555] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:33 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:33.902591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:33.924397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.925055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.928365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.929943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:33.930751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:33.931421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:33.966026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:33.980035 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98f4a899-e2a7-453d-8deb-4e4c515b7e55 tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=n-d-833090-19&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.082764 Sep 08 10:15:33.992615 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 304/556] 10.222.0.59 () {58 vars in 1196 bytes} [Thu Sep 8 10:15:33 2022] GET /compute/v2.1/os-services?host=n-d-833090-19&binary=xxx => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:33.998156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:34.003696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.004542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.005776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.006551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.007392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.008246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.062006 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee0146d2-1e0b-40d1-953f-4cb78c4b3c8c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.068030 Sep 08 10:15:34.067708 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 305/557] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:15:33 2022] GET /compute/v2.1/os-services => generated 949 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:34.107189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:34.115154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.117467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.118939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.120144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.122683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.124383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.175742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:34.180194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:34.190309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:34.194860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:34.200019 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c3be2bd-27aa-49fb-9998-98b333df221b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.781430 Sep 08 10:15:34.202905 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 253/558] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:33 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:34.219940 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7033a2c-13b7-441c-bf2f-cf0e5a74a22c tempest-ServicesAdminNegativeTestJSON-1879652093 tempest-ServicesAdminNegativeTestJSON-1879652093-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.120618 Sep 08 10:15:34.223961 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 306/559] 10.222.0.59 () {58 vars in 1198 bytes} [Thu Sep 8 10:15:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:15:34.454246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:34.455374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:34.463954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.464452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.464898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.465624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.466086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.474093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.791285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ab40cc3-c389-49d1-9263-9c0fe9c1ad49 tempest-ServicesAdminNegativeTestJSON-1265625585 tempest-ServicesAdminNegativeTestJSON-1265625585-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:34.800774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ab40cc3-c389-49d1-9263-9c0fe9c1ad49 tempest-ServicesAdminNegativeTestJSON-1265625585 tempest-ServicesAdminNegativeTestJSON-1265625585-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '30aeb1c1a2d140bea8ed8a19e424726d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55ea63637584c8282c55b7cead7c326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ab40cc3-c389-49d1-9263-9c0fe9c1ad49 tempest-ServicesAdminNegativeTestJSON-1265625585 tempest-ServicesAdminNegativeTestJSON-1265625585-project] Request method failure captured: Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDB6LZeXZwObH2lps5XiRmOyOlGg1UgCJAzUwszWPldGUAw6zpPflGMv82dlFJmdOMEZraEe8AR3EDkcEnKMzWJAMy3lx1KT06GXkKVB-Md7qKKwT3Zm3KVLoSxjS_aOLdvBG0JZbiyUwwT9cwhIikNnihF2NNBin1h_bf3aqvivmg Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: d55ea63637584c8282c55b7cead7c326 Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1265625585 Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:15:34.827381 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d55ea63637584c8282c55b7cead7c326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d55ea63637584c8282c55b7cead7c326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d55ea63637584c8282c55b7cead7c326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d55ea63637584c8282c55b7cead7c326", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1265625585 Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: d55ea63637584c8282c55b7cead7c326 Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1265625585 Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServicesAdminNegativeTestJSON-1265625585-project Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 30aeb1c1a2d140bea8ed8a19e424726d Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1265625585-project Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:15:34.828861 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:15:34.830232 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:15:34.831386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:15:34.835053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ab40cc3-c389-49d1-9263-9c0fe9c1ad49 tempest-ServicesAdminNegativeTestJSON-1265625585 tempest-ServicesAdminNegativeTestJSON-1265625585-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:34.836589 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ab40cc3-c389-49d1-9263-9c0fe9c1ad49 tempest-ServicesAdminNegativeTestJSON-1265625585 tempest-ServicesAdminNegativeTestJSON-1265625585-project] 10.222.0.59 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.603704 Sep 08 10:15:34.837692 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 254/560] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:15:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 605 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:34.922560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:34.924220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:34.933336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.934212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.934869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:34.935838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:34.936755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:34.937527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:35.021181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:35.038548 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4348290-6f39-4d01-a8e8-35fa8a9dca84 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 0.581417 Sep 08 10:15:35.040155 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 307/561] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:34 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:35.078733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:35.091564 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6af60c44-2db7-4b95-8375-8a72772afa59 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1270 microversion: 2.1 time: 0.173643 Sep 08 10:15:35.104924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 255/562] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:34 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:35.232374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:35.233088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:35.251142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:35.252254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:35.254768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:35.255820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:35.257092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:35.258051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:35.749516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:35.765204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:35.767022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:35.768380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11506690-ac17-4325-8be2-ce5e2b671ebe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.540547 Sep 08 10:15:35.769936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 308/563] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:35 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:36.071271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:36.072547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:36.093825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:36.099528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:36.100876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:36.105699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:36.107225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:36.110785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:36.118682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:36.119604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:36.137153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:36.137676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:36.138145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:36.138860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:36.139319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:36.139778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:36.477123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:36.488579 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0bc981e-ef1b-4383-be72-156ea35eb931 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.374170 Sep 08 10:15:36.489382 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 309/564] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:36 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:36.579068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:36.589617 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6196cd08-78bd-44ff-8b36-c305cd564b2e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1471 microversion: 2.1 time: 0.522986 Sep 08 10:15:36.592134 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 256/565] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:36 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:36.800519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:36.801293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:36.813771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:36.815018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:36.815710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:36.816662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:36.818593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:36.820051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:37.137527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:37.147488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:37.155332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:37.172578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ce115405-579e-4360-92ac-512d7de4a74c req-a7af93fc-0d8a-4f87-90ab-aa3d3b728042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5a736f-021a-43fd-ae81-209ae40bc1f5", "tag": "642a50fe-153c-4e4e-82bf-40d85d4ed091"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:37.181641 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-228702f9-33c5-4486-a952-54e1d3af31e1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.386122 Sep 08 10:15:37.201098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 310/566] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:36 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:37.214087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ce115405-579e-4360-92ac-512d7de4a74c req-a7af93fc-0d8a-4f87-90ab-aa3d3b728042 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:37.214823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ce115405-579e-4360-92ac-512d7de4a74c req-a7af93fc-0d8a-4f87-90ab-aa3d3b728042 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:37.215418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ce115405-579e-4360-92ac-512d7de4a74c req-a7af93fc-0d8a-4f87-90ab-aa3d3b728042 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:37.240557 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ce115405-579e-4360-92ac-512d7de4a74c req-a7af93fc-0d8a-4f87-90ab-aa3d3b728042 service nova] Creating event network-changed:642a50fe-153c-4e4e-82bf-40d85d4ed091 for instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 on n-h1-833090-19 Sep 08 10:15:37.258619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ce115405-579e-4360-92ac-512d7de4a74c req-a7af93fc-0d8a-4f87-90ab-aa3d3b728042 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088486 Sep 08 10:15:37.259933 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 257/567] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:37.519199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:37.520106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:37.535497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:37.536485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:37.537144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:37.538122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:37.539022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:37.540441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:37.619402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:37.620155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:37.641530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:37.647975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:37.650774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:37.655860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:37.659889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:37.660821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:38.452959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:38.464780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:38.465851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f66b763-fbfc-44a9-886e-3a792ceaeb61 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.951854 Sep 08 10:15:38.474807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 311/568] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:37 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:38.495256 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-489f79cb-ed8d-47e9-b986-086813951f29 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1477 microversion: 2.1 time: 0.880627 Sep 08 10:15:38.496260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 258/569] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:37 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1477 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:38.507440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ac956c5f-f37a-4002-aca2-4d61304d282a req-ee7da0a8-c175-495a-a68e-ae215b391866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5fe548-8e50-4c79-bfd8-ec2369cd4719", "tag": "75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:38.513176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:38.513807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:38.528803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:38.530217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:38.531370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:38.533967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:38.534787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:38.535442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:38.553368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ac956c5f-f37a-4002-aca2-4d61304d282a req-ee7da0a8-c175-495a-a68e-ae215b391866 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:38.555781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ac956c5f-f37a-4002-aca2-4d61304d282a req-ee7da0a8-c175-495a-a68e-ae215b391866 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:38.557453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ac956c5f-f37a-4002-aca2-4d61304d282a req-ee7da0a8-c175-495a-a68e-ae215b391866 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:38.598265 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ac956c5f-f37a-4002-aca2-4d61304d282a req-ee7da0a8-c175-495a-a68e-ae215b391866 service nova] Creating event network-changed:75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28 for instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 on n-h2-833090-19 Sep 08 10:15:38.615051 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ac956c5f-f37a-4002-aca2-4d61304d282a req-ee7da0a8-c175-495a-a68e-ae215b391866 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115592 Sep 08 10:15:38.623399 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 259/570] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:38.630596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:38.631302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:38.660199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:38.660705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:38.661164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:38.661897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:38.662362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:38.662792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:39.051349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:39.071287 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49507f8e-3d6c-4723-85ef-a79bc85b8946 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 200 len: 1587 microversion: 2.1 time: 0.594966 Sep 08 10:15:39.075724 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 312/571] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:38 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 1587 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:39.459680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:39.473324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:39.474862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:39.482636 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29bea866-e2fb-40a3-92e4-86d9ad9fc37a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 0.857582 Sep 08 10:15:39.483547 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 260/572] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:38 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:39.507615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:39.508480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:39.519633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:39.520348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:39.520946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:39.521819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:39.522431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:39.523013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:39.529432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:39.530072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:39.553794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:39.554306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:39.554755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:39.556915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:39.557389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:39.560493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:40.087898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:40.103251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-43beece9-e93b-4e2a-869c-19fbb7d7df68 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.599705 Sep 08 10:15:40.115546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:40.126296 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 313/573] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:39 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:40.142681 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db6b1a39-f6ce-4c09-8e36-bdce3e1fa168 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1477 microversion: 2.1 time: 0.617530 Sep 08 10:15:40.143347 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 261/574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:39 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1477 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:40.509336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:40.509951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:40.521126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:40.521635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:40.522470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:40.522781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:40.531637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:40.534955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:40.799973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=40 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:41.133382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:41.134051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:41.144530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:41.146393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:41.146941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:41.148832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:41.153776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:41.154561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:41.505947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:41.516254 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1bf8a683-40e4-422d-9c94-3cf197a65250 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.386972 Sep 08 10:15:41.519593 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 262/575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:41 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:41.530438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:41.540887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:41.564985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:41.566227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:41.566832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:41.568890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:41.570101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:41.574144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:41.841292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:41.857718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:41.859749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:41.866366 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d90fadc8-5434-4cdb-bdac-cd9b01c7d559 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1568 microversion: 2.25 time: 1.361096 Sep 08 10:15:41.867399 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 314/576] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:40 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1568 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:41.926416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:41.940425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99030ca9-ccab-43cd-8129-ebd8ef4a567e tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1463 microversion: 2.1 time: 0.419532 Sep 08 10:15:41.941573 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 263/577] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:41 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1463 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:41.969970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:41.971217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:41.990991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:41.995173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:41.996506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:42.002972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:42.003876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:42.006251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:42.544934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:42.545550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:42.555052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:42.557665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:42.558156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:42.558906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:42.559368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:42.561908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:42.748433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:42.979322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:43.007062 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad7cab45-742f-4575-942e-efb877ec22ff tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1463 microversion: 2.1 time: 1.040391 Sep 08 10:15:43.010237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 315/578] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:41 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1463 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:43.024111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:43.026190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:43.051061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.055640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.056378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.059148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.072327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.073200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.258903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:43.273908 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e44ba0a-9c2f-4d90-b46c-42cff3ab4b7f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.733629 Sep 08 10:15:43.274510 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 264/579] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:42 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:43.280309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:43.289964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:43.304885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.309647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.310469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.311624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.316314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.317074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.533119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:43.533689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:43.534233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:43.534704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:43.535183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:43.582905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:43.600141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:43.604473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:43.608683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dd82e6ea-e1b4-434e-a228-b85fbc203e15 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1558 microversion: 2.25 time: 0.596682 Sep 08 10:15:43.611869 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 316/580] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:43 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1558 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:43.644912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7ee19a5-d62e-4a69-9fa2-3319ef30af52 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '.version_select at 0x7f23516f7d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:43.653087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7ee19a5-d62e-4a69-9fa2-3319ef30af52 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.661375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7ee19a5-d62e-4a69-9fa2-3319ef30af52 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.662249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7ee19a5-d62e-4a69-9fa2-3319ef30af52 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.669984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:43.678036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:43.698730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.700207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.708844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.709925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.712099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.712771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.717646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7ee19a5-d62e-4a69-9fa2-3319ef30af52 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.071508 Sep 08 10:15:43.718637 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 317/581] 10.222.0.59 () {60 vars in 1184 bytes} [Thu Sep 8 10:15:43 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:15:43.738042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-fe5a7bd1-eca0-4214-85b3-d3f523478e99 req-4a6c963e-1749-4378-b29f-173d2e82afc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d242c4-0703-440b-a09e-e0b93a5dd086", "name": "network-vif-plugged", "status": "completed", "tag": "06750d27-6888-4a9f-8d43-37eec362ecfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:43.779500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fe5a7bd1-eca0-4214-85b3-d3f523478e99 req-4a6c963e-1749-4378-b29f-173d2e82afc3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.781010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fe5a7bd1-eca0-4214-85b3-d3f523478e99 req-4a6c963e-1749-4378-b29f-173d2e82afc3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.782705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fe5a7bd1-eca0-4214-85b3-d3f523478e99 req-4a6c963e-1749-4378-b29f-173d2e82afc3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.809375 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c1aea7a-1083-443e-96c1-9a0b1bd6265b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 1067 microversion: 2.1 time: 0.531816 Sep 08 10:15:43.814005 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 265/582] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:43 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 1067 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:15:43.833705 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-fe5a7bd1-eca0-4214-85b3-d3f523478e99 req-4a6c963e-1749-4378-b29f-173d2e82afc3 service nova] Creating event network-vif-plugged:06750d27-6888-4a9f-8d43-37eec362ecfd for instance f2d242c4-0703-440b-a09e-e0b93a5dd086 on n-h1-833090-19 Sep 08 10:15:43.843885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:43.844823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:43.847927 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-fe5a7bd1-eca0-4214-85b3-d3f523478e99 req-4a6c963e-1749-4378-b29f-173d2e82afc3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117536 Sep 08 10:15:43.848540 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 318/583] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:43.854283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:43.856468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:43.867485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.868013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.868460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.869194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.874455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.875446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.876766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.877744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:43.878678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.879302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:43.880587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:43.881115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:44.164263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=9 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:44.495078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:15:44.536982 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cc2b9fd-db81-44a6-8507-c93bc9ab643a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 2052 microversion: 2.25 time: 0.707545 Sep 08 10:15:44.537422 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 266/584] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:43 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 2052 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:44.542981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:44.549019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:44.562685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=93 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:44.564968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:44.565644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:44.567365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:44.568295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:44.568986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:44.570425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:44.850986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:44.867192 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-53baf8c2-4408-4a9e-8f84-c8c2d5b3dfc7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 1.016975 Sep 08 10:15:44.879966 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 319/585] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:43 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:44.888996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1059621609", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "a201f7b1-2b10-4321-b5d2-383c4b92fcf0"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:44.964112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] validate_networks() for [('a201f7b1-2b10-4321-b5d2-383c4b92fcf0', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:15:45.328279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:45.348070 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-30507820-6051-4a55-bc2e-d519e8aba74a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.808580 Sep 08 10:15:45.348889 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 267/586] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:44 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:45.602524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31dc9cc2-44b5-486d-8970-4df31141dc8d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Action: 'create', calling method: .version_select at 0x7f23517833a0>, body: {"keypair": {"name": "tempest-keypair-598675092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCke5vSZvJaGBQ0aWJ/1h9lqLHTXMbD5CLZWqV1dc1zdLzypCdCjVjaiV6l9TeYkeFoLvC5lenvUtakgq65n2P3dJBcTcdV3sYbdxVP7NnPur6CLgVDnIR3jLsZpE7/y6w=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:45.619553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-31dc9cc2-44b5-486d-8970-4df31141dc8d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Getting quotas for project 4054b9269fef44c0b434249584cbecf7. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:45.625860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-31dc9cc2-44b5-486d-8970-4df31141dc8d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Getting quotas for user ccce637e46fb484ea5d46c0371206da6 and project 4054b9269fef44c0b434249584cbecf7. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:45.655651 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31dc9cc2-44b5-486d-8970-4df31141dc8d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.296325 Sep 08 10:15:45.656582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 268/587] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:15:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:45.890768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:45.892372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:45.899137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:45.899735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:45.900407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:45.901187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:45.901908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:45.902405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:46.095619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:46.096372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:46.096922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:46.107257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:46.108047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:46.120281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:46.121158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:46.125600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:46.126684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:46.127308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:46.127827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:46.179831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:46.187022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for user 448b7c1cb3eb4b63a427a3d7b7d6eb13 and project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:46.221042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:15:46.225988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:15:46.291781 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-101ccf94-8783-47b9-8027-5412201d657b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.406660 Sep 08 10:15:46.293185 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 320/588] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:15:46.307557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-be8878c1-3f5e-4750-8d9e-d0f9c81c0976 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:46.308563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-be8878c1-3f5e-4750-8d9e-d0f9c81c0976 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:46.518225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:46.538291 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c65262e-f8db-423b-ac14-c6c050e101ac tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.647506 Sep 08 10:15:46.555196 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 269/589] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:45 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:46.566654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:46.567589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:46.586923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:46.587423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:46.587893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:46.588602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:46.589052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:46.589596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:46.798914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be8878c1-3f5e-4750-8d9e-d0f9c81c0976 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:46.808211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be8878c1-3f5e-4750-8d9e-d0f9c81c0976 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:46.813732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be8878c1-3f5e-4750-8d9e-d0f9c81c0976 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:46.820197 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-be8878c1-3f5e-4750-8d9e-d0f9c81c0976 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1262 microversion: 2.25 time: 0.517549 Sep 08 10:15:46.821135 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 321/590] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:46 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1262 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:47.478507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:47.486824 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cbcecab8-372d-4aef-9403-da56ebfaa33e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.929662 Sep 08 10:15:47.492701 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 270/591] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:46 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:47.561706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:47.563661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:47.571674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:47.572454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:47.573319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:47.576593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:47.577880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:47.580519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:47.848874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:47.850102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:47.860983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:47.865024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:47.865657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:47.868163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:47.871372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:47.872137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:47.915666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:48.050198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:48.072363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:48.074066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:48.078541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a963961-f524-4b82-a28f-a063e0a8fc90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1314 microversion: 2.25 time: 0.233843 Sep 08 10:15:48.082564 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 271/592] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:47 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:48.092637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1546327784", "imageRef": "0c753bb4-84ee-434b-9226-5c4b15e25418", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "06f971c7-afda-425d-8ab0-a096a50ba9c0"}], "security_groups": [{"name": "tempest-securitygroup--1438261254"}], "key_name": "tempest-keypair-598675092", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:48.127696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:48.138100 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2bc6f3db-1c74-4a42-8285-d8a6eacc1e70 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.580244 Sep 08 10:15:48.140013 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 322/593] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:47 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:48.419819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] validate_networks() for [('06f971c7-afda-425d-8ab0-a096a50ba9c0', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:15:48.516388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:48.517199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:48.528088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:48.528650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:48.529032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:48.529930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:48.530400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:48.530835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:48.990023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:48.999815 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-74862d6f-a93f-43ba-832d-f3eadbbba27e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.487493 Sep 08 10:15:49.001418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 323/594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:48 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:49.113398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:49.114555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:49.125021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:49.125611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:49.125997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:49.126719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:49.134191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:49.134965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:49.696870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:49.731056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:49.740471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:49.742648 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4f9905b-33d7-4363-a2c5-5d1991340777 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.634097 Sep 08 10:15:49.744376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 324/595] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:49 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:15:49.751096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:49.752109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:49.762796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:49.763625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:49.765347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:49.767088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:49.767923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:49.768514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:49.816032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:49.817026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:49.818304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:49.818722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:49.819159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:49.845187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:49.845503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:49.845982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:49.852533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:49.853190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:49.853639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:49.879652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Getting quotas for project 4054b9269fef44c0b434249584cbecf7. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:49.884992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Getting quotas for user ccce637e46fb484ea5d46c0371206da6 and project 4054b9269fef44c0b434249584cbecf7. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:49.901593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:15:49.908346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0c753bb4-84ee-434b-9226-5c4b15e25418',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:15:49.982758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-873048d9-a888-46a8-a586-13e245d93f76 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.898785 Sep 08 10:15:49.983925 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 272/596] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:15:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:15:49.989143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1acaee3f-ecd4-49fc-8362-92c191c99b06 req-02778efd-5ff1-4eae-a949-560fd960203d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5a736f-021a-43fd-ae81-209ae40bc1f5", "name": "network-vif-plugged", "status": "completed", "tag": "642a50fe-153c-4e4e-82bf-40d85d4ed091"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:50.001112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1acaee3f-ecd4-49fc-8362-92c191c99b06 req-02778efd-5ff1-4eae-a949-560fd960203d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:50.001944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1acaee3f-ecd4-49fc-8362-92c191c99b06 req-02778efd-5ff1-4eae-a949-560fd960203d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:50.002592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1acaee3f-ecd4-49fc-8362-92c191c99b06 req-02778efd-5ff1-4eae-a949-560fd960203d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:50.014150 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1acaee3f-ecd4-49fc-8362-92c191c99b06 req-02778efd-5ff1-4eae-a949-560fd960203d service nova] Creating event network-vif-plugged:642a50fe-153c-4e4e-82bf-40d85d4ed091 for instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 on n-h1-833090-19 Sep 08 10:15:50.027351 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1acaee3f-ecd4-49fc-8362-92c191c99b06 req-02778efd-5ff1-4eae-a949-560fd960203d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041933 Sep 08 10:15:50.030477 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 273/597] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:50.037548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0bbadb11-6937-4bca-9e20-02a63b71ebc2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:50.038482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0bbadb11-6937-4bca-9e20-02a63b71ebc2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:50.139988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:50.157888 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5051a5b-fa89-4da7-83b5-69056e5a4882 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.412249 Sep 08 10:15:50.161792 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 325/598] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:49 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:50.177288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:50.191826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:50.213771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:50.214270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:50.217187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:50.218550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:50.223567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:50.224217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:50.293099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0bbadb11-6937-4bca-9e20-02a63b71ebc2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:50.303391 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0bbadb11-6937-4bca-9e20-02a63b71ebc2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1245 microversion: 2.1 time: 0.270331 Sep 08 10:15:50.306879 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 274/599] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:50 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1245 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:50.633378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:50.649134 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eeef718d-9322-4b72-bdd3-99358cb82e0b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.485867 Sep 08 10:15:50.651205 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 326/600] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:50 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:50.773812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:50.774421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:50.792563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:50.797512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:50.801906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:50.802872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:50.804204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:50.804829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.083734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:51.099942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:51.103554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:51.105325 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cd9cb962-4027-48b0-b9d4-8c708262b2db tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.335949 Sep 08 10:15:51.106662 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 275/601] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:50 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:51.115232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ba78f6f4-9f12-41c9-b6b8-89c6c9f282c5 req-f0fec949-f25e-4eff-b407-03b098f08e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32bd39-e3a8-4d12-bcb9-755de5068631", "tag": "55482318-61d3-45e3-b82f-fe0ec7626732"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:51.147799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba78f6f4-9f12-41c9-b6b8-89c6c9f282c5 req-f0fec949-f25e-4eff-b407-03b098f08e45 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.152857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba78f6f4-9f12-41c9-b6b8-89c6c9f282c5 req-f0fec949-f25e-4eff-b407-03b098f08e45 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.156145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba78f6f4-9f12-41c9-b6b8-89c6c9f282c5 req-f0fec949-f25e-4eff-b407-03b098f08e45 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.185612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ba78f6f4-9f12-41c9-b6b8-89c6c9f282c5 req-f0fec949-f25e-4eff-b407-03b098f08e45 service nova] Creating event network-changed:55482318-61d3-45e3-b82f-fe0ec7626732 for instance ea32bd39-e3a8-4d12-bcb9-755de5068631 on n-h2-833090-19 Sep 08 10:15:51.193031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:51.193731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:51.199017 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ba78f6f4-9f12-41c9-b6b8-89c6c9f282c5 req-f0fec949-f25e-4eff-b407-03b098f08e45 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099168 Sep 08 10:15:51.202212 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 327/602] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:15:51.204178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.205085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.207973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.209003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.209682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.211188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.335622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:51.336402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:51.345930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.346436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.346880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.351417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.351934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.355830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.536089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:51.552601 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d640e5e-2f0b-46c0-b8cf-7e7bfd6382c3 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1297 microversion: 2.1 time: 0.224913 Sep 08 10:15:51.575002 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 328/603] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:51 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1297 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:51.679843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:51.686644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:51.694469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.694945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.695605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.696471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:51.697083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:51.697804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:51.709971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:51.725963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9633ec15-c6db-4555-a0c7-f277abd662ab tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.537863 Sep 08 10:15:51.727060 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 276/604] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:51 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:52.140020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:52.141815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:52.157381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:52.162087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:52.162933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:52.163880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:52.164616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:52.165854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:52.448695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:52.458365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6fd2ca3f-e40c-4a6e-9271-1996eae4fd81 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1312 microversion: 2.1 time: 0.783428 Sep 08 10:15:52.458965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 329/605] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:51 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1312 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:52.640047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:52.641874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1873579989", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4a01de9c-22cd-443f-9615-bc8a1f2b2669"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:52.650809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:52.654491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:52.656466 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6cfb2ca0-4dab-412d-ba32-869ad1b3b478 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.525550 Sep 08 10:15:52.672439 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 277/606] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:52 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:52.683023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:52.683911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:52.690765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:52.691505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:52.692269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:52.693245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:52.693855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:52.694511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:52.759300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] validate_networks() for [('4a01de9c-22cd-443f-9615-bc8a1f2b2669', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:15:52.768838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:52.779977 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff3c6976-a2f8-4a1d-bc26-74e875f88c6b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1303 microversion: 2.1 time: 0.102520 Sep 08 10:15:52.781689 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 278/607] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:52 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:52.800995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:52.803648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:52.829391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:52.830434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:52.830434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:52.831251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:52.835413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:52.835978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.178489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:53.187653 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8a87a32-66c9-49eb-861e-6589a2ca3ad5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.404590 Sep 08 10:15:53.191778 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 279/608] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:52 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:53.411162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:15:53.411629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:15:53.412141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:15:53.412549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:15:53.413126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:15:53.422695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:53.423115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:53.423611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.424353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:53.424981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:53.425561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.457130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:15:53.464316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for user 46a59f79e24b4644a167dc0a4d2c4af9 and project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:15:53.481048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:15:53.483813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:15:53.488399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:53.489514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:53.498710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:53.499446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:53.501346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.502375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:53.502604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:53.503037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.571301 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9bccc80-758b-4950-ab20-e2a61900a60b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049505 Sep 08 10:15:53.579340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 330/609] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:15:53.593488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40d9e951-16d7-4459-9600-1a09fb3123a8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:53.594791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-40d9e951-16d7-4459-9600-1a09fb3123a8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:53.677565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-40d9e951-16d7-4459-9600-1a09fb3123a8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:53.687264 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-40d9e951-16d7-4459-9600-1a09fb3123a8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1211 microversion: 2.1 time: 0.104170 Sep 08 10:15:53.697264 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 331/610] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:53 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:53.730864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:53.751184 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f857497-113c-466b-806d-8bb7ce0fa4bb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1462 microversion: 2.1 time: 0.271611 Sep 08 10:15:53.764392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 280/611] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:53 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1462 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:53.778588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:53.779367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:53.787933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:53.788790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:53.792253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.793617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:53.794618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:53.797563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:53.832601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75f5e95d-852c-4ee7-b864-3817e4fe1130 tempest-FloatingIPDetailsNegativeTestJSON-460223267 tempest-FloatingIPDetailsNegativeTestJSON-460223267-project] Calling method '.version_select at 0x7f2351788790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:53.963288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-75f5e95d-852c-4ee7-b864-3817e4fe1130 tempest-FloatingIPDetailsNegativeTestJSON-460223267 tempest-FloatingIPDetailsNegativeTestJSON-460223267-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4910a462-64bd-45df-9153-6de51b455878 could not be found", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:15:53.964026 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-75f5e95d-852c-4ee7-b864-3817e4fe1130 tempest-FloatingIPDetailsNegativeTestJSON-460223267 tempest-FloatingIPDetailsNegativeTestJSON-460223267-project] HTTP exception thrown: Floating IP not found for ID 4910a462-64bd-45df-9153-6de51b455878 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75f5e95d-852c-4ee7-b864-3817e4fe1130 tempest-FloatingIPDetailsNegativeTestJSON-460223267 tempest-FloatingIPDetailsNegativeTestJSON-460223267-project] Request method failure captured: Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-floating-ips/4910a462-64bd-45df-9153-6de51b455878 HTTP/1.1 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDZ8kuHXGYEA86732JX7AUCHJhIVWq9eZCR4v4m3_ebKeM1yGmjeDUnpeQIXeDIs25tcDclLm9lQYMU53jMJ51LCBgfTI6644Vs2PY2EaetL9Gu41V9moiEMtcejFVjVhMaeXwf2i3fGo0jOWdsAC4KQCU1optyg2TKepRAXX9Dlu8 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 79e4908d023f4223a0be16db5065c299 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-460223267 Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:15:53.995057 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/79e4908d023f4223a0be16db5065c299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/79e4908d023f4223a0be16db5065c299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/79e4908d023f4223a0be16db5065c299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_79e4908d023f4223a0be16db5065c299", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-460223267 Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 79e4908d023f4223a0be16db5065c299 Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-460223267 Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-460223267-project Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 910c03d72431494c849b3fae0e107ba7 Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-460223267-project Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: exception: Floating IP not found for ID 4910a462-64bd-45df-9153-6de51b455878 Sep 08 10:15:53.996803 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '4910a462-64bd-45df-9153-6de51b455878'} Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:15:53.997657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4910a462-64bd-45df-9153-6de51b455878 could not be found Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71a48f74-e4d5-4f84-9762-20e905e00dd8'] Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4910a462-64bd-45df-9153-6de51b455878. Sep 08 10:15:53.999072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4910a462-64bd-45df-9153-6de51b455878 Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:15:54.001185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:15:54.002758 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:15:54.002758 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4910a462-64bd-45df-9153-6de51b455878 Sep 08 10:15:54.002758 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:15:54.004649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75f5e95d-852c-4ee7-b864-3817e4fe1130 tempest-FloatingIPDetailsNegativeTestJSON-460223267 tempest-FloatingIPDetailsNegativeTestJSON-460223267-project] Returning 404 to user: Floating IP not found for ID 4910a462-64bd-45df-9153-6de51b455878 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:15:54.006801 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-75f5e95d-852c-4ee7-b864-3817e4fe1130 tempest-FloatingIPDetailsNegativeTestJSON-460223267 tempest-FloatingIPDetailsNegativeTestJSON-460223267-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/4910a462-64bd-45df-9153-6de51b455878" status: 404 len: 111 microversion: 2.1 time: 0.306700 Sep 08 10:15:54.008484 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 332/612] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:15:53 2022] GET /compute/v2.1/os-floating-ips/4910a462-64bd-45df-9153-6de51b455878 => generated 111 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:15:54.033464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:54.054664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:54.056207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:54.057383 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f99ffdb8-2f77-47e9-a70e-895f7b9467f0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.291817 Sep 08 10:15:54.073362 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 281/613] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:53 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:54.096717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:54.097379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:54.114905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.116248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.116683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.125820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.126316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.126764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.325036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:54.339007 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e9168fe-029a-4e70-881d-8bc7319240dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1303 microversion: 2.1 time: 0.261505 Sep 08 10:15:54.356088 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 282/614] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:54 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1303 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:54.361600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:54.362224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:54.365764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:54.366783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:54.369275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.370434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.371027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.372231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.372857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.373434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.376358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.376891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.377423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.378184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.380785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.381805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.662225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:54.677033 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28d5fd10-33fc-44d1-88a4-98c8a191bab5 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.319723 Sep 08 10:15:54.679643 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 283/615] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:54 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:54.714471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:54.715705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:54.723104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.724020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.724620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.725900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:54.727594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:54.728601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:54.850452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:54.871701 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01a6bbd9-c506-4d81-a3b7-2e343be037af tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1263 microversion: 2.1 time: 0.162086 Sep 08 10:15:54.891769 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 284/616] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:54 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:54.962461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-869e0638-84f3-4e3b-a5c4-e2f8f1e39bcb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1615 microversion: 2.1 time: 0.946603 Sep 08 10:15:54.965549 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 333/617] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:54 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1615 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:54.991249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:15:54.992195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:55.008020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.008526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.008967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.009680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.010139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.010563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.084712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:55.085331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:55.091085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '618a90a225464fd7a022f255ba971864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2517430e01d84442acc0384598fb5e63', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:55.091698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] flavor_id is None. Assuming migration. {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 10:15:55.092439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.092938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.094233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.095137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.095796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.096607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:15:55.100882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.285064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:55.294327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:55.295862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:55.297210 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de4043df-587a-45fd-9995-26b36825732b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.216939 Sep 08 10:15:55.298276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 334/618] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:55 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:55.319125 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-082e1050-448d-4e7f-8bba-45fa0379f96c tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5/action" status: 202 len: 0 microversion: 2.1 time: 0.331109 Sep 08 10:15:55.321172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 285/619] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:15:54 2022] POST /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:15:55.330588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:55.331546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:55.339775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.340561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.341158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.342057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.343318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.344688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.362558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:55.364371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:55.375266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.377666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.378286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.380746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.381382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.383074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.784797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:55.809143 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-edbe6f07-99e0-4e85-a38c-604268bcb223 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.478673 Sep 08 10:15:55.813156 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 335/620] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:55 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:55.832751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:55.834797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:55.856962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.857824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.859413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:55.862191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:55.862926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:55.865222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:56.397331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:56.407055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a3a03679-db96-40c1-b00c-48138fd7f7a8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1303 microversion: 2.1 time: 1.048757 Sep 08 10:15:56.412738 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 286/621] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:55 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1303 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:15:56.425883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:56.426498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:56.441410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:56.442099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:56.442699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:56.443633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:56.444254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:56.444846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:56.697050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:56.718496 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8eaea4cc-7c2a-4c47-aad5-426a1f73811a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1269 microversion: 2.1 time: 0.304169 Sep 08 10:15:56.737047 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 287/622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:56 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1269 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:56.742997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:56.744028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:56.757193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:56.760104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:56.760554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:56.761785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:56.763754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:56.764366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:57.064704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:57.088550 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a4fdd72-c802-4611-a122-7d9a0cbbe0fb tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 1.269788 Sep 08 10:15:57.089532 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 336/623] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:55 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:57.108382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:57.110079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:57.136665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:57.137356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:57.140751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:57.141653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:57.144411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:57.146853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:58.297703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:58.302091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:58.324499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:58.326154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:58.327318 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-359ade2b-a03f-4bcc-8996-49ceb200a2c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 1.588808 Sep 08 10:15:58.331806 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 288/624] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:56 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:15:58.337460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:58.346214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:58.377597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:58.380194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:58.381312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:58.384306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:58.384980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:58.386272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:58.821409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:58.831876 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cf72a4f8-de6c-4c98-a09d-2be883a83907 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1303 microversion: 2.1 time: 0.498617 Sep 08 10:15:58.853788 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 289/625] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:58 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1303 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:58.863168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:58.873059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:58.909142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:58.909798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:58.910418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:58.918120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:58.918851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:58.920506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:58.939688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:58.953220 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-571aca25-9e91-44a1-a658-805cb0c2fc43 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 1.854645 Sep 08 10:15:58.979760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 337/626] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:57 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:58.992862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:58.993996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:59.000742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:59.003046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:59.003823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:59.004430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:59.005489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:59.006166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:59.007202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:59.858552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:59.869740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:15:59.871504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d832487b-f5f7-45b8-b460-151ba197d43c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 1.012155 Sep 08 10:15:59.872961 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 290/627] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:58 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:59.882409 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-875819eb-7c1d-437a-88fd-21c2a4e01bee tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.900121 Sep 08 10:15:59.887781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:59.889662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:59.892085 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 338/628] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:58 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:15:59.909031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:15:59.909809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:15:59.920189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:15:59.925464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:59.927722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:59.928181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:59.928349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:59.928650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:59.928965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:59.929812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:59.930732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:15:59.932535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:59.933946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:15:59.934555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:15:59.935157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:00.164169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:00.186872 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3579c187-5b18-43cf-884c-e0b150392a46 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1303 microversion: 2.1 time: 0.286546 Sep 08 10:16:00.188833 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 339/629] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:15:59 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1303 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:00.195031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:00.196818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:00.209538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:00.210038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:00.213906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:00.214994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:00.220260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:00.230923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:00.307234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:00.349332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:00.388413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:00.403713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:00.424941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:00.426305 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e10c8bb6-170a-46f5-9dd0-bef0dc2ba5de tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.552177 Sep 08 10:16:00.454453 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 291/630] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:15:59 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:00.880630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:00.903150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:00.904768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:00.908494 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b50a776e-baeb-4366-8f6c-0e6eaaf54f4c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.718359 Sep 08 10:16:00.919774 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 340/631] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:00 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:00.924717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:00.926252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:00.931410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:00.932308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:00.933252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:00.934304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:00.935913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:00.936518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:00.977246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:00.977772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:00.978222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:00.978953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:00.988063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:00.989560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:01.799573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:01.818260 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c9e4588-fc1f-4061-9ee0-7355d2af7a0d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.920805 Sep 08 10:16:01.818873 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 292/632] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:00 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:01.840627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:01.841536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:01.861700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:01.862439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:01.862979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:01.864171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:01.864719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:01.865206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:01.994570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:02.012785 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-454408fc-79a6-4a77-b7a5-ff4b53f8e195 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 1.092425 Sep 08 10:16:02.023619 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 341/633] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:00 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:02.029752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-38868645-ec4d-4f33-a834-c3f46b806d11 req-d4580411-d774-4aae-b705-35f537a72712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32bd39-e3a8-4d12-bcb9-755de5068631", "name": "network-vif-plugged", "status": "completed", "tag": "55482318-61d3-45e3-b82f-fe0ec7626732"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:02.056621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-38868645-ec4d-4f33-a834-c3f46b806d11 req-d4580411-d774-4aae-b705-35f537a72712 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.057297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-38868645-ec4d-4f33-a834-c3f46b806d11 req-d4580411-d774-4aae-b705-35f537a72712 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.057903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-38868645-ec4d-4f33-a834-c3f46b806d11 req-d4580411-d774-4aae-b705-35f537a72712 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.098858 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-38868645-ec4d-4f33-a834-c3f46b806d11 req-d4580411-d774-4aae-b705-35f537a72712 service nova] Creating event network-vif-plugged:55482318-61d3-45e3-b82f-fe0ec7626732 for instance ea32bd39-e3a8-4d12-bcb9-755de5068631 on n-h2-833090-19 Sep 08 10:16:02.108317 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-38868645-ec4d-4f33-a834-c3f46b806d11 req-d4580411-d774-4aae-b705-35f537a72712 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082820 Sep 08 10:16:02.125067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 342/634] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:02.137541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:02.138474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:02.148193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.148680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.149572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.155537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.155860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:02.158600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.158877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.170288 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-202ed6d0-9bb9-4300-9ee3-8a14e4518d47 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.333420 Sep 08 10:16:02.172054 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 293/635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:01 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:02.178194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:02.179025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:02.191586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.192376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.192966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.193908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.194520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.195239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.726638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:02.734900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:02.741516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:02.743488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:02.745002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ddea74b3-7c71-4ea0-87f4-df7206e8d599 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.618221 Sep 08 10:16:02.745137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c2c7b27-c4a9-433f-b900-6df950bcc83c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.571610 Sep 08 10:16:02.745638 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 294/636] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:02 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:02.746410 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 343/637] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:02 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:02.768889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c6dcedaa-0ab4-4581-8794-0b0819bd9eb7 req-c29f70fb-0d74-4d3e-b6e0-4eb187af8806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc06ff9-6688-4171-829f-608b36008d7c", "tag": "ef6e6845-4aee-4922-9016-5f3098f1a1f7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:02.779659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6dcedaa-0ab4-4581-8794-0b0819bd9eb7 req-c29f70fb-0d74-4d3e-b6e0-4eb187af8806 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.781005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6dcedaa-0ab4-4581-8794-0b0819bd9eb7 req-c29f70fb-0d74-4d3e-b6e0-4eb187af8806 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.781669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6dcedaa-0ab4-4581-8794-0b0819bd9eb7 req-c29f70fb-0d74-4d3e-b6e0-4eb187af8806 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.793823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c6dcedaa-0ab4-4581-8794-0b0819bd9eb7 req-c29f70fb-0d74-4d3e-b6e0-4eb187af8806 service nova] Creating event network-changed:ef6e6845-4aee-4922-9016-5f3098f1a1f7 for instance 7dc06ff9-6688-4171-829f-608b36008d7c on n-h1-833090-19 Sep 08 10:16:02.800682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c6dcedaa-0ab4-4581-8794-0b0819bd9eb7 req-c29f70fb-0d74-4d3e-b6e0-4eb187af8806 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042151 Sep 08 10:16:02.801979 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 295/638] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:02.845404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:02.846596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:02.855401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.856709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.857347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:02.858255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:02.859809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:02.860455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.049579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:03.050302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:03.074479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.075178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.075705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.076748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.077260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.077655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.105916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:03.117415 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8a49e53-2d52-473f-a57c-ab94a66bf171 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.278831 Sep 08 10:16:03.124249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 344/639] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:02 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:03.209694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:03.211083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:03.235995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.239843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.240387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.241144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.243596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.244406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.333475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:03.344736 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8fbc3332-bd2d-4f01-a467-f6f8f3c7bda6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.299115 Sep 08 10:16:03.357016 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 296/640] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:03 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:03.436258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:03.461463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:03.470792 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-353dd6e8-c225-4557-b9fb-de0e394d20d1 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.270133 Sep 08 10:16:03.471704 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 345/641] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:03 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:03.777080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:03.779010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:03.779922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:03.781231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:03.786492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:03.792301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.792793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.793235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.793950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.794406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.794831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.802662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.803160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.803627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:03.804341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:03.804965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:03.805546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.123339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:04.138714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:04.140140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:04.141129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:04.142591 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b48fd61-e164-4cf3-8604-31285bf88513 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.370139 Sep 08 10:16:04.149504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c1347a4-e2a8-4615-b809-667b3723cf0e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.381395 Sep 08 10:16:04.153482 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 297/642] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:03 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:04.156554 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 346/643] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:03 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:04.166053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:04.166907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:04.182275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:04.184117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:04.188571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.189459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:04.190180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:04.190759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.370465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:04.371440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:04.395300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:04.406699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:04.407156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.407945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:04.410776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:04.411221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.466645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:04.480005 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-71a27f70-33ae-4b4c-8097-260e65c7d836 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.321891 Sep 08 10:16:04.480875 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 298/644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:04 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:04.517088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:04.518532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:04.531765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:04.543152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:04.543893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.544756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:04.546658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:04.547415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:04.865975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:04.877738 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7c798b3-d83c-41da-91c1-e0ecad634cbd tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.511500 Sep 08 10:16:04.878592 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 347/645] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:04 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:04.997740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:05.033849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97187b55-ec08-4245-a7b9-870771fb6eb0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.526546 Sep 08 10:16:05.036096 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 299/646] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:04 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:05.170126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:05.171683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:05.185890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:05.186957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:05.208316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.215906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.216635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.217258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.218735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.219741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.220381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.221029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.221645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.223677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.226189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.228624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.700062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:05.712498 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31d01706-0af7-405a-84d7-ae89e0ce6c87 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.539151 Sep 08 10:16:05.717456 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 300/647] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:05 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:05.719136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:05.731667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:05.733685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:05.744442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:05.745891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:05.748832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3524b424-bef5-4b26-8f5e-15cbda3a1fa6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.581077 Sep 08 10:16:05.752244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.753027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.754444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.756589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.757999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.759703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.768319 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 348/648] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:05 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:05.902604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:05.903759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:05.916386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.920175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.921434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:05.922373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:05.923058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:05.923935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:06.331822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:06.355287 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2933166a-33d7-40bc-908b-f76bef06f0e6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.634992 Sep 08 10:16:06.355838 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 301/649] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:05 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:06.361519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:06.362379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:06.384103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:06.387852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:06.388386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:06.399450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:06.400585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:06.401207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:06.401766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:06.477259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:06.491403 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb63fa8b-0465-4b63-a001-4ae93ce2745c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.592650 Sep 08 10:16:06.492040 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 349/650] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:05 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:06.635068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:06.646785 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e83e941-dacf-4df8-942e-5b91b867e001 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.289527 Sep 08 10:16:06.649017 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 302/651] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:06 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:06.743236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:06.744556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:06.751004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:06.751984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:06.752671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:06.753498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:06.754320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:06.754979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:06.791330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:06.792182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:06.799140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:06.799675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:06.800111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:06.800874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:06.801270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:06.801691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.023888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.025051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.036121 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-674f3ea4-31f6-40ab-88de-58fc88c415c9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.296813 Sep 08 10:16:07.036876 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 350/652] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:06 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:07.052108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.054387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.055804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ba15c01-eed9-44f3-ad0c-34f3df9c7c9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.275761 Sep 08 10:16:07.057049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 303/653] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:06 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:07.385371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:07.386301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:07.395389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:07.395928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:07.396579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.397478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:07.398418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:07.398869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.516698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:07.517325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:07.531408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:07.532180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:07.533232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.533963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:07.534427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:07.534861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.656630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.666638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e73fea05-272d-4bde-b781-2c11ef0e953f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.286164 Sep 08 10:16:07.667557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 351/654] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:07 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:07.672489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:07.673102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:07.684466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:07.686865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:07.687342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.688287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:07.688914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:07.689502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:07.827074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.837064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2cc232d-1abb-43c1-b4ee-be276308aec2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.325247 Sep 08 10:16:07.848121 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 304/655] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:07 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:07.951592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:07.960307 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f394d5c9-369c-4fb3-aa29-620030ed8d05 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.291549 Sep 08 10:16:07.961227 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 352/656] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:07 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:08.061954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:08.062846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:08.069129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.069617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.070046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.070747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.071194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.071640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.087668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:08.088291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:08.096283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.097046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.097682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.098569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.099191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.099920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.575291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:08.584361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:08.585584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:08.588783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:08.590062 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14b67031-3595-4ab4-9365-05f851d3da52 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.507805 Sep 08 10:16:08.591919 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 353/657] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:08 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:08.596477 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-19eaa026-0811-4aa4-90be-9c56329fa266 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.538947 Sep 08 10:16:08.597333 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 305/658] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:08 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:08.690971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:08.691494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:08.698520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.699151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.700024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.700925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.707687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.708281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.870417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:08.871027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:08.877313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.878175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.878986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.879945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:08.880970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:08.881604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:08.895563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:09.060862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:09.071532 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efd14472-dc27-4c24-965b-8c60c3e1d677 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.384730 Sep 08 10:16:09.072754 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 354/659] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:08 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:09.078178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:09.079254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:09.087445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.088305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.088810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:09.089732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.090275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.090775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:09.190190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:09.198259 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1cc4c4c3-df0a-4f4e-b9a8-187ecd871e71 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.331849 Sep 08 10:16:09.199111 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 306/660] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:08 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:09.306574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:09.321913 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc4ce350-b643-431c-9184-ee870957c375 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.247788 Sep 08 10:16:09.322628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 355/661] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:09 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:09.542706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9e563d59-4246-49d0-9f0f-9a18b77da22a req-8399d27d-632f-435f-b591-7160ee043b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc06ff9-6688-4171-829f-608b36008d7c", "name": "network-vif-plugged", "status": "completed", "tag": "ef6e6845-4aee-4922-9016-5f3098f1a1f7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:09.555931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9e563d59-4246-49d0-9f0f-9a18b77da22a req-8399d27d-632f-435f-b591-7160ee043b9d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.556692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9e563d59-4246-49d0-9f0f-9a18b77da22a req-8399d27d-632f-435f-b591-7160ee043b9d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.557117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9e563d59-4246-49d0-9f0f-9a18b77da22a req-8399d27d-632f-435f-b591-7160ee043b9d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:09.590656 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9e563d59-4246-49d0-9f0f-9a18b77da22a req-8399d27d-632f-435f-b591-7160ee043b9d service nova] Creating event network-vif-plugged:ef6e6845-4aee-4922-9016-5f3098f1a1f7 for instance 7dc06ff9-6688-4171-829f-608b36008d7c on n-h1-833090-19 Sep 08 10:16:09.597186 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9e563d59-4246-49d0-9f0f-9a18b77da22a req-8399d27d-632f-435f-b591-7160ee043b9d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061538 Sep 08 10:16:09.598972 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 307/662] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:09.621902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:09.626039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:09.627006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:09.634196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:09.650045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.650747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.651255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.651726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:09.652386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.653524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.653980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.654411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:09.658821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:09.659797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:09.660422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:09.661035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.078177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.081790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.087753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.089215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.089722 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c87f7959-da60-479f-8330-3c3f02681e65 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.472060 Sep 08 10:16:10.090310 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 308/663] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:09 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:10.090432 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f2dff29f-6740-486e-b1da-b00ac9cdb685 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.477476 Sep 08 10:16:10.091353 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 356/664] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:09 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:10.095590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:10.096412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:10.102770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:10.103491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:10.104185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.105151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:10.105768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:10.106528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.223102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:10.224146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:10.232591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:10.233759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:10.234296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.235084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:10.235648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:10.236147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.256372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:10.266413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.274692 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6fb2ba83-9517-4af9-b97c-4d0c5b6d4289 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1311 microversion: 2.1 time: 0.182864 Sep 08 10:16:10.275280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 309/665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:10 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:10.402561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.411571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1874284720", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "1fc268cd-ae55-4256-b9c7-92d5b594854f"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:10.411709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b65a446-a63e-45d1-bd47-b782b02f15f6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.193712 Sep 08 10:16:10.412554 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 357/666] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:10 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:10.418544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:10.419995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:10.427542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:10.428298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:10.429523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.430476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:10.431138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:10.431809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:10.595255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] validate_networks() for [('1fc268cd-ae55-4256-b9c7-92d5b594854f', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:16:10.835748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:10.848080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-568e10a4-aed6-41fa-a5e2-e09e2f15d081 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.433815 Sep 08 10:16:10.859107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 358/667] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:10 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:11.115539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:11.116264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:11.122552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.123040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.124096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.125002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.125459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.126075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.774982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:11.789796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:16:11.793454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:16:11.793454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:16:11.793454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:16:11.793454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:16:11.799666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99be32e6-6a5b-4a7c-ba99-522d8be8c31d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1471 microversion: 2.1 time: 0.688969 Sep 08 10:16:11.802906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 359/668] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:11 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1471 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:11.804072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.804853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.806874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.807718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.808189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.808621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.812655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:11.813642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:11.822128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.823092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.823826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.824857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.825717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.826374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.831729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:11.836933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for user 1c08994220f44d5db166b899e80c2a12 and project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:11.870010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:16:11.872650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:16:11.940135 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0dba3eb9-e0b3-4a1d-a7d5-c4d51e39418e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.663739 Sep 08 10:16:11.941151 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 310/669] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:16:11.948816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:11.954176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:11.962699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.963565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.964228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:11.965152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:11.965817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:11.966462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.198911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:12.220888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:12.222352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:12.223501 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5c733f94-b374-42b1-9670-ae41c23a84b5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1362 microversion: 2.25 time: 0.418673 Sep 08 10:16:12.239135 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 360/670] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:11 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:12.239135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:12.239135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:12.239135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.239135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.241951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.241951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.241951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.241951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.386021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:12.394447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04d3f794-d9d7-4c61-80c4-a51c3e40ca4c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1493 microversion: 2.1 time: 0.452090 Sep 08 10:16:12.395045 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 311/671] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:11 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1493 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:12.411592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:12.412238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:12.425770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.426108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.426550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.427559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.428022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.428399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.788036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:12.801070 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-729e2560-8380-4016-bc4a-da4420cfe135 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.575458 Sep 08 10:16:12.802931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 361/672] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:12 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:12.809749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:12.811371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:12.819987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.820887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.822269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.824269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.825675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.827077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.864359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:12.893198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a6f39220-3a46-4f7a-a944-b8ed32b44665 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.496896 Sep 08 10:16:12.899500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 312/673] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:12 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:12.907607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c168408f-c800-4f77-b05a-ec206bcf3c7c req-e975b080-862f-41f6-8804-e2cc46e541ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f135a161-48ff-4d0e-b00c-41bf24ba6240", "tag": "f0b3fee2-3af1-471a-b848-b24d91841bac"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:12.932988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c168408f-c800-4f77-b05a-ec206bcf3c7c req-e975b080-862f-41f6-8804-e2cc46e541ab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:12.933496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c168408f-c800-4f77-b05a-ec206bcf3c7c req-e975b080-862f-41f6-8804-e2cc46e541ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:12.934033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c168408f-c800-4f77-b05a-ec206bcf3c7c req-e975b080-862f-41f6-8804-e2cc46e541ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:12.962661 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c168408f-c800-4f77-b05a-ec206bcf3c7c req-e975b080-862f-41f6-8804-e2cc46e541ab service nova] Creating event network-changed:f0b3fee2-3af1-471a-b848-b24d91841bac for instance f135a161-48ff-4d0e-b00c-41bf24ba6240 on n-h2-833090-19 Sep 08 10:16:12.979539 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c168408f-c800-4f77-b05a-ec206bcf3c7c req-e975b080-862f-41f6-8804-e2cc46e541ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079314 Sep 08 10:16:12.980814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 313/674] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:13.014303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:13.030157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29bd929d-3572-4f6b-9d27-7d5832b9800e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1204 microversion: 2.1 time: 0.223316 Sep 08 10:16:13.032947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 362/675] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:12 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1204 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:13.050644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.062698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.078490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.079060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.079535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.080273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.080774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.081331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.172298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.173088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.184107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.184719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.185213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.186445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.187102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.187820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.372137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:13.380869 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83d35967-faec-4162-a6f5-263c5445311c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.346841 Sep 08 10:16:13.381577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 363/676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:13 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:13.386612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.387311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.404504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.405506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.405950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.406678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.407131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.407800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.450517 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-912d3355-310e-421b-aa78-806592e42ddb tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1646 microversion: 2.1 time: 0.465151 Sep 08 10:16:13.451130 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 314/677] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:12 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1646 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:13.474821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.475930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.486270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.487060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.487724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.488942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.489665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.490290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.600687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:13.609805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:13.612348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:13.614747 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-71ab19d8-de32-4d26-8884-b7545161cc20 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1558 microversion: 2.25 time: 0.231913 Sep 08 10:16:13.615935 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 364/678] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:13 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:13.643328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.644226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.651268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.651851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.652290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.653005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.653478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.653930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.703954 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1db94fcd-be7d-4c09-824f-dacd935bc2bc tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1646 microversion: 2.1 time: 0.232986 Sep 08 10:16:13.706875 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 315/679] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:13 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1646 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:13.735162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.740389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.740892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.741529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.742443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.743084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.743553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.780370 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea72e3ad-596e-49b9-bc96-8ec21c56460e tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.052264 Sep 08 10:16:13.782447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 316/680] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:16:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:13.803196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-19", "block_migration": true, "disk_over_commit": false}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:13.806026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.813292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.813878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.814384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.815174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.815854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.816354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.846975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lazy-loading 'flavor' on Instance uuid 7dc06ff9-6688-4171-829f-608b36008d7c {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:13.861881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Going to try to live migrate instance to n-h2-833090-19 {{(pid=122456) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:16:13.914128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:13.931562 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0ab4a05-dafc-40e5-a9f6-43bb1d23a5da tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 2053 microversion: 2.25 time: 0.292335 Sep 08 10:16:13.932856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 365/681] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:13 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 2053 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:13.937965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:13.939011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:13.945806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.946626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.947377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:13.948465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:13.949150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:13.949716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:14.145344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:14.155141 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f374325-01d9-47dd-a54c-89e26a3ae599 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.220763 Sep 08 10:16:14.156089 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 366/682] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:13 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:14.161620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:14.162649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:14.172905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:14.175657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:14.176339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:14.177261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:14.177862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:14.178302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:14.437176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:14.463796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-871991ba-b7d3-449b-a645-e011e2caa653 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.295356 Sep 08 10:16:14.464741 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 367/683] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:14 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:14.472411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:14.473379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:14.482473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:14.495715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:14.496428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:14.497295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:14.499383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:14.500103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:14.900829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:14.915262 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f35d99a6-dc85-4118-b8a3-878db049eb27 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 2053 microversion: 2.25 time: 0.449349 Sep 08 10:16:14.915883 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 368/684] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:14 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 2053 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:14.921044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:14.921647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:14.927494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:14.927989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:14.928429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:14.929123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:14.929578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:14.930008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.109863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:15.118229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4ce49d1-a75b-4afa-a9f4-6b453b01b7f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.201230 Sep 08 10:16:15.118818 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 369/685] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:14 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:15.124288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:15.125058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:15.132008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.132658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.133220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.134202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.135035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.135717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.273025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:15.280942 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7852eb9-1fda-4d25-b60e-d4e365c10421 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.160713 Sep 08 10:16:15.281525 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 370/686] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:15 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:15.285849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:15.289660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.290087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.290530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.291268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.291764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.292181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.322554 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-157ac702-585e-4bdf-8ff9-3ce990977424 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.039588 Sep 08 10:16:15.323320 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 371/687] 10.222.0.59 () {60 vars in 1217 bytes} [Thu Sep 8 10:16:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:16:15.328980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:15.330120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:15.336425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.336951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.337354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.338054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.338511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.338939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.467886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:15.476119 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b06a56e2-fe1a-422a-9bdd-6c423f46ab43 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1472 microversion: 2.1 time: 0.151784 Sep 08 10:16:15.476700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 372/688] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:15 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:15.481603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:15.482143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:15.488915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.489412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.489850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.490543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.491000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.491427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.527648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:15.558202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48e2f226-14ee-4742-9093-e7cb8b72a46d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631/action" status: 202 len: 0 microversion: 2.25 time: 0.080260 Sep 08 10:16:15.562190 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 373/689] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:16:15 2022] POST /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:15.564785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:15.565481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:15.571669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.572154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.572591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.573282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.573733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.574158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.706198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:15.714476 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5df4068e-34e1-4fd9-87c7-c091de6a0176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.154305 Sep 08 10:16:15.719612 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 374/690] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:15 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:15.723853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:15.724479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:15.731199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.731753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.732273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.733095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:15.733555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:15.734096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:15.985732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:16.002683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-740f67fd-107f-4c1b-91d2-c54c13211fb7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 2058 microversion: 2.25 time: 0.286415 Sep 08 10:16:16.004228 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 375/691] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:15 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 2058 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:16.144589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:16.145245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:16.151513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.152010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.152455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.153202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.153683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.154666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.400364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:16.409764 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03d36cff-ac0d-40b3-a320-5fae5ebff29b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.269073 Sep 08 10:16:16.410637 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 376/692] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:16 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:16.415035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:16.415676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:16.422050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.422538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.422972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.423704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.424163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.424593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.635234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:16.643886 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dddb3607-1ae6-444f-b74b-9c1a346a1dce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.232303 Sep 08 10:16:16.647518 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 377/693] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:16 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:16.649007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:16.649601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:16.657833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.658442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.658885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.659616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.660098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.660551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.796573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:16.804538 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99db2dd7-b364-4ea2-96b2-7ef66a192fae tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1478 microversion: 2.1 time: 0.159123 Sep 08 10:16:16.805112 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 378/694] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:16 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:16.809882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9caf0876-e2ed-458c-8323-9c47b879dd67 req-f0e5cf94-61cd-48fe-beb2-a730fb8a8f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c8cba7f-a173-4f5a-bb60-0732504ddf03", "tag": "7cf4a2fc-044c-4c08-87b6-e7915bff99d4"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:16.819382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9caf0876-e2ed-458c-8323-9c47b879dd67 req-f0e5cf94-61cd-48fe-beb2-a730fb8a8f1f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.819913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9caf0876-e2ed-458c-8323-9c47b879dd67 req-f0e5cf94-61cd-48fe-beb2-a730fb8a8f1f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.820346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9caf0876-e2ed-458c-8323-9c47b879dd67 req-f0e5cf94-61cd-48fe-beb2-a730fb8a8f1f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.831121 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9caf0876-e2ed-458c-8323-9c47b879dd67 req-f0e5cf94-61cd-48fe-beb2-a730fb8a8f1f service nova] Creating event network-changed:7cf4a2fc-044c-4c08-87b6-e7915bff99d4 for instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 on n-h1-833090-19 Sep 08 10:16:16.836027 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9caf0876-e2ed-458c-8323-9c47b879dd67 req-f0e5cf94-61cd-48fe-beb2-a730fb8a8f1f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029766 Sep 08 10:16:16.836636 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 379/695] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:16.842208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:16.842898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:16.849200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.849740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.850124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:16.850814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:16.851276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:16.851722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.046758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:17.056179 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61296f84-4692-450c-bf37-d56abcbc2998 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.218233 Sep 08 10:16:17.072675 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 380/696] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:16 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:17.077407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:17.078033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:17.084290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.084766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.085373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.086080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.086814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.086957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.228941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:17.253484 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b98aca5-2fab-437e-a4c9-91bde389793d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 2058 microversion: 2.25 time: 0.179709 Sep 08 10:16:17.254409 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 381/697] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:17 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 2058 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:17.438235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:17.438846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:17.446265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.446748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.447198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.447937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.448392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.448801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.666513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:17.676512 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15feca37-db1f-485d-b882-1960337f13fd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.242724 Sep 08 10:16:17.677108 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 382/698] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:17 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:17.682208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:17.683046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:17.690586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.691277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.691811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.692500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.693103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.693709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.844306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:17.852306 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76013e9a-606a-49c6-b41e-7379e090a7fc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.174022 Sep 08 10:16:17.853090 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 383/699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:17 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:17.859421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:17.860067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:17.866272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.866899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.867344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:17.868083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:17.868561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:17.868996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.002081 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-175980ca-07da-4c07-ba31-1ca19c9d9723 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c/action" status: 202 len: 0 microversion: 2.1 time: 4.203502 Sep 08 10:16:18.003351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 317/700] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:13 2022] POST /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c/action => generated 0 bytes in 4207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:16:18.004905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:18.011845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:18.012463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:18.012774 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2bdb84be-782d-44fb-9456-63b3af15dfba tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1478 microversion: 2.1 time: 0.158915 Sep 08 10:16:18.013387 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 384/701] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:17 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:18.019256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.019787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.020232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.020933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.021393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.021812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.079577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:18.080196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:18.086286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.086775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.087219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.087968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.088424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.088851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.192679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:18.203341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ae1bc4ee-ea9f-428e-8983-4b9e4fefa9cf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.195502 Sep 08 10:16:18.204059 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 318/702] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:18 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:18.254898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:18.264607 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-373ebbd2-f074-49b0-a646-8d4e7459f1b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.188941 Sep 08 10:16:18.265203 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 385/703] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:18 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:18.281750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:18.282420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:18.288939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.289440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.290088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.290787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.291253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.291740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.430856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:18.443581 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2cda0e98-1c3c-41b3-86d3-1cc2f4265f76 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 2038 microversion: 2.25 time: 0.166952 Sep 08 10:16:18.444158 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 319/704] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:18 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 2038 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:18.469131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-19", "block_migration": "auto"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:18.471599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:18.477585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.478066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.478503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.479193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.479679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.480103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.504048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'flavor' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:18.516746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Going to try to live migrate instance to n-h1-833090-19 {{(pid=122457) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:16:18.526589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:18.703423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:18.704357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:18.711014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.711568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.712282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.713239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.713761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.714414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.938874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:18.952659 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5478adb2-60da-4451-ab95-dc5de44ba631 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.252275 Sep 08 10:16:18.953797 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 320/705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:18 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:18.958564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:18.959328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:18.967106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.967839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.968413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:18.969789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:18.970552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:18.971140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.218551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:19.232307 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a77e8a9-8848-4fad-afc1-4cef04865886 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.277274 Sep 08 10:16:19.232986 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 321/706] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:18 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:19.240154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:19.241000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:19.247354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:19.248195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:19.248989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.250040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:19.250567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:19.251059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.486550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:19.500641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c9a8222-305c-4530-ada5-ecfcc32253e2 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1463 microversion: 2.1 time: 0.264580 Sep 08 10:16:19.501896 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 322/707] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:19 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:19.511578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:19.513143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:19.525040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:19.526648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:19.527806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.529590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:19.530816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:19.532112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.542905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:19.723133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:19.732668 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d7234f3-9f18-4955-b695-685fd380971a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.228411 Sep 08 10:16:19.733457 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 323/708] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:19 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:19.746099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:19.747002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:19.753932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:19.754455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:19.754899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.755646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:19.756106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:19.756537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:19.978514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:19.986472 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2c50afcd-ed39-4cfa-af59-66280a8b4b15 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.252113 Sep 08 10:16:19.986983 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 324/709] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:19 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:19.991940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:19.994363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:20.000497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.000995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.001436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.002245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.002721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.003166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.152713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a36c3a9b-57d6-4649-b8ba-1c69c61da328 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 0 microversion: 2.1 time: 0.164566 Sep 08 10:16:20.156552 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 325/710] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:19 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:16:20.164679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:20.165299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:20.205315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.205744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.206185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.206904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.207923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.207923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.518129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:20.526362 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9cbf383-5c57-4191-ad5c-59333bada2eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.367219 Sep 08 10:16:20.527017 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 326/711] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:20 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:20.535771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-57c74e47-ba54-4536-a888-8e42f3f17c6f req-7db440cf-ba5f-40cb-ba3d-bbadb88cf8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc06ff9-6688-4171-829f-608b36008d7c", "name": "network-vif-unplugged", "status": "completed", "tag": "ef6e6845-4aee-4922-9016-5f3098f1a1f7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:20.559453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-57c74e47-ba54-4536-a888-8e42f3f17c6f req-7db440cf-ba5f-40cb-ba3d-bbadb88cf8f7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.560202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-57c74e47-ba54-4536-a888-8e42f3f17c6f req-7db440cf-ba5f-40cb-ba3d-bbadb88cf8f7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.560826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-57c74e47-ba54-4536-a888-8e42f3f17c6f req-7db440cf-ba5f-40cb-ba3d-bbadb88cf8f7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.572754 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-57c74e47-ba54-4536-a888-8e42f3f17c6f req-7db440cf-ba5f-40cb-ba3d-bbadb88cf8f7 service nova] Creating event network-vif-unplugged:ef6e6845-4aee-4922-9016-5f3098f1a1f7 for instance 7dc06ff9-6688-4171-829f-608b36008d7c on n-h1-833090-19 Sep 08 10:16:20.579775 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-57c74e47-ba54-4536-a888-8e42f3f17c6f req-7db440cf-ba5f-40cb-ba3d-bbadb88cf8f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047727 Sep 08 10:16:20.581549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 327/712] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:20.588238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:20.589030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:20.608489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.609055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.609501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.610233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.610714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.611582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.655383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:20.656102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:20.656686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:20.657138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lazy-loading 'fault' on Instance uuid f2d242c4-0703-440b-a09e-e0b93a5dd086 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:21.151939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0b7f9d6-9e18-4497-863e-485e271cd134 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1599 microversion: 2.1 time: 0.567292 Sep 08 10:16:21.165379 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 328/713] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:20 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1599 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:21.172081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:21.172904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:21.183376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.184389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.185177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.187239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.187966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.188996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.423450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:21.432869 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-185b5010-ece3-4f1d-b0fc-6addeccafade tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.266133 Sep 08 10:16:21.434255 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 329/714] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:21 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:21.440960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:21.441730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:21.447760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.448308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.448903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.449764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.450217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.450640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.513495 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f02ddd86-b85a-4d25-bd40-d5f70311c4dd tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631/action" status: 202 len: 0 microversion: 2.25 time: 3.048738 Sep 08 10:16:21.514825 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 386/715] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:16:18 2022] POST /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631/action => generated 0 bytes in 3051 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:21.520640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:21.522382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:21.534105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.535329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.536052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.537014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.537719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.538516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.695784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:21.706363 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-edc4936b-afd2-40fa-a9d1-85f53b7412b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.270827 Sep 08 10:16:21.706952 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 330/716] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:21 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:21.712063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:21.714633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:21.721512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.722262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.722712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.723424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.723943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.724346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.770089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:21.773713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:21.780716 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc4c46a6-533c-4ce4-84c8-da096180dd93 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.264447 Sep 08 10:16:21.781533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 387/717] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:21 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:21.788248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:21.789057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:21.796378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.797099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.798014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.798729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.799186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.799645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.816045 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3fca086-ba3e-44f0-aaae-24ef297383c3 tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action" status: 202 len: 0 microversion: 2.1 time: 0.107534 Sep 08 10:16:21.821036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 331/718] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:21 2022] POST /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:16:21.822705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:21.823323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:21.831383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.831904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.832343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.833053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:21.833507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:21.834428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:21.864782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:22.014406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.018423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.023587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.025039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.026394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a0b8e51-5540-46b4-8841-1da19966a98e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.243767 Sep 08 10:16:22.029806 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c264e31-d169-4f05-a65a-6fe5e649f407 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.208200 Sep 08 10:16:22.029950 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 388/719] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:21 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:22.030053 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 332/720] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:21 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:22.032441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-664edbec-b0ff-4a32-a26d-77e9a26ec2d2 req-c70d8484-86a8-4aba-a823-ff000134907f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d242c4-0703-440b-a09e-e0b93a5dd086", "name": "network-vif-plugged", "status": "completed", "tag": "06750d27-6888-4a9f-8d43-37eec362ecfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:22.036697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:22.039370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:22.043620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-664edbec-b0ff-4a32-a26d-77e9a26ec2d2 req-c70d8484-86a8-4aba-a823-ff000134907f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.044300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-664edbec-b0ff-4a32-a26d-77e9a26ec2d2 req-c70d8484-86a8-4aba-a823-ff000134907f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.045437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-664edbec-b0ff-4a32-a26d-77e9a26ec2d2 req-c70d8484-86a8-4aba-a823-ff000134907f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.048589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.049204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.050550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.050550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.051198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.051991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.059026 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-664edbec-b0ff-4a32-a26d-77e9a26ec2d2 req-c70d8484-86a8-4aba-a823-ff000134907f service nova] Creating event network-vif-plugged:06750d27-6888-4a9f-8d43-37eec362ecfd for instance f2d242c4-0703-440b-a09e-e0b93a5dd086 on n-h1-833090-19 Sep 08 10:16:22.064968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-664edbec-b0ff-4a32-a26d-77e9a26ec2d2 req-c70d8484-86a8-4aba-a823-ff000134907f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036637 Sep 08 10:16:22.065985 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 389/721] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:22.181393 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad870818-aad7-42e0-80f2-741bbbbf46dd tempest-ServersAdminTestJSON-434453819 tempest-ServersAdminTestJSON-434453819-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1616 microversion: 2.1 time: 0.152434 Sep 08 10:16:22.181971 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 333/722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:22 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1616 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:22.205692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:22.206277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:22.212547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.213031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.213477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.214181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.214673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.215107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.241570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:16:22.347723 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af3e776a-9022-4f35-865d-c1d4f1174a01 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 204 len: 0 microversion: 2.1 time: 0.146856 Sep 08 10:16:22.354072 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 390/723] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:16:22 2022] DELETE /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:22.358012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:22.359211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:22.366186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.366953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.367910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.369942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.370602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.371331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.458859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:22.460152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:22.471198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.471728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.472650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.473538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.474179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.475149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.556352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.565546 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-498c4c5a-9f13-4882-96b0-451148a2eae6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1470 microversion: 2.1 time: 0.211595 Sep 08 10:16:22.573103 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 334/724] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:22 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:22.627351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0f93ed23-260d-47a0-adbe-6e0b48b4af55 req-f11c915e-bf2c-46f1-aecc-c377ebad38e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc06ff9-6688-4171-829f-608b36008d7c", "tag": "ef6e6845-4aee-4922-9016-5f3098f1a1f7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:22.637790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f93ed23-260d-47a0-adbe-6e0b48b4af55 req-f11c915e-bf2c-46f1-aecc-c377ebad38e7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.639131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f93ed23-260d-47a0-adbe-6e0b48b4af55 req-f11c915e-bf2c-46f1-aecc-c377ebad38e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.639815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f93ed23-260d-47a0-adbe-6e0b48b4af55 req-f11c915e-bf2c-46f1-aecc-c377ebad38e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.652029 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0f93ed23-260d-47a0-adbe-6e0b48b4af55 req-f11c915e-bf2c-46f1-aecc-c377ebad38e7 service nova] Creating event network-changed:ef6e6845-4aee-4922-9016-5f3098f1a1f7 for instance 7dc06ff9-6688-4171-829f-608b36008d7c on n-h1-833090-19 Sep 08 10:16:22.658077 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0f93ed23-260d-47a0-adbe-6e0b48b4af55 req-f11c915e-bf2c-46f1-aecc-c377ebad38e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034024 Sep 08 10:16:22.659536 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 335/725] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:22.673794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.682758 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4cc8e507-f3b1-462a-a8ec-f71307669ca4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.229013 Sep 08 10:16:22.683725 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 391/726] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:22 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:22.730982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:22.731747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:22.738597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.739092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.739550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.740303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.740757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.741175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.804642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:22.805149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:22.812660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.813154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.813602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.814328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:22.814790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:22.815222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:22.929075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.939241 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a1b99f8-2380-42bd-99a3-c732e55427ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.211057 Sep 08 10:16:22.941954 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 336/727] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:22 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:22.975570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:22.983438 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-68314af1-ab3c-4bf2-84c4-3152955c6d27 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.182840 Sep 08 10:16:22.984028 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 392/728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:22 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:23.050388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:23.051002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:23.055043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:23.055791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:23.057950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.058580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.059245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.059781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.060306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.060738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.063541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.064067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.064513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.065237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.065695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.066185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.264495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:23.267727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:23.271283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:23.273106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:23.274541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:23.275814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba07e4db-1821-4dff-95a3-556da1a8dadc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.225907 Sep 08 10:16:23.277593 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54550125-b8e5-40af-95ca-bc8505f3de29 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.231203 Sep 08 10:16:23.278256 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 337/729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:23 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:23.280096 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 393/730] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:23 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:23.596854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:23.597476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:23.605707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.606192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.606650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.608028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.608028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.608276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.708679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:23.709818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:23.716144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.717205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.717772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.718696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.719305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.719916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.746525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:23.754557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:23.760489 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b0edec64-c164-43a0-92c5-6e98fc02ba47 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1470 microversion: 2.1 time: 0.167940 Sep 08 10:16:23.761106 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 338/731] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:23 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:23.867830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:23.876676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd00e47c-91d1-4e48-8188-4a6740ab5c33 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.171834 Sep 08 10:16:23.877261 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 394/732] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:23 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:23.939140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6caa33ee-674c-4b93-9f06-430a5dd80cda req-6ceeb2e5-c040-4189-8694-5dfa1428c726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32bd39-e3a8-4d12-bcb9-755de5068631", "name": "network-vif-unplugged", "status": "completed", "tag": "55482318-61d3-45e3-b82f-fe0ec7626732"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:23.952266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6caa33ee-674c-4b93-9f06-430a5dd80cda req-6ceeb2e5-c040-4189-8694-5dfa1428c726 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.953392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6caa33ee-674c-4b93-9f06-430a5dd80cda req-6ceeb2e5-c040-4189-8694-5dfa1428c726 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.953826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6caa33ee-674c-4b93-9f06-430a5dd80cda req-6ceeb2e5-c040-4189-8694-5dfa1428c726 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.966385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:23.967006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:23.979978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.981298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.982784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.984158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:23.984944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:23.986119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:23.988415 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6caa33ee-674c-4b93-9f06-430a5dd80cda req-6ceeb2e5-c040-4189-8694-5dfa1428c726 service nova] Creating event network-vif-unplugged:55482318-61d3-45e3-b82f-fe0ec7626732 for instance ea32bd39-e3a8-4d12-bcb9-755de5068631 on n-h2-833090-19 Sep 08 10:16:23.994754 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6caa33ee-674c-4b93-9f06-430a5dd80cda req-6ceeb2e5-c040-4189-8694-5dfa1428c726 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060904 Sep 08 10:16:23.995723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 339/733] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:24.008607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:24.009638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:24.017514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.018190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.019256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.020289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.020861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.021392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.270514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.273594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.279952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4335f643-e58e-43c5-b3f6-66e2011c8af1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.318548 Sep 08 10:16:24.280506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 395/734] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:23 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:24.285472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-bedfcf97-40ed-4b9d-95b2-604f26ed62a5 req-dc998300-2a84-4fa8-84c6-ef3c96de124f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f135a161-48ff-4d0e-b00c-41bf24ba6240", "name": "network-vif-plugged", "status": "completed", "tag": "f0b3fee2-3af1-471a-b848-b24d91841bac"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:24.296222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bedfcf97-40ed-4b9d-95b2-604f26ed62a5 req-dc998300-2a84-4fa8-84c6-ef3c96de124f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.296713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bedfcf97-40ed-4b9d-95b2-604f26ed62a5 req-dc998300-2a84-4fa8-84c6-ef3c96de124f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.297150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bedfcf97-40ed-4b9d-95b2-604f26ed62a5 req-dc998300-2a84-4fa8-84c6-ef3c96de124f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.300420 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04a34774-81fe-4ff5-94bb-c9083f191262 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.296266 Sep 08 10:16:24.301522 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 340/735] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:24 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:24.306386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:24.307143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:24.313199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.313678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.314106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.314797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.315368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.315707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.324082 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-bedfcf97-40ed-4b9d-95b2-604f26ed62a5 req-dc998300-2a84-4fa8-84c6-ef3c96de124f service nova] Creating event network-vif-plugged:f0b3fee2-3af1-471a-b848-b24d91841bac for instance f135a161-48ff-4d0e-b00c-41bf24ba6240 on n-h2-833090-19 Sep 08 10:16:24.329309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-bedfcf97-40ed-4b9d-95b2-604f26ed62a5 req-dc998300-2a84-4fa8-84c6-ef3c96de124f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Sep 08 10:16:24.330102 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 396/736] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:24.335496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:24.336109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:24.345133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.345133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.345133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.346111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.346111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.346537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.580039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.588939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-210623f3-1d9e-4679-a479-b34ae4d86469 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.285891 Sep 08 10:16:24.589515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.603619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.603619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.603619 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e59bca23-fb1b-4f8f-88ae-a7696001c43e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.270478 Sep 08 10:16:24.605355 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 341/737] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:24 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:24.619700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 397/738] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:24 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:24.785230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:24.785836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:24.788311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:24.795132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.795745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.796277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.796985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.797439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.797864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.868430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:24.876739 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-339d0fb4-1e43-443b-88a4-15079074ce11 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1428 microversion: 2.1 time: 0.096248 Sep 08 10:16:24.877336 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 342/739] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:24 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:24.900201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:24.900973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:24.908121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.908726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.909242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:24.910023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:24.910558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:24.911068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.047971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.057500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51264d86-5c00-4915-bb5c-1c77db71bece tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1476 microversion: 2.1 time: 0.161206 Sep 08 10:16:25.058497 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 398/740] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:24 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:25.302387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:25.302998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:25.309147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.309571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.310008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.310695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.311149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.311597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.328126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:25.328749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:25.330736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:25.336266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.336764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.337204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.337921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.338379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.338813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.519174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.524336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.527732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c10e1d3-595f-4f43-b566-c621b7817d2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.229152 Sep 08 10:16:25.528561 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 343/741] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:25 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:25.534186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-09588fe2-fe6e-491a-ac91-d79cc8d2abb4 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.210441 Sep 08 10:16:25.544565 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 399/742] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:25 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:25.616724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:25.617742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:25.631506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:25.632393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:25.639800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.641731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.643730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.644744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.647152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.647619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.649256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.649741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.650182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.650887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.651787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.651787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.968996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.976808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.978601 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1571c63d-7c8b-4711-b846-491b9ac4af23 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.367849 Sep 08 10:16:25.979246 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 344/743] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:25 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:25.984031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:25.984645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:25.989739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.991204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:25.991516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.992019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.992479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:25.992594 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87f8eea9-791b-43d8-a74c-e3428cf6a553 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.367911 Sep 08 10:16:25.993253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 400/744] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:25 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:25.993386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:25.993617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:25.994044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.014299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea32bd39-e3a8-4d12-bcb9-755de5068631", "tag": "55482318-61d3-45e3-b82f-fe0ec7626732"}, {"server_uuid": "bb738fed-0ef2-44df-b2cf-44ea224180b9", "name": "network-vif-deleted", "tag": "0ed4c5fb-51cd-471f-a184-9b79c88dd5a2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:26.025132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.025614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.026051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.028104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.029196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.029638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.030093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lazy-loading 'fault' on Instance uuid bb738fed-0ef2-44df-b2cf-44ea224180b9 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:26.039948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] Creating event network-changed:55482318-61d3-45e3-b82f-fe0ec7626732 for instance ea32bd39-e3a8-4d12-bcb9-755de5068631 on n-h2-833090-19 Sep 08 10:16:26.040523 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] Creating event network-vif-deleted:0ed4c5fb-51cd-471f-a184-9b79c88dd5a2 for instance bb738fed-0ef2-44df-b2cf-44ea224180b9 on n-h1-833090-19 Sep 08 10:16:26.053233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7585424c-6b9c-43e0-b625-b705d22b6ad8 req-1a98ec50-0763-4bee-a684-6bd58c44b485 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043795 Sep 08 10:16:26.054122 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 401/745] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:26.080101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:26.082670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:26.083381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:26.090464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.090730 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a7c8da2-2dea-4e6a-96bc-1693a2222bb6 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 200 len: 1304 microversion: 2.1 time: 0.110152 Sep 08 10:16:26.091028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.091815 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 345/746] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:25 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:26.091993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.092697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.093150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.093576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.283914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:26.294309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a183965b-a830-49e0-b425-07fc916ef85d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1475 microversion: 2.1 time: 0.215944 Sep 08 10:16:26.295120 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 402/747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:26 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1475 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:26.346622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-306d60da-ee7e-415b-afbc-b025e721082e req-c49f1327-82e9-4a2d-bcad-03eae5a5cdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8cba7f-a173-4f5a-bb60-0732504ddf03", "name": "network-vif-plugged", "status": "completed", "tag": "7cf4a2fc-044c-4c08-87b6-e7915bff99d4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:26.357989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-306d60da-ee7e-415b-afbc-b025e721082e req-c49f1327-82e9-4a2d-bcad-03eae5a5cdcf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.358515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-306d60da-ee7e-415b-afbc-b025e721082e req-c49f1327-82e9-4a2d-bcad-03eae5a5cdcf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.359152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-306d60da-ee7e-415b-afbc-b025e721082e req-c49f1327-82e9-4a2d-bcad-03eae5a5cdcf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.373835 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-306d60da-ee7e-415b-afbc-b025e721082e req-c49f1327-82e9-4a2d-bcad-03eae5a5cdcf service nova] Creating event network-vif-plugged:7cf4a2fc-044c-4c08-87b6-e7915bff99d4 for instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 on n-h1-833090-19 Sep 08 10:16:26.380262 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-306d60da-ee7e-415b-afbc-b025e721082e req-c49f1327-82e9-4a2d-bcad-03eae5a5cdcf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037012 Sep 08 10:16:26.381649 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 346/748] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:26.551815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:26.552429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:26.558696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.559191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.559802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:26.559933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.560504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:26.560641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.561078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.561503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.567394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.568130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.568733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.569657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:26.570142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:26.570564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:26.758398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:26.762366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:26.766826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69a5aba0-89b0-46d5-abd0-6f86cf05112b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.219203 Sep 08 10:16:26.767410 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 403/749] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:26 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:26.770667 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5af6e30a-770d-42ae-a470-07c28b1fde7e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1371 microversion: 2.1 time: 0.216199 Sep 08 10:16:26.771243 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 347/750] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:26 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:27.002558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.003195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.010530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.011305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.011923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.013214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.013968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.014553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.018318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.018978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.026097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.026587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.027022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.027818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.028303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.028728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.528887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:27.531611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:27.540536 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-209beceb-4fc2-46fe-aa88-22cd4168f25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1308 microversion: 2.1 time: 0.541735 Sep 08 10:16:27.541143 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 404/751] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:26 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:27.547314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.548218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: bb738fed-0ef2-44df-b2cf-44ea224180b9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.556351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.557247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.557719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.559104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.559444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.560677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.572065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:27.580978 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] HTTP exception thrown: Instance bb738fed-0ef2-44df-b2cf-44ea224180b9 could not be found. Sep 08 10:16:27.582559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Request method failure captured: Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 HTTP/1.1 Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcB0yhTabdMqQ2NqfB56dWMBABcf-6QsAZR23Rrax4za2ozhJ42Z92jJOwxoIcnu-bBGmKkzSemNnfNYOnMNAoIurBVhpv5Nv3gwoXsysbZXFfSWxpoEP5wxEl-XJAFst4eARstl7SJRMRxZ1jmqmutc0n9Hgc-wc9HNMR0otohqF7I Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cbb286972c294412b02697600bf9e63d Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:16:27.583309 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbb286972c294412b02697600bf9e63d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbb286972c294412b02697600bf9e63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbb286972c294412b02697600bf9e63d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbb286972c294412b02697600bf9e63d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cbb286972c294412b02697600bf9e63d Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersAdminTestJSON-1112604747-project Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: f7a5e1612ec14bf3a091d7717562c006 Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersAdminTestJSON-1112604747-project Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance bb738fed-0ef2-44df-b2cf-44ea224180b9 could not be found. Sep 08 10:16:27.585044 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bb738fed-0ef2-44df-b2cf-44ea224180b9'} Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb738fed-0ef2-44df-b2cf-44ea224180b9 could not be found. Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:16:27.586040 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb738fed-0ef2-44df-b2cf-44ea224180b9 could not be found. Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb738fed-0ef2-44df-b2cf-44ea224180b9 could not be found. Sep 08 10:16:27.590757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:27.593156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Returning 404 to user: Instance bb738fed-0ef2-44df-b2cf-44ea224180b9 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:16:27.593156 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-275ce1c8-8279-476c-884d-f275998988f3 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9" status: 404 len: 111 microversion: 2.1 time: 0.043362 Sep 08 10:16:27.593156 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 405/752] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:27 2022] GET /compute/v2.1/servers/bb738fed-0ef2-44df-b2cf-44ea224180b9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:16:27.594523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.595256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.596112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:27.597526 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8fb06da9-f6dd-4348-8031-a06184564660 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.583593 Sep 08 10:16:27.598607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 348/753] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:27 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:27.602653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.603285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.603865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.604695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.604861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.605350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.605683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.605985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.613461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.617877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.619214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.620270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.620903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.621527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.659904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:16:27.754539 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9f9f753-405f-40ba-aac1-8f6c4cbb969b tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "DELETE /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 204 len: 0 microversion: 2.1 time: 0.154329 Sep 08 10:16:27.755488 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 349/754] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:16:27 2022] DELETE /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:27.764666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.766080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.773091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.774046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.774046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.774711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.775165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.776302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.910184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:27.918968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab008b70-8ada-4e9c-9a63-27e6695df907 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1475 microversion: 2.1 time: 0.329991 Sep 08 10:16:27.919854 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 406/755] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:27 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:27.925033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:27.925844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:27.932216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.932947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.933533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:27.934930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:27.935888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:27.936478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.057212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:28.067817 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-861540ad-fc8d-4ab3-9ab1-220765ed5e2c tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1469 microversion: 2.1 time: 0.307322 Sep 08 10:16:28.079492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 350/756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:27 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:28.079492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:28.079492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:28.086231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.086231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.086926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.087766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.088653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.089309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.104644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:28.115094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f8a58b3-57ab-414f-b870-8e293836f3d7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.193096 Sep 08 10:16:28.115722 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 407/757] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:27 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:28.120564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5a736f-021a-43fd-ae81-209ae40bc1f5", "name": "network-vif-unplugged", "status": "completed", "tag": "642a50fe-153c-4e4e-82bf-40d85d4ed091"}, {"name": "network-changed", "server_uuid": "2f5a736f-021a-43fd-ae81-209ae40bc1f5", "tag": "642a50fe-153c-4e4e-82bf-40d85d4ed091"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:28.131436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.131998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.132433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.145468 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Creating event network-vif-unplugged:642a50fe-153c-4e4e-82bf-40d85d4ed091 for instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 on n-h2-833090-19 Sep 08 10:16:28.145988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Creating event network-changed:642a50fe-153c-4e4e-82bf-40d85d4ed091 for instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 on n-h2-833090-19 Sep 08 10:16:28.153973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:16:28.175267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e94c6b12-931f-4296-8440-bb53674dbbb1 req-346662f4-e678-485a-8a31-cfb3dbbffc70 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.058075 Sep 08 10:16:28.176215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 408/758] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:28.229575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:28.238399 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89f4e68c-c003-47dd-bda9-c19a43628be6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1557 microversion: 2.1 time: 0.168607 Sep 08 10:16:28.238971 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 351/759] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:28 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:28.262047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:28.262674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:28.268939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.269424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.269865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.270631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.271089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.271546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.351097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d93dd5c-57c3-4724-994d-618741e743dd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093473 Sep 08 10:16:28.351738 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 409/760] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:16:28 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:28.565486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:28.566221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:28.576447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.577229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.577889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.578802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.579698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.580218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.626278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:28.626895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:28.633603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.634261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.634774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.635535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.635998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.636435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.940535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:28.954074 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-05b248b9-a0ad-4499-af9e-983ecb72166b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1487 microversion: 2.1 time: 0.390538 Sep 08 10:16:28.956272 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 352/761] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:28 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1487 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:28.984978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:28.985727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:28.992536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.993294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.993892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:28.994659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:28.995287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:28.995742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.013956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:29.038032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:29.040931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:29.042237 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e217ad7d-3b7c-4b94-bd71-619dcdc34cbe tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.421095 Sep 08 10:16:29.055623 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 410/762] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:28 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:29.055623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:29.055623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:29.063034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.063034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.063585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.064416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.065228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.065903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.146734 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60ee3eaa-c1e6-4fcf-b728-f38e12383d93 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03/action" status: 202 len: 0 microversion: 2.1 time: 0.100812 Sep 08 10:16:29.150848 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 411/763] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:29 2022] POST /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:16:29.154258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:29.155008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:29.161702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.162271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.162720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.163471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.163928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.164370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.696616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:29.701098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:29.712668 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-113ea892-aa98-44a3-93a9-1a5acbfa1225 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1473 microversion: 2.1 time: 0.754889 Sep 08 10:16:29.713313 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 353/764] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:28 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1473 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:29.721282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:29.721282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:29.730184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.733630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.734288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.735820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.737754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.737754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.790294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:29.801094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3361bf04-8397-41ea-b9f1-7c764d5c5fd0 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1469 microversion: 2.1 time: 0.650233 Sep 08 10:16:29.815189 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 412/765] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:29 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1469 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:29.821996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:29.822939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:29.831291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.832240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.832986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:29.833298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:29.834109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:29.835024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.185082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.218064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7d5c55e-0fc6-4283-b6de-934d0e550142 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.499492 Sep 08 10:16:30.231789 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 354/766] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:29 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:30.232173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.239664 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c9fe3f7-d62e-48df-8f59-341ef3543562 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 200 len: 1472 microversion: 2.1 time: 0.425589 Sep 08 10:16:30.244608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:30.245565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:30.247151 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 413/767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:29 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:30.259946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b6162ca8-121a-4466-a407-dae073ec0823 req-2a7961ba-93f5-44a1-95c9-e90b9507c48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709e738b-2bf5-4fcc-90d0-9f9465312e0a", "name": "network-vif-deleted", "tag": "96c475c3-2bcf-4c72-95b3-c1adbec45357"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:30.262991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.265641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.266093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.266926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.267670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.279866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.285924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b6162ca8-121a-4466-a407-dae073ec0823 req-2a7961ba-93f5-44a1-95c9-e90b9507c48d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.286995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b6162ca8-121a-4466-a407-dae073ec0823 req-2a7961ba-93f5-44a1-95c9-e90b9507c48d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.287635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b6162ca8-121a-4466-a407-dae073ec0823 req-2a7961ba-93f5-44a1-95c9-e90b9507c48d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.301033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b6162ca8-121a-4466-a407-dae073ec0823 req-2a7961ba-93f5-44a1-95c9-e90b9507c48d service nova] Creating event network-vif-deleted:96c475c3-2bcf-4c72-95b3-c1adbec45357 for instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a on n-h1-833090-19 Sep 08 10:16:30.308607 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b6162ca8-121a-4466-a407-dae073ec0823 req-2a7961ba-93f5-44a1-95c9-e90b9507c48d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058160 Sep 08 10:16:30.313897 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 414/768] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:30.320298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-829120894"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:30.324269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:30.333690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.334887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.334887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.335859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.336412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.336844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.640647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5c4bf647-28f4-4565-91a4-a40198db42f0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03/action" status: 202 len: 0 microversion: 2.1 time: 0.325199 Sep 08 10:16:30.647496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 415/769] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:30 2022] POST /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:16:30.647681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.653463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.655216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.656217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e265190a-a250-4f65-af52-a07a2b053043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351286af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:30.656338 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2829f118-09e1-4eff-a2ad-088dc187ab1a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.421285 Sep 08 10:16:30.667785 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 355/770] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:30 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:30.717519 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e265190a-a250-4f65-af52-a07a2b053043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.068030 Sep 08 10:16:30.718146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 416/771] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:30 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:30.738604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:30.739230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:30.745419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.746160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.747438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.748183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.748640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.749070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.825278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:30.826417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:30.833784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.834401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.834941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.836912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.837484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.838136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.873993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.874609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.875312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:30.875891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lazy-loading 'fault' on Instance uuid 709e738b-2bf5-4fcc-90d0-9f9465312e0a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:30.947238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.962770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60b930b1-7dad-4b23-b585-e68736611290 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 200 len: 1303 microversion: 2.1 time: 0.141138 Sep 08 10:16:30.975452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:30.976092 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 417/772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:30 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:30.986381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f88f0ac-2cf8-4b45-824d-fe829f0b0b6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1473 microversion: 2.1 time: 0.251826 Sep 08 10:16:30.986986 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 356/773] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:30 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:30.987217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d62a571f-7790-4e74-b662-28c25b021801 req-d55a9c99-02b0-4bf1-a683-5a8dae600740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f135a161-48ff-4d0e-b00c-41bf24ba6240", "tag": "f0b3fee2-3af1-471a-b848-b24d91841bac"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:30.997598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d62a571f-7790-4e74-b662-28c25b021801 req-d55a9c99-02b0-4bf1-a683-5a8dae600740 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:30.998187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d62a571f-7790-4e74-b662-28c25b021801 req-d55a9c99-02b0-4bf1-a683-5a8dae600740 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:30.998685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d62a571f-7790-4e74-b662-28c25b021801 req-d55a9c99-02b0-4bf1-a683-5a8dae600740 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:31.015148 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d62a571f-7790-4e74-b662-28c25b021801 req-d55a9c99-02b0-4bf1-a683-5a8dae600740 service nova] Creating event network-changed:f0b3fee2-3af1-471a-b848-b24d91841bac for instance f135a161-48ff-4d0e-b00c-41bf24ba6240 on n-h2-833090-19 Sep 08 10:16:31.020995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d62a571f-7790-4e74-b662-28c25b021801 req-d55a9c99-02b0-4bf1-a683-5a8dae600740 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043421 Sep 08 10:16:31.022262 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 418/774] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:31.251531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:31.252279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:31.259866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:31.260354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:31.260795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:31.261497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:31.261971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:31.262398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:31.398432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:31.406320 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0db70ba3-914c-4c03-a4d2-d9a4c6031690 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.159927 Sep 08 10:16:31.406899 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 357/775] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:31 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:31.687065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:31.687792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:31.694157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:31.694761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:31.695210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:31.695971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:31.696411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:31.696839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:31.734210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e43c140c-c9c6-4dc7-bf70-3f7d50af8e69 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351644ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:31.782661 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e43c140c-c9c6-4dc7-bf70-3f7d50af8e69 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.052849 Sep 08 10:16:31.783668 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 358/776] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:31 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:31.844077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:31.861530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:31.863295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:31.865403 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27777451-5018-4f0d-9a94-65b3542295ad tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.182731 Sep 08 10:16:31.866156 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 419/777] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:31 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:31.993098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:31.993857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: 709e738b-2bf5-4fcc-90d0-9f9465312e0a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:32.000309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.000803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.001240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.001952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.002410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.002842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.010515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:32.011190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:32.018506 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] HTTP exception thrown: Instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a could not be found. Sep 08 10:16:32.019175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.019722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.020161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.020944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Request method failure captured: Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a HTTP/1.1 Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcB0yhTabdMqQ2NqfB56dWMBABcf-6QsAZR23Rrax4za2ozhJ42Z92jJOwxoIcnu-bBGmKkzSemNnfNYOnMNAoIurBVhpv5Nv3gwoXsysbZXFfSWxpoEP5wxEl-XJAFst4eARstl7SJRMRxZ1jmqmutc0n9Hgc-wc9HNMR0otohqF7I Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cbb286972c294412b02697600bf9e63d Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:16:32.021152 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbb286972c294412b02697600bf9e63d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbb286972c294412b02697600bf9e63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbb286972c294412b02697600bf9e63d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbb286972c294412b02697600bf9e63d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cbb286972c294412b02697600bf9e63d Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminTestJSON-1112604747-project Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: f7a5e1612ec14bf3a091d7717562c006 Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminTestJSON-1112604747-project Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a could not be found. Sep 08 10:16:32.022745 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '709e738b-2bf5-4fcc-90d0-9f9465312e0a'} Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a could not be found. Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:16:32.023714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a could not be found. Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a could not be found. Sep 08 10:16:32.025058 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:16:32.026365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.026365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.027225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Returning 404 to user: Instance 709e738b-2bf5-4fcc-90d0-9f9465312e0a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:16:32.028868 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e379d615-87f2-4452-a05a-54c2a9ee9606 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a" status: 404 len: 111 microversion: 2.1 time: 0.039193 Sep 08 10:16:32.029456 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 359/778] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:31 2022] GET /compute/v2.1/servers/709e738b-2bf5-4fcc-90d0-9f9465312e0a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:16:32.038843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:32.039634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:32.054680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.055324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.055952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.056831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.057392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.057973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.092889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:16:32.174290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:32.182883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-41e0fb18-e050-4210-a30b-a1360fd9a170 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 204 len: 0 microversion: 2.1 time: 0.147922 Sep 08 10:16:32.184016 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 360/779] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:16:32 2022] DELETE /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:32.184869 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e82b859a-aa9e-42e7-aa40-6a84ffa67535 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1473 microversion: 2.1 time: 0.178421 Sep 08 10:16:32.191830 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 420/780] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:32 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:32.194121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:32.195763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:32.204114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.204640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.205103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.205853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.206300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.206720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.342609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:32.351168 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6b1b02d-e2bf-4333-a4f8-ec680b412152 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1469 microversion: 2.1 time: 0.162300 Sep 08 10:16:32.352250 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 361/781] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:32 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:32.429236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:32.429853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:32.436592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.437079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.437520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.438210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.438701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.439133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.574523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:32.583126 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4431090c-64e0-43d5-bc90-454a2e767c49 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.157773 Sep 08 10:16:32.583738 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 421/782] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:32 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:32.798564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-441addcd-3dd9-4f81-8970-6bad20f8770a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351aec700>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:32.846109 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-441addcd-3dd9-4f81-8970-6bad20f8770a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.051272 Sep 08 10:16:32.846679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 362/783] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:32 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:32.892622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:32.893265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:32.899283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.899808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.900283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.900979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:32.901439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:32.901869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:32.917206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:33.037315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:33.046003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:33.047444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:33.048639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eff7dde3-6357-4ed1-9517-c3f19e66646c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.160046 Sep 08 10:16:33.049196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 422/784] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:32 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:33.214722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:33.216088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:33.224238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:33.224785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:33.225229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:33.225934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:33.226532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:33.227162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:33.375113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:33.375769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:33.382210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:33.382700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:33.383146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:33.383888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:33.384363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:33.385557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:33.567572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:33.578330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fefbe09e-7285-4d65-859a-019a57623db9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1473 microversion: 2.1 time: 0.371107 Sep 08 10:16:33.596683 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 363/785] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:33 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:33.606879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:33.607859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:33.616419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:33.617028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:33.617528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:33.618394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:33.618854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:33.619279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:33.944573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:33.954453 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef24739f-7b31-4635-88ad-5209e72f28a7 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1469 microversion: 2.1 time: 0.584089 Sep 08 10:16:33.955146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 423/786] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:33 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1469 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:33.959873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df5bdbe1-3c08-41dd-9562-e59ce1f7493b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235128b280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:34.011928 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df5bdbe1-3c08-41dd-9562-e59ce1f7493b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.055430 Sep 08 10:16:34.013828 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 424/787] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:33 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:34.089928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:34.090891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:34.099507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:34.100064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:34.100667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:34.101823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:34.114757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:34.117772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:34.415045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:34.429028 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-236b2f9a-4df6-4627-83f7-dcb3bb46ed41 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1503 microversion: 2.1 time: 0.823055 Sep 08 10:16:34.429966 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 364/788] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:33 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1503 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:34.606809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:34.607452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:34.617799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:34.619826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:34.620491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:34.623385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:34.625281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:34.626932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:34.648015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:34.658987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:34.660414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:34.665102 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bccf08a7-435e-4476-a7b9-1cf4d5939730 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.591915 Sep 08 10:16:34.666123 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 425/789] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:34 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:34.979808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:34.981183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:35.002821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.004702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.008574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.008574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.009593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.013203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.139547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:35.157356 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa950dbc-977f-40f0-840a-cdf404cbc294 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1470 microversion: 2.1 time: 0.556937 Sep 08 10:16:35.158601 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 365/790] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:34 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1470 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:35.163735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10733a65-278a-43e9-866d-fb326f578d64 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351644040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:35.229256 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10733a65-278a-43e9-866d-fb326f578d64 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.069252 Sep 08 10:16:35.229975 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 366/791] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:35 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:35.236027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:35.237079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:35.244852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.248133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.248831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.249775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.250442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.251331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.358765 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f6abca6-5202-49a5-8004-c0d38328633f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5/action" status: 204 len: 0 microversion: 2.1 time: 0.127278 Sep 08 10:16:35.361806 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 367/792] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:35 2022] POST /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5/action => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:35.388889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:35.390350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:35.409381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.415660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.416350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.417016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.424102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.424748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.457692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:35.466454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b945b26-fdfe-404e-b6d9-fb47775d4937 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1469 microversion: 2.1 time: 0.490437 Sep 08 10:16:35.472595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 426/793] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:34 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1469 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:35.491584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:35.492486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:35.501821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.502317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.502760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.503498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:35.510767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:35.511241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:35.985501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:36.002827 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c070a121-47cb-41d8-847f-50eee66b0cbf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1493 microversion: 2.1 time: 0.528174 Sep 08 10:16:36.017284 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 427/794] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:35 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1493 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:36.036310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:36.039151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:36.074417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.075141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.075765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.076677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.077316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.077904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.166888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:36.177528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d59f8ddf-da47-4e1e-b84d-f2fa50e0571d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1470 microversion: 2.1 time: 0.798426 Sep 08 10:16:36.188753 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 368/795] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:35 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1470 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:36.213163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09c2bb81-0acf-4905-9520-dfdb8beeba26 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '.version_select at 0x7f23517e95e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:36.226553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09c2bb81-0acf-4905-9520-dfdb8beeba26 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.232816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09c2bb81-0acf-4905-9520-dfdb8beeba26 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.235342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09c2bb81-0acf-4905-9520-dfdb8beeba26 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.300016 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09c2bb81-0acf-4905-9520-dfdb8beeba26 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1574 microversion: 2.1 time: 0.100948 Sep 08 10:16:36.312660 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 369/796] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:16:36 2022] GET /compute/v2.1/os-migrations => generated 1574 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:36.327998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7d6a85f7-ac04-4dea-8533-bea488129043 req-c2f2cedb-1afd-4f14-9b12-09d859b07b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d242c4-0703-440b-a09e-e0b93a5dd086", "name": "network-vif-deleted", "tag": "06750d27-6888-4a9f-8d43-37eec362ecfd"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:36.353917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7d6a85f7-ac04-4dea-8533-bea488129043 req-c2f2cedb-1afd-4f14-9b12-09d859b07b27 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.357435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7d6a85f7-ac04-4dea-8533-bea488129043 req-c2f2cedb-1afd-4f14-9b12-09d859b07b27 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.357957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7d6a85f7-ac04-4dea-8533-bea488129043 req-c2f2cedb-1afd-4f14-9b12-09d859b07b27 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.391339 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7d6a85f7-ac04-4dea-8533-bea488129043 req-c2f2cedb-1afd-4f14-9b12-09d859b07b27 service nova] Creating event network-vif-deleted:06750d27-6888-4a9f-8d43-37eec362ecfd for instance f2d242c4-0703-440b-a09e-e0b93a5dd086 on n-h1-833090-19 Sep 08 10:16:36.401976 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7d6a85f7-ac04-4dea-8533-bea488129043 req-c2f2cedb-1afd-4f14-9b12-09d859b07b27 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087872 Sep 08 10:16:36.406293 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 370/797] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:36.424097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c682811c-2faf-4f7f-8720-59885b10d70b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235165ab80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:36.476057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:36.489578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:36.491181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:36.493162 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d35ff441-d735-4f21-998e-3bbe0610e0f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.467563 Sep 08 10:16:36.494472 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 428/798] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:36 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:36.508405 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c682811c-2faf-4f7f-8720-59885b10d70b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.096085 Sep 08 10:16:36.517692 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 371/799] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:36 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:36.532638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:36.543441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:36.544931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:36.546963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:36.561619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.562368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.563444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.565594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.566106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.566546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.567081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.567265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.568038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.570315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.573873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.574411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.615210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:36.616105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:36.616614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:36.617140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lazy-loading 'fault' on Instance uuid f2d242c4-0703-440b-a09e-e0b93a5dd086 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:36.676587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7a5e1612ec14bf3a091d7717562c006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb286972c294412b02697600bf9e63d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:36.688244 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04f618e4-c359-44de-ba0d-4d473752815d tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 200 len: 1304 microversion: 2.1 time: 0.169169 Sep 08 10:16:36.705487 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 372/800] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:36 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:36.818939 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db91e7ce-d773-422a-9184-3987ff81c502 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1646 microversion: 2.1 time: 0.322948 Sep 08 10:16:36.819839 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 429/801] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:36 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1646 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:37.029353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1632244341", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4a01de9c-22cd-443f-9615-bc8a1f2b2669"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:37.140910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] validate_networks() for [('4a01de9c-22cd-443f-9615-bc8a1f2b2669', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:16:37.186672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5a736f-021a-43fd-ae81-209ae40bc1f5", "name": "network-vif-plugged", "status": "completed", "tag": "642a50fe-153c-4e4e-82bf-40d85d4ed091"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:37.198806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:37.200068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:37.200600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:37.217533 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] Creating event network-vif-plugged:642a50fe-153c-4e4e-82bf-40d85d4ed091 for instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 on n-h2-833090-19 Sep 08 10:16:37.224458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:16:37.239726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-512a32c9-44ca-45a0-9b6c-302a56aeb4e0 req-9840871f-bf67-4e28-baa8-8b7e69bff7ac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058585 Sep 08 10:16:37.241228 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 430/802] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:37.247109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:37.248209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:37.258639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:37.259641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:37.260325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:37.261311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:37.262546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:37.263228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:37.691880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:37.704826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9ceb2204-ee4c-4823-8056-654f4ba1cef9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1470 microversion: 2.1 time: 0.462098 Sep 08 10:16:37.706293 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 431/803] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:37 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:37.719892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:37.721007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:37.736109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:37.737619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:37.738299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:37.739348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:37.740790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:37.742966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.324785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:38.349165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:38.356816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:38.361022 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bbb00773-af97-493b-a05b-8e4ebd89c836 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.653555 Sep 08 10:16:38.364382 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 432/804] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:37 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:38.386171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a65002c3-327d-4114-9bf4-3b7dcf29ca0f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351286b80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:38.451966 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a65002c3-327d-4114-9bf4-3b7dcf29ca0f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.085389 Sep 08 10:16:38.452937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 433/805] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:38 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:38.457432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:38.458598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] [instance: f2d242c4-0703-440b-a09e-e0b93a5dd086] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:38.466187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:38.466187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:38.466641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.467619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:38.468741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:38.469592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.485561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] HTTP exception thrown: Instance f2d242c4-0703-440b-a09e-e0b93a5dd086 could not be found. Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Request method failure captured: Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 HTTP/1.1 Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcB0yhTabdMqQ2NqfB56dWMBABcf-6QsAZR23Rrax4za2ozhJ42Z92jJOwxoIcnu-bBGmKkzSemNnfNYOnMNAoIurBVhpv5Nv3gwoXsysbZXFfSWxpoEP5wxEl-XJAFst4eARstl7SJRMRxZ1jmqmutc0n9Hgc-wc9HNMR0otohqF7I Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cbb286972c294412b02697600bf9e63d Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:16:38.487799 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbb286972c294412b02697600bf9e63d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cbb286972c294412b02697600bf9e63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cbb286972c294412b02697600bf9e63d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cbb286972c294412b02697600bf9e63d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cbb286972c294412b02697600bf9e63d Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersAdminTestJSON-1112604747 Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersAdminTestJSON-1112604747-project Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: f7a5e1612ec14bf3a091d7717562c006 Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersAdminTestJSON-1112604747-project Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f2d242c4-0703-440b-a09e-e0b93a5dd086 could not be found. Sep 08 10:16:38.489455 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f2d242c4-0703-440b-a09e-e0b93a5dd086'} Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d242c4-0703-440b-a09e-e0b93a5dd086 could not be found. Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:16:38.490732 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d242c4-0703-440b-a09e-e0b93a5dd086 could not be found. Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d242c4-0703-440b-a09e-e0b93a5dd086 could not be found. Sep 08 10:16:38.493547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:16:38.495649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] Returning 404 to user: Instance f2d242c4-0703-440b-a09e-e0b93a5dd086 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:16:38.496713 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efea1295-0241-483a-a342-05214b0eac96 tempest-ServersAdminTestJSON-1112604747 tempest-ServersAdminTestJSON-1112604747-project] 10.222.0.59 "GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086" status: 404 len: 111 microversion: 2.1 time: 0.042956 Sep 08 10:16:38.497444 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 434/806] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:38 2022] GET /compute/v2.1/servers/f2d242c4-0703-440b-a09e-e0b93a5dd086 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:16:38.588389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:16:38.588923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:16:38.589416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:16:38.590530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:16:38.590941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:16:38.604100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:38.604585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:38.605015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.605740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:38.606192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:38.606609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.630554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:38.639096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for user 46a59f79e24b4644a167dc0a4d2c4af9 and project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:38.652960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:16:38.656007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:16:38.732012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:38.732924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:38.734966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:38.746060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:38.751572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:38.753949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.756995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:38.757755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:38.758345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:38.796984 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-950cc801-b7c4-4cec-9dd7-bb1adc780799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784331 Sep 08 10:16:38.798094 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 373/807] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:16:38.810278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a5ee9f2-1d5e-46ed-8522-3cf103d29d7f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:38.811192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a5ee9f2-1d5e-46ed-8522-3cf103d29d7f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:39.023365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5a5ee9f2-1d5e-46ed-8522-3cf103d29d7f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:39.036814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a5ee9f2-1d5e-46ed-8522-3cf103d29d7f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1211 microversion: 2.1 time: 0.230790 Sep 08 10:16:39.038334 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 374/808] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:38 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1211 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:39.163255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:39.183354 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a93371a-0171-4926-b394-87634d546430 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1470 microversion: 2.1 time: 0.457092 Sep 08 10:16:39.185166 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 435/809] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:38 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1470 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:39.268067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2d0695f1-f852-4145-87f1-0620357afcf6 req-1d7db9b0-df52-4f8f-9918-64f648e71a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8cba7f-a173-4f5a-bb60-0732504ddf03", "name": "network-vif-plugged", "status": "completed", "tag": "7cf4a2fc-044c-4c08-87b6-e7915bff99d4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:39.296379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2d0695f1-f852-4145-87f1-0620357afcf6 req-1d7db9b0-df52-4f8f-9918-64f648e71a08 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:39.296901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2d0695f1-f852-4145-87f1-0620357afcf6 req-1d7db9b0-df52-4f8f-9918-64f648e71a08 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:39.297286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2d0695f1-f852-4145-87f1-0620357afcf6 req-1d7db9b0-df52-4f8f-9918-64f648e71a08 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:39.321269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:39.323554 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2d0695f1-f852-4145-87f1-0620357afcf6 req-1d7db9b0-df52-4f8f-9918-64f648e71a08 service nova] Creating event network-vif-plugged:7cf4a2fc-044c-4c08-87b6-e7915bff99d4 for instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 on n-h1-833090-19 Sep 08 10:16:39.329757 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2d0695f1-f852-4145-87f1-0620357afcf6 req-1d7db9b0-df52-4f8f-9918-64f648e71a08 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068116 Sep 08 10:16:39.335249 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 375/810] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:39.393945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:39.395278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:39.414916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:39.416794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:39.417438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:39.419429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:39.420043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:39.420594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:39.470995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5a2cf4c-8a6d-4641-943e-63ec19a195e0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235165ac10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:39.605419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5a2cf4c-8a6d-4641-943e-63ec19a195e0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.140066 Sep 08 10:16:39.607821 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 376/811] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:39 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:39.794172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:39.814888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:39.820064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:39.825179 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1cee282d-b8c3-4416-9d07-526ec02acac3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1568 microversion: 2.25 time: 0.432594 Sep 08 10:16:39.827144 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 436/812] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:39 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:40.066669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:40.067418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:40.081485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.081892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.082314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.083362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.083891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.084391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.190165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:40.200406 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4af7cb18-749b-4e09-9613-e1602a4b4829 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1207 microversion: 2.1 time: 0.137491 Sep 08 10:16:40.201225 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 377/813] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:40 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1207 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:40.209770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:40.210837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:40.217901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.218925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.220003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.220949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.221646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.222294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.459246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:40.481480 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0ca90f6-3ece-4db5-9507-251b4973302f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1462 microversion: 2.1 time: 0.275585 Sep 08 10:16:40.482728 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 437/814] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:40 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1462 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:40.506117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:40.506738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:40.516021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.516521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.516960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.517693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.520108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.521259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.623111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82650eef-2ac5-47aa-99f7-d1dacacff937 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2352196430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:40.694319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82650eef-2ac5-47aa-99f7-d1dacacff937 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.075691 Sep 08 10:16:40.696294 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 438/815] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:40 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:40.780578 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bbb8940f-94a6-41c6-ad61-95be86375aaf tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1615 microversion: 2.1 time: 0.278301 Sep 08 10:16:40.783944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 378/816] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:40 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1615 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:40.813606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d486dec3-4ce7-42e4-8cbe-12e0dc1b5a05 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '.version_select at 0x7f235128dd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:40.817479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d486dec3-4ce7-42e4-8cbe-12e0dc1b5a05 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.819751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d486dec3-4ce7-42e4-8cbe-12e0dc1b5a05 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.820385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d486dec3-4ce7-42e4-8cbe-12e0dc1b5a05 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.857990 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d486dec3-4ce7-42e4-8cbe-12e0dc1b5a05 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1575 microversion: 2.1 time: 0.048339 Sep 08 10:16:40.860533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:40.861411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:40.872576 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 439/817] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:16:40 2022] GET /compute/v2.1/os-migrations => generated 1575 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:40.874250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.875172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.877132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:40.878062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:40.881656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:40.882324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.198180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2096822030", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:41.201752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:41.215202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:41.241155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:41.249367 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2d9358e-a222-44d4-a2c4-b97ae8d27950 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1543 microversion: 2.25 time: 0.393752 Sep 08 10:16:41.252995 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 379/818] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:40 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1543 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:41.288167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:16:41.290580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:41.296629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:41.303630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.304504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.305219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.306155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.306816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.307483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.471015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:41.479209 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-884b932b-419b-45bc-abb7-1d6ac8a9a1b2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1269 microversion: 2.1 time: 0.225091 Sep 08 10:16:41.481663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 380/819] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:41 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:41.490360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-636b1a3c-3431-45bd-999c-9e621cf6e9c1 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '.version_select at 0x7f23516191f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:41.493845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-636b1a3c-3431-45bd-999c-9e621cf6e9c1 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.494524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-636b1a3c-3431-45bd-999c-9e621cf6e9c1 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.495159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-636b1a3c-3431-45bd-999c-9e621cf6e9c1 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.507631 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-636b1a3c-3431-45bd-999c-9e621cf6e9c1 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.024893 Sep 08 10:16:41.508837 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 381/820] 10.222.0.59 () {60 vars in 1184 bytes} [Thu Sep 8 10:16:41 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:41.524083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:41.529862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:41.552047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.552870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.553549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.554542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.555248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.557213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.776972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:16:41.778153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:16:41.778718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:16:41.779257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:16:41.779812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:16:41.791592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.793420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.794062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.795073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:41.795781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:41.796451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:41.827400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:41.844281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for user 5f96685045b340b2a978ece9dd591640 and project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:41.862559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:16:41.882151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:16:41.887896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid ea32bd39-e3a8-4d12-bcb9-755de5068631 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:41.934019 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e1ffc0c-a8c0-40c0-880d-98151b6f2173 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 2038 microversion: 2.25 time: 0.407913 Sep 08 10:16:41.936308 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 382/821] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:41 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 2038 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:41.947822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98d6f3dc-530d-4e33-bc8f-31b8a3ba6f32 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23516a41f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:41.994741 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e8125d2-2bb5-43bc-8eb8-4a47a1ba912d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800424 Sep 08 10:16:41.997188 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 440/822] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:16:42.009348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8ac931d-0fe1-46e2-bf53-bc3e7b600746 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Action: 'create', calling method: .version_select at 0x7f2351288e50>, body: {"keypair": {"name": "tempest-keypair-2143528919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDFC+chI9D4FghPNS8oh1ESDWHwilixRgqVU8I6YxoK9aYWPWXg4r73q5JMYfojVKetRuV1rfi7j26LnbJR+Y6jGD55FpcnmW55jaYdD/+7mQO0puiAj2nDhUVFxxrgtw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:42.042751 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98d6f3dc-530d-4e33-bc8f-31b8a3ba6f32 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.105308 Sep 08 10:16:42.043411 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 383/823] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:41 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:42.060877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0e5bb1b-d988-4b20-88f4-368eddb86175 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:42.063216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0e5bb1b-d988-4b20-88f4-368eddb86175 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:42.064639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b8ac931d-0fe1-46e2-bf53-bc3e7b600746 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:42.077316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:42.086903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b8ac931d-0fe1-46e2-bf53-bc3e7b600746 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for user 448b7c1cb3eb4b63a427a3d7b7d6eb13 and project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:42.129334 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8ac931d-0fe1-46e2-bf53-bc3e7b600746 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.130728 Sep 08 10:16:42.135965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 441/824] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:16:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:16:42.257214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0e5bb1b-d988-4b20-88f4-368eddb86175 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:42.277824 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0e5bb1b-d988-4b20-88f4-368eddb86175 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1213 microversion: 2.1 time: 0.229408 Sep 08 10:16:42.278974 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 384/825] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:42 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:42.512903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:42.513845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:42.529849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:42.534956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:42.537663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:42.543113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:42.545569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:42.549277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:43.064664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-141e6629-8093-433a-8b6e-fea2ab1001a7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23516a0a60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:43.162289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-141e6629-8093-433a-8b6e-fea2ab1001a7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.101611 Sep 08 10:16:43.163661 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 385/826] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:43 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:43.251792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:43.264170 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-47cc5939-07be-46ff-b0c7-393242431031 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.752635 Sep 08 10:16:43.265099 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 442/827] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:42 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:43.309052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:43.310041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:43.320874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:43.321991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:43.323010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:43.325831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:43.327495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:43.328600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:43.505620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:43.526105 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8067e69c-ee38-4516-aceb-9b8bbda97c2c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1209 microversion: 2.1 time: 0.221858 Sep 08 10:16:43.527084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 386/828] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:43 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1209 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:43.700173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1225381547", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:43.798235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:16:43.798657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:16:43.799137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:16:43.799573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:16:43.800000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:16:43.816963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:43.817925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:43.819265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:43.821992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:43.826371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:43.827054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:43.872319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Getting quotas for project 36485dc6be9a4653b038ee4649e00390. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:43.887109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Getting quotas for user 29c7fd02e8314c9faf7da08dcd0d8be8 and project 36485dc6be9a4653b038ee4649e00390. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:43.900065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:16:43.903686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:16:43.976730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-644c6918-b981-4951-8df2-ff8555f09a06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.498190 Sep 08 10:16:43.977976 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 443/829] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:16:43.995782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0dcc7a2a-a439-4b9b-b257-a4fd8a2e36e9 req-eb7746ca-d928-4482-8492-913b2318c62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03a7af3-2569-4592-bab4-88792475ddec", "tag": "3ea7fc6f-91bc-42c7-89eb-65b824d46318"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:44.004909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e246d38c-7a0e-4f3e-bc62-33865556c9bd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:44.006783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e246d38c-7a0e-4f3e-bc62-33865556c9bd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:44.023719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0dcc7a2a-a439-4b9b-b257-a4fd8a2e36e9 req-eb7746ca-d928-4482-8492-913b2318c62d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:44.028208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0dcc7a2a-a439-4b9b-b257-a4fd8a2e36e9 req-eb7746ca-d928-4482-8492-913b2318c62d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:44.029235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0dcc7a2a-a439-4b9b-b257-a4fd8a2e36e9 req-eb7746ca-d928-4482-8492-913b2318c62d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:44.066481 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0dcc7a2a-a439-4b9b-b257-a4fd8a2e36e9 req-eb7746ca-d928-4482-8492-913b2318c62d service nova] Creating event network-changed:3ea7fc6f-91bc-42c7-89eb-65b824d46318 for instance a03a7af3-2569-4592-bab4-88792475ddec on n-h1-833090-19 Sep 08 10:16:44.074948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0dcc7a2a-a439-4b9b-b257-a4fd8a2e36e9 req-eb7746ca-d928-4482-8492-913b2318c62d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095274 Sep 08 10:16:44.076309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 387/830] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:44.123498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e246d38c-7a0e-4f3e-bc62-33865556c9bd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:44.132491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e246d38c-7a0e-4f3e-bc62-33865556c9bd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:44.140053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e246d38c-7a0e-4f3e-bc62-33865556c9bd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:44.149840 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e246d38c-7a0e-4f3e-bc62-33865556c9bd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1454 microversion: 2.91 time: 0.158871 Sep 08 10:16:44.150779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 444/831] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:43 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:44.181847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7968dc9d-6a46-4eb0-95bb-59d854a359ec tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235165a550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:44.262526 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7968dc9d-6a46-4eb0-95bb-59d854a359ec tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.085729 Sep 08 10:16:44.264448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 388/832] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:44 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:44.299445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:44.300115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:44.316904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:44.317406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:44.317922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:44.318554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:44.319015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:44.319446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:44.568972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:44.569883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:44.594423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:44.595947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:44.598058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:44.598935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:44.615943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:44.616448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:44.653263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:44.662623 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72487711-6f17-48db-9e28-7a5320c5bb89 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.371415 Sep 08 10:16:44.666506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 445/833] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:44 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:44.863231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:44.872947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32bf2fdc-50ce-4533-86c9-99b904cd9488 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1283 microversion: 2.1 time: 0.309713 Sep 08 10:16:44.882430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 389/834] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:44 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1283 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:45.144220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1031994548", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "a201f7b1-2b10-4321-b5d2-383c4b92fcf0"}], "security_groups": [{"name": "tempest-securitygroup--1842642863"}], "key_name": "tempest-keypair-2143528919", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:45.179003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:45.180582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:45.194648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:45.195688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:45.196739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:45.197924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:45.198767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:45.199609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:45.321413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] validate_networks() for [('a201f7b1-2b10-4321-b5d2-383c4b92fcf0', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:16:45.424384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:45.439160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:45.442657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:45.454825 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fbc53d0a-f5d1-4e90-91ef-e66ff3df58af tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1450 microversion: 2.91 time: 0.280212 Sep 08 10:16:45.456866 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 390/835] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:45 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1450 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:45.462507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e6dd606-a7ff-4134-8f85-c01ef4f88abf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23516a0940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:45.535490 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e6dd606-a7ff-4134-8f85-c01ef4f88abf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.077172 Sep 08 10:16:45.547130 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 391/836] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:45 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:45.699403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:45.700065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:45.712400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:45.713188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:45.713785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:45.715248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:45.716393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:45.716978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.350142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:46.364442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f17cb64-8e4f-45b4-a392-06ecb497ebef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.670111 Sep 08 10:16:46.365984 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 392/837] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:45 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:46.387952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:46.388872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:46.395155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:46.395947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:46.396563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.397462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:46.398084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:46.398673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.572873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:16:46.573565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:16:46.574835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:16:46.575364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:16:46.575916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:16:46.587787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:46.588812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:46.590442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.591475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:46.592220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:46.593733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.615270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:46.623007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for user 448b7c1cb3eb4b63a427a3d7b7d6eb13 and project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:46.639761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:16:46.643215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:16:46.691545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:46.716573 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-390b16b5-d0b4-4433-8bed-07b22487167d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.336379 Sep 08 10:16:46.721489 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 393/838] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:46 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:46.728393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:46.730892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:46.744117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:46.746469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:46.747160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.748798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:46.750717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:46.752599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:46.766221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9cd17f9-adf2-4a8b-bdad-201e51af1079 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.626000 Sep 08 10:16:46.767778 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 446/839] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:16:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:16:46.776166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58c2af29-fe16-41ce-9bd2-992d8064696d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351293b80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:46.862836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58c2af29-fe16-41ce-9bd2-992d8064696d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.093605 Sep 08 10:16:46.863444 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 447/840] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:46 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:46.891336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93839a08-c072-4ff4-a75f-1fec52a0bbe6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:46.892253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93839a08-c072-4ff4-a75f-1fec52a0bbe6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:46.973534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:46.993718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:46.995628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:47.015631 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4182752b-99b3-40e4-baac-3f0f6f5134bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1506 microversion: 2.91 time: 0.292511 Sep 08 10:16:47.016194 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 394/841] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:46 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:47.041019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9a2ccf47-aa7e-4523-8b42-046649a4c7f4 req-f702143b-2197-47a5-90c0-1a951b559286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257df6a9-a628-4d96-9e8c-b040c5681437", "tag": "a498a092-4c03-4501-a24d-1264d184487c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:47.093471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a2ccf47-aa7e-4523-8b42-046649a4c7f4 req-f702143b-2197-47a5-90c0-1a951b559286 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:47.100364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a2ccf47-aa7e-4523-8b42-046649a4c7f4 req-f702143b-2197-47a5-90c0-1a951b559286 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:47.101307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a2ccf47-aa7e-4523-8b42-046649a4c7f4 req-f702143b-2197-47a5-90c0-1a951b559286 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:47.129251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93839a08-c072-4ff4-a75f-1fec52a0bbe6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:47.137079 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9a2ccf47-aa7e-4523-8b42-046649a4c7f4 req-f702143b-2197-47a5-90c0-1a951b559286 service nova] Creating event network-changed:a498a092-4c03-4501-a24d-1264d184487c for instance 257df6a9-a628-4d96-9e8c-b040c5681437 on n-h2-833090-19 Sep 08 10:16:47.148994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93839a08-c072-4ff4-a75f-1fec52a0bbe6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:47.153049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9a2ccf47-aa7e-4523-8b42-046649a4c7f4 req-f702143b-2197-47a5-90c0-1a951b559286 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119538 Sep 08 10:16:47.153206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93839a08-c072-4ff4-a75f-1fec52a0bbe6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:47.157613 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 395/842] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:47.162605 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93839a08-c072-4ff4-a75f-1fec52a0bbe6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1286 microversion: 2.25 time: 0.282535 Sep 08 10:16:47.176892 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 448/843] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:46 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1286 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:47.394692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:47.396207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:47.409528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:47.410309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:47.410931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:47.411912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:47.412639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:47.413332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:47.639781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:47.669150 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ce65536-00a4-4ce0-8b9b-6215b4dc292d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.277997 Sep 08 10:16:47.683675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 396/844] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:47 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:47.751064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:47.752432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:47.761619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:47.762441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:47.763229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:47.764184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:47.764840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:47.765462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:47.886683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-130e0a53-62b3-4880-b8cc-66a167e4f684 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23515ed790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:47.956326 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-130e0a53-62b3-4880-b8cc-66a167e4f684 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.080606 Sep 08 10:16:47.958285 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 397/845] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:47 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:48.008403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.011685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:48.019218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e6c672ea-ece5-474f-89db-bb8b5a5a9898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.276013 Sep 08 10:16:48.020074 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 449/846] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:47 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:48.047170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:48.047849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:48.055127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:48.055670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:48.056349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:48.057270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:48.058417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:48.059012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:48.128438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.139672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.141309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.147700 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b22b127-7071-4ee5-b847-e195ebf4fc20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1512 microversion: 2.91 time: 0.104433 Sep 08 10:16:48.148507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 398/847] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:48 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1512 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:48.191564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:48.192198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:48.198489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:48.198978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:48.199661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:48.200687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:48.201175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:48.201612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:48.301893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.312529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.314117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.315418 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01d8622f-8dc6-4bdf-8e94-316ba099c296 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1338 microversion: 2.25 time: 0.128403 Sep 08 10:16:48.316565 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 450/848] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:48 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1338 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:48.696991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:48.697680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:48.700847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:48.707093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:48.707667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:48.708170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:48.708872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:48.709374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:48.709796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:48.860204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:48.873116 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31c8bbdf-b3e2-4d78-84be-a64ae35d8235 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.180443 Sep 08 10:16:48.873990 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 399/849] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:48 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:48.974800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93a9aeaf-72b1-4508-8e02-5f537b403af5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351290550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:49.030207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93a9aeaf-72b1-4508-8e02-5f537b403af5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.059933 Sep 08 10:16:49.040287 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 451/850] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:48 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:49.043249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:49.043899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:49.050286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.050792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.051232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.051969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.053190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.053783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.176598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:49.177686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:49.186333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.187131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.187774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.188765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.189518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.190108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.217571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.228676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20f9cc6b-123d-40df-8a1c-bccb85f360ac tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.189163 Sep 08 10:16:49.230203 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 400/851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:49 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:49.352100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:49.352836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:49.355554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.359694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.360314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.360848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.361903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.362475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.362999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.367192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.367545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:49.369187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.376009 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-53d1ff98-1d8c-4156-b2a7-b5e7744f705e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1512 microversion: 2.91 time: 0.203513 Sep 08 10:16:49.376937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 452/852] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:49 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:49.447493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.456883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.458339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:49.459833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fff0544d-5742-433d-aa53-a1183812dae1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1338 microversion: 2.25 time: 0.111844 Sep 08 10:16:49.460139 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 401/853] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:49 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:49.897061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:49.898488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:49.907173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.908131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.908691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:49.909493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:49.910056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:49.910545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.052588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b466ec3-1e70-4a50-a518-5159c2aa3719 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351619430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.100914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.110044 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5f7c8ec4-e7f4-4d68-9c99-ca91d2d3d0e2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.216844 Sep 08 10:16:50.111854 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 453/854] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:49 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:50.116446 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b466ec3-1e70-4a50-a518-5159c2aa3719 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1413 microversion: 2.1 time: 0.072037 Sep 08 10:16:50.124948 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 402/855] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:50.255835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.256450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:50.262917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.263403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.263869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.264565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.265020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.265447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.400572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.404532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.405168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:50.408865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8128d713-5667-4032-bdf6-94776df36515 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.156968 Sep 08 10:16:50.409458 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 454/856] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:50.412468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.412818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.413248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.413942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.414386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.414804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.478340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.485110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.485717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:50.486964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.488425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.491892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.492376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.492813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.493505 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec902fdb-f55c-480a-81d1-64a14d48a3bc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1533 microversion: 2.91 time: 0.092989 Sep 08 10:16:50.493615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.493954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.494360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 403/857] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1533 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:50.494493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.562639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.571551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.573031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:50.574218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85a5018a-33f0-45b4-85a2-b2ab11bbb007 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1338 microversion: 2.25 time: 0.092966 Sep 08 10:16:50.574780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 455/858] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1338 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:50.577763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.578406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:50.584654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.585133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.585565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.586260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.586709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.587136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.705585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lazy-loading 'services' on Instance uuid acacb00b-705f-4760-ba09-6c802380b190 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:50.729501 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46be5651-42be-46a5-be7d-b8b14f46a5e4 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1940 microversion: 2.91 time: 0.212017 Sep 08 10:16:50.730113 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 404/859] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1940 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:50.764001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.764600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:50.770691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.771180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.771660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.772362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.772811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.773233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.889895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lazy-loading 'services' on Instance uuid acacb00b-705f-4760-ba09-6c802380b190 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:50.907592 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b658510-343f-4b06-bc7c-659be4f4889b tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1940 microversion: 2.91 time: 0.147837 Sep 08 10:16:50.908186 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 456/860] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1940 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:50.935269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:50.938911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.939398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.939860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.940591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.941403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.941527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.965073 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b4b14fb-98bd-4969-b465-b064f37f4107 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.034117 Sep 08 10:16:50.965695 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 405/861] 10.222.0.59 () {60 vars in 1217 bytes} [Thu Sep 8 10:16:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:16:50.978979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:50.980124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:50.982041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:50.988282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.988785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.989215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:50.989911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:50.990363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:50.990792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.015516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lazy-loading 'flavor' on Instance uuid acacb00b-705f-4760-ba09-6c802380b190 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:51.132195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-90a74133-f5df-4ed1-9fa2-7b925d9af366 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23516a0ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.180341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-90a74133-f5df-4ed1-9fa2-7b925d9af366 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1422 microversion: 2.1 time: 0.051788 Sep 08 10:16:51.181105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 406/862] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:51 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1422 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:51.185638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.186342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:51.192663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.193167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.193598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.194281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.194731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.195149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.248007 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87857187-354c-4886-8340-c6853e28cbf3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action" status: 202 len: 0 microversion: 2.91 time: 0.272648 Sep 08 10:16:51.248783 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 457/863] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:16:50 2022] POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:16:51.254257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ebe2c173-c5d3-48a7-952b-ae2e0bfd9ec8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235128b160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.324652 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ebe2c173-c5d3-48a7-952b-ae2e0bfd9ec8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 200 len: 1422 microversion: 2.1 time: 0.074090 Sep 08 10:16:51.326262 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 458/864] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:16:51 2022] GET /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:51.332456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.333182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:51.342735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.343702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.344934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.346204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.346945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.347881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.392343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.405286 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e7b5e37-14e1-42b8-ba30-183da6bf4816 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.223016 Sep 08 10:16:51.405970 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 407/865] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:51 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:51.410715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb1c7a52-2596-44e0-8c2d-eaed407df33a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235156e550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.429426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.439445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.441200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.446916 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-84e34213-3e2b-43fc-be23-695bd5cccbb7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.119488 Sep 08 10:16:51.447645 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 459/866] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:51 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:51.453092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.453909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:51.460679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.461063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.461505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.462260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.462654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.463079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.632972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.645746 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c639921-14d6-4110-92e0-99bf7cf0d768 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.196244 Sep 08 10:16:51.652040 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 460/867] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:51 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:51.652040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:51.652705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:51.659092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.659524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.659967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.660672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.661120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.661673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.744576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.756127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.757668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:51.758798 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a44d212f-9feb-456e-8a01-3a13a6663134 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1338 microversion: 2.25 time: 0.111077 Sep 08 10:16:51.759858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 461/868] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:51 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:51.864757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d5f7f870-b0a4-455f-bd62-96999b3c8eb8 req-6a2eb845-3a49-4e02-bb0f-35e23cfe198b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03a7af3-2569-4592-bab4-88792475ddec", "name": "network-vif-plugged", "status": "completed", "tag": "3ea7fc6f-91bc-42c7-89eb-65b824d46318"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:51.876381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d5f7f870-b0a4-455f-bd62-96999b3c8eb8 req-6a2eb845-3a49-4e02-bb0f-35e23cfe198b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:51.876871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d5f7f870-b0a4-455f-bd62-96999b3c8eb8 req-6a2eb845-3a49-4e02-bb0f-35e23cfe198b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:51.877323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d5f7f870-b0a4-455f-bd62-96999b3c8eb8 req-6a2eb845-3a49-4e02-bb0f-35e23cfe198b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:51.890703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d5f7f870-b0a4-455f-bd62-96999b3c8eb8 req-6a2eb845-3a49-4e02-bb0f-35e23cfe198b service nova] Creating event network-vif-plugged:3ea7fc6f-91bc-42c7-89eb-65b824d46318 for instance a03a7af3-2569-4592-bab4-88792475ddec on n-h1-833090-19 Sep 08 10:16:51.895919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d5f7f870-b0a4-455f-bd62-96999b3c8eb8 req-6a2eb845-3a49-4e02-bb0f-35e23cfe198b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 Sep 08 10:16:51.896394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 462/869] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:52.192771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb1c7a52-2596-44e0-8c2d-eaed407df33a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 204 len: 0 microversion: 2.1 time: 0.785606 Sep 08 10:16:52.193356 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 408/870] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:51 2022] DELETE /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:52.202914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:52.203633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:52.210163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.210746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.211292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.212124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.212652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.214088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.244178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:16:52.330043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82264d14-7ce4-4aba-94c0-f57f932c5082 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 204 len: 0 microversion: 2.1 time: 0.131863 Sep 08 10:16:52.330849 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 463/871] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:16:52 2022] DELETE /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:16:52.427241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:52.431587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:52.432206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:52.435032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-505643922", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "1fc268cd-ae55-4256-b9c7-92d5b594854f"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:52.439222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.439777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.440221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.441010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.441398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.441827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.496762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] validate_networks() for [('1fc268cd-ae55-4256-b9c7-92d5b594854f', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:16:52.663065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:52.673245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26ea16ed-7411-4ab9-9a12-814e05706dc5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.246599 Sep 08 10:16:52.687697 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 409/872] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:52 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:52.687697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:52.687697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:52.687697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.688198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.688198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.688896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.689691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.690450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.784446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:52.794464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:52.796298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:52.803426 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67afdc6d-7872-4c3b-82a7-d1f80ee02796 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.128428 Sep 08 10:16:52.804057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 410/873] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:52 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:52.816292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:52.816292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:52.816926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.817426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.817868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:52.818585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:52.819110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:52.819580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.046108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.058045 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ae56bd6-7aa7-41d8-93be-5abe5a88a144 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.251815 Sep 08 10:16:53.071854 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 411/874] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:52 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:53.079130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:53.080083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:53.087771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.088816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.090309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.090665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:16:53.099099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.099210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:16:53.099338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.099445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:16:53.100114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.100214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:16:53.100214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:16:53.114091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.114091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.114091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.114091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.114674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.114674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.143835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:16:53.153453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for user 1c08994220f44d5db166b899e80c2a12 and project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:16:53.176347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:16:53.179268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:16:53.233407 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b8e6369-f560-4a45-baed-fcbd65fb3ce7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803075 Sep 08 10:16:53.234212 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 464/875] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:16:53.251915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6d01cf6-51f1-4a58-bf2c-7f39365d565f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:53.252951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6d01cf6-51f1-4a58-bf2c-7f39365d565f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:53.353584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6d01cf6-51f1-4a58-bf2c-7f39365d565f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.363636 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6d01cf6-51f1-4a58-bf2c-7f39365d565f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1207 microversion: 2.1 time: 0.121934 Sep 08 10:16:53.364643 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 465/876] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:53 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1207 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:53.377998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.390069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.392093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.393995 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a81a5dc1-e676-4797-9733-e7b53f5881b8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.320714 Sep 08 10:16:53.394857 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 412/877] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:53 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:53.699263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:53.700160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:53.707760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.708352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.709019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.710142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.710814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.711247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.836449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:53.837263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:53.844224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.844824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.845757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.846577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.847308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.847772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.850147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.852545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:53.860817 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00550929-64e1-4b6e-8bb0-fe68d738f8c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1311 microversion: 2.1 time: 0.166569 Sep 08 10:16:53.861892 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 466/878] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:53 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1311 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:53.889176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-051e11ab-3d93-42f7-837a-d792d8dd4a3b req-546032ab-4c94-4880-a098-c4c80dfb97f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7265635f-ed38-4363-84e1-d4f53815fb77", "tag": "d0564e9f-ad94-40f2-a233-8c2e9ea93b6a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:53.899807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-051e11ab-3d93-42f7-837a-d792d8dd4a3b req-546032ab-4c94-4880-a098-c4c80dfb97f5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.900663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-051e11ab-3d93-42f7-837a-d792d8dd4a3b req-546032ab-4c94-4880-a098-c4c80dfb97f5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.901361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-051e11ab-3d93-42f7-837a-d792d8dd4a3b req-546032ab-4c94-4880-a098-c4c80dfb97f5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.912883 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-051e11ab-3d93-42f7-837a-d792d8dd4a3b req-546032ab-4c94-4880-a098-c4c80dfb97f5 service nova] Creating event network-changed:d0564e9f-ad94-40f2-a233-8c2e9ea93b6a for instance 7265635f-ed38-4363-84e1-d4f53815fb77 on n-h2-833090-19 Sep 08 10:16:53.920476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.925462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-051e11ab-3d93-42f7-837a-d792d8dd4a3b req-546032ab-4c94-4880-a098-c4c80dfb97f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050679 Sep 08 10:16:53.926988 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 467/879] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:53.929301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.930993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:53.934354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-719ac9f9-037d-4a7c-8bcb-3b48b49262bf req-13095a0f-e733-4d42-bf6f-a81c85b4d851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257df6a9-a628-4d96-9e8c-b040c5681437", "name": "network-vif-plugged", "status": "completed", "tag": "a498a092-4c03-4501-a24d-1264d184487c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:53.938054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89031c77-5b1c-457e-bfe7-b3d968783413 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.105415 Sep 08 10:16:53.938641 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 413/880] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:53 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:53.944570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-719ac9f9-037d-4a7c-8bcb-3b48b49262bf req-13095a0f-e733-4d42-bf6f-a81c85b4d851 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:53.945050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-719ac9f9-037d-4a7c-8bcb-3b48b49262bf req-13095a0f-e733-4d42-bf6f-a81c85b4d851 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:53.945482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-719ac9f9-037d-4a7c-8bcb-3b48b49262bf req-13095a0f-e733-4d42-bf6f-a81c85b4d851 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:53.957132 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-719ac9f9-037d-4a7c-8bcb-3b48b49262bf req-13095a0f-e733-4d42-bf6f-a81c85b4d851 service nova] Creating event network-vif-plugged:a498a092-4c03-4501-a24d-1264d184487c for instance 257df6a9-a628-4d96-9e8c-b040c5681437 on n-h2-833090-19 Sep 08 10:16:53.962022 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-719ac9f9-037d-4a7c-8bcb-3b48b49262bf req-13095a0f-e733-4d42-bf6f-a81c85b4d851 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 Sep 08 10:16:53.962646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 468/881] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:54.087799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:54.089599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:54.099333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.099935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.100442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.101401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.101956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.102617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.285025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:54.293477 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3da09dd-586a-4b5c-9173-57c2a9c7d31a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.212247 Sep 08 10:16:54.294051 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 414/882] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:54 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:54.387621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:54.388413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:54.395575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.396162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.396664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.397433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.397954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.398454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.421150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:54.421761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:54.427749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.428237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.428668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.429359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.429806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.430227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.477783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:54.489563 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58ea0e51-46ef-4589-a25a-43cf651bbbbc tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1259 microversion: 2.1 time: 0.104244 Sep 08 10:16:54.490182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 469/883] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:54 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1259 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:54.695427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:54.704752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:54.706647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:54.707408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0af7370-84f2-4ad6-9184-cda43986df7d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.290884 Sep 08 10:16:54.708222 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 415/884] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:54 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:54.886060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:54.886694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:54.892845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.893333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.893818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.894553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.895106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.895629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.967762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:54.968384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:54.974464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.974950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.975380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:54.976105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:54.976554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:54.976974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.076869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:55.088198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:55.090880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:55.098640 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e7a2e3ed-6543-4500-beb1-4b45198e606b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.134799 Sep 08 10:16:55.099943 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 416/885] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:54 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:55.107276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cc73de37-fb3c-4e55-b729-63b53de4ce8b req-5007143a-6b81-4c98-bc46-76e1a7db4352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8cba7f-a173-4f5a-bb60-0732504ddf03", "name": "network-vif-deleted", "tag": "7cf4a2fc-044c-4c08-87b6-e7915bff99d4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:55.119353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cc73de37-fb3c-4e55-b729-63b53de4ce8b req-5007143a-6b81-4c98-bc46-76e1a7db4352 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.120755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cc73de37-fb3c-4e55-b729-63b53de4ce8b req-5007143a-6b81-4c98-bc46-76e1a7db4352 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.121408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cc73de37-fb3c-4e55-b729-63b53de4ce8b req-5007143a-6b81-4c98-bc46-76e1a7db4352 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.130341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:55.139423 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cc73de37-fb3c-4e55-b729-63b53de4ce8b req-5007143a-6b81-4c98-bc46-76e1a7db4352 service nova] Creating event network-vif-deleted:7cf4a2fc-044c-4c08-87b6-e7915bff99d4 for instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 on n-h1-833090-19 Sep 08 10:16:55.140009 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3372b8fa-d359-4a7f-826c-7076feeaaf64 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1493 microversion: 2.1 time: 0.258487 Sep 08 10:16:55.140906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 470/886] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:54 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1493 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:55.157734 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cc73de37-fb3c-4e55-b729-63b53de4ce8b req-5007143a-6b81-4c98-bc46-76e1a7db4352 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056278 Sep 08 10:16:55.158723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 417/887] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:55.166356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.167737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.174164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.174670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.175276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.176023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.176473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.176885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.317066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.318519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.324972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.325780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.326485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.327583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.328226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.328912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.465092 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4891e96-5b00-416f-9e6d-741ef3ca7028 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1646 microversion: 2.1 time: 0.303622 Sep 08 10:16:55.466556 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 471/888] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1646 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:55.488411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.489025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.496751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.496751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.497193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.497964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.498503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.499031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.610405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:55.619151 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6737072a-172d-4ca2-a23d-14c500f0124a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.306300 Sep 08 10:16:55.619811 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 418/889] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:55.624951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.625732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.632413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.632903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.633345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.634047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.634683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.635110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.720687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:55.726511 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b40ebff5-abb7-4bf9-9825-c8edbef9ba73 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1646 microversion: 2.1 time: 0.241896 Sep 08 10:16:55.732624 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e706ce40-da41-448b-9cf1-d588a4f9498d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1265 microversion: 2.1 time: 0.111743 Sep 08 10:16:55.741282 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 472/890] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1646 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:55.744141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 419/891] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:55.751708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.752626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.755727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.759122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.759643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.760103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.760820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.761297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.761459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.761719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.763615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.767520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.768659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.769402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.770048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.799846 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5968e54-8f6a-4f37-8fbf-f3324b49ce61 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.050740 Sep 08 10:16:55.801102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 420/892] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:16:55.813155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:55.814084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.820477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.821057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.821753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.822890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.823587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.824215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.878719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:55.904485 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e733330a-54f3-4d93-a379-44a9a721d5ec tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec/action" status: 202 len: 0 microversion: 2.1 time: 0.095006 Sep 08 10:16:55.905468 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 421/893] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:55 2022] POST /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:16:55.913846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:55.915053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:55.923808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.924308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.924844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:55.925511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:55.925987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:55.926410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.034632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.043087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.044583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.045717 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4695e66d-ae3c-40aa-9a1b-9ee68dea79ce tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.303400 Sep 08 10:16:56.055757 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 473/894] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:56.132117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:56.132964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:56.140180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:56.140909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:56.141552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.142267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:56.142788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:56.143181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.167942 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eeac5c39-e792-4a2d-ad31-d2b18ac66cf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1651 microversion: 2.1 time: 0.254888 Sep 08 10:16:56.169232 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 422/895] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:55 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1651 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:56.222633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.231893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.233356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.238680 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa016c65-c1b4-40a9-90ef-5832675fa748 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.112581 Sep 08 10:16:56.239485 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 474/896] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:56 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:56.642486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:56.643018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:56.649041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:56.649526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:56.649958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.650649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:56.651174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:56.651622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.759454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:56.760381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:56.766406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:56.766969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:56.767408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.768128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:56.768579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:56.768996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:56.952459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:56.960601 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac380172-2bfa-43d0-b628-b40c8af60992 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.322033 Sep 08 10:16:56.964761 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 423/897] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:56 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:57.015526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.023274 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9cf6e129-154f-4059-8174-03b008ce00d2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.268728 Sep 08 10:16:57.023918 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 475/898] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:56 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:57.070590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:57.071232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:57.077830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.078321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.078755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.079474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.079940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.080365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.184326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8c58ef5c-e7be-4dda-848b-bb4f6f0e3c72 req-dea9c0f2-b554-4526-a62c-bee3c2f0865e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae4810a-a023-44d3-9497-d41ed8fe7914", "tag": "923ae83a-f524-4844-a2a4-05d910357730"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:57.194143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8c58ef5c-e7be-4dda-848b-bb4f6f0e3c72 req-dea9c0f2-b554-4526-a62c-bee3c2f0865e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.194646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8c58ef5c-e7be-4dda-848b-bb4f6f0e3c72 req-dea9c0f2-b554-4526-a62c-bee3c2f0865e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.195069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8c58ef5c-e7be-4dda-848b-bb4f6f0e3c72 req-dea9c0f2-b554-4526-a62c-bee3c2f0865e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.206283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8c58ef5c-e7be-4dda-848b-bb4f6f0e3c72 req-dea9c0f2-b554-4526-a62c-bee3c2f0865e service nova] Creating event network-changed:923ae83a-f524-4844-a2a4-05d910357730 for instance eae4810a-a023-44d3-9497-d41ed8fe7914 on n-h1-833090-19 Sep 08 10:16:57.212407 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8c58ef5c-e7be-4dda-848b-bb4f6f0e3c72 req-dea9c0f2-b554-4526-a62c-bee3c2f0865e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032741 Sep 08 10:16:57.213124 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 476/899] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:16:57.218022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:57.218703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:57.224702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.225278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.225614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.226304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.226749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.227172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.398602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.406879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.408354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.409465 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee9fa18a-6cd3-4e1a-bc58-cbfd59732125 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.343104 Sep 08 10:16:57.410030 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 424/900] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:57 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:57.433465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:57.434085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:57.440305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.440795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.441230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.441938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.442389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.442810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.723145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.726578 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6381df89-9392-4e24-97b3-0ed22d13f556 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1631 microversion: 2.1 time: 0.512212 Sep 08 10:16:57.727292 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 477/901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:57 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1631 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:57.732534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.733975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:57.739566 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88be8f34-5e9b-4bac-abbc-2a3f31e9b4d1 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.314434 Sep 08 10:16:57.740128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 425/902] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:57 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:57.750727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-19", "block_migration": true, "disk_over_commit": false}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:16:57.753272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:57.759988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.760627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.760898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.761600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.762050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.762475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.787030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lazy-loading 'flavor' on Instance uuid a03a7af3-2569-4592-bab4-88792475ddec {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:16:57.799566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Going to try to live migrate instance to n-h2-833090-19 {{(pid=122457) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:16:57.985582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:57.986452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:57.993379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.993940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.994460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:57.995229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:57.995818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:57.996303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.134933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.142874 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-062c36bc-a718-4317-a74d-aa6289e452d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.161387 Sep 08 10:16:58.143438 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 426/903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:57 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:58.149802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:58.150416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:58.157367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:58.157850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:58.158282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.159148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:58.159640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:58.160069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.295832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.303665 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2466b1df-67ae-4249-9ed6-7c0c3188d5b9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.159219 Sep 08 10:16:58.304234 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 427/904] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:58 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:58.438294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:58.438938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:58.444923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:58.445406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:58.445846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.446543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:58.446996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:58.447423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.580507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.589143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.590603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.591750 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a72ccfb9-64ff-4415-a40f-4dcbe4eafc35 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.157444 Sep 08 10:16:58.592316 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 428/905] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:58 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:58.767878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:58.768535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:58.770408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:16:58.775810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:58.776295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:58.776725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.777435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:58.777857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:58.778322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:58.843809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.851969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.853401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:58.858294 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e26dc9c5-2aa1-44e6-92a3-39566ae46b3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.094249 Sep 08 10:16:58.858866 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 429/906] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:58 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:16:59.166309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:59.166963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:59.173564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.174053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.174491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.175190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.175685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.176109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.428868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.436607 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c1c7f507-6266-45a2-9b31-21aefc159f9a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1313 microversion: 2.1 time: 0.274251 Sep 08 10:16:59.437183 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 430/907] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:59 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:16:59.456472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:59.457091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:59.462843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.463847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.464290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.465003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.465438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.465861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.603643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.612453 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-232e5e81-d091-4684-b680-cfb9c67ff47a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.159924 Sep 08 10:16:59.613008 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 431/908] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:16:59 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:16:59.617666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:59.618276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:59.624390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.624896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.625298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.626001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.626455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.626877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.758156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.766890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.768372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.769483 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9dc5b058-052b-46ed-8369-249c5985fd9c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.155561 Sep 08 10:16:59.770046 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 432/909] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:59 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:16:59.886405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:16:59.886926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:16:59.892865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.893343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.893803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.894540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:16:59.894990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:16:59.895412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:16:59.962708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.972624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.974426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:16:59.980325 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a0be51f-c065-4bdf-a5ec-8f9174ed231d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.097950 Sep 08 10:16:59.981007 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 433/910] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:16:59 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:00.464662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:00.465286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:00.473163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:00.473654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:00.474092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:00.474806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:00.475259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:00.475717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:00.696876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:00.706119 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4fc90a01-e475-4f13-a356-36fa5cd3bfc1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1463 microversion: 2.1 time: 0.246451 Sep 08 10:17:00.720954 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 434/911] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:00 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1463 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:00.720954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:00.720954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:00.720954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:00.720954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:00.721465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:00.721465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:00.721465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:00.721676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:00.937554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:00.947012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e316f543-1614-490b-9e99-1e88ec0448bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.238842 Sep 08 10:17:00.959499 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 435/912] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:00 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:00.959499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:00.959499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:00.965200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:00.965200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:00.965200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:00.965200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:00.965659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:00.965659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.004254 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c62a2e8-1c62-4123-94dc-7a7a1d3e63fd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec/action" status: 202 len: 0 microversion: 2.1 time: 3.257174 Sep 08 10:17:01.006172 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 478/913] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:16:57 2022] POST /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec/action => generated 0 bytes in 3260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:17:01.012828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:01.013472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:01.020616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.021109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.021592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.022250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.023026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.023482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.074073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.080769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:17:01.088038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:17:01.088395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:17:01.089725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:17:01.090272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:17:01.090680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:17:01.187371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:01.199356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.207801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.209342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.210590 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e23456d5-4dac-4d25-a355-17c663e1fe9d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.203264 Sep 08 10:17:01.211364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 479/914] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:01 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:01.214958 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e6b3ff8-176d-4d8a-9563-49408b9de0b4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437/action" status: 202 len: 0 microversion: 2.1 time: 0.265205 Sep 08 10:17:01.215654 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 436/915] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:17:00 2022] POST /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:17:01.220880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:01.221499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:01.223204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:01.224007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:01.230441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.231190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.231826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.232799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.234241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.235669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.237886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.238267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.238718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.239489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.239945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.242387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.357189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.371576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.373333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.378989 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4994c783-0464-437a-b275-3391ec6317e7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.166439 Sep 08 10:17:01.379604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 480/916] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:01 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:01.384466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:01.385279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:01.391995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.392666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.393269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.394108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.394700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.395260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.430914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.440541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-646b3e39-b7cb-4a1e-9a3d-21be65352fb7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.223823 Sep 08 10:17:01.456233 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 437/917] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:01 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:01.583165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:01.592931 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2c33ffb-67c7-4fad-97d2-5a3292fef3a2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1472 microversion: 2.1 time: 0.212103 Sep 08 10:17:01.593670 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 481/918] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:01 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:01.977433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:01.979789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:01.986503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.987185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.987671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:01.988384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:01.988835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:01.989351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.131868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.140809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c64e6751-f815-4e79-986e-56aa30a99efd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.167181 Sep 08 10:17:02.151786 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 438/919] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:01 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:02.239378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:02.240511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:02.248256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.249014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.249455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.250650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.251672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.251765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.412601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:02.414367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:02.438907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.441707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.442292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.442726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.448656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.449604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.449892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.450080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.451553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.452885 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a7f8933-9412-4c7d-ab15-62210dd26c98 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.217987 Sep 08 10:17:02.453761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 482/920] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:02 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:02.466107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:02.467340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:02.474530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.474787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.475354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.476398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.476993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.477554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.494117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:02.538701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.549684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.551725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.563808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df147414-9951-4d84-a5a8-3c86030a3cbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.156721 Sep 08 10:17:02.571919 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 439/921] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:02 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:02.581080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c6980c40-f5eb-4325-8d72-5fbcdaac5610 req-11374997-5934-4a2a-8e6f-838b337a45eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03a7af3-2569-4592-bab4-88792475ddec", "name": "network-vif-unplugged", "status": "completed", "tag": "3ea7fc6f-91bc-42c7-89eb-65b824d46318"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:02.605563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6980c40-f5eb-4325-8d72-5fbcdaac5610 req-11374997-5934-4a2a-8e6f-838b337a45eb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.606424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6980c40-f5eb-4325-8d72-5fbcdaac5610 req-11374997-5934-4a2a-8e6f-838b337a45eb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.606921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6980c40-f5eb-4325-8d72-5fbcdaac5610 req-11374997-5934-4a2a-8e6f-838b337a45eb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.631815 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c6980c40-f5eb-4325-8d72-5fbcdaac5610 req-11374997-5934-4a2a-8e6f-838b337a45eb service nova] Creating event network-vif-unplugged:3ea7fc6f-91bc-42c7-89eb-65b824d46318 for instance a03a7af3-2569-4592-bab4-88792475ddec on n-h1-833090-19 Sep 08 10:17:02.639800 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c6980c40-f5eb-4325-8d72-5fbcdaac5610 req-11374997-5934-4a2a-8e6f-838b337a45eb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066089 Sep 08 10:17:02.640851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 440/922] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:02.646293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:02.647013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:02.652328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.653613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.654111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.654559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.655261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:02.655921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:02.656350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:02.663423 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2917e788-2dbf-4484-b530-98607b66ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.201819 Sep 08 10:17:02.664305 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 483/923] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:02 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:02.818517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:02.827238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7e4069a-ba71-44ed-9629-800934c351f5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1472 microversion: 2.1 time: 0.185697 Sep 08 10:17:02.827850 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 441/924] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:02 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:03.164793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:03.165330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:03.167810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:03.174869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.175363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.175836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.176539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.177000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.177418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.308758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.316486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08e3aaf1-9cd3-4b37-8e42-e22333ed67c2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.156196 Sep 08 10:17:03.317065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 484/925] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:03 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:03.478363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:03.478962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:03.485384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.485875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.486559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.487241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.487724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.488142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.597457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:03.598571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:03.604915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=34 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:03.607594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.608484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.609129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.610046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.610662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.611690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.633896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.644082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.645849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.647389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5823d63-ad99-4789-9cfe-5363c16f7156 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.172982 Sep 08 10:17:03.648617 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 442/926] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:03 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:03.688334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.692416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:03.693025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:03.697523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.699849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.700004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.700388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.700818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.701515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.701961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.702378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.705810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02ff7519-9e76-4720-82b7-6eab8950e3ed tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.113321 Sep 08 10:17:03.711921 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 485/927] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:03 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:03.770573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1df75843-ad18-4b42-a57e-cf14bce1ba87 req-fa1d5f0a-7de2-4390-9044-6616ede55ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae4810a-a023-44d3-9497-d41ed8fe7914", "name": "network-vif-plugged", "status": "completed", "tag": "923ae83a-f524-4844-a2a4-05d910357730"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:03.785736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1df75843-ad18-4b42-a57e-cf14bce1ba87 req-fa1d5f0a-7de2-4390-9044-6616ede55ff8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.786223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1df75843-ad18-4b42-a57e-cf14bce1ba87 req-fa1d5f0a-7de2-4390-9044-6616ede55ff8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.786653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1df75843-ad18-4b42-a57e-cf14bce1ba87 req-fa1d5f0a-7de2-4390-9044-6616ede55ff8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.813167 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1df75843-ad18-4b42-a57e-cf14bce1ba87 req-fa1d5f0a-7de2-4390-9044-6616ede55ff8 service nova] Creating event network-vif-plugged:923ae83a-f524-4844-a2a4-05d910357730 for instance eae4810a-a023-44d3-9497-d41ed8fe7914 on n-h1-833090-19 Sep 08 10:17:03.821112 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1df75843-ad18-4b42-a57e-cf14bce1ba87 req-fa1d5f0a-7de2-4390-9044-6616ede55ff8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059802 Sep 08 10:17:03.821745 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 486/928] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:03.851076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:03.852075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:03.862335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.862835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.863282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.864034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:03.864492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:03.864988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:03.866464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:03.875407 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f41d5937-d81d-4e52-a7d6-410c846689b9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.191586 Sep 08 10:17:03.877397 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 443/929] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:03 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:04.073277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.081894 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d6c92ab7-01e6-4e4a-bcc5-932bfd5b2394 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1472 microversion: 2.1 time: 0.235206 Sep 08 10:17:04.082486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 487/930] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:03 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:04.340920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:04.341632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:04.348020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.348434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.348964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.349661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.350209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.350636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.515428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.541542 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca54566a-6791-4b00-93d5-d317dfce9908 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.205254 Sep 08 10:17:04.552343 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 444/931] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:04 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:04.667069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-89710412-b30e-475c-8113-85dbf27a9af5 req-77d8b861-722e-4488-ab24-d1c607f43038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a03a7af3-2569-4592-bab4-88792475ddec", "tag": "3ea7fc6f-91bc-42c7-89eb-65b824d46318"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:04.683844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:04.684582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:04.686080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89710412-b30e-475c-8113-85dbf27a9af5 req-77d8b861-722e-4488-ab24-d1c607f43038 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.686874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89710412-b30e-475c-8113-85dbf27a9af5 req-77d8b861-722e-4488-ab24-d1c607f43038 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.687575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89710412-b30e-475c-8113-85dbf27a9af5 req-77d8b861-722e-4488-ab24-d1c607f43038 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.694147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.694733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.695286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.696105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.696677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.697161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.705845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-89710412-b30e-475c-8113-85dbf27a9af5 req-77d8b861-722e-4488-ab24-d1c607f43038 service nova] Creating event network-changed:3ea7fc6f-91bc-42c7-89eb-65b824d46318 for instance a03a7af3-2569-4592-bab4-88792475ddec on n-h1-833090-19 Sep 08 10:17:04.712833 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-89710412-b30e-475c-8113-85dbf27a9af5 req-77d8b861-722e-4488-ab24-d1c607f43038 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049526 Sep 08 10:17:04.714351 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 488/932] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:04.736224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:04.737211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:04.746507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.747256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.747917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.748650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.749110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.749689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.850330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.860481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.862604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.869529 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-855f25e4-1c5e-42e5-a110-5f377955ebde tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.138911 Sep 08 10:17:04.871301 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 489/933] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:04 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:04.890609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.899212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.900969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:04.902277 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6063b409-4f4a-4098-a2e1-60d601f5b58c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.225812 Sep 08 10:17:04.903296 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 445/934] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:04 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:04.906008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:04.906808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:04.914641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.915221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.915897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:04.918288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:04.919251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:04.920399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.093235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:05.101120 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a604d3cf-40ab-434b-bb00-280be2f2a712 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.200702 Sep 08 10:17:05.101702 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 490/935] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:04 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:05.107324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:05.108311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:05.114673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.115235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.115756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.116536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.117059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.117581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.296863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:05.305074 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09520cd8-9e5f-4507-b348-0ace721b69c7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.202171 Sep 08 10:17:05.305638 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 446/936] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:05 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:05.565058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:05.565744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:05.567754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:05.588761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.589313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.589837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.591379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.591867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.593435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.840395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9a142853-1888-46c3-8562-a2e8d8e03ef5 req-7338b29a-6188-46f6-82b0-811adfde3b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7265635f-ed38-4363-84e1-d4f53815fb77", "name": "network-vif-plugged", "status": "completed", "tag": "d0564e9f-ad94-40f2-a233-8c2e9ea93b6a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:05.854839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:05.856979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:05.859506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a142853-1888-46c3-8562-a2e8d8e03ef5 req-7338b29a-6188-46f6-82b0-811adfde3b21 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.860138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a142853-1888-46c3-8562-a2e8d8e03ef5 req-7338b29a-6188-46f6-82b0-811adfde3b21 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.860790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a142853-1888-46c3-8562-a2e8d8e03ef5 req-7338b29a-6188-46f6-82b0-811adfde3b21 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.873114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-353191ad-dfa0-4984-8ebe-c71e2ee19ee5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1307 microversion: 2.1 time: 0.311841 Sep 08 10:17:05.883703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 491/937] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:05 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:05.887775 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9a142853-1888-46c3-8562-a2e8d8e03ef5 req-7338b29a-6188-46f6-82b0-811adfde3b21 service nova] Creating event network-vif-plugged:d0564e9f-ad94-40f2-a233-8c2e9ea93b6a for instance 7265635f-ed38-4363-84e1-d4f53815fb77 on n-h2-833090-19 Sep 08 10:17:05.894169 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9a142853-1888-46c3-8562-a2e8d8e03ef5 req-7338b29a-6188-46f6-82b0-811adfde3b21 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057434 Sep 08 10:17:05.895715 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 447/938] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:05.903059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:05.903697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:05.910462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.910961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.911400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.912168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.912626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.913107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.933484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:05.934349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:05.941815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.942530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.943060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:05.944027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:05.944599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:05.945117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.011937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.020983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.023149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.028977 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1d5a2af-61a6-497f-8932-66cf64c51448 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.134479 Sep 08 10:17:06.039967 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 492/939] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:05 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:06.124402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:06.125012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:06.133709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.134198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.134636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.136539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.137024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.137455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.151583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.160727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.162304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.163417 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29489d65-b04b-4b26-8135-eb3ae38b8d9b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.236910 Sep 08 10:17:06.164073 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 448/940] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:05 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:06.288847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.298462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e52c991d-d620-4e47-9588-3762c60b7200 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.177884 Sep 08 10:17:06.299417 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 493/941] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:06 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:06.328777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:06.329653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:06.336438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.337024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.337596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.338898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.339479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.339978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.476459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:06.484198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6015fb9c-b021-44f4-9b2c-9ef5d7e648ec tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.159353 Sep 08 10:17:06.484792 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 449/942] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:06 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:06.665890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8f3552d-c5f4-4202-a653-736786d50f44"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:06.668419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:06.674833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.675427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.675986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.676694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.677154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.677580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.897271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:06.897846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:06.904116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.904589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.905014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:06.905687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:06.906130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:06.906543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.046220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.054076 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96f4863c-bfb0-4a45-9ced-dd764a8076bd tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1486 microversion: 2.1 time: 0.160967 Sep 08 10:17:07.054654 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 450/943] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:06 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1486 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:07.068011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:07.069192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:07.079964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.080831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.081638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.082885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.083765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.084531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.151586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.159772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.161217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.165898 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dfa83a38-d3b4-41e7-a293-124f6220a211 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.105372 Sep 08 10:17:07.167002 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 451/944] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:07 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:07.171509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36cd6ab0-dca2-4673-95f6-2ccb43cfd123 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:07.177100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36cd6ab0-dca2-4673-95f6-2ccb43cfd123 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.177586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36cd6ab0-dca2-4673-95f6-2ccb43cfd123 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.178019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36cd6ab0-dca2-4673-95f6-2ccb43cfd123 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.237015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36cd6ab0-dca2-4673-95f6-2ccb43cfd123 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:17:07.280361 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36cd6ab0-dca2-4673-95f6-2ccb43cfd123 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914/action" status: 202 len: 0 microversion: 2.1 time: 0.112135 Sep 08 10:17:07.281101 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 452/945] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:17:07 2022] POST /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:17:07.286714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:07.287842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:07.294432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.294908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.295340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.296059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.296506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.296924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.430949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.433922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:07.441628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.443172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.444334 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e0bcdb5-936a-43c7-ade3-3aba5f7d8206 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.161966 Sep 08 10:17:07.444883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 453/946] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:07 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:07.449679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:07.450338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:07.456525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.457007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.457440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.458135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.458582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.458999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.601286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.611180 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b84f9dbe-40e1-4ab8-aeca-be56e2322724 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.165046 Sep 08 10:17:07.611797 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 454/947] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:07 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:07.616291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:07.616897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:07.623093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.623704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.624520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.625432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.626080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.626535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.756678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.764378 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0b916d9-ae1e-46cc-9a5d-70ce31e2ea1c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.151636 Sep 08 10:17:07.764946 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 455/948] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:07 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:07.769315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:07.769936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:07.775564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.776549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.776986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.777676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:07.778128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:07.778551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:07.917773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:07.925451 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8d975a37-e8bc-4d3c-9f32-19975f42942e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.159568 Sep 08 10:17:07.926045 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 456/949] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:07 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:08.092529 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d93364b2-9c50-4781-90fb-56240aa8e969 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "POST /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430428 Sep 08 10:17:08.093171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 494/950] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:17:06 2022] POST /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 194 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:08.194732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:08.195385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:08.202256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.202743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.203179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.203897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.204387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.204809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.269368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.278198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.279691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.284717 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a418d41d-b303-4645-a551-92c49cdc91e0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.093943 Sep 08 10:17:08.285289 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 457/951] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:08 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:08.470160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:08.470784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:08.477351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.477830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.478261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.478945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.479387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.479835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.608217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.616581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.618023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.619137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7a21761-c3e8-4717-88bc-c80710ab67f2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1412 microversion: 2.25 time: 0.153541 Sep 08 10:17:08.620269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 495/952] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:08 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:08.633828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:08.634455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:08.641429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.641981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.642300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.642998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.643451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.643907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.781734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.787679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:08.788293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:08.789672 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-089fef4b-e05a-4ba5-a215-02ca7ffe0350 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.159640 Sep 08 10:17:08.790436 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 458/953] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:08 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:08.795429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.795948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.796382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.797220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.797676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.798099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.932893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:08.940797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f84208d0-c097-4b87-aa69-121f3ffdb51d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.157133 Sep 08 10:17:08.941377 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 496/954] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:08 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:08.950394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:08.951007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:08.957483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.957966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.958405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:08.959096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:08.959641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:08.960069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:09.124640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:09.132461 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-791e3b8a-52c4-44a7-b803-e138ade3237b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.186548 Sep 08 10:17:09.133037 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 459/955] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:08 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:09.312943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:09.313493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:09.320330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:09.320816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:09.321252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:09.321960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:09.322412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:09.323486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:09.389032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:09.401628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:09.403168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:09.408494 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ffbc87b-6709-4f90-ae88-cd9926c1f0c8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.099609 Sep 08 10:17:09.409071 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 497/956] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:09 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:09.656107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:09.656724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:09.662865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:09.663350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:09.663830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:09.664527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:09.664989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:09.665411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:09.811988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:09.812917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:09.819705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:09.820192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:09.820627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:09.821331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:09.821776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:09.822194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.098140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.107204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.108712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.109920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-78cb2a16-17dd-48f7-aabf-06b8026ffb2e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1609 microversion: 2.25 time: 0.457781 Sep 08 10:17:10.113119 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 460/957] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:09 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1609 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:10.115961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:10.116578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:10.123542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.124043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.124479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.125184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.125636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.126061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.264426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.294600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-883e1a42-51e8-42a8-9d87-c456e18d77d8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.485890 Sep 08 10:17:10.295762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 498/958] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:09 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:10.301131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:10.301763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:10.307906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.308491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.309000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.309792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.310896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.310896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.433853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.446734 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb51feb1-8992-4436-bd41-54fb25f32217 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.334280 Sep 08 10:17:10.448207 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 461/959] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:10 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:10.453323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:10.454151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:10.459267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-88bfaf8c-a3bc-4e2d-a544-01ee010cebd9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.162328 Sep 08 10:17:10.460930 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 499/960] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:17:10 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:17:10.464079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.464770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.465405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.465889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.466367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.466880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.469030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:10.469748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:10.481030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.483044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.483636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.484478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:10.485042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:10.485570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:10.513908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:10.597938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.612613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.617773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.633893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f2557dc-2b43-49d3-9df3-9577101226e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.171052 Sep 08 10:17:10.635894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 500/961] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:10 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:10.699678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:10.708070 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f28b18f-8642-4ca2-8e39-340c964aa893 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.258646 Sep 08 10:17:10.712736 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 462/962] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:10 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:11.323990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:11.324726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:11.332413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.333365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.334203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.335502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.336192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.336846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.482141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:11.483334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:11.491855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.492649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.493303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.494278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.494954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.495352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:11.496230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.504166 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c3efc56-f905-48e6-8fbc-87779feccd3b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.186759 Sep 08 10:17:11.506955 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 501/963] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:11 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:11.640472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:11.648603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-53985199-650e-42d2-a059-cf6696971041 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1503 microversion: 2.1 time: 0.171064 Sep 08 10:17:11.649389 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 463/964] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:11 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:11.670775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:11.671886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:11.678233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.678720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.679375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.680214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.680816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.681386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.734318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:11.734835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:11.741368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.742056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.742755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.743721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.744384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.745010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.763218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:11.771733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:11.773490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:11.788597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f734cd5a-d48b-45d9-85ac-a64f38008fa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.124113 Sep 08 10:17:11.803920 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 502/965] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:11 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:11.908646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:11.917917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-915c71f5-f332-4fdf-8127-b12c97aecb87 req-c49b53aa-08ab-402a-9b71-0a0c16143fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7265635f-ed38-4363-84e1-d4f53815fb77", "tag": "d0564e9f-ad94-40f2-a233-8c2e9ea93b6a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:11.921261 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b636b85-6dcc-4784-b3ef-32ffa45cc92c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.189732 Sep 08 10:17:11.924545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 464/966] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:11 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:11.930424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-915c71f5-f332-4fdf-8127-b12c97aecb87 req-c49b53aa-08ab-402a-9b71-0a0c16143fe1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:11.930965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-915c71f5-f332-4fdf-8127-b12c97aecb87 req-c49b53aa-08ab-402a-9b71-0a0c16143fe1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:11.931392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-915c71f5-f332-4fdf-8127-b12c97aecb87 req-c49b53aa-08ab-402a-9b71-0a0c16143fe1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:11.953491 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-915c71f5-f332-4fdf-8127-b12c97aecb87 req-c49b53aa-08ab-402a-9b71-0a0c16143fe1 service nova] Creating event network-changed:d0564e9f-ad94-40f2-a233-8c2e9ea93b6a for instance 7265635f-ed38-4363-84e1-d4f53815fb77 on n-h2-833090-19 Sep 08 10:17:11.958594 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-915c71f5-f332-4fdf-8127-b12c97aecb87 req-c49b53aa-08ab-402a-9b71-0a0c16143fe1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044858 Sep 08 10:17:11.959534 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 503/967] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:12.529893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:12.529893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:12.538864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:12.539697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:12.540490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:12.541441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:12.542974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:12.543736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:12.675706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:12.677137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:12.683963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:12.684698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:12.685448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:12.686303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:12.687016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:12.687627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:12.851153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:12.861265 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1fb5ad1-5580-43a6-bbaa-389bd3d019a8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.338231 Sep 08 10:17:12.863090 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 465/968] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:12 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:12.875970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:12.876724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:12.885780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:12.886278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:12.886728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:12.887637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:12.889090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:12.889698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:12.978038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:12.987200 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7bbc786-cfce-4848-b401-b9dd35133858 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1478 microversion: 2.1 time: 0.317396 Sep 08 10:17:12.988188 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 504/969] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:12 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1478 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:12.993136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:12.994102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:13.000612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.001384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.002086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:13.003022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.003717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.004503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:13.023177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:13.043677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:13.051528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:13.058418 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70b2bc8e-e5fe-433a-99d4-f33a600650b4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.193692 Sep 08 10:17:13.080433 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 466/970] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:12 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:13.085919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-64d0aceb-d9b8-4dc6-b3af-62e329e68324 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '.version_select at 0x7f2351388310>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:13.090163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64d0aceb-d9b8-4dc6-b3af-62e329e68324 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.090775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64d0aceb-d9b8-4dc6-b3af-62e329e68324 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.091776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64d0aceb-d9b8-4dc6-b3af-62e329e68324 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:13.114295 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-64d0aceb-d9b8-4dc6-b3af-62e329e68324 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.1 time: 0.031913 Sep 08 10:17:13.115552 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 467/971] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:17:13 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:13.134728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:13.137575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:13.152779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.153530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.154513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:13.156478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.156968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.157473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:13.239230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:13.251002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5a64aac-4d50-4af8-aed3-1bee0f926681 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.261524 Sep 08 10:17:13.252283 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 505/972] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:12 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:13.344064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b9e0114-2502-42af-b5f7-04e794002f6b tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1631 microversion: 2.1 time: 0.213310 Sep 08 10:17:13.352910 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 468/973] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:13 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1631 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:13.378430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa2cd2dc-c7df-4005-809b-352566b2bfe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Action: 'create', calling method: .version_select at 0x7f235110af70>, body: {"keypair": {"name": "tempest-keypair-2094581277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/IZeFO6P/G4g3yfhQn5ASJsmrmoH1OJ4nmj7NbGTyguWsTC+ucXEjQVdpEj7hv5Hmkc395EgmEzRcxbln5yrWpsUlQijTSPUfElM5j9z6T4UxCcLXx/mxmOpuqiympTg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:13.395645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-fa2cd2dc-c7df-4005-809b-352566b2bfe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:13.400530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-fa2cd2dc-c7df-4005-809b-352566b2bfe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for user 46a59f79e24b4644a167dc0a4d2c4af9 and project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:13.438121 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa2cd2dc-c7df-4005-809b-352566b2bfe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063392 Sep 08 10:17:13.438954 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 506/974] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:13.902328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:13.903150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:13.911509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.912253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.912729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:13.913795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:13.914408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:13.915328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:14.087066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:14.087652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:14.099489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:14.100053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:14.100688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:14.101549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:14.102012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:14.102436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:14.161646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:14.169181 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bced3ae0-21ba-4f9a-a3c0-de7dc8b9f517 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.274375 Sep 08 10:17:14.170187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 469/975] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:13 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:14.185761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:14.194660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:14.196247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:14.202485 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b47246cc-30ec-4faa-98cf-3aade7e3df3f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.119815 Sep 08 10:17:14.207583 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 507/976] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:14 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:14.275151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:14.276809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:14.282976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:14.283553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:14.283952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:14.284660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:14.285110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:14.285531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:14.483059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:14.491916 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98ad1f8e-852e-4d2f-9090-f8249ff85077 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.221288 Sep 08 10:17:14.492846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 470/977] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:14 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:14.981802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-762489266", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4a01de9c-22cd-443f-9615-bc8a1f2b2669"}], "security_groups": [{"name": "tempest-securitygroup--230438236"}], "key_name": "tempest-keypair-2094581277", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:15.089088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] validate_networks() for [('4a01de9c-22cd-443f-9615-bc8a1f2b2669', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:17:15.192670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:15.193207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:15.200219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.200705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.209565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.210390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.210865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.211298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.216322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:15.454130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:15.461780 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e524fd98-b9bf-4a42-aa22-15a4a70a2c11 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.273082 Sep 08 10:17:15.462355 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 471/978] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:15 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:15.474983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:15.475635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:15.477504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:15.483238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.483757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.484194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.484895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.485349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.486029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.563743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:15.571966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:15.573421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:15.578436 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f90e3c3e-ffa3-4112-97fd-311c2304628c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.107174 Sep 08 10:17:15.579036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 472/979] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:15 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:15.579390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:17:15.579906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:17:15.580500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:17:15.580975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:17:15.581451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:17:15.583659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:15.584462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:15.590770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.591329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.591858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.592684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.593353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.593845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.599435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.599973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.600413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.601124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:15.601578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:15.602001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:15.614098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:15.619704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for user 46a59f79e24b4644a167dc0a4d2c4af9 and project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:15.631712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:17:15.634008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:17:15.687599 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9784eb90-b364-447e-a066-e86c4623a3ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710301 Sep 08 10:17:15.688474 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 508/980] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:17:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:17:15.699668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9ae2b51-b68d-488c-b1a6-f8292fb4c828 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:15.700288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9ae2b51-b68d-488c-b1a6-f8292fb4c828 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:15.751394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:15.760164 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f27ce53b-2781-4b62-829d-9a94a828ba2e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.180018 Sep 08 10:17:15.760806 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 473/981] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:15 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:15.768567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c9ae2b51-b68d-488c-b1a6-f8292fb4c828 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:15.776353 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9ae2b51-b68d-488c-b1a6-f8292fb4c828 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1234 microversion: 2.1 time: 0.080806 Sep 08 10:17:15.776947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 509/982] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:15 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:16.484644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:16.485257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:16.492191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.492679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.493118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.493860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.494814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.495237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.610615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:16.611245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:16.618073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.618560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.619188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.619917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.620374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.621024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.642043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:16.651880 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36249ce1-06b9-42e0-afd4-d12bef929b8b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.170915 Sep 08 10:17:16.652462 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 474/983] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:16 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:16.688924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:16.697096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:16.698609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:16.705228 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e7bbbb5-f9fe-4ead-881e-8b93790e1a14 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.099264 Sep 08 10:17:16.705793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 510/984] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:16 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:16.783509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:16.784063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:16.790161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.790637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.791728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.792413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.792892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.793307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.800166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:16.800778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:16.806744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.807237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.807735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.808452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:16.808907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:16.809335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:16.896134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:16.908672 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f55878f-484e-4821-b667-b50159c97fe2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1286 microversion: 2.1 time: 0.111903 Sep 08 10:17:16.911024 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 511/985] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:16 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:16.963385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:16.971664 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3b3a097-6909-4fea-aef5-eeaa34e70f94 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.192078 Sep 08 10:17:16.972249 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 475/986] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:16 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:17.678856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:17.679506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:17.689144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:17.689828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:17.690471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:17.691189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:17.692276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:17.692276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:17.734098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:17.734728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:17.742211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:17.742711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:17.743156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:17.743927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:17.744580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:17.745011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:18.041183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:18.050521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:18.052156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:18.058015 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4fe467ea-70df-4c32-8c86-f261b40cd7d5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.327817 Sep 08 10:17:18.058674 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 476/987] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:17 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:18.078261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:18.079424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:18.087023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:18.087708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:18.088241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:18.089007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:18.089529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:18.090025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:18.194338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:18.204337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c478e98-0803-4faf-9f37-0413f5827b38 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.532809 Sep 08 10:17:18.204908 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 512/988] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:17 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:18.209947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:18.210545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:18.216619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:18.217316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:18.218091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:18.219002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:18.219763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:18.220409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:18.445500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:18.464867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b4bcbbb7-2639-4026-824b-e9af60ec34bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1359 microversion: 2.1 time: 0.390930 Sep 08 10:17:18.474195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 477/989] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:18 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:18.493404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:18.501849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-325c9191-c19c-42f8-b389-a57cf507ef4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.295750 Sep 08 10:17:18.502664 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 513/990] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:18 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:18.848917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5e638a98-c076-4101-9abd-7f4546319566 req-1a2ee8bf-4ea7-4c55-8adf-3e371b71beda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48255b60-3703-431a-9b76-c65d2bc9966a", "tag": "df6ea807-8c33-4365-8e03-6d7ea7ae7a93"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:18.859639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5e638a98-c076-4101-9abd-7f4546319566 req-1a2ee8bf-4ea7-4c55-8adf-3e371b71beda service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:18.860100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5e638a98-c076-4101-9abd-7f4546319566 req-1a2ee8bf-4ea7-4c55-8adf-3e371b71beda service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:18.866329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5e638a98-c076-4101-9abd-7f4546319566 req-1a2ee8bf-4ea7-4c55-8adf-3e371b71beda service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:18.880894 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5e638a98-c076-4101-9abd-7f4546319566 req-1a2ee8bf-4ea7-4c55-8adf-3e371b71beda service nova] Creating event network-changed:df6ea807-8c33-4365-8e03-6d7ea7ae7a93 for instance 48255b60-3703-431a-9b76-c65d2bc9966a on n-h1-833090-19 Sep 08 10:17:18.886554 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5e638a98-c076-4101-9abd-7f4546319566 req-1a2ee8bf-4ea7-4c55-8adf-3e371b71beda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041386 Sep 08 10:17:18.887185 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 478/991] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:19.088297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:19.088975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:19.095847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.096335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.096779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.097483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.097943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.098378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.171415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:19.179527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:19.180996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:19.186822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fbff79b1-3108-4921-88ad-699d9cc76ad8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.102468 Sep 08 10:17:19.187745 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 514/992] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:19 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:19.227848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:19.229063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:19.235140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.235827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.236255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.236943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.237386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.237798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.396530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:19.404370 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ed402523-fa94-44e8-95c5-6e98ca9e6080 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.180790 Sep 08 10:17:19.404939 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 479/993] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:19 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:19.490683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:19.491208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:19.497883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.498361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.498797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.499520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.500056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.500403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.525457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:19.526069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:19.532194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.532677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.533268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.533965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:19.534418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:19.534841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:19.710701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:19.719063 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7def023-ebd7-43a5-8d6c-07ceb0682be1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1359 microversion: 2.1 time: 0.232484 Sep 08 10:17:19.719660 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 515/994] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:19 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:19.738630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:19.746552 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ed5978d-0f40-46bf-935e-d10cb798a927 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.225383 Sep 08 10:17:19.747062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 480/995] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:19 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:20.214981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:20.215652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:20.222469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.222954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.223394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.224185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.224637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.225058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.301013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:20.310234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:20.311682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:20.317240 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-06f42f70-e92e-4fff-af3d-3dd119498e78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.106856 Sep 08 10:17:20.318025 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 516/996] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:20 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:20.427215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:20.427857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:20.435904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.436584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.437319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.438185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.438786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.439569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.650510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:20.658998 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24626ad4-948d-4450-a21b-89cd6308f1ae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.235546 Sep 08 10:17:20.659886 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 481/997] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:20 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:20.742317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:20.743210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:20.749889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.750376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.751131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.751530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.751986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.752410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.772189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:20.773078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:20.782571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.783287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.783930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:20.784784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:20.785303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:20.785675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.042066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:21.066608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:21.072363 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fdc238a5-c709-46e2-b66c-2d9e93f25e3d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1359 microversion: 2.1 time: 0.333971 Sep 08 10:17:21.073111 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 517/998] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:20 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:21.086330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0c1e84ad-fcda-42c3-bcad-a79cb0966073 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.320745 Sep 08 10:17:21.089798 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 482/999] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:20 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:21.345781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:21.346460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:21.354421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:21.354915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:21.355358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.356100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:21.356561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:21.356992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.422888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:21.431074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:21.432557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:21.435175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:21.438081 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-543302a2-1816-41e4-bb47-aaf9687b1b16 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.096277 Sep 08 10:17:21.438654 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 518/1000] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:21 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:21.682701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:21.683521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:21.690009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:21.690522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:21.690916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.691924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:21.692376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:21.692805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.831618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:21.839390 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87c8d75f-a9c2-4532-af3f-951f3608a728 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.160808 Sep 08 10:17:21.840349 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 483/1001] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:21 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:21.860560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:21.861336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:21.869000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:21.869488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:21.869928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.870626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:21.871076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:21.871516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:21.897876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:17:21.921510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:21.974381 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a87a2273-6668-4fa2-9f48-de2ac54530d3 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 204 len: 0 microversion: 2.1 time: 0.121312 Sep 08 10:17:21.974975 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 519/1002] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:17:21 2022] DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:17:22.073959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-337991740", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "823216011", "adminPass": "***", "networks": [{"uuid": "f7c6d110-3293-4188-afce-fe7df0ee82de"}], "security_groups": [{"name": "tempest-securitygroup--321215783"}], "key_name": "tempest-keypair-401213841", "user_data": "}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:22.097826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:22.098690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:22.106533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.107022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.107455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.108216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.108675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.109087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.251328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] validate_networks() for [('f7c6d110-3293-4188-afce-fe7df0ee82de', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:17:22.299774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:22.308140 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8835b12c-33aa-4901-a43b-6bf19c509591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1359 microversion: 2.1 time: 0.214746 Sep 08 10:17:22.308727 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 520/1003] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:22 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:22.313287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:22.313885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:22.319646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.320137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.320559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.321991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.322260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.322680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.528812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:22.536685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-37f1034f-9d5c-4961-a91f-37ca3958d21a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.226990 Sep 08 10:17:22.537268 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 521/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:22 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:22.541947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:22.542585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:22.548606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.549096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.549536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.550237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.550696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.551121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.626384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:22.635984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:22.637611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:22.643370 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-053e0225-2c3f-4e0a-a9ef-3219ea721c4a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1560 microversion: 2.91 time: 0.105097 Sep 08 10:17:22.643992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 522/1005] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:22 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1560 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:22.765265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:17:22.766357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:17:22.766975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:17:22.767552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:17:22.768035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:17:22.778544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.779045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.779543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.780501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.780764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.781192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.799686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Getting quotas for project f866078f90e94d6ea0a7d681334f2bfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:22.804691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Getting quotas for user 1d06be3d5e0c41aaa44598ee5f9cd4a2 and project f866078f90e94d6ea0a7d681334f2bfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:22.821118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:17:22.824188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:17:22.867019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:22.867639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:22.874754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.875310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.875776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.876466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:22.876916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:22.877338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:22.882294 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08328395-d38e-4962-8f74-2ea4669fd429 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.813018 Sep 08 10:17:22.887629 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 484/1006] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:17:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:17:22.894659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f723a763-dfb2-47da-8206-64ba178c0cd6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:22.895277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f723a763-dfb2-47da-8206-64ba178c0cd6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:22.953781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f723a763-dfb2-47da-8206-64ba178c0cd6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:22.961385 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f723a763-dfb2-47da-8206-64ba178c0cd6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1261 microversion: 2.1 time: 0.070444 Sep 08 10:17:22.976102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 485/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:22 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:23.084791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:23.093734 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fbeb5b47-aca9-47bb-b0f7-ead9591bffd0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.230847 Sep 08 10:17:23.097780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 523/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:22 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:23.332341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:23.333259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:23.340795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.341514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.341996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.342969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.343640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.344078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.454057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0ac7c529-249c-4543-8569-f35091fa02f1"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:23.456764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:23.463259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.463792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.464404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.465318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.465785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.466218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.499665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:23.507660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ea90275-b7a2-4bb6-9237-0f31d8d26423 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1359 microversion: 2.1 time: 0.179479 Sep 08 10:17:23.508321 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 524/1009] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:23 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:23.561104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:23.561729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:23.567582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.568066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.568498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.569186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.569759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.570177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.671306 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] HTTP exception thrown: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Request method failure captured: Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments/f8f3552d-c5f4-4202-a653-736786d50f44 HTTP/1.1 Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 74 Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcCJcu8ceB4YOLZdDnLyycDf5J97f0-g05XYXrwhIzLQcaJ8QGhwC01DygL_kbW2A9EBhtCt35ba_uJel_6W9f0vMi_N44-53RYdnJt50CReI6GJ0jZuRLEr8MtZvUALrDT2Fp2Q_nORcJcQvS0f0ghGK1a4joaH7NFKO18NlyQLA7o Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25c552069a1f4910a9f90fcc33cd88ac Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesAdminNegativeTest-385884461 Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:17:23.699949 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25c552069a1f4910a9f90fcc33cd88ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25c552069a1f4910a9f90fcc33cd88ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25c552069a1f4910a9f90fcc33cd88ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25c552069a1f4910a9f90fcc33cd88ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesAdminNegativeTest-385884461 Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25c552069a1f4910a9f90fcc33cd88ac Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-385884461 Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesAdminNegativeTest-385884461-project-admin Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2d2881cf2a1c4329957ee886be24fca6 Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesAdminNegativeTest-385884461-project-admin Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: {"volumeAttachment": {"volumeId": "0ac7c529-249c-4543-8569-f35091fa02f1"}} Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:17:23.701586 n-d-833090-19 devstack@n-api.service[122456]: exception: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': 'a9a87449-ea1f-432b-988d-b8a9ac85c7de', 'id': 'f8f3552d-c5f4-4202-a653-736786d50f44', 'body': {'volumeAttachment': {'volumeId': '0ac7c529-249c-4543-8569-f35091fa02f1'}}} Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:17:23.702572 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. (HTTP 404) (Request-ID: req-35ab7594-012e-468a-926d-ecf86f9da70a) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:17:23.703837 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:17:23.705241 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. Sep 08 10:17:23.706645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:23.708052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Returning 400 to user: Volume 0ac7c529-249c-4543-8569-f35091fa02f1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:17:23.708052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe7627c2-7294-4925-96df-56115150568f tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] 10.222.0.59 "PUT /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments/f8f3552d-c5f4-4202-a653-736786d50f44" status: 400 len: 107 microversion: 2.1 time: 0.378945 Sep 08 10:17:23.708052 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 486/1010] 10.222.0.59 () {60 vars in 1433 bytes} [Thu Sep 8 10:17:23 2022] PUT /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments/f8f3552d-c5f4-4202-a653-736786d50f44 => generated 107 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:17:23.714257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:23.714983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:23.724474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.725552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.726466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.727406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.728420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.729084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.732591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:23.743679 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-33dba541-587d-48cf-8839-54758128b362 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.186230 Sep 08 10:17:23.744440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 525/1011] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:23 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:23.806568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:23.807171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:23.814075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.814664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.815177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.816019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.816704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.817142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.822675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:23.833143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:23.834756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:23.841236 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee6230e3-e492-450d-99cf-00972595f84f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1560 microversion: 2.91 time: 0.132716 Sep 08 10:17:23.841961 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 487/1012] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:23 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1560 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:23.865396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-26e2e5a2-4a99-49f1-be56-3bba59474fa6 req-760ac886-690e-4632-9150-bb8e12fc350b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48255b60-3703-431a-9b76-c65d2bc9966a", "name": "network-vif-plugged", "status": "completed", "tag": "df6ea807-8c33-4365-8e03-6d7ea7ae7a93"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:23.877873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26e2e5a2-4a99-49f1-be56-3bba59474fa6 req-760ac886-690e-4632-9150-bb8e12fc350b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.878610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26e2e5a2-4a99-49f1-be56-3bba59474fa6 req-760ac886-690e-4632-9150-bb8e12fc350b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.879264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26e2e5a2-4a99-49f1-be56-3bba59474fa6 req-760ac886-690e-4632-9150-bb8e12fc350b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:23.891321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-26e2e5a2-4a99-49f1-be56-3bba59474fa6 req-760ac886-690e-4632-9150-bb8e12fc350b service nova] Creating event network-vif-plugged:df6ea807-8c33-4365-8e03-6d7ea7ae7a93 for instance 48255b60-3703-431a-9b76-c65d2bc9966a on n-h1-833090-19 Sep 08 10:17:23.896853 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-26e2e5a2-4a99-49f1-be56-3bba59474fa6 req-760ac886-690e-4632-9150-bb8e12fc350b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Sep 08 10:17:23.897607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 488/1013] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:23.973232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lazy-loading 'services' on Instance uuid a9a87449-ea1f-432b-988d-b8a9ac85c7de {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:17:23.986961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:23.987707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:23.994601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:23.995093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:23.997274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.000581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.001232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.002076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.070863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:24.080146 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31b5c5c4-eaaa-45b9-8f6c-a47172b58282 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1313 microversion: 2.1 time: 0.097603 Sep 08 10:17:24.080793 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 489/1014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:23 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:24.108939 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-546569f6-af03-47bf-92f1-d970eaf46890 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments/f8f3552d-c5f4-4202-a653-736786d50f44" status: 202 len: 0 microversion: 2.1 time: 0.306496 Sep 08 10:17:24.110878 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 526/1015] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:17:23 2022] DELETE /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments/f8f3552d-c5f4-4202-a653-736786d50f44 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:17:24.116335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:24.116944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:24.120183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:24.122528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:24.123544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.124184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.124466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.125169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.125788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.126039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.129090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.129577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.131287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.131287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.131287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.131604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.165651 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4af4826f-8d0a-420b-b11c-64619468716c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049226 Sep 08 10:17:24.166274 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 527/1016] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:24 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:24.257081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:24.266769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45b47e4e-2869-4015-ae8c-bf482a8e6922 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.154197 Sep 08 10:17:24.267565 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 490/1017] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:24 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:24.532018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:24.532640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:24.540256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.540796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.541887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.542882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.543799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.544532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.770422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:24.771631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:24.783562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.784515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.785212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.786200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.786906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.791223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:24.791861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.800068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:24.808726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ff8ab20-ed3d-44cd-842f-a0c90984bbd9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1359 microversion: 2.1 time: 0.275331 Sep 08 10:17:24.808726 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 528/1018] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:24 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:24.870512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:24.871116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:24.877371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.877858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.878299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.879004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:24.879470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:24.879906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:24.964868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:24.981150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:24.982947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:24.989394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b6f6662-227c-4879-96fa-0c66b84342fa tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.123790 Sep 08 10:17:24.991569 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 529/1019] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:24 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:25.001605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:25.011017 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54f71e0a-182f-4794-8885-5e0d672ff39b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.246773 Sep 08 10:17:25.012863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 491/1020] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:24 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:25.107319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:25.108392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:25.116494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.118641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.119723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.120840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.122263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.123685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.179789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:25.183765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:25.196047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.197187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.197616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.198798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.199420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.200018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.232242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:25.242958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc9421e5-ddc2-4cf9-b3d8-a2b24986bbb9 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1319 microversion: 2.1 time: 0.140419 Sep 08 10:17:25.243894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 530/1021] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:25 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:25.270402 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dc4a1f4-afae-4409-b30e-97245ff65a66 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095825 Sep 08 10:17:25.271568 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 492/1022] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:25 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:25.298590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:25.299775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:25.308057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.309076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.309762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.310737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.311455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.312312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.603795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:25.670045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:25.683821 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e23d8e4d-1e79-4e06-a9b4-f758f1a9105f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.390407 Sep 08 10:17:25.705206 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 531/1023] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:25 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:25.834215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:25.834864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:25.842692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.844665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.845322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:25.846422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:25.847086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:25.847766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.029906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:26.046804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:26.048077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:26.067928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.068682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.069379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.070226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.070759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.071286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.245301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:26.266530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:26.268310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:26.273884 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-409ab83e-a7c3-4483-8397-88168de973fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.244655 Sep 08 10:17:26.275158 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 532/1024] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:26 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:26.280025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:26.292415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:26.299166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.299975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.300619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.301553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.302185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.302787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.729201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:26.746509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-06ec1c4f-55de-410e-82f2-a8807db1aca2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1542 microversion: 2.1 time: 0.916110 Sep 08 10:17:26.747562 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 493/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:25 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1542 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:26.762225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:26.765260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:26.802226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.808579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.813667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.814754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.816025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.816687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.900593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:26.918385 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e0cacacb-af01-4ea6-b72d-d2bdeb8f4ada tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.641777 Sep 08 10:17:26.931796 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 533/1026] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:26 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:26.942110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:26.944510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:26.958605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.959610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.960222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:26.960983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:26.961447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:26.962520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.009854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:27.016318 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e498877a-5f34-457c-b2bb-e8358724f266 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082692 Sep 08 10:17:27.022805 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 534/1027] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:26 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:27.030695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:27.032766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:27.041228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.042019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.042637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.044984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.050863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.051874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.403546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:27.417097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-37f4319e-19e8-46d6-b78f-937c04422a89 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.668093 Sep 08 10:17:27.434661 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 494/1028] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:26 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:27.455998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:27.456517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:27.468581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.469692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.470317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.471210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.472666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.473926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.537939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:27.550119 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d90d3ed6-84b3-4281-9874-5fd0d7c12cf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.525931 Sep 08 10:17:27.550975 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 535/1029] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:27 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:27.567477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:27.568471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:27.584490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.585266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.585865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.587318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.587946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.588523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.724309 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-19a50170-5868-46fe-a495-7d4134e7e551 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.293874 Sep 08 10:17:27.725096 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 495/1030] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:17:27 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-interface => generated 285 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:27.776120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:27.784855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:27.786311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:27.800322 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af42b11f-4d69-4c73-bd70-4c229979f899 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.247732 Sep 08 10:17:27.805815 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 536/1031] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:27 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:27.947706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:27.949024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:27.958519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.960030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.968163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:27.968927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:27.969397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:27.969818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:28.035061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:28.052574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:28.086266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:28.087806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:28.088487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:28.089468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:28.091671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:28.092365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:28.168194 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db9aa5fa-e293-4212-8dbb-e4b83c05eb8e tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137181 Sep 08 10:17:28.171090 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 537/1032] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:28 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:28.380388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:28.398210 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e7f25049-227f-4930-8981-9865a09271da tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.454623 Sep 08 10:17:28.411849 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 496/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:27 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:28.444618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:28.445513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:28.452333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:28.461120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:28.461851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:28.462711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:28.463304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:28.464152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:28.577803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:28.578407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:28.595195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:28.595436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:28.595850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:28.596547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:28.596992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:28.597407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:29.112286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:29.127016 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c991681c-18ee-40fd-bccd-fd765e14619c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.687180 Sep 08 10:17:29.127642 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 538/1034] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:28 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:29.163817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:29.164454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:29.174741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:29.175270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:29.175751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:29.176985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:29.177442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:29.178063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:29.842265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:29.860610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:29.862196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:29.882498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ff59bb1-b0fa-42d1-addf-99c27e9b77fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.731809 Sep 08 10:17:29.885290 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 539/1035] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:29 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:29.896083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-398bcabe-8633-432d-bfb0-9c0c36c0c7c7 req-3d8b32e5-cc68-4496-9ad3-f29b6190d786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217dc8af-fc3f-4e7e-a8d7-7addfb73cb79", "tag": "64745746-af98-4786-b9f1-4a5e3db412ae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:29.917727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:29.918924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-398bcabe-8633-432d-bfb0-9c0c36c0c7c7 req-3d8b32e5-cc68-4496-9ad3-f29b6190d786 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:29.919408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-398bcabe-8633-432d-bfb0-9c0c36c0c7c7 req-3d8b32e5-cc68-4496-9ad3-f29b6190d786 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:29.923070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-398bcabe-8633-432d-bfb0-9c0c36c0c7c7 req-3d8b32e5-cc68-4496-9ad3-f29b6190d786 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:29.931742 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27c441b3-1909-409c-a073-00f0d2bb9d0c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 1.355241 Sep 08 10:17:29.932434 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 497/1036] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:28 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:29.943621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:29.950103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:29.965614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:29.966148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:29.968753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:29.969652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:29.971307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:29.973580 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-398bcabe-8633-432d-bfb0-9c0c36c0c7c7 req-3d8b32e5-cc68-4496-9ad3-f29b6190d786 service nova] Creating event network-changed:64745746-af98-4786-b9f1-4a5e3db412ae for instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 on n-h1-833090-19 Sep 08 10:17:29.974921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:29.985605 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-398bcabe-8633-432d-bfb0-9c0c36c0c7c7 req-3d8b32e5-cc68-4496-9ad3-f29b6190d786 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096128 Sep 08 10:17:29.991099 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 540/1037] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:30.001952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:30.002677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:30.014222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.017205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.017690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.021466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.021956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.022398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.067916 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-47691f72-e748-4839-881d-fd5d6290a981 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131663 Sep 08 10:17:30.069929 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 498/1038] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:29 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:30.080996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3051e1cd-100c-406f-a038-3471987ff089 req-3642393f-01ba-4d16-98b3-44d812abf141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48255b60-3703-431a-9b76-c65d2bc9966a", "tag": "df6ea807-8c33-4365-8e03-6d7ea7ae7a93"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:30.103935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3051e1cd-100c-406f-a038-3471987ff089 req-3642393f-01ba-4d16-98b3-44d812abf141 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.104921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3051e1cd-100c-406f-a038-3471987ff089 req-3642393f-01ba-4d16-98b3-44d812abf141 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.105543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3051e1cd-100c-406f-a038-3471987ff089 req-3642393f-01ba-4d16-98b3-44d812abf141 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.121112 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3051e1cd-100c-406f-a038-3471987ff089 req-3642393f-01ba-4d16-98b3-44d812abf141 service nova] Creating event network-changed:df6ea807-8c33-4365-8e03-6d7ea7ae7a93 for instance 48255b60-3703-431a-9b76-c65d2bc9966a on n-h1-833090-19 Sep 08 10:17:30.126846 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3051e1cd-100c-406f-a038-3471987ff089 req-3642393f-01ba-4d16-98b3-44d812abf141 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054320 Sep 08 10:17:30.128095 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 499/1039] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:30.155757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:30.157589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:30.177435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.180321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.183933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.184990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.189078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.191386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.525944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:30.564258 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0145710b-ca21-4fef-b514-f868a1088ee6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.571665 Sep 08 10:17:30.566504 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 541/1040] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:29 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:30.693058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:30.705098 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2a22186-2867-4edf-8cac-9922aac6cc02 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.558403 Sep 08 10:17:30.715007 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 500/1041] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:30 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:30.921666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:30.922550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:30.937001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.937854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.938493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.939424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.940073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.940811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.958986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:30.960233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:30.979046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.982244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.983181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:30.984118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:30.984739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:30.985571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.167504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:31.182304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:31.183787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:31.199957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19bce554-f523-4819-ae01-e8975e50fdae tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.281606 Sep 08 10:17:31.211985 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 542/1042] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:30 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:31.222161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:31.222161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:31.232154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:31.232583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:31.236129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.236968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:31.237449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:31.237891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.302593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-94edd426-d8cf-4bc4-9c99-6859b1be7e03 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100567 Sep 08 10:17:31.303962 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 543/1043] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:31 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:31.327414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:31.337162 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98f78a0a-b847-4cc4-93ed-b68c4f621c16 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.381753 Sep 08 10:17:31.348128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 501/1044] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:30 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:31.595242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:31.595905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:31.618152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:31.618919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:31.621177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.622173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:31.624615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:31.625275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.739282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:31.739826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:31.749286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:31.749777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:31.750204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.750907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:31.751514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:31.751939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:31.923880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:31.931993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d53faade-c36f-44f3-a9d6-9139a00e2aa6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.342362 Sep 08 10:17:31.932574 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 544/1045] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:31 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:32.021341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6b822a6f-28e5-4434-9aa2-cb2671e557cc req-81425205-1ce2-4113-af2a-ec5c61894525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5fe548-8e50-4c79-bfd8-ec2369cd4719", "name": "network-vif-deleted", "tag": "75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:32.038405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6b822a6f-28e5-4434-9aa2-cb2671e557cc req-81425205-1ce2-4113-af2a-ec5c61894525 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.040787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6b822a6f-28e5-4434-9aa2-cb2671e557cc req-81425205-1ce2-4113-af2a-ec5c61894525 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.041737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6b822a6f-28e5-4434-9aa2-cb2671e557cc req-81425205-1ce2-4113-af2a-ec5c61894525 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.053960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:32.070409 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6b822a6f-28e5-4434-9aa2-cb2671e557cc req-81425205-1ce2-4113-af2a-ec5c61894525 service nova] Creating event network-vif-deleted:75c54ddc-4cd2-4aa7-b7e4-5a9b26d5de28 for instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 on n-h2-833090-19 Sep 08 10:17:32.078892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6b822a6f-28e5-4434-9aa2-cb2671e557cc req-81425205-1ce2-4113-af2a-ec5c61894525 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061121 Sep 08 10:17:32.080639 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 545/1046] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:32.083626 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-abd0e0b1-dd8d-4be8-bbca-e93723391a86 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.337479 Sep 08 10:17:32.088753 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 502/1047] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:31 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:32.230832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:32.231661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:32.241702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.244294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.245078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.246055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.247763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.248705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.317349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:32.322300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:32.335351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.338950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.339730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.340698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.341451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.345005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.399610 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-13e5716a-02bb-4534-a1ba-4f74131353ae tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086678 Sep 08 10:17:32.400895 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 503/1048] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:32 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:32.406670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:32.407666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:32.414309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.415151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.419786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.421179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.421968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.422639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.447236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:32.460051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:32.468896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:32.475036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29c62210-d17b-4a5e-ab69-a1ad07935c7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.248871 Sep 08 10:17:32.476136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 546/1049] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:32 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:32.674820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:32.687729 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ed68b7a-ff55-4daf-8779-add4f92dc894 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.285539 Sep 08 10:17:32.689468 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 504/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:32 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:32.956518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:32.958035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:32.965785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.966554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.966979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:32.968806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:32.969454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:32.970205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.111571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:33.112183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:33.114345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:33.115453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:33.126197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.127512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.127962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.128978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.129602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.130199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.229161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:33.242280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-86ff2dc6-ae81-4fa7-97f4-05a64e624618 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.289692 Sep 08 10:17:33.252230 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 547/1051] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:32 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:33.325666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:33.334406 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d48218fe-4261-4b90-a84f-4d6a6bf015c2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.227244 Sep 08 10:17:33.334992 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 505/1052] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:33 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:33.412602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:33.415633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:33.421649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.422138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.422574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.423266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.423907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.424477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.456498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d4f690f-f4c7-45c5-be2a-88130197ff3d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047874 Sep 08 10:17:33.457340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 548/1053] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:17:33 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:17:33.509817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:33.510338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:33.517233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.518078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.518584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.519362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.519915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.520423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.600848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:33.612035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:33.613500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:33.620826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2795c98b-7f50-4433-a659-23d6cb35e5d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.114911 Sep 08 10:17:33.621742 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 506/1054] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:33 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:33.677314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1360953651", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4292d5c7-f384-4ff2-99f6-6890bfefc9ef"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:33.714700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:33.715573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:33.722960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.723478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.723914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.724801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:33.725802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:33.726319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:33.739075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] validate_networks() for [('4292d5c7-f384-4ff2-99f6-6890bfefc9ef', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:17:34.077386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:34.095788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b070655-8044-4e22-8d6c-7a17246a0af9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.385314 Sep 08 10:17:34.100028 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 507/1055] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:33 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:34.269362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:34.270375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:34.288553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.289064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.289704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.293172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.293920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.294561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.663725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:34.666890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:34.675713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87323ee4-b585-4eb8-8c8f-0210835a1eff tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.411016 Sep 08 10:17:34.687830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:17:34.687830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:17:34.687830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:17:34.687830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:17:34.687830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:17:34.695082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.695082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.695082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.695082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.695552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.695552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.695943 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 508/1056] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:34 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:34.701061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:34.701977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:34.707640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:34.710072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.711040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.712300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.713259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.713871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.714437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.714781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Getting quotas for project d4a6efff1d8d4870a2eaf4402c6bf57e. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:34.720491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Getting quotas for user 85eda5dbb3ca4158b10c4a89a1c62386 and project d4a6efff1d8d4870a2eaf4402c6bf57e. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:34.738293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:17:34.740644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:17:34.800248 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe54aabe-2086-4d78-8a4b-48cea7451596 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132088 Sep 08 10:17:34.801392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 549/1057] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:17:34.807286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:34.808293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:34.818260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.818909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.819439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.820983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:34.821543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:34.822056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:34.977368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:34.990232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:34.994503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:34.997663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:35.009333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:35.009593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e6ce062-179b-4714-b7c5-01776547b3fb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.206757 Sep 08 10:17:35.019736 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 550/1058] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:34 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:35.020281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01014568-a479-4eef-bb02-c074a6e9cc6a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.322924 Sep 08 10:17:35.027522 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 509/1059] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:34 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:35.032582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-154813d1-4470-4dab-af5c-f84910f545a9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:35.033276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-154813d1-4470-4dab-af5c-f84910f545a9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:35.107427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-154813d1-4470-4dab-af5c-f84910f545a9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:35.115423 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-154813d1-4470-4dab-af5c-f84910f545a9 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1218 microversion: 2.1 time: 0.098965 Sep 08 10:17:35.116033 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 551/1060] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:35 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:35.126923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:35.127661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:35.139004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:35.139834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:35.140435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:35.141137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:35.141586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:35.142009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:35.312626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:35.321217 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3812ecf-ba91-4fc3-a0fa-2b9542c66e9b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.199649 Sep 08 10:17:35.322082 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 510/1061] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:35 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:35.708798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:35.713145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:35.723111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:35.723645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:35.724087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:35.724798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:35.725261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:35.725689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:35.872138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:35.880672 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb10ef93-795b-47eb-8059-20592057edb6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.181762 Sep 08 10:17:35.881261 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 552/1062] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:35 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:35.915603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1b3706c0-1150-4cef-9075-508bffd6affc req-a7578969-1d47-482e-8f4e-1b34d8a964ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217dc8af-fc3f-4e7e-a8d7-7addfb73cb79", "name": "network-vif-plugged", "status": "completed", "tag": "64745746-af98-4786-b9f1-4a5e3db412ae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:35.926308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1b3706c0-1150-4cef-9075-508bffd6affc req-a7578969-1d47-482e-8f4e-1b34d8a964ab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:35.926959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1b3706c0-1150-4cef-9075-508bffd6affc req-a7578969-1d47-482e-8f4e-1b34d8a964ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:35.927599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1b3706c0-1150-4cef-9075-508bffd6affc req-a7578969-1d47-482e-8f4e-1b34d8a964ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:35.941009 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1b3706c0-1150-4cef-9075-508bffd6affc req-a7578969-1d47-482e-8f4e-1b34d8a964ab service nova] Creating event network-vif-plugged:64745746-af98-4786-b9f1-4a5e3db412ae for instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 on n-h1-833090-19 Sep 08 10:17:35.947909 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1b3706c0-1150-4cef-9075-508bffd6affc req-a7578969-1d47-482e-8f4e-1b34d8a964ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036386 Sep 08 10:17:35.949212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 511/1063] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:36.038242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:36.038854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:36.055659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.055871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.056573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.057525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.058189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.061587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:36.063574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:36.067223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.071756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.072557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.073073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.074707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.075595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.076051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.152449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:36.162955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:36.166261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:36.172502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ab577e7-7b0a-4e9f-9d55-3385bfaba8d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.138166 Sep 08 10:17:36.173298 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 553/1064] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:36 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:36.178794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:36.179792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:36.187128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.187902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.188534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.189384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.189987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.190593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.208080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:36.283504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:36.293831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4941e749-5ade-4a7c-99be-47b049f236a1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1222 microversion: 2.1 time: 0.118963 Sep 08 10:17:36.294531 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 554/1065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:36 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:36.331994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:36.341124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48c40c92-d39c-4f0f-9e44-0ccc46e402e0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.301448 Sep 08 10:17:36.341695 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 512/1066] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:36 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:36.352891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:36.353847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:36.360715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.361277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.361777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.362567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.363196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.363720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.511415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:36.519329 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-553f2ed9-5490-4bfc-aa7b-f16ad34e6f01 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.170425 Sep 08 10:17:36.520112 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 555/1067] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:36 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:36.903899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:36.904505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:36.913788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.915138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.915630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:36.916376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:36.916832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:36.917253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.208490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:37.209853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:37.227195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.228390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.229062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.230122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.230962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.232353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.318911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.337155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.340336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.347749 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4cb98eb0-1ccf-4624-b9b1-500c607f06e9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.145885 Sep 08 10:17:37.364056 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 556/1068] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:37 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:37.375992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:37.376827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:37.384274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.395077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.395984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.398407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.399780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.401506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.500944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.515618 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae484a54-5b6f-42ed-9500-651cc93d1ba1 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1270 microversion: 2.1 time: 0.150100 Sep 08 10:17:37.517888 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 557/1069] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:37 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:37.523005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:37.524401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:37.543367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.543919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.544358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.545064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.545521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.545949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.601072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.617304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-034c9acd-c98f-49c7-9a31-c18706259246 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1477 microversion: 2.1 time: 0.717320 Sep 08 10:17:37.618621 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 513/1070] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:36 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1477 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:37.623385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:37.627581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:37.639113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.639646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.640080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.641672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:37.642125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:37.642577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:37.921685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.950859 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3360afc6-91c1-487f-a0ee-03bbcb30ade8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1386 microversion: 2.1 time: 0.431652 Sep 08 10:17:37.951669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:37.953150 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 558/1071] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:37 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:37.963380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d81e60ef-9bbd-4e85-9064-e1b0eb38797b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1496 microversion: 2.1 time: 0.343434 Sep 08 10:17:37.964284 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 514/1072] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:37 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1496 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:38.217191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257df6a9-a628-4d96-9e8c-b040c5681437", "name": "network-vif-unplugged", "status": "completed", "tag": "a498a092-4c03-4501-a24d-1264d184487c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:38.240084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.240698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.241177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.260420 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] Creating event network-vif-unplugged:a498a092-4c03-4501-a24d-1264d184487c for instance 257df6a9-a628-4d96-9e8c-b040c5681437 on n-h1-833090-19 Sep 08 10:17:38.266513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] Instance 257df6a9-a628-4d96-9e8c-b040c5681437 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:17:38.283865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-94dcde03-265a-424d-9a3c-85d7b7a08e08 req-827f1450-f58d-491d-a1b2-19e1e3fe1eb4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070800 Sep 08 10:17:38.284589 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 559/1073] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:38.381907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:38.382434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:38.392839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.393862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.394477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.396018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.396710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.398022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.491245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:38.499690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:38.501309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:38.506248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e780756-1b99-4181-8326-b507a45ab8c3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1537 microversion: 2.91 time: 0.129882 Sep 08 10:17:38.506846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 515/1074] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:38 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1537 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:38.542393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:38.543712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:38.550553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.551403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.552039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.552917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.554141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.554265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.641931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:38.642649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:38.649483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.650032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.650513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.651771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.652790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.653468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:38.653883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.665797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89372009-6608-4837-855b-09be4f404feb tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1276 microversion: 2.1 time: 0.128425 Sep 08 10:17:38.684332 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 560/1075] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:38 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:38.943058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:38.952013 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e16d0955-8b80-4c9c-a50a-3b9cf74b6027 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1476 microversion: 2.1 time: 0.314077 Sep 08 10:17:38.963979 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 516/1076] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:38 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1476 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:38.975907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:38.976555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:38.988631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.989071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.989490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.990205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:38.990660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:38.991167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:38.998718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:38.999339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:39.009955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.012462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.013181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.014139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.014611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.015038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.284271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:39.290852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:39.293447 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b378dd52-3173-4430-ba7c-7d95cbba1546 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1585 microversion: 2.1 time: 0.321150 Sep 08 10:17:39.299007 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c75698b6-48ea-40d0-af8a-46b038972c39 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 200 len: 1473 microversion: 2.1 time: 0.313785 Sep 08 10:17:39.299742 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 517/1077] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:38 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 1473 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:39.311270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 561/1078] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:38 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1585 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:39.319541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:39.320995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:39.324224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-226626830"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:39.327746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:39.333982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.334627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.334759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.335023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.335194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.335988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.337097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.337896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.338365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.338659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.338998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.339787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.455368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d373284b-98dc-4346-879d-7b8dd907abb2 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142245 Sep 08 10:17:39.456348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 518/1079] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:17:39 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:39.535853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:39.536784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:39.544845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.545854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.546792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.547874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.548661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.549285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.629076 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69295879-dddc-4127-b1cb-077cdaec56d9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914/action" status: 202 len: 0 microversion: 2.1 time: 0.310323 Sep 08 10:17:39.637059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 562/1080] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:17:39 2022] POST /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 08 10:17:39.642731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a5471a36-89ca-445e-a809-08e66fcb64db tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351110f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:39.653492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:39.665816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:39.669994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:39.684236 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac48cf0a-f246-484b-8867-2caae349fc95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1537 microversion: 2.91 time: 0.152831 Sep 08 10:17:39.688993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 519/1081] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:39 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:39.693978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:39.702664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:39.714883 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a5471a36-89ca-445e-a809-08e66fcb64db tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1413 microversion: 2.1 time: 0.076166 Sep 08 10:17:39.716591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.717315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.717959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.718879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.719507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.720982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.724071 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 563/1082] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:39 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:39.978017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:39.979327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:39.986813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.987309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.987777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:39.988575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:39.989109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:39.989426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.000792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:40.011419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a088452-1cfd-4853-bfd7-694bc80c6c11 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.321307 Sep 08 10:17:40.013366 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 520/1083] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:39 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:40.317652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257df6a9-a628-4d96-9e8c-b040c5681437", "tag": "a498a092-4c03-4501-a24d-1264d184487c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:40.327152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:40.338071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.338715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.339155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.339496 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79a64ed2-f257-4df9-8096-11ec829d5011 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1476 microversion: 2.1 time: 0.365675 Sep 08 10:17:40.341009 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 564/1084] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:39 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:40.369413 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] Creating event network-changed:a498a092-4c03-4501-a24d-1264d184487c for instance 257df6a9-a628-4d96-9e8c-b040c5681437 on n-h1-833090-19 Sep 08 10:17:40.376030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] Instance 257df6a9-a628-4d96-9e8c-b040c5681437 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:17:40.388522 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-926cc25b-9467-4958-82c1-7da1de9d932f req-2ada3bde-a8b8-4061-91a7-d0bb31c28b4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074166 Sep 08 10:17:40.389501 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 521/1085] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:40.725212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:40.727272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:40.733747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-120684f2-3725-47d1-8e0f-4a53312cf939 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351230b80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:40.742367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.743608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.745439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.747726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.748599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.749457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.817808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-120684f2-3725-47d1-8e0f-4a53312cf939 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1413 microversion: 2.1 time: 0.090213 Sep 08 10:17:40.818976 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 522/1086] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:40 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:40.824961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:40.825924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:40.833785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.834656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.835099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.836457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.836920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.837341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.874218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:40.888004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:40.889871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:40.895868 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3479f2b5-8ebe-4a95-8b23-4cfc1938379e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1540 microversion: 2.91 time: 0.179108 Sep 08 10:17:40.897140 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 565/1087] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:40 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1540 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:40.903047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9b892c4e-443a-4ce4-9dc0-83895c8be874 req-c406892d-f7dc-4db5-91f5-4475fc53ecd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217dc8af-fc3f-4e7e-a8d7-7addfb73cb79", "tag": "64745746-af98-4786-b9f1-4a5e3db412ae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:40.916562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9b892c4e-443a-4ce4-9dc0-83895c8be874 req-c406892d-f7dc-4db5-91f5-4475fc53ecd8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.917072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9b892c4e-443a-4ce4-9dc0-83895c8be874 req-c406892d-f7dc-4db5-91f5-4475fc53ecd8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.917653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9b892c4e-443a-4ce4-9dc0-83895c8be874 req-c406892d-f7dc-4db5-91f5-4475fc53ecd8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.932909 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9b892c4e-443a-4ce4-9dc0-83895c8be874 req-c406892d-f7dc-4db5-91f5-4475fc53ecd8 service nova] Creating event network-changed:64745746-af98-4786-b9f1-4a5e3db412ae for instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 on n-h1-833090-19 Sep 08 10:17:40.938236 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9b892c4e-443a-4ce4-9dc0-83895c8be874 req-c406892d-f7dc-4db5-91f5-4475fc53ecd8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039804 Sep 08 10:17:40.939390 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 566/1088] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:40.946881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:40.950943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:40.958007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.958558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.959055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:40.960109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:40.960259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:40.961285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:41.049328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-833090-19". {{(pid=122457) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:17:41.192862 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-472c40cd-1e8b-4407-8b0f-154ddfce42c2 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action" status: 202 len: 0 microversion: 2.91 time: 0.250718 Sep 08 10:17:41.197422 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 567/1089] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:17:40 2022] POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:17:41.212984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:41.215931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:41.231979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:41.232740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:41.239979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:41.240845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:41.241335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:41.241797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:41.600290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:41.617408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fecf2a8e-d3a7-431c-ab36-54ec9e4bdcb1 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1585 microversion: 2.1 time: 0.796463 Sep 08 10:17:41.618023 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 523/1090] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:40 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1585 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:41.622893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:41.623515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:41.643120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:41.643675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:41.644350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:41.645089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:41.645555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:41.646679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:41.810785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:41.830723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:41.832200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:41.837541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f365e890-94d8-48b5-b0df-fe6d1905ef3d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1488 microversion: 2.91 time: 0.218508 Sep 08 10:17:41.852006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 524/1091] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:41 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:41.864022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:41.864777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:41.871719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:41.872588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:41.873131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:41.873846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:41.874302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:41.874945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:42.079712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:42.094461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f549c80-e048-47ab-82ec-32c7b4b3af10 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.895020 Sep 08 10:17:42.095279 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 568/1092] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:41 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:42.102897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6dfb313b-234e-4f8a-af5b-3aefdc336276 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355575310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:42.181997 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6dfb313b-234e-4f8a-af5b-3aefdc336276 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1413 microversion: 2.1 time: 0.085409 Sep 08 10:17:42.195384 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 569/1093] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:42 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:42.338644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:42.348156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c4858af-7ebd-4a99-b6c6-04cd5d609bf9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1476 microversion: 2.1 time: 0.494748 Sep 08 10:17:42.348830 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 525/1094] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:41 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:42.408953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-bcd6f441-570e-4944-b5e5-c606e542ff64 req-722ce72d-bcde-4a02-b0b6-66aa62388245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711f7258-107d-4fde-8f8b-acc6c61cfd73", "tag": "9a244b22-98a5-4fb0-9ef9-0486da2bed46"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:42.419741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bcd6f441-570e-4944-b5e5-c606e542ff64 req-722ce72d-bcde-4a02-b0b6-66aa62388245 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:42.420225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bcd6f441-570e-4944-b5e5-c606e542ff64 req-722ce72d-bcde-4a02-b0b6-66aa62388245 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:42.420663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bcd6f441-570e-4944-b5e5-c606e542ff64 req-722ce72d-bcde-4a02-b0b6-66aa62388245 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:42.435980 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-bcd6f441-570e-4944-b5e5-c606e542ff64 req-722ce72d-bcde-4a02-b0b6-66aa62388245 service nova] Creating event network-changed:9a244b22-98a5-4fb0-9ef9-0486da2bed46 for instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 on n-h2-833090-19 Sep 08 10:17:42.442044 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-bcd6f441-570e-4944-b5e5-c606e542ff64 req-722ce72d-bcde-4a02-b0b6-66aa62388245 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037130 Sep 08 10:17:42.442945 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 570/1095] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:42.869632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:42.870300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:42.876608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:42.877082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:42.877509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:42.878186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:42.878636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:42.879048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:42.945104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:42.953484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:42.954934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:42.959960 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6d7bd1a-46e8-4881-8d46-75b8ebc24fef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.094204 Sep 08 10:17:42.961039 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 526/1096] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:42 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:43.123333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:43.123995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:43.130172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:43.130658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:43.131097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:43.131822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:43.132463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:43.132894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:43.202733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2f33996-cfd2-417e-873a-a21c350120d7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23512300d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:43.253212 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2f33996-cfd2-417e-873a-a21c350120d7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1413 microversion: 2.1 time: 0.054261 Sep 08 10:17:43.253824 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 527/1097] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:43 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:43.269072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:43.277341 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b65aeeef-8f4e-4576-b2f3-39119cd11f20 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.158869 Sep 08 10:17:43.277905 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 571/1098] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:43 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:43.373023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:43.373715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:43.379627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:43.380109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:43.380539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:43.381226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:43.381676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:43.382096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:43.509748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:43.512083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:43.518597 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-92915db6-f070-41df-8d5e-c6d71382f0e4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1474 microversion: 2.1 time: 0.149450 Sep 08 10:17:43.519180 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 528/1099] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:43 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1474 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:43.903616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-28ea669e-c6c9-4297-94f7-312c81b9c997 req-524b9437-2acc-4574-8848-c991e5030ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae4810a-a023-44d3-9497-d41ed8fe7914", "name": "network-vif-plugged", "status": "completed", "tag": "923ae83a-f524-4844-a2a4-05d910357730"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:43.918037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28ea669e-c6c9-4297-94f7-312c81b9c997 req-524b9437-2acc-4574-8848-c991e5030ae1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:43.919976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28ea669e-c6c9-4297-94f7-312c81b9c997 req-524b9437-2acc-4574-8848-c991e5030ae1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:43.919976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28ea669e-c6c9-4297-94f7-312c81b9c997 req-524b9437-2acc-4574-8848-c991e5030ae1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:43.923356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:43.944052 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-28ea669e-c6c9-4297-94f7-312c81b9c997 req-524b9437-2acc-4574-8848-c991e5030ae1 service nova] Creating event network-vif-plugged:923ae83a-f524-4844-a2a4-05d910357730 for instance eae4810a-a023-44d3-9497-d41ed8fe7914 on n-h1-833090-19 Sep 08 10:17:43.962676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-28ea669e-c6c9-4297-94f7-312c81b9c997 req-524b9437-2acc-4574-8848-c991e5030ae1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062542 Sep 08 10:17:43.963517 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 572/1100] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:43.988924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:43.989529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:44.002610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.003095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.003724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.004277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.004724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.005141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.089479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:44.097620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:44.099017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:44.103874 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-adeb0092-b31a-4fc0-81a7-b131a512785a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.119609 Sep 08 10:17:44.104441 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 529/1101] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:43 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:44.271866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0a7a4d07-1aaa-4e23-961a-7f4ebb033017 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355524940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:44.300705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:44.301337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:44.308804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.309287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.309720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.310408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.310853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.311265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.320808 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0a7a4d07-1aaa-4e23-961a-7f4ebb033017 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1413 microversion: 2.1 time: 0.054697 Sep 08 10:17:44.321251 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 573/1102] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:44 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:44.526062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:44.534957 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c87d8dd-d58c-4c97-bed1-0eeb0dd89101 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.238008 Sep 08 10:17:44.544217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:44.545100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:44.550373 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 530/1103] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:44 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:44.553913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.554416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.555233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.556130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.556783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.557211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.705411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:44.806376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:44.814604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44e9460e-70f6-499e-95a7-b0849ea9f1d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1471 microversion: 2.1 time: 0.276081 Sep 08 10:17:44.820324 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 574/1104] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:44 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:44.839251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:44.840214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:44.846949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.847712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.848349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.849391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.850010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.850647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.936849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-654cfcfb-4ee7-4cee-8f9f-b5b7f5aa761a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437/action" status: 204 len: 0 microversion: 2.1 time: 0.102610 Sep 08 10:17:44.941095 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 531/1105] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:17:44 2022] POST /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437/action => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:17:44.947355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:44.948449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:44.956133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.956902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.957531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:44.958646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:44.959414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:44.960251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:45.111423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:45.118647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:45.133952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:45.134660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:45.142291 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7fd48afb-bb52-4811-bf4c-803f6b25a01c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1471 microversion: 2.1 time: 0.199352 Sep 08 10:17:45.155742 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 575/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:44 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:45.155850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:45.155850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:45.155850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:45.155850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:45.156244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:45.156244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:45.221300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:45.231585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:45.233041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:45.239029 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fc2521ac-449f-4d1e-b3cb-2667fa1545fc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.110811 Sep 08 10:17:45.254499 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 532/1107] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:45 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:45.337398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-044297e5-b7b8-4702-85a0-8507fd44b50d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355505280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:45.575789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:45.575789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:45.580283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:45.581004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:45.581608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:45.582517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:45.583134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:45.583741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:45.832289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:45.846334 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8bce4ae-dc1f-4226-8502-d665dcd7593f tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.277777 Sep 08 10:17:45.872190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 533/1108] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:45 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:46.168352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:46.170007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:46.176983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:46.177780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:46.178389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:46.179296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:46.180372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:46.181012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:46.595895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:46.613957 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a12076b-9873-41c2-ab54-20166a25686b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1471 microversion: 2.1 time: 0.450201 Sep 08 10:17:46.628596 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 534/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:46 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:46.643072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:46.648876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:46.656712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:46.657639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:46.658805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:46.660308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:46.660948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:46.661539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:46.762025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:46.773494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:46.775737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:46.783234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6456876d-ceb7-4df4-976c-a4bb746f2fba tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.153032 Sep 08 10:17:46.784695 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 535/1110] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:46 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:46.882927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:46.883953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:46.890265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:46.891090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:46.891793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:46.892735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:46.893503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:46.894223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:47.071113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:47.080071 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cf478035-89c9-4752-ae16-e1c616d83548 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.203535 Sep 08 10:17:47.080939 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 536/1111] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:46 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:47.641581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:47.642611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:47.664863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:47.665551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:47.666095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:47.667069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:47.667573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:47.668006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:48.332295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:48.371037 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-026f1eb8-e26d-47b7-8ede-360262a12e25 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1471 microversion: 2.1 time: 0.727239 Sep 08 10:17:48.372870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 537/1112] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:47 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1471 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:48.406510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:48.407662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:48.440126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:48.443782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:48.447129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:48.449338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:48.449853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:48.450572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:48.622833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:48.633700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:48.639608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:48.653727 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b83789f-2607-4acf-b915-28735ab11e56 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.279252 Sep 08 10:17:48.655253 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 538/1113] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:48 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:48.661460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:48.662467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:48.702069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:48.704102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:48.707033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:48.708253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:48.709590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:48.711255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:49.352393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:49.364000 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4bbf5e42-5dea-49f9-9b6e-5ffa6ca1c506 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.706473 Sep 08 10:17:49.364761 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 539/1114] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:48 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:49.389623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257df6a9-a628-4d96-9e8c-b040c5681437", "name": "network-vif-plugged", "status": "completed", "tag": "a498a092-4c03-4501-a24d-1264d184487c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:49.429425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:49.435749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:49.436336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:49.471076 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] Creating event network-vif-plugged:a498a092-4c03-4501-a24d-1264d184487c for instance 257df6a9-a628-4d96-9e8c-b040c5681437 on n-h1-833090-19 Sep 08 10:17:49.480533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] Instance 257df6a9-a628-4d96-9e8c-b040c5681437 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:17:49.506328 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9f81840b-f245-48d2-8c57-0a72cfa0fbfb req-57f073a8-a020-4dac-853e-33d4baaad26d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127573 Sep 08 10:17:49.507749 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 540/1115] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:49.519039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:49.519797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:49.536737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:49.537659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:49.537659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:49.538193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:49.538517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:49.539018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:49.852952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:49.882876 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07f514b9-16a0-4c7a-a2b0-d8eaad77454b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1471 microversion: 2.1 time: 0.373181 Sep 08 10:17:49.883555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 541/1116] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:49 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:49.893864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:49.900728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:49.914524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:49.915388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:49.920927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:49.921999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:49.922679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:49.923270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:50.092640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:50.107250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:50.111196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:50.124964 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-709ecfa6-904b-4eb4-9469-b5208878baec tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.238473 Sep 08 10:17:50.125638 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 542/1117] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:49 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:50.391664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:50.392339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:50.461973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:50.461973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:50.461973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:50.461973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:50.462424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:50.462424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:50.804493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:50.822341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b42586e1-3c1b-4b2c-af47-7963f882975d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.433489 Sep 08 10:17:50.824218 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 543/1118] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:50 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:50.906634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:50.907949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:50.920226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:50.922123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:50.924255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:50.930344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:50.943954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:50.946794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:50.977446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:51.205810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:51.216902 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b96ea91b-37db-4f2a-9758-2641ecf22b1b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1471 microversion: 2.1 time: 0.314085 Sep 08 10:17:51.220566 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 544/1119] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:50 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1471 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:51.236489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:51.237103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:51.255245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:51.258457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:51.258966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:51.261010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:51.261492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:51.261928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:51.428233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:51.438606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:51.440659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:51.448070 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-654d36f8-2471-4823-84ab-076b67c5849e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.226441 Sep 08 10:17:51.449308 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 545/1120] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:51 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:51.849211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:51.851437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:51.859885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:51.860815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:51.862729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:51.863831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:51.864624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:51.865786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.107727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:52.118248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ccad42cf-bd72-4610-9766-fed616a0dd52 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.273937 Sep 08 10:17:52.119403 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 546/1121] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:51 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:52.127932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-99d1becf-7e0f-4983-98b3-f8dd2be736c1 req-e9eea2a7-77c2-4aa6-806d-8a18c12ca011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711f7258-107d-4fde-8f8b-acc6c61cfd73", "name": "network-vif-plugged", "status": "completed", "tag": "9a244b22-98a5-4fb0-9ef9-0486da2bed46"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:52.141363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-99d1becf-7e0f-4983-98b3-f8dd2be736c1 req-e9eea2a7-77c2-4aa6-806d-8a18c12ca011 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.142670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-99d1becf-7e0f-4983-98b3-f8dd2be736c1 req-e9eea2a7-77c2-4aa6-806d-8a18c12ca011 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.143475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-99d1becf-7e0f-4983-98b3-f8dd2be736c1 req-e9eea2a7-77c2-4aa6-806d-8a18c12ca011 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.158227 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-99d1becf-7e0f-4983-98b3-f8dd2be736c1 req-e9eea2a7-77c2-4aa6-806d-8a18c12ca011 service nova] Creating event network-vif-plugged:9a244b22-98a5-4fb0-9ef9-0486da2bed46 for instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 on n-h2-833090-19 Sep 08 10:17:52.165966 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-99d1becf-7e0f-4983-98b3-f8dd2be736c1 req-e9eea2a7-77c2-4aa6-806d-8a18c12ca011 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045316 Sep 08 10:17:52.167030 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 547/1122] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:52.251441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:52.252335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:52.261217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.261811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.262321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.263108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.265075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.265608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.459680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:52.468932 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0398ca1-0808-4b00-bc32-ae84f692a5c8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1463 microversion: 2.1 time: 0.222402 Sep 08 10:17:52.484516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 548/1123] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:52 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1463 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:52.492852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:52.493790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:52.520070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.521329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.523406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.525112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.525866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.526789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.614596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:52.624354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:52.626257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:52.633130 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f2a67eb2-99c6-4bfc-8df5-fe39cefc005b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.145191 Sep 08 10:17:52.634118 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 549/1124] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:52 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:52.639563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:52.640377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:52.646716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:52.650346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.651021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.651785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.654114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:52.654114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:52.654114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:52.908603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:52.918651 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-255dfc5b-38b8-4b1c-98ae-42cf04ed2c4b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1463 microversion: 2.1 time: 0.283361 Sep 08 10:17:52.919242 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 550/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:52 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1463 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:52.960315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f40e2725-30f5-4cd5-be3b-0e554fe5325f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'create', calling method: .version_select at 0x7f23512dd280>, body: {"keypair": {"name": "tempest-keypair-165698989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7zQaBo3zPKcN/ezgSdARy2IXgRFOgZlBKmDpZDg/aKUTkWEjlqP+8sJ643g8Um6edJmlrsOLh7AiZwAx7m19wCfR8D2DpkftQhUHSMI09BrOEZFe477fL4rDAwbIzX4w=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:52.981251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f40e2725-30f5-4cd5-be3b-0e554fe5325f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:52.986727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f40e2725-30f5-4cd5-be3b-0e554fe5325f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for user 5f96685045b340b2a978ece9dd591640 and project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:53.028301 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f40e2725-30f5-4cd5-be3b-0e554fe5325f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086753 Sep 08 10:17:53.044968 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 551/1126] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:17:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:17:53.148273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:53.150978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:53.169473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:53.171905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:53.172938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:53.174487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:53.175759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:53.177309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:53.453382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:53.477585 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5289b95-b8f8-4874-802a-b8d6c4498f72 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1318 microversion: 2.1 time: 0.335071 Sep 08 10:17:53.477585 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 552/1127] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:53 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:53.672521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:53.673611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:53.684844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:53.687807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:53.688337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:53.689205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:53.689764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:53.691415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:53.848889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:53.861328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:53.868826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:53.880613 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87d0fe0f-8f77-408f-b5e3-c0551841ddd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.211215 Sep 08 10:17:53.883680 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 553/1128] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:53 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:54.495497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:54.496906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:54.508240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:54.509023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:54.509635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:54.511373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:54.516106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:54.517514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:54.956097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:55.124493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=13 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:55.309841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:55.318455 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94472492-3bcc-42ec-8405-dc3b977ef9be tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1508 microversion: 2.1 time: 0.826695 Sep 08 10:17:55.319686 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 554/1129] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:54 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1508 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:55.324552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:55.325348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:55.338937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:55.339729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:55.351749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:55.352910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:55.355833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:55.356280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:55.587512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:55.608959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:55.610788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:55.617087 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d7a4d78-b081-4311-bfb3-1957e12ffb95 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.296051 Sep 08 10:17:55.633000 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 555/1130] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:55 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:55.762418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ee322fd-e1cc-47d4-930b-4169a6be07be tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '.version_select at 0x7f23512dd5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:55.766157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ee322fd-e1cc-47d4-930b-4169a6be07be tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:55.770702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ee322fd-e1cc-47d4-930b-4169a6be07be tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:55.770702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ee322fd-e1cc-47d4-930b-4169a6be07be tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:55.800070 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ee322fd-e1cc-47d4-930b-4169a6be07be tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.041727 Sep 08 10:17:55.813679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 556/1131] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:17:55 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:55.827745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-716a8a53-24a8-4ca0-ab83-9cdf1b92282d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:55.839411 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-716a8a53-24a8-4ca0-ab83-9cdf1b92282d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015690 Sep 08 10:17:55.844618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 557/1132] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:17:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:55.871963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-886ac3e5-b01f-4b8d-9a49-fe6a889e2561 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1739684347", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:55.922106 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-886ac3e5-b01f-4b8d-9a49-fe6a889e2561 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.060768 Sep 08 10:17:55.922710 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 558/1133] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Sep 8 10:17:55 2022] POST /compute/v2.1/flavors => generated 499 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:17:55.984009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1bed1076-7e44-4c63-aace-be9b4d4b4097 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:56.004467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1bed1076-7e44-4c63-aace-be9b4d4b4097 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.049519 Sep 08 10:17:56.015842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 559/1134] 10.222.0.59 () {58 vars in 1182 bytes} [Thu Sep 8 10:17:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:17:56.216748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-624937100", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "88df2ccb-a2a4-4719-a2f3-6ac61d383c22"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:56.847427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-044297e5-b7b8-4702-85a0-8507fd44b50d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1422 microversion: 2.1 time: 11.514532 Sep 08 10:17:56.848533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 576/1135] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:45 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1422 bytes in 11517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:56.851143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:17:56.871375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:56.872159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:56.884054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:56.884855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:56.885651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:56.887523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:56.888166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:56.888802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:56.984710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:56.998897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:57.002846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:57.009081 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5fbcb4a3-b96c-4594-8910-b93887121004 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.159458 Sep 08 10:17:57.010290 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 577/1136] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:56 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:57.015133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48df7035-6090-4406-946c-b263da4ca877 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23510de310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:57.092082 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48df7035-6090-4406-946c-b263da4ca877 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 200 len: 1422 microversion: 2.1 time: 0.080350 Sep 08 10:17:57.092986 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 578/1137] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:17:57 2022] GET /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:57.118726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-86f3a1ff-4c43-4e8e-b68e-c511d535bf42 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23511101f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:57.164576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:17:57.164892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:17:57.166060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:17:57.166695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:17:57.167289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:17:57.183064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:57.184308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:57.185023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:57.186285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:57.186949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:57.187594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:57.216729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:57.222127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for user 5f96685045b340b2a978ece9dd591640 and project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:57.248276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:17:57.253581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:17:57.375830 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-06768481-f82d-4dbb-96c8-3e3bf3531875 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163238 Sep 08 10:17:57.381870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 560/1138] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:17:57.396243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8811c715-e096-4f02-b0f0-d7ffd94f1ee9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:57.411886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8811c715-e096-4f02-b0f0-d7ffd94f1ee9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:57.486896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8811c715-e096-4f02-b0f0-d7ffd94f1ee9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:57.498080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8811c715-e096-4f02-b0f0-d7ffd94f1ee9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1278 microversion: 2.1 time: 0.112906 Sep 08 10:17:57.503964 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 561/1139] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:57 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:57.781411 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-86f3a1ff-4c43-4e8e-b68e-c511d535bf42 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 204 len: 0 microversion: 2.1 time: 0.671666 Sep 08 10:17:57.782015 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 579/1140] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:57 2022] DELETE /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:17:57.790846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:57.791347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:57.799338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:57.799977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:57.800455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:57.801292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:57.801829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:57.802290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:57.830648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:17:57.911936 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2a7f38bb-da0a-46f7-a63f-4dce8a96d510 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 204 len: 0 microversion: 2.1 time: 0.125154 Sep 08 10:17:57.913232 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 562/1141] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:17:57 2022] DELETE /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:17:57.969988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-95349014", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "1fc268cd-ae55-4256-b9c7-92d5b594854f"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:58.024275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] validate_networks() for [('1fc268cd-ae55-4256-b9c7-92d5b594854f', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:17:58.038751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:58.039510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:58.045754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.046366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.046919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.047893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.048606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.049162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.129662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:58.137880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:58.139373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:58.144183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac8d9863-794a-4dfe-84d6-b245e1532b2a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.110286 Sep 08 10:17:58.144762 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 563/1142] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:58 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:17:58.389773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "dddb45de-e011-48b5-8a0d-118a03bde163"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:17:58.392215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:58.398898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.399387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.400031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.400742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.401200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.401629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.432363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:17:58.432790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:17:58.433376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:17:58.433793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:17:58.434223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:17:58.448063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.448551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.448987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.449713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.450164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.450584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.453179 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] HTTP exception thrown: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Request method failure captured: Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73/os-volume_attachments/690b9962-efec-47bb-a65e-36fcf0fccbb3 HTTP/1.1 Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 74 Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcCJcu8ceB4YOLZdDnLyycDf5J97f0-g05XYXrwhIzLQcaJ8QGhwC01DygL_kbW2A9EBhtCt35ba_uJel_6W9f0vMi_N44-53RYdnJt50CReI6GJ0jZuRLEr8MtZvUALrDT2Fp2Q_nORcJcQvS0f0ghGK1a4joaH7NFKO18NlyQLA7o Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25c552069a1f4910a9f90fcc33cd88ac Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesAdminNegativeTest-385884461 Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:17:58.455375 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25c552069a1f4910a9f90fcc33cd88ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25c552069a1f4910a9f90fcc33cd88ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25c552069a1f4910a9f90fcc33cd88ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25c552069a1f4910a9f90fcc33cd88ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesAdminNegativeTest-385884461 Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25c552069a1f4910a9f90fcc33cd88ac Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-385884461 Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesAdminNegativeTest-385884461-project-admin Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2d2881cf2a1c4329957ee886be24fca6 Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesAdminNegativeTest-385884461-project-admin Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: {"volumeAttachment": {"volumeId": "dddb45de-e011-48b5-8a0d-118a03bde163"}} Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:17:58.456932 n-d-833090-19 devstack@n-api.service[122456]: exception: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': '711f7258-107d-4fde-8f8b-acc6c61cfd73', 'id': '690b9962-efec-47bb-a65e-36fcf0fccbb3', 'body': {'volumeAttachment': {'volumeId': 'dddb45de-e011-48b5-8a0d-118a03bde163'}}} Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:17:58.457771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. (HTTP 404) (Request-ID: req-a7386c62-d1e7-49bf-8994-3e10f8b441c7) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:17:58.458911 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:17:58.462518 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. Sep 08 10:17:58.464084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:17:58.465560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] Returning 404 to user: Volume 690b9962-efec-47bb-a65e-36fcf0fccbb3 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:17:58.465560 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-674f6e6e-9177-4a66-85e5-7a71d1d011b5 tempest-VolumesAdminNegativeTest-385884461 tempest-VolumesAdminNegativeTest-385884461-project-admin] 10.222.0.59 "PUT /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73/os-volume_attachments/690b9962-efec-47bb-a65e-36fcf0fccbb3" status: 404 len: 109 microversion: 2.1 time: 0.071022 Sep 08 10:17:58.465560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 564/1143] 10.222.0.59 () {60 vars in 1433 bytes} [Thu Sep 8 10:17:58 2022] PUT /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73/os-volume_attachments/690b9962-efec-47bb-a65e-36fcf0fccbb3 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:17:58.474220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:17:58.479323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for user 1c08994220f44d5db166b899e80c2a12 and project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:17:58.491513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:17:58.493807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:17:58.522960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:58.523662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:58.529873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.530556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.531152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.532029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:58.532623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:58.533311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:58.542021 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a24f0da1-cca4-44fc-b567-d22d15eefb1f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575918 Sep 08 10:17:58.542855 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 580/1144] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:17:58.556862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d23e13b-f063-4ac1-8dd5-b1a6054d1ba7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:58.557566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d23e13b-f063-4ac1-8dd5-b1a6054d1ba7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:58.644984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3d23e13b-f063-4ac1-8dd5-b1a6054d1ba7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:58.646781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:58.655619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e008eb1e-7ff4-4037-bfca-14b9402ef831 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1282 microversion: 2.1 time: 0.137444 Sep 08 10:17:58.656677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d23e13b-f063-4ac1-8dd5-b1a6054d1ba7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1206 microversion: 2.1 time: 0.104141 Sep 08 10:17:58.656942 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 565/1145] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:58 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:17:58.667484 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 581/1146] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:58 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1206 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:59.173059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:59.173742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:59.180830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:59.181313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:59.181746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:59.182452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:59.182904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:59.183322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:59.250413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:59.253914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:17:59.260164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:59.261607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:59.267220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b57fbcb-4cc2-4f91-9e7a-edee91bd9009 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.098179 Sep 08 10:17:59.267890 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 566/1147] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:17:59 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:17:59.694243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:59.694764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:17:59.694877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:59.694972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:17:59.703238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:59.703776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:59.704212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:59.704699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:59.704970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:59.705209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:59.705657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:59.706391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:59.706509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:17:59.706815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:59.706922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:17:59.707268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:17:59.778762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:59.788725 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a4d940b2-ee37-4779-b430-1461ed221352 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1282 microversion: 2.1 time: 0.098753 Sep 08 10:17:59.789437 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 582/1148] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:59 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:17:59.795178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:17:59.803832 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a8e77b84-a205-4148-a381-2417abf8ccb2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1210 microversion: 2.1 time: 0.113798 Sep 08 10:17:59.804380 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 567/1149] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:17:59 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:00.295985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:00.296691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:00.303352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.303778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.304324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.305034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.305491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.305905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.384578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:00.393027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:00.394476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:00.400139 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-386a9d81-17ba-4caf-8c1d-b4cfea2ccbbb tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.108026 Sep 08 10:18:00.400753 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 583/1150] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:00 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:00.719340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:00.719945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:00.726516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.727078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.727637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.728410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.728946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.729379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.755177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:18:00.812887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:00.813494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:00.821998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.822388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.823016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.823734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.824345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.824765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.844305 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10535bde-75e2-4431-975e-6b1d5f564131 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 204 len: 0 microversion: 2.1 time: 0.127227 Sep 08 10:18:00.845257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 568/1151] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:00 2022] DELETE /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:18:00.853810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:00.854740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:00.861874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.862369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.862812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.863564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.864028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.864476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.892700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:00.902470 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afa15c27-f635-4cd6-8337-2afcd68bf5b3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1274 microversion: 2.1 time: 0.094237 Sep 08 10:18:00.903077 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 584/1152] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:00 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:00.908199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:00.908866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:00.921532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.922284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.922728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.923442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:00.924069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:00.924537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:00.932797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:00.940906 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-729c3925-943e-4d10-9cb7-fc25f2c93c26 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1210 microversion: 2.1 time: 0.094276 Sep 08 10:18:00.941677 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 569/1153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:00 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:01.061560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:01.071002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-702c8279-cdff-43c1-9d3c-75199d245bdf tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1514 microversion: 2.1 time: 0.166549 Sep 08 10:18:01.071756 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 585/1154] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:00 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:01.428739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:01.429404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:01.441129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.441624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.442096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:01.442807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.443827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.445700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:01.533581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:01.546378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:01.547989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:01.554917 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62d263ab-951f-4fb3-b710-3d3e3d0c83e2 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.130466 Sep 08 10:18:01.568050 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 570/1155] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:01 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:01.884626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f4253a9f-807d-4c4f-91cc-3dc32496f9af req-5f745f4e-38b0-4253-b700-a84adaa2cca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae4810a-a023-44d3-9497-d41ed8fe7914", "name": "network-vif-deleted", "tag": "923ae83a-f524-4844-a2a4-05d910357730"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:01.896947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f4253a9f-807d-4c4f-91cc-3dc32496f9af req-5f745f4e-38b0-4253-b700-a84adaa2cca0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.897318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f4253a9f-807d-4c4f-91cc-3dc32496f9af req-5f745f4e-38b0-4253-b700-a84adaa2cca0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.897742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f4253a9f-807d-4c4f-91cc-3dc32496f9af req-5f745f4e-38b0-4253-b700-a84adaa2cca0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:01.909997 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f4253a9f-807d-4c4f-91cc-3dc32496f9af req-5f745f4e-38b0-4253-b700-a84adaa2cca0 service nova] Creating event network-vif-deleted:923ae83a-f524-4844-a2a4-05d910357730 for instance eae4810a-a023-44d3-9497-d41ed8fe7914 on n-h1-833090-19 Sep 08 10:18:01.916505 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f4253a9f-807d-4c4f-91cc-3dc32496f9af req-5f745f4e-38b0-4253-b700-a84adaa2cca0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036787 Sep 08 10:18:01.917180 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 586/1156] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:01.926045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:01.926859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:01.935223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.935554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.936201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:01.937271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.937986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.938628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:01.966479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:01.967192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:01.982173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.982807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.983255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:01.988387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:01.989273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:01.989879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:02.042789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:02.051644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-459fced5-6d60-4396-8ac2-dd8b80940c7a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1330 microversion: 2.1 time: 0.129807 Sep 08 10:18:02.055704 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 571/1157] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:01 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:02.075557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:02.083481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e8756b1f-40e4-40e5-8102-1c5485e06404 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1202 microversion: 2.1 time: 0.122179 Sep 08 10:18:02.084648 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 587/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:01 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1202 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:02.094533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:02.095156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:02.101193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:02.101686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:02.102127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:02.102830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:02.103289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:02.103745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:02.233217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:02.248708 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dbe13383-5a18-48fc-b5bb-47bc5c9b4d53 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1514 microversion: 2.1 time: 0.157992 Sep 08 10:18:02.249293 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 572/1159] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:02 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:02.584894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:02.585501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:02.591708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:02.592218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:02.592996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:02.594113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:02.594608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:02.596013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:02.665604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:02.673857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:02.675397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:02.681518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-71cc322e-9323-4aca-91c6-1623c601c494 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.100605 Sep 08 10:18:02.682104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 588/1160] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:02 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:03.078647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:03.082349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:03.091038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.091593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.092113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.092900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.093431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.093933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.109620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:03.111218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:03.127799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.128792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.130339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.135142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.135959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.136400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.195479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:03.206387 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c547a4c1-8352-4445-828d-f2244c606ed3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1338 microversion: 2.1 time: 0.131795 Sep 08 10:18:03.207509 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 573/1161] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:03 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:03.231772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:03.240622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d02d0336-2a30-492a-adab-e4460ece8876 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1258 microversion: 2.1 time: 0.137480 Sep 08 10:18:03.241314 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 589/1162] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:03 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1258 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:03.270821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:03.271829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:03.278499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.279414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.280061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.281138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.281551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.281970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.509669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:03.524192 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad9fe07a-299f-48b1-a7b1-49195831e6ee tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1514 microversion: 2.1 time: 0.257100 Sep 08 10:18:03.525794 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 574/1163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:03 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:03.708854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:03.709967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:03.716868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.717321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.717759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.718615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.719069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.719629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.816056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:03.827012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:03.829347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:03.835425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cf1b564a-d46d-42eb-b044-9ef65341b5b9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.130489 Sep 08 10:18:03.836573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 590/1164] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:03 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:03.896381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1083c093-bef7-44ff-89a0-fe04ebb1f42d req-7bd71b1a-11aa-44a1-b195-8775d262b1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711f7258-107d-4fde-8f8b-acc6c61cfd73", "name": "network-vif-deleted", "tag": "9a244b22-98a5-4fb0-9ef9-0486da2bed46"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:03.916831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1083c093-bef7-44ff-89a0-fe04ebb1f42d req-7bd71b1a-11aa-44a1-b195-8775d262b1d4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:03.918820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1083c093-bef7-44ff-89a0-fe04ebb1f42d req-7bd71b1a-11aa-44a1-b195-8775d262b1d4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:03.920179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1083c093-bef7-44ff-89a0-fe04ebb1f42d req-7bd71b1a-11aa-44a1-b195-8775d262b1d4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:03.938068 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1083c093-bef7-44ff-89a0-fe04ebb1f42d req-7bd71b1a-11aa-44a1-b195-8775d262b1d4 service nova] Creating event network-vif-deleted:9a244b22-98a5-4fb0-9ef9-0486da2bed46 for instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 on n-h2-833090-19 Sep 08 10:18:03.946559 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1083c093-bef7-44ff-89a0-fe04ebb1f42d req-7bd71b1a-11aa-44a1-b195-8775d262b1d4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053646 Sep 08 10:18:03.947833 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 575/1165] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:04.230125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:04.231357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:04.248592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.249086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.249523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.250290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.250740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.251161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.264130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:04.265569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:04.267261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:04.289900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.290590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.292447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.293389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.302609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.303627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.657323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:04.668162 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e050e62-dc37-4659-8802-50b20e5e63a5 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1264 microversion: 2.1 time: 0.408423 Sep 08 10:18:04.669832 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 576/1166] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:04 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1264 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:04.693439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:04.695348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:04.702460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.703369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.703889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.704862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.705834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.706590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.750778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.751564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.752003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.752628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lazy-loading 'fault' on Instance uuid 711f7258-107d-4fde-8f8b-acc6c61cfd73 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:04.826416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:04.836909 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a512de2c-abca-4d64-8f06-79d97a6d12ff tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 200 len: 1308 microversion: 2.1 time: 0.165843 Sep 08 10:18:04.837501 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 577/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:04 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:04.849190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:04.866267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:04.867522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:04.868778 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-205c3a34-b6c6-48bd-9d1e-a7917ab4983c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.642413 Sep 08 10:18:04.872005 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 591/1168] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:04 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:04.885748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.887571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.888021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.888826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:04.889365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:04.889968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:04.980203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:04.991595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:04.995689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:05.003412 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b23830e-2dec-4158-8b56-54b031ef6e15 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1533 microversion: 2.91 time: 0.143711 Sep 08 10:18:05.004718 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 578/1169] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:04 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1533 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:05.033807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:05.035276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:05.043158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.044072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.044519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.045528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.046644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.047745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.162261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lazy-loading 'services' on Instance uuid acacb00b-705f-4760-ba09-6c802380b190 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:05.201505 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d2ce76e0-5d0f-45b8-8d5c-3660437cac2f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1940 microversion: 2.91 time: 0.172009 Sep 08 10:18:05.204582 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 592/1170] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:05 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1940 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:05.234280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:05.234875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:05.241545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.242182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.242636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.243654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.244177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.244674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.275581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-02db7ca3-f4a7-46fb-8470-368013898ab5 req-0e6853c3-cac5-4757-8be8-a651929b6ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:05.287781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lazy-loading 'flavor' on Instance uuid acacb00b-705f-4760-ba09-6c802380b190 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:05.293751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-02db7ca3-f4a7-46fb-8470-368013898ab5 req-0e6853c3-cac5-4757-8be8-a651929b6ad4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.294241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-02db7ca3-f4a7-46fb-8470-368013898ab5 req-0e6853c3-cac5-4757-8be8-a651929b6ad4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.294685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-02db7ca3-f4a7-46fb-8470-368013898ab5 req-0e6853c3-cac5-4757-8be8-a651929b6ad4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.319873 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-02db7ca3-f4a7-46fb-8470-368013898ab5 req-0e6853c3-cac5-4757-8be8-a651929b6ad4 service nova] Creating event network-changed:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h1-833090-19 Sep 08 10:18:05.335616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-02db7ca3-f4a7-46fb-8470-368013898ab5 req-0e6853c3-cac5-4757-8be8-a651929b6ad4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064918 Sep 08 10:18:05.336791 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 593/1171] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:18:05.566475 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5ace276-122a-4145-9158-7cb8e911496b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action" status: 202 len: 0 microversion: 2.91 time: 0.337273 Sep 08 10:18:05.567810 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 579/1172] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:18:05 2022] POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:18:05.579047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:05.580017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:05.587304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.588073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.588804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.589734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.590185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.590805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.684104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:05.693504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:05.694223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:05.698616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:05.700485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:05.700969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.701701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.702381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.703325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.703875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.704540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.706683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ecd0f03-1df4-493f-ad73-c6ce79698f27 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.133654 Sep 08 10:18:05.707895 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 594/1173] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:05 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:05.712901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:05.861235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:05.862705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: 711f7258-107d-4fde-8f8b-acc6c61cfd73] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:05.869696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.870451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.871079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.871882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.872345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.872778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.887841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] HTTP exception thrown: Instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 could not be found. Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Request method failure captured: Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 HTTP/1.1 Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBxVtf8J3pcAHRk-hQwGXxjdY74kXBAY-NkHpL2IMFei33aimtkGVyvn2dPyJRzP8qZQVVANinS8nDKeImBhjbzaeSmnPBaojr_7zDDU8eHkj6I7KWqX7lXakvNv7mcGV403Sb7MIyQbfd_RNirMntdxZyI6gF1_UNte2hzhKs7Pkw Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d4a6efff1d8d4870a2eaf4402c6bf57e Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesAdminNegativeTest-334783261 Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:05.889882 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d4a6efff1d8d4870a2eaf4402c6bf57e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d4a6efff1d8d4870a2eaf4402c6bf57e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d4a6efff1d8d4870a2eaf4402c6bf57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d4a6efff1d8d4870a2eaf4402c6bf57e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesAdminNegativeTest-334783261 Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d4a6efff1d8d4870a2eaf4402c6bf57e Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-334783261 Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesAdminNegativeTest-334783261-project Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 85eda5dbb3ca4158b10c4a89a1c62386 Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesAdminNegativeTest-334783261-project Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 could not be found. Sep 08 10:18:05.891632 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '711f7258-107d-4fde-8f8b-acc6c61cfd73'} Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 could not be found. Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:05.892563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 could not be found. Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 could not be found. Sep 08 10:18:05.894015 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:05.896638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Returning 404 to user: Instance 711f7258-107d-4fde-8f8b-acc6c61cfd73 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:05.896638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-719ee0a6-2606-4f2d-8472-5acefca40da8 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73" status: 404 len: 111 microversion: 2.1 time: 0.034487 Sep 08 10:18:05.896638 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 595/1174] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:05 2022] GET /compute/v2.1/servers/711f7258-107d-4fde-8f8b-acc6c61cfd73 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:05.899870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:05.900690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:05.910164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.910888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.911577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:05.912839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:05.913234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:05.913839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.208308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:06.220095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f2f740f-3723-492c-b295-cffbbae0f321 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.530692 Sep 08 10:18:06.220934 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 580/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:05 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:06.238972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:06.244362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9c8c35f5-70dd-41da-b2af-af77ad083158 req-b6bf2122-37fb-4abb-a3e3-5c7e6c7a8f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280de92f-4be7-49dc-a244-92b0106011de", "tag": "ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:06.251056 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed66aa33-adcb-490a-b87a-1902c255328e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.355075 Sep 08 10:18:06.255284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9c8c35f5-70dd-41da-b2af-af77ad083158 req-b6bf2122-37fb-4abb-a3e3-5c7e6c7a8f31 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.256192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9c8c35f5-70dd-41da-b2af-af77ad083158 req-b6bf2122-37fb-4abb-a3e3-5c7e6c7a8f31 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.256985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9c8c35f5-70dd-41da-b2af-af77ad083158 req-b6bf2122-37fb-4abb-a3e3-5c7e6c7a8f31 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.264361 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 596/1176] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:05 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:06.270289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9c8c35f5-70dd-41da-b2af-af77ad083158 req-b6bf2122-37fb-4abb-a3e3-5c7e6c7a8f31 service nova] Creating event network-changed:ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac for instance 280de92f-4be7-49dc-a244-92b0106011de on n-h1-833090-19 Sep 08 10:18:06.276089 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9c8c35f5-70dd-41da-b2af-af77ad083158 req-b6bf2122-37fb-4abb-a3e3-5c7e6c7a8f31 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050845 Sep 08 10:18:06.276997 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 581/1177] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:06.613984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:06.614696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:06.621435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.622242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.623125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.624107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.624653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.625203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.737234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:06.737957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:06.744025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.744512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.744945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.746009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.746270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.746698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.775508 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2dc09cb8-39af-4e93-a418-588803b1f3ea tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1814 microversion: 2.1 time: 0.165159 Sep 08 10:18:06.776382 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 597/1178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:06 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1814 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:06.800048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:06.805674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.806333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.806881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.808191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:06.808740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:06.809374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:06.819896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:06.829851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:06.831663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:06.836405 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6dfee610-60b7-4cd3-93a8-3c58b070f4f5 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040685 Sep 08 10:18:06.837116 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 598/1179] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:18:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:18:06.837448 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1396bc60-6042-41fe-a146-d68b1dcd0c46 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.105208 Sep 08 10:18:06.843966 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 582/1180] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:06 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:07.245076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:07.245766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:07.253117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:07.253651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:07.254182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:07.255098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:07.255660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:07.256195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:07.276056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:07.276838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:07.278508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:07.284146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:07.288202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:07.288873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:07.289450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:07.290634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:07.291252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:07.292043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:07.491954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:07.494865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:07.507332 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3f1f763-8b0c-4249-a8b5-d049ff2699b4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.266865 Sep 08 10:18:07.511400 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 599/1181] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:07 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:07.600951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:07.617490 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db0b82cd-ab3b-4422-b4f1-b9f3f2fcb4ee tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.345856 Sep 08 10:18:07.618340 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 583/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:07 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:07.865056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:07.865637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:07.875326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:07.875843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:07.876499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:07.877556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:07.878011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:07.878436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:07.957958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:07.982185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:07.983937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:07.989825 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e0e1d27b-5408-4c3b-b24b-4ff17b813f78 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.128683 Sep 08 10:18:07.990466 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 600/1183] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:07 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:08.251557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec69a2b5-8003-47da-bc69-0e80a29ff812", "device": "/dev/xvdb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:08.254666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:08.261416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:08.261887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:08.262320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:08.263018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:08.263492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:08.263952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:08.530860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:08.531475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:08.538405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:08.538900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:08.539417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:08.540168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:08.540629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:08.541059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:08.649313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:08.677767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:08.686186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d2033364-dc05-4d93-9e99-f2041915f21b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.159127 Sep 08 10:18:08.686781 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 601/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:08 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:08.691500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:08.692123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:08.698876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:08.699452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:08.699946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:08.700694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:08.701155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:08.701669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:08.929747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:08.942636 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0d7d374-b34a-4a89-8ea7-b0bf4471ef77 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.253838 Sep 08 10:18:08.943992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 602/1185] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:08 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:09.018940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:09.019679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:09.033030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.034623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.037114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.040718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.041224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.044426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.063062 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f307b336-5708-4ad9-a451-b63a6ec6ad08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "POST /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815301 Sep 08 10:18:09.064421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 584/1186] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:18:08 2022] POST /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:09.192779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:09.201721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:09.203204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:09.209376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f021c577-8ccc-47c3-b882-1ef1d92ec8df tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.194806 Sep 08 10:18:09.210323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 603/1187] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:09 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:09.237334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:09.237837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:09.244078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.244552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.244982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.245667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.246114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.246546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.274514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:18:09.381845 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04193b0f-3a81-4bf8-8aff-a2d8f559d5dc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 204 len: 0 microversion: 2.1 time: 0.147601 Sep 08 10:18:09.382758 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 585/1188] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:09 2022] DELETE /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:18:09.391858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:09.393111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:09.401468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.402401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.403007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.404190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.405145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.405643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.566492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:09.582566 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6351d68-4ebc-48af-85c7-aa750b652f3c tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1680 microversion: 2.1 time: 0.194953 Sep 08 10:18:09.596492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 604/1189] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:09 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:09.710676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:09.711616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:09.718092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.718852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.719391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.720213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.720766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.721293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.861139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:09.870736 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97039005-e04b-4788-9a2d-c3ed9c4f2093 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.165081 Sep 08 10:18:09.871589 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 586/1190] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:09 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:09.970071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:09.971962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:09.980929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.982581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.983699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:09.985221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:09.985889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:09.986508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:10.151265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:10.159821 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76acf22d-519d-47aa-a626-2a50d25420bd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.195538 Sep 08 10:18:10.160989 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 605/1191] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:09 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:10.240646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:10.241546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:10.249253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:10.250056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:10.250687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:10.251645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:10.252284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:10.252886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:10.339197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:10.348125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:10.349628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:10.354985 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5aa7757d-f647-42eb-9820-2afcc2c193f8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.120163 Sep 08 10:18:10.355747 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 587/1192] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:10 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:10.608354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:10.608836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:10.615993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:10.616471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:10.616901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:10.617582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:10.618027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:10.618437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:10.771533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:10.783399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aadfa65a-4829-40b2-be40-7c38a39cefe5 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1680 microversion: 2.1 time: 0.179247 Sep 08 10:18:10.784038 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 606/1193] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:10 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:10.894193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:10.895116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:10.901250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:10.901817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:10.902495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:10.903283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:10.903840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:10.904422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.067963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:11.081314 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b539b0a1-67ba-4ca2-a7ee-e993c8c71895 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.186565 Sep 08 10:18:11.086922 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 588/1194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:10 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:11.184564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:11.185505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:11.192091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:11.192578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:11.193009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.193785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:11.194600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:11.195027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.343104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:11.351642 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80dc1492-20b3-4ca6-ae48-b52579a12dcb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.171427 Sep 08 10:18:11.352218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 607/1195] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:11 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:11.382245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:11.383031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:11.389955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:11.390436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:11.391081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.391803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:11.392261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:11.392680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.461083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:11.469421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:11.470869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:11.476606 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc824912-58dc-48c1-9e12-f22524edf822 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.098364 Sep 08 10:18:11.477184 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 589/1196] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:11 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:11.806663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:11.807407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:11.814842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:11.815698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:11.816389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.817181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:11.817743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:11.818755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:11.965692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:11.973726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc32fe1e-c8c5-4890-8c34-d44d65f05d8d tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1680 microversion: 2.1 time: 0.171276 Sep 08 10:18:11.974538 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 608/1197] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:11 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:12.099975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:12.100590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:12.106867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.107352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.107836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.108814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.109266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.109687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.246392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:12.255417 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c3ef436b-8758-43d3-a604-9f3244f2bfc3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.159365 Sep 08 10:18:12.256983 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 590/1198] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:12 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:12.374609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:12.375225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:12.382362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.382856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.383284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.384071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.384526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.384951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.504688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:12.505300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:12.514094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.514587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.515026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.515760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.517441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.520503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.578796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:12.594697 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ead3d93-6c9d-4fd7-a14b-4950734df7d1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.223769 Sep 08 10:18:12.596718 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 609/1199] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:12 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:12.679576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:12.693866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:12.695844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:12.702634 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2abcc432-cc92-4054-95a2-d9c14f3b7ee8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.201442 Sep 08 10:18:12.716322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 591/1200] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:12 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:12.769436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2eef15f2-f31f-4b45-a138-75d1904ee72f req-2c61e70b-fef1-4ffc-ab16-81346b56d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a87449-ea1f-432b-988d-b8a9ac85c7de", "name": "network-vif-deleted", "tag": "d15f0a36-3cb2-4865-b261-767233c6a5a5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:12.785215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2eef15f2-f31f-4b45-a138-75d1904ee72f req-2c61e70b-fef1-4ffc-ab16-81346b56d9f6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.785706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2eef15f2-f31f-4b45-a138-75d1904ee72f req-2c61e70b-fef1-4ffc-ab16-81346b56d9f6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.786147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2eef15f2-f31f-4b45-a138-75d1904ee72f req-2c61e70b-fef1-4ffc-ab16-81346b56d9f6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.808218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-66b42c25-09df-459a-88db-2fdb59421b74 req-c55fdcdc-2703-40a2-8aff-87420816eb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280de92f-4be7-49dc-a244-92b0106011de", "name": "network-vif-plugged", "status": "completed", "tag": "ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:12.818198 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2eef15f2-f31f-4b45-a138-75d1904ee72f req-2c61e70b-fef1-4ffc-ab16-81346b56d9f6 service nova] Creating event network-vif-deleted:d15f0a36-3cb2-4865-b261-767233c6a5a5 for instance a9a87449-ea1f-432b-988d-b8a9ac85c7de on n-h2-833090-19 Sep 08 10:18:12.818739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-66b42c25-09df-459a-88db-2fdb59421b74 req-c55fdcdc-2703-40a2-8aff-87420816eb23 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:12.819711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-66b42c25-09df-459a-88db-2fdb59421b74 req-c55fdcdc-2703-40a2-8aff-87420816eb23 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:12.820282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-66b42c25-09df-459a-88db-2fdb59421b74 req-c55fdcdc-2703-40a2-8aff-87420816eb23 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:12.825167 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2eef15f2-f31f-4b45-a138-75d1904ee72f req-2c61e70b-fef1-4ffc-ab16-81346b56d9f6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062768 Sep 08 10:18:12.825796 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 610/1201] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:12.840550 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-66b42c25-09df-459a-88db-2fdb59421b74 req-c55fdcdc-2703-40a2-8aff-87420816eb23 service nova] Creating event network-vif-plugged:ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac for instance 280de92f-4be7-49dc-a244-92b0106011de on n-h1-833090-19 Sep 08 10:18:12.846161 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-66b42c25-09df-459a-88db-2fdb59421b74 req-c55fdcdc-2703-40a2-8aff-87420816eb23 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049378 Sep 08 10:18:12.847596 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 592/1202] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:12.998183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:12.999387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:13.002767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:13.018741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.019970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.021932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.028523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.031721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.032431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.076057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.076681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.077345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.078042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lazy-loading 'fault' on Instance uuid a9a87449-ea1f-432b-988d-b8a9ac85c7de {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:13.143781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eda5dbb3ca4158b10c4a89a1c62386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a6efff1d8d4870a2eaf4402c6bf57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:13.153420 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cd10b66-975f-4b36-8174-c04c7e20b730 tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 200 len: 1331 microversion: 2.1 time: 0.159882 Sep 08 10:18:13.154359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 611/1203] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:12 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:13.279045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:13.280137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:13.288491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.289383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.290124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.291314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.291986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.293207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.454803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:13.464012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffd89ff1-52fa-453c-9f84-71da6c05fcb9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.189037 Sep 08 10:18:13.464921 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 593/1204] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:13 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:13.621979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:13.623394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:13.631543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.632084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.632582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.633396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.633913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.634399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.741822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:13.743350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:13.760695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.761226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.761708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.762451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:13.762910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:13.763338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:13.809938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:13.821029 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08e7b1ee-1f42-4379-a11d-d78a3938a149 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.203669 Sep 08 10:18:13.821994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 612/1205] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:13 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:13.858557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:13.867936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:13.869373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:13.874816 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a18b0145-02be-4857-a9ce-0cf719f25878 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.141034 Sep 08 10:18:13.875396 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 594/1206] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:13 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:14.177193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:14.178835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] [instance: a9a87449-ea1f-432b-988d-b8a9ac85c7de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:14.184742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.185222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.185661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.186375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.186830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.187254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.201880 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] HTTP exception thrown: Instance a9a87449-ea1f-432b-988d-b8a9ac85c7de could not be found. Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Request method failure captured: Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de HTTP/1.1 Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcBxVtf8J3pcAHRk-hQwGXxjdY74kXBAY-NkHpL2IMFei33aimtkGVyvn2dPyJRzP8qZQVVANinS8nDKeImBhjbzaeSmnPBaojr_7zDDU8eHkj6I7KWqX7lXakvNv7mcGV403Sb7MIyQbfd_RNirMntdxZyI6gF1_UNte2hzhKs7Pkw Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d4a6efff1d8d4870a2eaf4402c6bf57e Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesAdminNegativeTest-334783261 Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:14.203764 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d4a6efff1d8d4870a2eaf4402c6bf57e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d4a6efff1d8d4870a2eaf4402c6bf57e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d4a6efff1d8d4870a2eaf4402c6bf57e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d4a6efff1d8d4870a2eaf4402c6bf57e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesAdminNegativeTest-334783261 Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d4a6efff1d8d4870a2eaf4402c6bf57e Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-334783261 Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesAdminNegativeTest-334783261-project Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 85eda5dbb3ca4158b10c4a89a1c62386 Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesAdminNegativeTest-334783261-project Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance a9a87449-ea1f-432b-988d-b8a9ac85c7de could not be found. Sep 08 10:18:14.205165 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'a9a87449-ea1f-432b-988d-b8a9ac85c7de'} Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a87449-ea1f-432b-988d-b8a9ac85c7de could not be found. Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:14.205920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a87449-ea1f-432b-988d-b8a9ac85c7de could not be found. Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a87449-ea1f-432b-988d-b8a9ac85c7de could not be found. Sep 08 10:18:14.207133 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:14.210146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Returning 404 to user: Instance a9a87449-ea1f-432b-988d-b8a9ac85c7de could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:14.210146 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d302df73-c9bf-4e4a-9ec7-efc2409496cc tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de" status: 404 len: 111 microversion: 2.1 time: 0.032047 Sep 08 10:18:14.210146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 613/1207] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:14 2022] GET /compute/v2.1/servers/a9a87449-ea1f-432b-988d-b8a9ac85c7de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:14.216221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a7a3dc8-4ec1-4211-8510-edb23307eb7b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] Calling method '.version_select at 0x7f23512c6940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:14.244864 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a7a3dc8-4ec1-4211-8510-edb23307eb7b tempest-VolumesAdminNegativeTest-334783261 tempest-VolumesAdminNegativeTest-334783261-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977528800" status: 202 len: 0 microversion: 2.1 time: 0.033897 Sep 08 10:18:14.245457 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 595/1208] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:18:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977528800 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:14.495211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:14.495699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:14.506610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.507089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.510428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.511191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.511689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.512330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.679518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:14.688370 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c6d23c4-dec1-4802-9577-59b00071377d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1306 microversion: 2.1 time: 0.204423 Sep 08 10:18:14.689018 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 614/1209] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:14 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1306 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:14.844249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:14.844870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:14.852892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.853384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.853819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.854525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.855158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.855388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.861173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:14.867594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-be98f000-6c11-4778-9321-5466a03ea15f req-2bed3c11-f212-4f84-8a95-0c3530c706e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "name": "network-vif-plugged", "status": "completed", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:14.880227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-be98f000-6c11-4778-9321-5466a03ea15f req-2bed3c11-f212-4f84-8a95-0c3530c706e0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.881551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-be98f000-6c11-4778-9321-5466a03ea15f req-2bed3c11-f212-4f84-8a95-0c3530c706e0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.882231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-be98f000-6c11-4778-9321-5466a03ea15f req-2bed3c11-f212-4f84-8a95-0c3530c706e0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.897438 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-be98f000-6c11-4778-9321-5466a03ea15f req-2bed3c11-f212-4f84-8a95-0c3530c706e0 service nova] Creating event network-vif-plugged:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h1-833090-19 Sep 08 10:18:14.903069 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-be98f000-6c11-4778-9321-5466a03ea15f req-2bed3c11-f212-4f84-8a95-0c3530c706e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040755 Sep 08 10:18:14.903906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 615/1210] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:14.910997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:14.916626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:14.920063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.920737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.921335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:14.922483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:14.923121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:14.923585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:15.025439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:15.038064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:15.040297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:15.044728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:15.051683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-135df360-5ba8-4aeb-b8b9-d19486244802 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.145771 Sep 08 10:18:15.051683 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 616/1211] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:14 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:15.066049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3cc2421c-6970-48ac-9681-e2baf5483f9b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.225612 Sep 08 10:18:15.068763 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 596/1212] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:14 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:15.711783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:15.712398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:15.719394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:15.719915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:15.720353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:15.721275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:15.721737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:15.722212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:15.863245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:15.867027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:15.872589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99812dd3-9840-44da-87ed-069079a1cdb1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1485 microversion: 2.1 time: 0.164705 Sep 08 10:18:15.873174 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 617/1213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:15 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1485 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:15.894864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:15.895407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:15.902740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:15.903220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:15.903694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:15.904383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:15.904830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:15.905249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:15.928805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lazy-loading 'flavor' on Instance uuid 280de92f-4be7-49dc-a244-92b0106011de {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:15.997679 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-735eef62-4131-482f-a56c-96448858a586 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de/action" status: 202 len: 0 microversion: 2.1 time: 0.106508 Sep 08 10:18:15.998332 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 597/1214] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:18:15 2022] POST /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:16.006793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:16.007405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:16.013873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:16.014588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:16.015032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:16.015774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:16.016234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:16.016721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:16.084575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:16.085521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:16.091983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:16.092485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:16.092939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:16.093853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:16.094457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:16.094893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:16.184332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:16.195068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:16.196666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:16.202936 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-77c58db1-9260-4154-a42f-2e92cd84ccd4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.124283 Sep 08 10:18:16.203951 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 598/1215] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:16 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:16.209492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:16.210409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:16.216633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:16.217418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:16.218092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:16.219006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:16.219714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:16.220365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:16.226025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:16.235172 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9d9e8ce8-caf3-4e02-a0e8-7e686d11bcae tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1493 microversion: 2.1 time: 0.232342 Sep 08 10:18:16.236171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 618/1216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:16 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1493 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:16.563414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:16.571707 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82c6ecaa-c9b4-49dc-ab14-9de7d9189ab0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1378 microversion: 2.1 time: 0.366423 Sep 08 10:18:16.572275 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 599/1217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:16 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1378 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:17.234044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:17.235364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:17.238856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:17.243979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.244501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.245132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.245845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.246306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.246801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.274910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:17.276354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:17.283409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.284274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.284396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.285058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.285955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.285955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.380584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:17.389243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:17.391018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:17.398192 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a103581-c82e-4eb3-acde-75ebcb622d26 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.168293 Sep 08 10:18:17.399139 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 619/1218] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:17 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:17.468213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:17.477765 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4975256a-1c89-4b67-8566-bc370ffac8ca tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 200 len: 1476 microversion: 2.1 time: 0.217997 Sep 08 10:18:17.491071 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 600/1219] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:17 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:17.501160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-181389647"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:17.503501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:17.510124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.510973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.511421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.512165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.512621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.513051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.595868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:17.596659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:17.603727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.604344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.605013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.605929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.606497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.607119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.762715 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1269e0c-af44-4267-92a3-33b4a9144e7c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de/action" status: 202 len: 0 microversion: 2.1 time: 0.265716 Sep 08 10:18:17.763687 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 620/1220] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:18:17 2022] POST /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:18:17.775900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f89499f2-de80-4b7c-ab18-c3e9f8a5114f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554abb80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:17.819094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:17.832346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c1d634ad-e127-4b26-ae17-8d31eccc2286 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1528 microversion: 2.1 time: 0.240420 Sep 08 10:18:17.832918 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 601/1221] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:17 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1528 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:17.848545 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f89499f2-de80-4b7c-ab18-c3e9f8a5114f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.067189 Sep 08 10:18:17.848545 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 621/1222] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:17 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:17.859074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:17.860810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:17.876234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.876831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.877336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:17.878278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:17.879179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:17.880982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.109170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:18.118032 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2afbb632-53e6-4754-a4b8-0c4a24ca3e28 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1528 microversion: 2.1 time: 0.264170 Sep 08 10:18:18.118908 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 622/1223] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:17 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1528 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:18.140527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83144317-b8e6-4d36-b566-b0343be6a515 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:18.163882 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83144317-b8e6-4d36-b566-b0343be6a515 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/88df2ccb-a2a4-4719-a2f3-6ac61d383c22" status: 202 len: 0 microversion: 2.1 time: 0.027182 Sep 08 10:18:18.164471 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 602/1224] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:18 2022] DELETE /compute/v2.1/flavors/88df2ccb-a2a4-4719-a2f3-6ac61d383c22 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:18.173981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5f5e35e-5149-4021-9b56-64a62f232fd1 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:18.198872 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5f5e35e-5149-4021-9b56-64a62f232fd1 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.029612 Sep 08 10:18:18.199995 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 623/1225] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:18:18 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:18.220105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:18.224533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:18.229065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:18.229559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:18.230016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.230702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:18.231153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:18.231613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.266529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:18.274466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Old instance type tempest-test_resize_flavor_-1739684347, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:18:18.281775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:18:18.282884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:18:18.283525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:18:18.284255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:18:18.284843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:18:18.369814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f0c8a466-2166-470d-848d-ad83ee8d64e7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869/action" status: 202 len: 0 microversion: 2.1 time: 0.153874 Sep 08 10:18:18.370732 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 603/1226] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:18:18 2022] POST /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:18.383969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:18.384619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:18.400771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:18.401274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:18.401901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.402605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:18.403504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:18.404301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.426789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:18.428033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:18.454435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:18.455315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:18.456054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.457000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:18.457477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:18.457909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:18.577586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:18.590280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:18.592289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:18.600500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9b180e9-6390-4778-95a2-0b69fe1e79d7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.177960 Sep 08 10:18:18.617119 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 604/1227] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:18 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:18.641951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:18.651129 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-396d13a3-d3b3-499e-85fd-32928a2acfe4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1537 microversion: 2.1 time: 0.276140 Sep 08 10:18:18.651759 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 624/1228] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:18 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:18.857972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f3db5d2-5650-4711-8b64-ec9b582e94c9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23511f73a0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:18.940670 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f3db5d2-5650-4711-8b64-ec9b582e94c9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.087896 Sep 08 10:18:18.941464 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 605/1229] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:18 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:19.632634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:19.633791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:19.642858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:19.643348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:19.644063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:19.645338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:19.646174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:19.646695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:19.678528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:19.679144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:19.689692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:19.690173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:19.690806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:19.691520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:19.692159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:19.693187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:19.722647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:19.731760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:19.733468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:19.738907 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b948f3bd-29d3-4d5f-9881-e32d69bf5601 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.112866 Sep 08 10:18:19.755802 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 625/1230] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:19 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:19.958392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d14d758b-292b-4a80-bb19-c7ed01a0b730 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355446160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:20.005866 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d14d758b-292b-4a80-bb19-c7ed01a0b730 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.052297 Sep 08 10:18:20.006450 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 626/1231] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:19 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:20.219419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:20.230616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80e21213-0543-47b3-9401-c11bf087aa8e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1537 microversion: 2.1 time: 0.557077 Sep 08 10:18:20.231214 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 606/1232] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:19 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1537 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:20.769353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:20.771419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:20.786937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:20.788308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:20.788867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:20.792979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:20.795717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:20.796268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:20.908118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:20.919762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:20.921510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:20.927343 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-705a9354-1a69-4752-b53a-0b90ce88e7c5 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.162392 Sep 08 10:18:20.940301 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 627/1233] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:20 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:21.024254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0dc4ce89-f935-4a88-a357-5a387be6355f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23511ded30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:21.082236 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0dc4ce89-f935-4a88-a357-5a387be6355f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.062856 Sep 08 10:18:21.082981 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 607/1234] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:21 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:21.256922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:21.257806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:21.264215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:21.264945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:21.265385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:21.266259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:21.266888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:21.267319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:21.471084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:21.479757 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60f6899b-4f60-42b9-a0d1-24679be49db0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1537 microversion: 2.1 time: 0.227291 Sep 08 10:18:21.480503 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 628/1235] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:21 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:21.958468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:21.961145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:21.971329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:21.971865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:21.973300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:21.974761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:21.975406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:21.975879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:22.046600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:22.061604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:22.063393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:22.069353 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dafcf12f-6744-417d-9b99-d5236ff8e459 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.116245 Sep 08 10:18:22.070004 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 608/1236] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:21 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:22.112109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a220427-99e7-4ad1-9c6e-0e2db84c0fc2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554bd670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:22.158548 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a220427-99e7-4ad1-9c6e-0e2db84c0fc2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.064298 Sep 08 10:18:22.159215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 629/1237] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:22 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:22.506877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:22.508877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:22.519501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:22.522385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:22.523537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:22.524140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:22.526233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:22.526954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:22.527727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:22.772403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:22.782183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec276e56-a345-40e9-9a4b-6cb95d0f8b14 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1537 microversion: 2.1 time: 0.281716 Sep 08 10:18:22.787590 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 609/1238] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:22 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:23.104227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:23.104834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:23.123252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.124606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.126288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.127345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.129535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.130463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.158162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ef90a4cf-e910-4f9e-8723-5272abe5e9ce req-a5bc9b9d-d4c5-4020-87e2-ed52fcefd805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280de92f-4be7-49dc-a244-92b0106011de", "name": "network-vif-plugged", "status": "completed", "tag": "ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:23.183746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ef90a4cf-e910-4f9e-8723-5272abe5e9ce req-a5bc9b9d-d4c5-4020-87e2-ed52fcefd805 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.184384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ef90a4cf-e910-4f9e-8723-5272abe5e9ce req-a5bc9b9d-d4c5-4020-87e2-ed52fcefd805 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.184829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ef90a4cf-e910-4f9e-8723-5272abe5e9ce req-a5bc9b9d-d4c5-4020-87e2-ed52fcefd805 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.197384 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ef90a4cf-e910-4f9e-8723-5272abe5e9ce req-a5bc9b9d-d4c5-4020-87e2-ed52fcefd805 service nova] Creating event network-vif-plugged:ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac for instance 280de92f-4be7-49dc-a244-92b0106011de on n-h1-833090-19 Sep 08 10:18:23.203934 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ef90a4cf-e910-4f9e-8723-5272abe5e9ce req-a5bc9b9d-d4c5-4020-87e2-ed52fcefd805 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062375 Sep 08 10:18:23.205429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 610/1239] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:18:23.210836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04695fe1-baf5-4a1a-8c12-f14eca530588 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351230430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:23.313213 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04695fe1-baf5-4a1a-8c12-f14eca530588 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.100360 Sep 08 10:18:23.320822 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 611/1240] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:23 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:23.360102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:23.360397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:23.361736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:23.369467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:23.375274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:23.380329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.383303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.384853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.388040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.388639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.389202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.392308 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b6334c7-3e9e-449e-9625-94be858b3f06 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.292346 Sep 08 10:18:23.393265 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 630/1241] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:23 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:23.587985 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2b32dec-0835-4144-8be8-8c06bd1e2708 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1860 microversion: 2.1 time: 0.241462 Sep 08 10:18:23.588720 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 612/1242] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:23 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1860 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:23.613402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-19", "block_migration": true, "disk_over_commit": false}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:23.616550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:23.624405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.625077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.626232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.627181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.627922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.628679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.667055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lazy-loading 'flavor' on Instance uuid 48255b60-3703-431a-9b76-c65d2bc9966a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:23.685849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Going to try to live migrate instance to n-h2-833090-19 {{(pid=122457) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:18:23.810316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:23.810931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:23.817706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.818196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.818654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:23.819332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:23.819804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:23.820413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:24.095640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:24.114747 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27fe6b68-d5b4-4b28-98dd-5439ca04f594 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.308234 Sep 08 10:18:24.115364 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 613/1243] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:23 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:24.337922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82df2dbf-4ad1-4837-9ed1-51b797991a13 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235128b3a0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:24.421494 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82df2dbf-4ad1-4837-9ed1-51b797991a13 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.087312 Sep 08 10:18:24.422269 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 614/1244] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:24 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:24.430219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:24.432246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:24.445293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:24.445802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:24.446238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:24.446947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:24.447562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:24.448302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:24.470640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:24.595901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:24.606448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:24.609272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:24.615959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-648b2485-57e7-4eba-9c13-ed100122ae24 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.192249 Sep 08 10:18:24.617195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 615/1245] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:24 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:25.169756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:25.171036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:25.188600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:25.189527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:25.190336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:25.192178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:25.193112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:25.193878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:25.412179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:25.438150 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be915a7c-885e-4106-8af5-601f908ce1dc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.279693 Sep 08 10:18:25.452707 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 616/1246] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:25 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:25.472867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50b19cce-9f12-47d3-941a-6a5cc4c58c37 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23512e6550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:25.544597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0469e6e6-ba9e-4825-9f24-03d15f2e1e9c tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/action" status: 202 len: 0 microversion: 2.1 time: 1.936034 Sep 08 10:18:25.545335 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 631/1247] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:18:23 2022] POST /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/action => generated 0 bytes in 1938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:25.554666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:25.555435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:25.569049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50b19cce-9f12-47d3-941a-6a5cc4c58c37 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.114579 Sep 08 10:18:25.569781 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 617/1248] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:25 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:25.587442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:25.589724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:25.591268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:25.593194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:25.595352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:25.597906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:25.656493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:25.657287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:25.666225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:25.667043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:25.667738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:25.668713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:25.669512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:25.670277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:25.770150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:25.782237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:25.785400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:25.793542 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5e8cedd-217f-4c90-813c-45ce0e3b1a12 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.146701 Sep 08 10:18:25.808956 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 618/1249] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:25 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:26.088145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:26.096788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18aad487-8b39-4ce6-9c00-b2c6b40e11c0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.546440 Sep 08 10:18:26.097384 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 632/1250] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:25 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:26.485131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:26.487162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:26.503835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:26.504361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:26.507794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:26.508965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:26.509684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:26.510836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:26.586313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6981e2b-7d36-4efa-8e46-7bffdab070f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355456e50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:26.669380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6981e2b-7d36-4efa-8e46-7bffdab070f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.080267 Sep 08 10:18:26.670665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 633/1251] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:26 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:26.776025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:26.826717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:26.827670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:26.834275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:26.835226 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3cdec508-b34e-4995-867d-21de395a0558 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.356229 Sep 08 10:18:26.849140 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 619/1252] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:26 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:26.855161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:26.856106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:26.857839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:26.858543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:26.859155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:26.998833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:27.013570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:27.015473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:27.038788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87e87cbb-4a29-4269-a212-638ab4fd391a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.215986 Sep 08 10:18:27.040583 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 634/1253] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:26 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:27.124537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:27.125189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:27.136188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:27.138874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:27.139356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:27.143627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:27.144186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:27.144639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:27.356553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:27.376102 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93d7d7f8-21cb-425e-81d2-0aeefad3d1f2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.256687 Sep 08 10:18:27.377741 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 620/1254] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:27 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:27.689823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81b70889-6971-4163-b658-a714a669fee7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355446040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:27.759110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81b70889-6971-4163-b658-a714a669fee7 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.073495 Sep 08 10:18:27.760041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 635/1255] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:27 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:27.862447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:27.862997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:27.872548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:27.873321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:27.873915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:27.874820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:27.875552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:27.876134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:28.070708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:28.071717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:28.080122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:28.083801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:28.084759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:28.085716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:28.090750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:28.092376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:28.206832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:28.211356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:28.223777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:28.225687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:28.226544 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7bcaccd-f5ad-40d2-b354-04d47b187730 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.367943 Sep 08 10:18:28.227246 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 621/1256] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:27 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:28.233429 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35449a59-0f97-4ec8-8675-7b2de994f4cc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.166779 Sep 08 10:18:28.247485 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 636/1257] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:28 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:28.403518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:28.404531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:28.411263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:28.424239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:28.425046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:28.426081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:28.426780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:28.427447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:28.759438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:28.773961 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38896460-36fc-469a-8dca-c0ec87f1da86 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.375501 Sep 08 10:18:28.776228 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 622/1258] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:28 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:28.788825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adf9f676-ca13-430f-ad83-8924ed1c83e8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554469d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:28.864072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-adf9f676-ca13-430f-ad83-8924ed1c83e8 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.090631 Sep 08 10:18:28.864808 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 637/1259] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:28 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:29.262046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:29.263374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:29.271576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:29.272157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:29.272302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:29.272721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:29.273109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:29.273657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:29.274185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:29.274675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:29.291889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:29.292488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:29.293008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:29.293928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:29.294461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:29.304012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:29.316220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:29.464793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:29.484059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:29.485762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:29.493291 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-264543fc-328d-4e64-9236-d52de504b3dd tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.226735 Sep 08 10:18:29.495255 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 638/1260] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:29 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:29.597522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:29.619287 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c62989c-a362-4837-885a-35199ccbdff6 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.364788 Sep 08 10:18:29.646050 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 623/1261] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:29 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:29.801287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:29.802518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:29.810849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:29.811666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:29.812288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:29.813171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:29.813790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:29.814382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:29.882125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8e1df68-ed47-4367-b52c-799bd294d47c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23511f7280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:29.976330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8e1df68-ed47-4367-b52c-799bd294d47c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.088457 Sep 08 10:18:29.977270 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 624/1262] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:29 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:30.103169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:30.118557 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-33c3ccab-aed8-4810-9880-aaa6bdbe87bf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.321879 Sep 08 10:18:30.121169 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 639/1263] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:29 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:30.528236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:30.529436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:30.552167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:30.553652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:30.556980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:30.559781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:30.561159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:30.565108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:30.665164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:30.670555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:30.679573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:30.679758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:30.680427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:30.681585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:30.682156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:30.682692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:30.740722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:30.754442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:30.757010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:30.764397 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f324f81-c9a8-484d-823f-03759fd89686 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.241986 Sep 08 10:18:30.765582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 625/1264] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:30 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:30.993617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a95ae88-42cb-4ee0-b045-511460c973e4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235132fb80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:31.077225 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a95ae88-42cb-4ee0-b045-511460c973e4 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.089296 Sep 08 10:18:31.085856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 626/1265] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:30 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:31.146548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:31.148211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:31.153441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:31.153946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:31.154392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:31.155112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:31.163729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:31.164331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:31.322313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:31.360864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e05bab55-a800-470d-9de6-987dbd01f492 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.708061 Sep 08 10:18:31.380263 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 640/1266] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:30 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:31.810081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:31.811930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:31.846177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:31.846681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:31.850287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:31.851763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:31.851873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:31.852277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:31.917707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:31.935364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a6a9eab-0134-4a58-b674-35a897e4f216 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.794713 Sep 08 10:18:31.939924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 627/1267] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:31 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:32.067357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:32.078463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:32.079935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:32.093318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf3ff16c-5cd5-42aa-9ebf-07bc1ee91dd3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2351cb8ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:32.123478 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d80743c4-7274-4019-8ac2-d41cb1373f7f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.329013 Sep 08 10:18:32.146900 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 641/1268] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:31 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:32.184115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf3ff16c-5cd5-42aa-9ebf-07bc1ee91dd3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.094802 Sep 08 10:18:32.184843 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 628/1269] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:32 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:32.387444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:32.388296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:32.401138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:32.402164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:32.404076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:32.406142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:32.407418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:32.408940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:32.814744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:32.824111 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-167d7fc8-151a-4852-929b-2e56fb08001a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.440418 Sep 08 10:18:32.828029 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 642/1270] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:32 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:32.969742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:32.970451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:32.986170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:32.987867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:32.989036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:32.991067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:32.992034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:32.993257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:33.154305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:33.155214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:33.177085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:33.177863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:33.179621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:33.181253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:33.181920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:33.182524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:33.343665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:33.361581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:33.367805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:33.390377 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1392f86-c302-43bc-8435-20f4e019a9a8 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.240059 Sep 08 10:18:33.395683 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 643/1271] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:33 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:33.413991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a574924c-a9d2-431a-8d8c-bb1c7d27b25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554ab430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:33.480729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a574924c-a9d2-431a-8d8c-bb1c7d27b25c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.082336 Sep 08 10:18:33.485127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 644/1272] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:33 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:33.835399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:33.849731 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2dd2b2a9-882f-4ccc-bd77-11ecf7cee591 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.885938 Sep 08 10:18:33.850259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:33.851076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:33.851657 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 629/1273] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:32 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:33.859004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:33.862249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:33.862942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:33.863954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:33.864682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:33.865349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.431879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:34.433147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:34.436555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:34.451347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:34.452202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:34.452876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.454479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:34.457806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10ee1cf0-b59c-4497-861b-16a8ebf975fd tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.610840 Sep 08 10:18:34.459243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:34.459512 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 645/1274] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:33 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:34.460390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.502103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1db33fb7-b5e8-4183-9323-05822d8c9440 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554ab160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:34.597810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1db33fb7-b5e8-4183-9323-05822d8c9440 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.101002 Sep 08 10:18:34.602044 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 646/1275] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:34 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:34.723002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:34.743057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:34.773661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:34.795532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:34.795532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:34.802359 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-916d7484-1731-463e-8242-ea62896dc09c tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.361989 Sep 08 10:18:34.803924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 630/1276] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:34 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:34.812542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:34.812542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:34.812542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.813986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:34.814506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:34.814958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.874042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:34.874661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:34.887767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:34.888424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:34.888689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.900706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:34.901446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:34.901899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:34.915603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:18:35.153136 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e70f141e-828d-470d-9bfa-9c0ca139073c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "DELETE /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 204 len: 0 microversion: 2.1 time: 0.369619 Sep 08 10:18:35.157737 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 647/1277] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:34 2022] DELETE /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:18:35.175291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:35.176793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:35.184978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:35.188161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:35.188739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:35.192229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:35.192879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:35.193404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:35.350094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:35.367330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e2d27717-f242-429d-9c2e-32175d0bcaa9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.495166 Sep 08 10:18:35.388428 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 631/1278] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:34 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:35.482520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:35.483142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:35.500550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:35.501047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:35.507877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:35.512394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:35.517286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:35.521663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:35.522160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:35.527238 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1bbb4cd8-f8bb-49ad-885f-093e7c86355a tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1710 microversion: 2.1 time: 0.366006 Sep 08 10:18:35.551194 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 648/1279] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:35 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1710 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:35.678237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fb8ca522-235f-4dd5-b9d4-331f980d7d52 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Action: 'create', calling method: .version_select at 0x7f2355505820>, body: {"pool": null} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:36.280528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:36.291021 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2f3af3d-51ae-42f2-87a6-e38f35acddc7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.812857 Sep 08 10:18:36.299192 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 632/1280] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:35 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:36.311620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b7995e0-b607-43bb-8a59-747c862d53b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235117b940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:36.395997 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b7995e0-b607-43bb-8a59-747c862d53b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.095165 Sep 08 10:18:36.397004 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 633/1281] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:36 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:36.406328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:36.410781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:36.429614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:36.431093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:36.431540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:36.433206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:36.437277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:36.438002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:36.564707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:36.580145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:36.583820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:36.592481 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-913321be-d993-43da-bad9-4c754e52a213 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.194006 Sep 08 10:18:36.625855 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 634/1282] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:36 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:36.641567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:36.642815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:36.657700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:36.659374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:36.660097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:36.661597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:36.662267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:36.662937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:36.981475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:36.994078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ace4ef56-1881-4197-a1a6-125d6f7e1ebc tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.357009 Sep 08 10:18:36.995087 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 635/1283] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:36 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:37.003825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:37.005227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:37.013600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:37.014603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:37.015279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:37.016247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:37.017103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:37.018110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:37.365417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:37.375902 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-792b572b-1444-4d7b-8a78-8d7b2f145ff6 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1710 microversion: 2.1 time: 0.378778 Sep 08 10:18:37.391516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 636/1284] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:36 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1710 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:37.391516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6b45b43-9e35-483a-ba16-f6247ab03768"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:37.391516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:37.393394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:37.394345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:37.396302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:37.396302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:37.396876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:37.397395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:37.428665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:37.920119 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fb8ca522-235f-4dd5-b9d4-331f980d7d52 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.356032 Sep 08 10:18:37.921115 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 649/1285] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:18:35 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:18:37.937181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:37.940865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:37.953060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:37.955774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:37.957883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:37.959091 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7241e225-8cfd-44b7-a0ce-2fd5e9404bf0 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "POST /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580672 Sep 08 10:18:37.960181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:37.961260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 637/1286] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:18:37 2022] POST /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments => generated 194 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:37.969251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:37.969981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:37.982753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff51d92f-d7de-4e41-b7e7-41616306f584 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235128b040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:38.140403 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff51d92f-d7de-4e41-b7e7-41616306f584 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1439 microversion: 2.1 time: 0.177552 Sep 08 10:18:38.143426 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 638/1287] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:37 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1439 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:38.162081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:38.164117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:38.182400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:38.183093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:38.184394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:38.185320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:38.185936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:38.187169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:38.235895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:38.255592 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8842881a-3980-4065-b13d-ae911c453d6b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.333240 Sep 08 10:18:38.268065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 650/1288] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:37 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:38.283915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-262813f5-eb17-4233-bff2-b4d15f632417 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Calling method '.version_select at 0x7f23554bddc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:38.319793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:38.336966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:38.338627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:38.354682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83a42db8-5506-4775-b66e-be0c8072d26e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1560 microversion: 2.91 time: 0.209180 Sep 08 10:18:38.357441 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 639/1289] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:38 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:38.370346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:38.370963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:38.400048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:38.406064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:38.407562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:38.409019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:38.410518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:38.413804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:39.690430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:39.711167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1e7cf10-3435-4066-a4ea-36bef9f5cdf5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 1.352357 Sep 08 10:18:39.714145 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 640/1290] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:38 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:39.743523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:39.744216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:39.778921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:39.779970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:39.782822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:39.783856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:39.786274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:39.788688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:39.796916 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-262813f5-eb17-4233-bff2-b4d15f632417 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/079a528e-f05b-4c1b-a4be-f83b044c135c" status: 200 len: 141 microversion: 2.1 time: 1.527703 Sep 08 10:18:39.797501 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 651/1291] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:18:38 2022] GET /compute/v2.1/os-floating-ips/079a528e-f05b-4c1b-a4be-f83b044c135c => generated 141 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:39.802450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9acfcc21-2790-4ac5-adb4-189e40938c70 req-1608dcdf-77e1-4ff4-8311-b607624c819a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217dc8af-fc3f-4e7e-a8d7-7addfb73cb79", "name": "network-vif-deleted", "tag": "64745746-af98-4786-b9f1-4a5e3db412ae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:39.849724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9acfcc21-2790-4ac5-adb4-189e40938c70 req-1608dcdf-77e1-4ff4-8311-b607624c819a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:39.850575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9acfcc21-2790-4ac5-adb4-189e40938c70 req-1608dcdf-77e1-4ff4-8311-b607624c819a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:39.851265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9acfcc21-2790-4ac5-adb4-189e40938c70 req-1608dcdf-77e1-4ff4-8311-b607624c819a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:39.874636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:39.875348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:39.876068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:39.876728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lazy-loading 'fault' on Instance uuid 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:39.893667 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9acfcc21-2790-4ac5-adb4-189e40938c70 req-1608dcdf-77e1-4ff4-8311-b607624c819a service nova] Creating event network-vif-deleted:64745746-af98-4786-b9f1-4a5e3db412ae for instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 on n-h1-833090-19 Sep 08 10:18:39.910172 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9acfcc21-2790-4ac5-adb4-189e40938c70 req-1608dcdf-77e1-4ff4-8311-b607624c819a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110581 Sep 08 10:18:39.923895 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 652/1292] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:39.935296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d06be3d5e0c41aaa44598ee5f9cd4a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f866078f90e94d6ea0a7d681334f2bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:39.946927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c472e779-fe40-4269-bbc9-1d68cdce4dd2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554bd3a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:39.951769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-434b2ba2-d727-4415-b0e1-f859384bacde tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 200 len: 1351 microversion: 2.1 time: 0.235806 Sep 08 10:18:39.962402 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 641/1293] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:39 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 1351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:39.976561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:39.977561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:39.986918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:39.987812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:39.988472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:40.005110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:40.008027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:40.008471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:40.237417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:40.248898 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d0a40d6-c935-4ad4-a2bc-d9fc5e9e4891 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.284992 Sep 08 10:18:40.249750 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 642/1294] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:39 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:40.258228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:40.259057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:40.268150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:40.271109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:40.271895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:40.273260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:40.275024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:40.288954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:40.498379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:40.523967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:40.528588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:40.544014 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02b081bc-5d49-4071-85e7-f9c7f4ea3902 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.291006 Sep 08 10:18:40.545190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 643/1295] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:40 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:40.553552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4eaddc8d-32f4-4283-91f9-1816babad0ce tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Calling method '.version_select at 0x7f23512e63a0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:40.959616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4eaddc8d-32f4-4283-91f9-1816babad0ce tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.412092 Sep 08 10:18:40.969261 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 644/1296] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:18:40 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:40.976217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:40.977742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:40.992831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:40.993625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:40.994312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:40.995256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:40.995957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:40.996617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:41.353497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:41.369927 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20ef3b00-25aa-4799-aa35-9397bc29ef93 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.399037 Sep 08 10:18:41.370701 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 645/1297] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:40 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:41.375372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ad9d2b6-23b2-420b-9b98-6f220afdf91d tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Calling method '.version_select at 0x7f23512ca280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:42.424464 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c472e779-fe40-4269-bbc9-1d68cdce4dd2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1448 microversion: 2.1 time: 2.498315 Sep 08 10:18:42.426568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 653/1298] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:39 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1448 bytes in 2501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:42.438509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:42.441637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:42.456934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.460133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.461390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.462216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.463250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.463850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.492066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 HTTP/1.1 Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:42.495634 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:42.497038 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '217dc8af-fc3f-4e7e-a8d7-7addfb73cb79'} Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:42.497812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:42.499050 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:42.500187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:42.500187 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-21cee6b6-6554-4e34-8721-cbc9db2ceed7 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 404 len: 111 microversion: 2.1 time: 0.069001 Sep 08 10:18:42.500187 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 654/1299] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:42 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:42.510429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:42.511057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:42.518196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.518723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.519356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.520270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.520888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.521475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.882084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:42.893460 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d9d3a85a-4ca2-4995-adfe-79b00897fa7d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.387812 Sep 08 10:18:42.899265 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 655/1300] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:42 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:42.907930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:42.911878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:42.934692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.935913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.936523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.937477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.944549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.945326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.968164 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ad9d2b6-23b2-420b-9b98-6f220afdf91d tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/079a528e-f05b-4c1b-a4be-f83b044c135c" status: 202 len: 0 microversion: 2.1 time: 1.596187 Sep 08 10:18:42.973386 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 646/1301] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:18:41 2022] DELETE /compute/v2.1/os-floating-ips/079a528e-f05b-4c1b-a4be-f83b044c135c => generated 0 bytes in 1597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:42.977223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:42.977994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:42.985525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.986021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.986458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:42.987233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:42.987888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:42.988378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:43.093827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:43.104743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:43.106074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:43.120583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:43.122493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b0c085f-e411-49d3-b100-832e48488450 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.221430 Sep 08 10:18:43.127291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 656/1302] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:42 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:43.137565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f130774-5a84-4b37-beb4-ccb71d63ad8c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23554bd4c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:43.236543 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f130774-5a84-4b37-beb4-ccb71d63ad8c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 200 len: 1448 microversion: 2.1 time: 0.107085 Sep 08 10:18:43.237351 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 657/1303] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:43 2022] GET /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 1448 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:43.248788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:43.252306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:43.270419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:43.271216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:43.271852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:43.273756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:43.276902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:43.277572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:43.296122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:43.305819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-399b059b-f7fb-48d5-be84-7bba4ea20e2b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.335644 Sep 08 10:18:43.320171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 647/1304] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:42 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:43.329441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f1c8ce1e-807a-4b5e-bcb6-ad5c8f7dc465 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Action: 'create', calling method: .version_select at 0x7f23512c6550>, body: {"pool": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:43.339536 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 HTTP/1.1 Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:43.355497 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:43.357138 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9f5fe548-8e50-4c79-bfd8-ec2369cd4719'} Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:43.357865 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:43.359085 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:43.360340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:43.360340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-592468b6-606a-47a0-9bc0-9e77726318ee tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 404 len: 111 microversion: 2.1 time: 0.118426 Sep 08 10:18:43.360340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 658/1305] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:43 2022] DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:43.374437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4019e550-a7a3-474a-8a2e-b850b29b70fb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235547dd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:44.215158 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4019e550-a7a3-474a-8a2e-b850b29b70fb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 204 len: 0 microversion: 2.1 time: 0.856204 Sep 08 10:18:44.215769 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 659/1306] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:43 2022] DELETE /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:18:44.220777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:44.221866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:44.246493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.247267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.250638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.254884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.258033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.258732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.314597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 HTTP/1.1 Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:44.317108 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:44.318492 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9f5fe548-8e50-4c79-bfd8-ec2369cd4719'} Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:44.319203 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:44.320872 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:44.322931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:44.322931 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f51bf75-5328-4fab-971c-917b70ae7877 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 404 len: 111 microversion: 2.1 time: 0.101663 Sep 08 10:18:44.322931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 660/1307] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:44 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:44.474845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8ff807fe-b124-441b-ae05-07ab50ffcc18 req-d33bacde-3608-48f9-a061-92ac080ae891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48255b60-3703-431a-9b76-c65d2bc9966a", "name": "network-vif-unplugged", "status": "completed", "tag": "df6ea807-8c33-4365-8e03-6d7ea7ae7a93"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:44.496987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8ff807fe-b124-441b-ae05-07ab50ffcc18 req-d33bacde-3608-48f9-a061-92ac080ae891 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.503979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8ff807fe-b124-441b-ae05-07ab50ffcc18 req-d33bacde-3608-48f9-a061-92ac080ae891 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.504492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8ff807fe-b124-441b-ae05-07ab50ffcc18 req-d33bacde-3608-48f9-a061-92ac080ae891 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.540477 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8ff807fe-b124-441b-ae05-07ab50ffcc18 req-d33bacde-3608-48f9-a061-92ac080ae891 service nova] Creating event network-vif-unplugged:df6ea807-8c33-4365-8e03-6d7ea7ae7a93 for instance 48255b60-3703-431a-9b76-c65d2bc9966a on n-h1-833090-19 Sep 08 10:18:44.551577 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8ff807fe-b124-441b-ae05-07ab50ffcc18 req-d33bacde-3608-48f9-a061-92ac080ae891 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.230764 Sep 08 10:18:44.557945 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 661/1308] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:44.567388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:44.568990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:44.577661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.578534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.579105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.579995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.580567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.581787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.899978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:44.907810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90ace7b1-2aa6-42fd-b5d9-115f5ea17fe3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.348433 Sep 08 10:18:44.908388 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 662/1309] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:44 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:44.916938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:44.923065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:44.942714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.943210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.943700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.944394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:44.944847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:44.945610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:44.990420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:45.067054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:45.089447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:45.091533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:45.098735 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e29cb556-a410-48f1-bd33-81047a57348a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.185332 Sep 08 10:18:45.099508 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 663/1310] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:44 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:45.104821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:45.105664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:45.113777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:45.114568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:45.115226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:45.116185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:45.116884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:45.117543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:45.146645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:18:45.236518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7e153a5e-676c-45a9-98b1-d9a193a5d194 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 204 len: 0 microversion: 2.1 time: 0.135105 Sep 08 10:18:45.238963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 664/1311] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:45 2022] DELETE /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:18:45.261985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1388fa36-a1dc-47fb-9ea8-aad38db10ff5 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '.version_select at 0x7f235549ce50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:45.288511 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1388fa36-a1dc-47fb-9ea8-aad38db10ff5 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401213841" status: 202 len: 0 microversion: 2.1 time: 0.047564 Sep 08 10:18:45.291282 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 665/1312] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:18:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401213841 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:45.310192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:45.310933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:45.328146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:45.328665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:45.333656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:45.334545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:45.335019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:45.335449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:45.605797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:45.615761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2c5e12a7-7710-4c25-a6ce-a9a0abc70dd3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.323318 Sep 08 10:18:45.620633 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 666/1313] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:45 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:45.631131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-696596830", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "1fc268cd-ae55-4256-b9c7-92d5b594854f"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:45.658561 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f1c8ce1e-807a-4b5e-bcb6-ad5c8f7dc465 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.337188 Sep 08 10:18:45.667924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 648/1314] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:18:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:45.675717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6213e128-e5d8-4fd8-b860-bd39cf8a3c04 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Calling method '.version_select at 0x7f2351461430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:45.770294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] validate_networks() for [('1fc268cd-ae55-4256-b9c7-92d5b594854f', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:18:46.664546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:18:46.665402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:18:46.665887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:18:46.666300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:18:46.666713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:18:46.686788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:46.688083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:46.690324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:46.693169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:46.696271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:46.696738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:46.750055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:18:46.768637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Getting quotas for user 1c08994220f44d5db166b899e80c2a12 and project 92c692b738c8421786bac8be03a047a5. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:18:46.798707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:18:46.801894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:18:46.926032 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f1883c0d-731d-499a-a880-7d2e1cc760f3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301109 Sep 08 10:18:46.934085 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 667/1315] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:18:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:18:46.945327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:46.945676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:46.960351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:46.960947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:46.961387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:46.962194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:46.962666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:46.963100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:46.973080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6213e128-e5d8-4fd8-b860-bd39cf8a3c04 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361" status: 202 len: 0 microversion: 2.1 time: 1.302197 Sep 08 10:18:46.974031 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 649/1316] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:18:45 2022] DELETE /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361 => generated 0 bytes in 1304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:18:46.978951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:46.979822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:47.005100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:47.005619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:47.006083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:47.006895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:47.007345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:47.007847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:47.142644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:47.157691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:47.161283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:47.184308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a610ad97-2ca9-4d32-a012-f91ecc1fc78a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.208954 Sep 08 10:18:47.186844 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 650/1317] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:46 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:47.200111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cdf81f7f-3a92-4a43-9cb7-e94be8656278 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:47.256560 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cdf81f7f-3a92-4a43-9cb7-e94be8656278 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/2024664494" status: 202 len: 0 microversion: 2.1 time: 0.068394 Sep 08 10:18:47.260925 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 651/1318] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:18:47 2022] DELETE /compute/v2.1/flavors/2024664494 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:47.280791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-26b9b540-d47c-43ce-a705-fef56f2fd8d6 req-ce623851-eade-4c36-9af4-046eb67e6cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48255b60-3703-431a-9b76-c65d2bc9966a", "tag": "df6ea807-8c33-4365-8e03-6d7ea7ae7a93"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:47.323004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:47.325188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26b9b540-d47c-43ce-a705-fef56f2fd8d6 req-ce623851-eade-4c36-9af4-046eb67e6cf5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:47.326633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26b9b540-d47c-43ce-a705-fef56f2fd8d6 req-ce623851-eade-4c36-9af4-046eb67e6cf5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:47.331999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26b9b540-d47c-43ce-a705-fef56f2fd8d6 req-ce623851-eade-4c36-9af4-046eb67e6cf5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:47.335251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22d99e37-7713-4f0b-bb9d-c83a869c5d37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.399977 Sep 08 10:18:47.336114 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 668/1319] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:46 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:47.342107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:47.343651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:47.352616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:47.353889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:47.354727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:47.355775 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-26b9b540-d47c-43ce-a705-fef56f2fd8d6 req-ce623851-eade-4c36-9af4-046eb67e6cf5 service nova] Creating event network-changed:df6ea807-8c33-4365-8e03-6d7ea7ae7a93 for instance 48255b60-3703-431a-9b76-c65d2bc9966a on n-h1-833090-19 Sep 08 10:18:47.355998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:47.357158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:47.358019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:47.367509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-26b9b540-d47c-43ce-a705-fef56f2fd8d6 req-ce623851-eade-4c36-9af4-046eb67e6cf5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104609 Sep 08 10:18:47.369468 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 652/1320] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:47.380157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-178c64d0-2863-4126-a110-4acd1bc645ec req-bd576a84-f93a-46e7-8dcf-48e793543d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280de92f-4be7-49dc-a244-92b0106011de", "name": "network-vif-unplugged", "status": "completed", "tag": "ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:47.407322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-178c64d0-2863-4126-a110-4acd1bc645ec req-bd576a84-f93a-46e7-8dcf-48e793543d8c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:47.409982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-178c64d0-2863-4126-a110-4acd1bc645ec req-bd576a84-f93a-46e7-8dcf-48e793543d8c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:47.412833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-178c64d0-2863-4126-a110-4acd1bc645ec req-bd576a84-f93a-46e7-8dcf-48e793543d8c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:47.441723 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-178c64d0-2863-4126-a110-4acd1bc645ec req-bd576a84-f93a-46e7-8dcf-48e793543d8c service nova] Creating event network-vif-unplugged:ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac for instance 280de92f-4be7-49dc-a244-92b0106011de on n-h1-833090-19 Sep 08 10:18:47.447217 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-178c64d0-2863-4126-a110-4acd1bc645ec req-bd576a84-f93a-46e7-8dcf-48e793543d8c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075586 Sep 08 10:18:47.448351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 653/1321] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:47.454731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7d51a9e5-8fc2-4255-b1e6-3b715feda587 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:47.456442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7d51a9e5-8fc2-4255-b1e6-3b715feda587 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:47.581277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7d51a9e5-8fc2-4255-b1e6-3b715feda587 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:47.593739 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7d51a9e5-8fc2-4255-b1e6-3b715feda587 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1207 microversion: 2.1 time: 0.143923 Sep 08 10:18:47.607489 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 654/1322] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:47 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1207 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:47.607489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7041877a-7e8d-4fc1-ac42-995f4aee62f2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Calling method '.version_select at 0x7f23513881f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:47.722596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-7041877a-7e8d-4fc1-ac42-995f4aee62f2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f8c61a81-fe8a-4b88-9de8-e49d48634361 could not be found", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:18:47.723568 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-7041877a-7e8d-4fc1-ac42-995f4aee62f2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] HTTP exception thrown: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7041877a-7e8d-4fc1-ac42-995f4aee62f2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Request method failure captured: Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361 HTTP/1.1 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcF7cZsoQ3uo27OGKCwkZxqe_EA9wcbokjbfYt0P2m2jGma4MAB1S85do5TQaEP8_RGl4u1Fz7kUULuXnc1CmorN7XYYscFzMdlPwSlQg35eKoxbLrztDY0Jit79ULkZw5caPWQEzopLb6npy2QvEh77t83tse0H-C9_pOU5zSkyP_8 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e45751bd9726417c8d244ea7a3280fc3 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsTestJSON-1897017628 Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:18:47.728120 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e45751bd9726417c8d244ea7a3280fc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e45751bd9726417c8d244ea7a3280fc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e45751bd9726417c8d244ea7a3280fc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e45751bd9726417c8d244ea7a3280fc3", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsTestJSON-1897017628 Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e45751bd9726417c8d244ea7a3280fc3 Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1897017628 Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsTestJSON-1897017628-project Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 19a6448816f54143879c40ed4f2f6297 Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsTestJSON-1897017628-project Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: exception: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f8c61a81-fe8a-4b88-9de8-e49d48634361'} Sep 08 10:18:47.729936 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:18:47.731006 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f8c61a81-fe8a-4b88-9de8-e49d48634361 could not be found Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ad38e58-2bb8-4a42-b43c-c1b534d4087e'] Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361. Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:47.733436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:47.735165 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:47.738043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:47.738043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:47.739325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7041877a-7e8d-4fc1-ac42-995f4aee62f2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Returning 404 to user: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:47.740006 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7041877a-7e8d-4fc1-ac42-995f4aee62f2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361" status: 404 len: 111 microversion: 2.1 time: 0.143332 Sep 08 10:18:47.743209 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 655/1323] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:18:47 2022] GET /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:47.755148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f0fb2791-e201-4d39-8477-44fb1b436af9 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:47.816748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f0fb2791-e201-4d39-8477-44fb1b436af9 tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.072020 Sep 08 10:18:47.836649 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 656/1324] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:18:47 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:47.847414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-498d8a58-378f-4993-998e-e7eb34a807e2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Calling method '.version_select at 0x7f23512c6280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.364169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-498d8a58-378f-4993-998e-e7eb34a807e2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f8c61a81-fe8a-4b88-9de8-e49d48634361 could not be found", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:18:48.364852 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-498d8a58-378f-4993-998e-e7eb34a807e2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] HTTP exception thrown: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-498d8a58-378f-4993-998e-e7eb34a807e2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Request method failure captured: Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361 HTTP/1.1 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcF7cZsoQ3uo27OGKCwkZxqe_EA9wcbokjbfYt0P2m2jGma4MAB1S85do5TQaEP8_RGl4u1Fz7kUULuXnc1CmorN7XYYscFzMdlPwSlQg35eKoxbLrztDY0Jit79ULkZw5caPWQEzopLb6npy2QvEh77t83tse0H-C9_pOU5zSkyP_8 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e45751bd9726417c8d244ea7a3280fc3 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsTestJSON-1897017628 Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:18:48.370097 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e45751bd9726417c8d244ea7a3280fc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e45751bd9726417c8d244ea7a3280fc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e45751bd9726417c8d244ea7a3280fc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e45751bd9726417c8d244ea7a3280fc3", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsTestJSON-1897017628 Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e45751bd9726417c8d244ea7a3280fc3 Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1897017628 Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsTestJSON-1897017628-project Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 19a6448816f54143879c40ed4f2f6297 Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsTestJSON-1897017628-project Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: exception: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f8c61a81-fe8a-4b88-9de8-e49d48634361'} Sep 08 10:18:48.371493 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:18:48.373065 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f8c61a81-fe8a-4b88-9de8-e49d48634361 could not be found Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44242153-9a35-45c6-92b8-e4962e665d9c'] Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361. Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:48.374483 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:48.376142 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:48.379249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 Sep 08 10:18:48.379249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.379249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-498d8a58-378f-4993-998e-e7eb34a807e2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] Returning 404 to user: Floating IP not found for ID f8c61a81-fe8a-4b88-9de8-e49d48634361 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:48.379249 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-498d8a58-378f-4993-998e-e7eb34a807e2 tempest-FloatingIPsTestJSON-1897017628 tempest-FloatingIPsTestJSON-1897017628-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361" status: 404 len: 111 microversion: 2.1 time: 0.530140 Sep 08 10:18:48.379249 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 657/1325] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:18:47 2022] DELETE /compute/v2.1/os-floating-ips/f8c61a81-fe8a-4b88-9de8-e49d48634361 => generated 111 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:48.397894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:48.400631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5fb8a809-598f-4a7f-a7ec-e01ff46fac7e tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.409694 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a8654d5e-aa75-4ca4-9bff-e33a9a1ae082 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 1.072201 Sep 08 10:18:48.422546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:48.428862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 669/1326] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:47 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:48.432677 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5fb8a809-598f-4a7f-a7ec-e01ff46fac7e tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/823216011" status: 202 len: 0 microversion: 2.1 time: 0.052799 Sep 08 10:18:48.438238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.438419 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 658/1327] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:18:48 2022] DELETE /compute/v2.1/flavors/823216011 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:48.441249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:48.448844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.449845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:48.459494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.461725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.462409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.462541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.463551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.463975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.464439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.464769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.464963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.466177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.466801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.467846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.782535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:48.794667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:48.802779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:48.817371 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-387ffeb3-f9c3-4b59-8bbe-de2352ee8cd0 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.387129 Sep 08 10:18:48.821422 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 670/1328] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:48 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:48.830032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3e377b3-cb2d-4fff-a44f-61ba9bbc355c tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.867558 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3e377b3-cb2d-4fff-a44f-61ba9bbc355c tempest-ServersWithSpecificFlavorTestJSON-1349894908 tempest-ServersWithSpecificFlavorTestJSON-1349894908-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044757 Sep 08 10:18:48.868963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 671/1329] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:18:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:48.873933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.874085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:48.874960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:48.882828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.884090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.884764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.885710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.886354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.886962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.903914 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b47f63a-d505-4258-bf31-0596fefc5154 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.462318 Sep 08 10:18:48.908945 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 659/1330] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:48 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:48.928373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:48.928880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:48.951837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.952354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.952799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.953534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:48.953988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:48.954414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:48.987969 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 HTTP/1.1 Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:18:48.989564 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:48.991062 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '217dc8af-fc3f-4e7e-a8d7-7addfb73cb79'} Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:48.991947 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:48.993421 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:48.995145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:48.995145 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-458b07cf-64ba-4df4-b62f-213a68f890c8 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "DELETE /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 404 len: 111 microversion: 2.1 time: 0.080745 Sep 08 10:18:48.995145 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 660/1331] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:48 2022] DELETE /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:48.995386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:49.005616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-815be045-2291-4e4e-8eea-f4d3db24649e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1259 microversion: 2.1 time: 0.135391 Sep 08 10:18:49.006521 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 672/1332] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:48 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:49.013548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:49.014161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:49.033942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.034433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.034902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.035652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.036105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.036523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.087867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 HTTP/1.1 Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:18:49.089575 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:49.091213 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '217dc8af-fc3f-4e7e-a8d7-7addfb73cb79'} Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:49.092157 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. Sep 08 10:18:49.093599 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.094912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:49.094912 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34447242-8667-4745-86e6-6ecdeb2405df tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79" status: 404 len: 111 microversion: 2.1 time: 0.085565 Sep 08 10:18:49.094912 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 661/1333] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:49 2022] GET /compute/v2.1/servers/217dc8af-fc3f-4e7e-a8d7-7addfb73cb79 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:49.100487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:49.101052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:49.109510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.109997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.110427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.111235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.111729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.112877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.131567 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 HTTP/1.1 Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:49.133343 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.134947 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9f5fe548-8e50-4c79-bfd8-ec2369cd4719'} Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:49.135918 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.137225 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.141009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:49.142090 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-40587647-4779-435d-8cf0-914370cc314c tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 404 len: 111 microversion: 2.1 time: 0.045810 Sep 08 10:18:49.143187 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 673/1334] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:18:49 2022] DELETE /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:49.151624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:49.152152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] [instance: 9f5fe548-8e50-4c79-bfd8-ec2369cd4719] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:49.162881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.163372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.163838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.164554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.165011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.165447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.201773 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] HTTP exception thrown: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Request method failure captured: Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 HTTP/1.1 Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcCStzezUv7_y-Q-dUkvDLKUxk_NBzzRp0lv9NRzNeGsuqUJ4nQBmmCs46-lAbgZOqbXbHjQ7cCcJWPQnSkgYlp9yYyGujfrRu8Kr_m2homIEhsroZID9IFxxDdp6Cj4YnKbY2qASiITpHjsye_Q9j-WqsVr5JvSnwewYWyKFtkba6U Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:18:49.203128 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f866078f90e94d6ea0a7d681334f2bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f866078f90e94d6ea0a7d681334f2bfe", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f866078f90e94d6ea0a7d681334f2bfe Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674 Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1d06be3d5e0c41aaa44598ee5f9cd4a2 Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-457978674-project Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.204576 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9f5fe548-8e50-4c79-bfd8-ec2369cd4719'} Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:49.205364 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. Sep 08 10:18:49.206714 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:18:49.207883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] Returning 404 to user: Instance 9f5fe548-8e50-4c79-bfd8-ec2369cd4719 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:49.207883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5471f50-389d-452b-971f-af651e8a9fb0 tempest-ServersWithSpecificFlavorTestJSON-457978674 tempest-ServersWithSpecificFlavorTestJSON-457978674-project] 10.222.0.59 "GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719" status: 404 len: 111 microversion: 2.1 time: 0.057505 Sep 08 10:18:49.207883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 662/1335] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:49 2022] GET /compute/v2.1/servers/9f5fe548-8e50-4c79-bfd8-ec2369cd4719 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:18:49.436377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:49.437113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:49.445240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fbe37e90-f0c0-4c11-b69f-9cba4ed53a90 req-a2c5e751-6e4a-463c-ac8d-44f585bceb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280de92f-4be7-49dc-a244-92b0106011de", "name": "network-vif-deleted", "tag": "ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:49.454309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.455060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.455726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.456605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.457215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.457914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.477347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fbe37e90-f0c0-4c11-b69f-9cba4ed53a90 req-a2c5e751-6e4a-463c-ac8d-44f585bceb79 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.477839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fbe37e90-f0c0-4c11-b69f-9cba4ed53a90 req-a2c5e751-6e4a-463c-ac8d-44f585bceb79 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.478287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fbe37e90-f0c0-4c11-b69f-9cba4ed53a90 req-a2c5e751-6e4a-463c-ac8d-44f585bceb79 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.503316 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fbe37e90-f0c0-4c11-b69f-9cba4ed53a90 req-a2c5e751-6e4a-463c-ac8d-44f585bceb79 service nova] Creating event network-vif-deleted:ae9f65b3-a5ad-4e8a-b2b8-ec78087756ac for instance 280de92f-4be7-49dc-a244-92b0106011de on n-h1-833090-19 Sep 08 10:18:49.510222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fbe37e90-f0c0-4c11-b69f-9cba4ed53a90 req-a2c5e751-6e4a-463c-ac8d-44f585bceb79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069211 Sep 08 10:18:49.512146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 663/1336] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:49.782035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:49.793406 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c00f6c79-2593-47ca-b690-563890509e63 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.360765 Sep 08 10:18:49.795479 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 674/1337] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:49 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:49.852884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:49.854614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:49.865651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.866495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.867039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.868055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.869535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.870696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.933211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:49.934235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:49.943116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.944061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.944763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:49.945726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:49.946434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:49.947385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:50.175660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:50.187373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:50.188883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:50.194833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20285097-666c-42b5-a039-535b3be42741 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.348579 Sep 08 10:18:50.211923 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 664/1338] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:49 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:50.226231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:50.228231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:50.241005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:50.241504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:50.247539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:50.247539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:50.247539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:50.248948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:50.386202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:50.403926 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6318a04-efb8-4019-8891-c018acce06ce tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1265 microversion: 2.1 time: 0.189779 Sep 08 10:18:50.422008 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 665/1339] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:50 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:50.466676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:50.491399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-117094be-f2cf-48f5-849b-e9ed41506d5a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.558673 Sep 08 10:18:50.492061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 675/1340] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:49 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:50.827974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:50.829346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:50.846005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:50.848389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:50.849773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:50.851785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:50.855228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:50.855931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.209678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:51.226635 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17a282dd-ab75-4bfc-83f8-91d3c68954d4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.412353 Sep 08 10:18:51.226850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:51.227439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:51.243707 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 666/1341] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:50 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:51.255750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:51.256258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:51.256704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.257456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:51.257925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:51.258358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.430976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:51.449680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:51.453103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:51.462949 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5004f7b9-7308-4bd6-8c1f-2eedc4316a1e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.241278 Sep 08 10:18:51.464306 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 676/1342] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:51 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:51.487947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:51.488846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:51.495258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:51.495771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:51.496380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.497250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:51.497861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:51.498456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.504808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:51.519565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:51.520478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:51.530008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:51.532025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:51.532690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.537472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:51.538282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:51.538871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:51.966218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:51.977316 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2fc329ea-94af-43f2-9e1e-5a1def139b72 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.546330 Sep 08 10:18:51.977920 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 667/1343] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:51 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:52.095337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:52.109634 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df72a86f-d8e7-4094-9bbc-33e5435b2c9e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.590169 Sep 08 10:18:52.110530 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 677/1344] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:51 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:52.250313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:52.251274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:52.262210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:52.268823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:52.269273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:52.270025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:52.270482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:52.270912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:52.491614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:52.492225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:52.502955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:52.503372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:52.506249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:52.507016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:52.507505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:52.507945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:52.824188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:52.839045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:52.842103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:52.856018 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac005e29-f407-4de6-9f13-3a05ccf34a20 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.368098 Sep 08 10:18:52.857432 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 678/1345] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:52 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:53.009119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:53.011152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:53.023325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:53.040037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.042392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.042920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b44b351-0c71-4e72-aa93-b6c29a60db0e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.793604 Sep 08 10:18:53.043426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:53.058220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.073485 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 668/1346] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:52 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:53.076322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.079730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:53.143970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:53.145111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:53.219628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.220127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.220556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:53.228280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.229032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.231966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:53.657602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:53.668913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:53.669980 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49c10eab-9850-4ee2-9421-07d1988c5b17 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.533837 Sep 08 10:18:53.677874 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-835e6c23-3d14-489e-8322-19b9bbc432f2 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.675426 Sep 08 10:18:53.691643 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 669/1347] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:53 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:53.692938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 679/1348] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:53 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:18:53.888295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:53.888910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:53.909260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.917818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.919411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:53.920738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.927944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.932549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:53.935176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-de5c4619-ef5c-4c56-b9c6-3e86053f0fe0 req-511c1ff6-cf62-4412-ad2c-5a055cd35ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cd6554-1319-4f7a-a52c-9c7bb059783e", "tag": "bbd4f58d-3540-4c63-8ba1-9a1f74b24a79"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:18:53.967681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de5c4619-ef5c-4c56-b9c6-3e86053f0fe0 req-511c1ff6-cf62-4412-ad2c-5a055cd35ece service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:53.971032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de5c4619-ef5c-4c56-b9c6-3e86053f0fe0 req-511c1ff6-cf62-4412-ad2c-5a055cd35ece service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:53.973818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de5c4619-ef5c-4c56-b9c6-3e86053f0fe0 req-511c1ff6-cf62-4412-ad2c-5a055cd35ece service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.024058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-de5c4619-ef5c-4c56-b9c6-3e86053f0fe0 req-511c1ff6-cf62-4412-ad2c-5a055cd35ece service nova] Creating event network-changed:bbd4f58d-3540-4c63-8ba1-9a1f74b24a79 for instance 71cd6554-1319-4f7a-a52c-9c7bb059783e on n-h2-833090-19 Sep 08 10:18:54.037315 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-de5c4619-ef5c-4c56-b9c6-3e86053f0fe0 req-511c1ff6-cf62-4412-ad2c-5a055cd35ece service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106102 Sep 08 10:18:54.039108 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 680/1349] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:54.073053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:54.074591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:54.095606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.096342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.096941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.097999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.098656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.099677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.147757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:54.160671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:54.162162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:54.173555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ad327b7-d06c-4904-9334-922144710114 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.289944 Sep 08 10:18:54.182270 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 670/1350] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:53 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:54.271334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:54.280002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:54.300282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.301059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.302284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.303231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.304427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.305027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.396427 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-655298a8-a3e9-445b-9b80-56130925a057 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129865 Sep 08 10:18:54.397031 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 671/1351] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:18:54 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:18:54.418216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:54.418715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:54.436069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.436572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.437125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.437849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.438296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.438901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.521587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:54.532568 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df75bfd1-ee30-4178-a218-41c897e88abf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.463693 Sep 08 10:18:54.537167 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 681/1352] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:54 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:54.655377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'services' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:18:54.705196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:54.705897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:54.718086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.718589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.719036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.724427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:54.742646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:54.743225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:54.828772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:54.957690 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e6bed35-9323-4e2d-8647-2af2268adefe tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments/b6b45b43-9e35-483a-ba16-f6247ab03768" status: 202 len: 0 microversion: 2.1 time: 0.543010 Sep 08 10:18:54.961675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 672/1353] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:18:54 2022] DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments/b6b45b43-9e35-483a-ba16-f6247ab03768 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:18:54.998790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:55.001345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:55.020508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:55.021008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:55.021455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:55.032961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:55.035018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:55.035275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:55.093734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:55.121090 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e92b8e6-5fef-4d36-8f9e-b5f1cff07f1d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1542 microversion: 2.1 time: 0.424175 Sep 08 10:18:55.121703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 682/1354] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:54 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1542 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:55.214310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:55.214932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:55.232280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:55.233996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:55.236100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:55.237692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:55.238361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:55.239034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:55.550050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:55.587208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:55.590775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:55.615117 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46939dbf-13cd-4a17-8da8-d62a52d65257 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.405219 Sep 08 10:18:55.623312 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 683/1355] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:55 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:55.645349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:55.648716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:55.672079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:55.676398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:55.680164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:55.685548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:55.686334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:55.686943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:56.079872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:56.091862 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-62a80f34-45ad-4f7a-8563-f093d0fdf0ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.465059 Sep 08 10:18:56.109830 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 684/1356] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:55 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:56.123513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:56.142745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8931df32-76e1-4e4f-b9d8-409299c6dc7b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 1.182670 Sep 08 10:18:56.147958 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 673/1357] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:54 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:56.168775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:56.169693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:56.176238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:56.176992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:56.177605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:56.178493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:56.179114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:56.179726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:56.555606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:56.568895 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f80c2623-a17c-47c4-b692-2ff692a187a1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1541 microversion: 2.1 time: 0.416030 Sep 08 10:18:56.569945 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 685/1358] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:56 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1541 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:56.649726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:56.650777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:56.661638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:56.662587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:56.663843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:56.664967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:56.665595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:56.666192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:56.855335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:56.867350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:56.870144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:56.877248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a27159f3-f531-444a-8c8d-b46f385e8e6a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.232825 Sep 08 10:18:56.896533 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 674/1359] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:56 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:18:57.119385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:57.120791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:57.128633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:57.129387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:57.138509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.139017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.139486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.140212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.140674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.141103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.170435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:57.171050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:57.185077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.185640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.186098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.194903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.195535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.196005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.587487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:18:57.745417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:57.754797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d08de86d-54ac-427a-a96f-d0b9f8bfb788 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.639197 Sep 08 10:18:57.756225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 686/1360] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:57 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:57.770684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:57.771898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:57.792252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.800695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.801114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.802160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.802304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.802726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.815500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:57.824984 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bbb28df4-5246-46cd-b66e-f31a9ecd005c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.658212 Sep 08 10:18:57.826590 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 675/1361] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:57 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:57.910078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:57.910905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:57.923392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.925435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.926249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:57.928738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:57.929500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:57.930385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:58.112329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:58.119085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:58.124370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:58.130768 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d031e09f-a035-40dd-b25b-f97bcf683fd1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1541 microversion: 2.1 time: 0.373356 Sep 08 10:18:58.131955 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 687/1362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:57 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1541 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:18:58.132508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:58.146366 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e05c0963-9545-4bd7-8e14-a895b056ec73 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.242165 Sep 08 10:18:58.146880 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 676/1363] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:18:57 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:18:58.683089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb6eca9c-ae6e-4a15-969e-bb92b8f14c94 tempest-ListImageFiltersNegativeTestJSON-1719303459 tempest-ListImageFiltersNegativeTestJSON-1719303459-project] Calling method '.version_select at 0x7f2355472b80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:58.733487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-bb6eca9c-ae6e-4a15-969e-bb92b8f14c94 tempest-ListImageFiltersNegativeTestJSON-1719303459 tempest-ListImageFiltersNegativeTestJSON-1719303459-project] HTTP exception thrown: Image not found. Sep 08 10:18:58.784094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:58.785778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb6eca9c-ae6e-4a15-969e-bb92b8f14c94 tempest-ListImageFiltersNegativeTestJSON-1719303459 tempest-ListImageFiltersNegativeTestJSON-1719303459-project] Request method failure captured: Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/images/7ff8d266-2c39-47ed-a3dc-e1d32fe22c7d HTTP/1.1 Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGSPRp7cFH1ZoXU1XBGX64Cvn59oQcZ1FTsKMWHRNW9U-yte1ZDAzNJNvLzMRWkwiwE3XXHC0Qf_Eboz5YIbbusK2UvlOFhMrGk1_OeCTzR4swecXmc2g6DViW0YgBLGwq8A-YG54r5LsnFknx7ESavlAeDO8Oyq01RU5JRy3ENxHs Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d2d380bb671c4d39a9441e8559519a27 Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1719303459 Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:18:58.795576 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2d380bb671c4d39a9441e8559519a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d2d380bb671c4d39a9441e8559519a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d2d380bb671c4d39a9441e8559519a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d2d380bb671c4d39a9441e8559519a27", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1719303459 Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d2d380bb671c4d39a9441e8559519a27 Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1719303459 Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListImageFiltersNegativeTestJSON-1719303459-project Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 74eda340ecea452d8c4265327ed13a41 Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1719303459-project Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7ff8d266-2c39-47ed-a3dc-e1d32fe22c7d'} Sep 08 10:18:58.798742 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:18:58.800932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7ff8d266-2c39-47ed-a3dc-e1d32fe22c7d Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:18:58.802631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ff8d266-2c39-47ed-a3dc-e1d32fe22c7d could not be found. Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:18:58.804030 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:18:58.805216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:18:58.807615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb6eca9c-ae6e-4a15-969e-bb92b8f14c94 tempest-ListImageFiltersNegativeTestJSON-1719303459 tempest-ListImageFiltersNegativeTestJSON-1719303459-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:18:58.808759 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb6eca9c-ae6e-4a15-969e-bb92b8f14c94 tempest-ListImageFiltersNegativeTestJSON-1719303459 tempest-ListImageFiltersNegativeTestJSON-1719303459-project] 10.222.0.59 "GET /compute/v2.1/images/7ff8d266-2c39-47ed-a3dc-e1d32fe22c7d" status: 404 len: 62 microversion: 2.1 time: 0.418954 Sep 08 10:18:58.809712 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 688/1364] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:18:58 2022] GET /compute/v2.1/images/7ff8d266-2c39-47ed-a3dc-e1d32fe22c7d => generated 62 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:18:58.830462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:58.840737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:58.844456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:58.849680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:58.852951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:18:58.853809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:18:58.854694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:58.856352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:58.874963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:58.875870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:58.876489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:58.877946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:18:58.895974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:18:58.896445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:18:59.936086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:18:59.949847 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e1ec66b-c499-4657-90f0-6bcffdd3062e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 1.170310 Sep 08 10:18:59.951359 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 677/1365] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:58 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:00.146870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:00.161293 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f0ec4498-0fa9-4862-a2b8-9a2a03a2fc0b tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 1.307535 Sep 08 10:19:00.176467 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 689/1366] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:18:58 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:00.194887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:00.206946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:00.221398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.229429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.230152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:00.233621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.234325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.236635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:00.379669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "name": "network-vif-unplugged", "status": "completed", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:00.397856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.399314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.401042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:00.433724 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] Creating event network-vif-unplugged:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h2-833090-19 Sep 08 10:19:00.452571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:19:00.487831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cdfae27d-92ad-4216-a553-ca749539ad52 req-17cee1fe-6acb-495e-b936-8467ec7fc91f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.534492 Sep 08 10:19:00.488455 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 678/1367] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:00.501034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:00.503414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:00.519660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.520157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.520977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:00.521286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.521744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.522162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:00.776080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:00.784454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ebb8538-aeb2-4d72-8ab8-04e59cb135c0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1541 microversion: 2.1 time: 0.606658 Sep 08 10:19:00.791414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 690/1368] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:00 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1541 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:00.975398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:00.976773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:00.985448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.989997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.990728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:00.991705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:00.994724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:00.995398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:01.103272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:01.121168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:01.131236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:01.153255 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7f4cc8ec-42e2-473d-af50-75739138f693 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1555 microversion: 2.91 time: 0.660851 Sep 08 10:19:01.155901 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 679/1369] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:00 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1555 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:01.190642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:01.191252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:01.206094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:01.206593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:01.214039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:01.214877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:01.215365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:01.219832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:01.715655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:01.726669 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3371349-c344-464e-b931-2e33df12c1c6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.540271 Sep 08 10:19:01.727181 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 680/1370] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:01 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:01.818083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:01.818697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:01.829292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:01.830312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:01.830746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:01.831454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:01.831922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:01.832341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:01.972519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:01.982983 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f159aee7-dfff-41eb-982b-3abb3f10a107 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 1.011350 Sep 08 10:19:01.987272 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 691/1371] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:00 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:02.190969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:02.192653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:02.206426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:02.210331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:02.213223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:02.214238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:02.217922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:02.218938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:02.300979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:02.316831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2ed6e05a-4b4a-41da-8dcc-5fa7d3b2853a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1541 microversion: 2.1 time: 0.501172 Sep 08 10:19:02.318240 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 681/1372] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:01 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1541 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:02.806954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:02.821090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:02.824099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:02.850572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:02.862098 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80b4990d-de04-4ae8-b6d5-c9bd4b69afcc tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1537 microversion: 2.91 time: 0.675455 Sep 08 10:19:02.866285 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 692/1373] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:02 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1537 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:19:02.925657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:02.957222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:02.959952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:02.961369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:02.996778 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] Creating event network-changed:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h2-833090-19 Sep 08 10:19:03.003557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:19:03.032032 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5f72eb4e-27b8-48a3-ab14-4d993943a9ad req-7cd93129-cdd8-4cd0-9d7b-713fa2396d51 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.632208 Sep 08 10:19:03.033508 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 682/1374] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:19:03.036830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a2e953d-2731-46f9-bfb8-7dbe7229b82d tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f2355417310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAWDgxeaCUTTozKiJzwc50YJz4+pBpE8snGBEvnaAghu3i6452joo5jj6kmHobBNIyHGiEROENkiO60UFFq8dS1mhScapwpqm2QiK5JYKCuOO0/taWp3DgrgU2uu1LbTQ=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a2e953d-2731-46f9-bfb8-7dbe7229b82d tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 257 Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:03.041159 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:03.042543 n-d-833090-19 devstack@n-api.service[122457]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAWDgxeaCUTTozKiJzwc50YJz4+pBpE8snGBEvnaAghu3i6452joo5jj6kmHobBNIyHGiEROENkiO60UFFq8dS1mhScapwpqm2QiK5JYKCuOO0/taWp3DgrgU2uu1LbTQ=="}} Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAWDgxeaCUTTozKiJzwc50YJz4+pBpE8snGBEvnaAghu3i6452joo5jj6kmHobBNIyHGiEROENkiO60UFFq8dS1mhScapwpqm2QiK5JYKCuOO0/taWp3DgrgU2uu1LbTQ=='}}} Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.043254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:03.044595 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:19:03.046072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:19:03.047253 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 10:19:03.047253 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.047253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a2e953d-2731-46f9-bfb8-7dbe7229b82d tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:03.047253 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a2e953d-2731-46f9-bfb8-7dbe7229b82d tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.173010 Sep 08 10:19:03.047253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 693/1375] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:19:02 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:19:03.057906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:03.058051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:03.058685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:03.067516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:03.072398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.074323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.075085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.075202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.075668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.076184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.077112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.077775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.078406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.078981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.080484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.080987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.571736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:03.577296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:03.586901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce49d122-aa58-4d0f-8e11-67a13fac2ca3 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.550203 Sep 08 10:19:03.607574 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 683/1376] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:03 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:03.615041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f23516a0b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-797321096", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:03.627064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:03.640558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:03.646368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for user 801f686cdd484dbbba95c7b6df08208a and project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:03.652345 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f62e3f2-296b-44af-9b78-994faad62543 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.608127 Sep 08 10:19:03.652931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 694/1377] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:03 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:03.664163 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:03.667530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-09df7099-2706-4933-9d92-015d773f6500 req-34ab4920-d1e2-4150-ae35-bc4bbe81cd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cd6554-1319-4f7a-a52c-9c7bb059783e", "name": "network-vif-plugged", "status": "completed", "tag": "bbd4f58d-3540-4c63-8ba1-9a1f74b24a79"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:03.678529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-09df7099-2706-4933-9d92-015d773f6500 req-34ab4920-d1e2-4150-ae35-bc4bbe81cd18 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.679017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-09df7099-2706-4933-9d92-015d773f6500 req-34ab4920-d1e2-4150-ae35-bc4bbe81cd18 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.679451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-09df7099-2706-4933-9d92-015d773f6500 req-34ab4920-d1e2-4150-ae35-bc4bbe81cd18 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 2166 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-797321096", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:03.681013 n-d-833090-19 devstack@n-api.service[122456]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-797321096', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:03.683690 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.686800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:03.690375 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7108b589-fb7a-4998-9fa2-b36ab881b3ed tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.081023 Sep 08 10:19:03.698262 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 684/1378] 10.222.0.59 () {60 vars in 1160 bytes} [Thu Sep 8 10:19:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:19:03.700676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-09df7099-2706-4933-9d92-015d773f6500 req-34ab4920-d1e2-4150-ae35-bc4bbe81cd18 service nova] Creating event network-vif-plugged:bbd4f58d-3540-4c63-8ba1-9a1f74b24a79 for instance 71cd6554-1319-4f7a-a52c-9c7bb059783e on n-h2-833090-19 Sep 08 10:19:03.705517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:03.706322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:03.706847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-09df7099-2706-4933-9d92-015d773f6500 req-34ab4920-d1e2-4150-ae35-bc4bbe81cd18 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052677 Sep 08 10:19:03.710993 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 695/1379] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:03.721404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.722723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.723407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.724527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.725195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.725336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9bb7fab-06bf-4f71-88af-0fd453787d8f tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f23553d9af0>, body: {"keypair": {"name": "tempest-keypair-1393660972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPybjXVAUmywH1i5fI1fgaITZIuSSWkdrJ/yYnnEcNWKWsm3vsXaCD1DCdlDkT1SglB+CBCXu2yBmbVup1+Ahffzp9p9WIvSPYJxT6x+PTIkGLWTTAHGS/E+AVs2lp0Grw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:03.725986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.764008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b9bb7fab-06bf-4f71-88af-0fd453787d8f tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:03.774967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b9bb7fab-06bf-4f71-88af-0fd453787d8f tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for user 801f686cdd484dbbba95c7b6df08208a and project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:03.823541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9bb7fab-06bf-4f71-88af-0fd453787d8f tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111050 Sep 08 10:19:03.836719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 696/1380] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:19:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:03.842011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f235545aee0>, body: {"keypair": {"name": "tempest-keypair-1393660972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxkDWDNYm3Z0sctRusBAfGVAoqBDCUcGWG2fXJtwCnXt1TZH5UF4CB8MvBufwT94Y8WTInDznScx7D35aAkgy4emYtIMkAFGWAaBuLivyV1oZ2jTdwa9wnmZdfem54w4g=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:03.862644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:03.868744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for user 801f686cdd484dbbba95c7b6df08208a and project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:03.912463 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] HTTP exception thrown: Key pair 'tempest-keypair-1393660972' already exists. Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 273 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: {"keypair": {"name": "tempest-keypair-1393660972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxkDWDNYm3Z0sctRusBAfGVAoqBDCUcGWG2fXJtwCnXt1TZH5UF4CB8MvBufwT94Y8WTInDznScx7D35aAkgy4emYtIMkAFGWAaBuLivyV1oZ2jTdwa9wnmZdfem54w4g=="}} Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: exception: Key pair 'tempest-keypair-1393660972' already exists. Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1393660972', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxkDWDNYm3Z0sctRusBAfGVAoqBDCUcGWG2fXJtwCnXt1TZH5UF4CB8MvBufwT94Y8WTInDznScx7D35aAkgy4emYtIMkAFGWAaBuLivyV1oZ2jTdwa9wnmZdfem54w4g=='}}} Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '801f686cdd484dbbba95c7b6df08208a-tempest-keypair-1393660972' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 08 10:19:03.924940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:19:03.929215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '801f686cdd484dbbba95c7b6df08208a-tempest-keypair-1393660972' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 10, 19, 3, 901134), 'updated_at': None, 'name': 'tempest-keypair-1393660972', 'user_id': '801f686cdd484dbbba95c7b6df08208a', 'fingerprint': '72:22:0b:ad:dd:09:97:d2:19:de:70:11:e5:87:e2:47', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxkDWDNYm3Z0sctRusBAfGVAoqBDCUcGWG2fXJtwCnXt1TZH5UF4CB8MvBufwT94Y8WTInDznScx7D35aAkgy4emYtIMkAFGWAaBuLivyV1oZ2jTdwa9wnmZdfem54w4g==', 'type': 'ssh'}] Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi keypair.create() Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._create() Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1393660972' already exists. Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 08 10:19:03.933356 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1393660972' already exists. Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1393660972' already exists. Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 409 to user: Key pair 'tempest-keypair-1393660972' already exists. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19511257-ab1f-4a57-81af-1bbdcbf37979 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.092500 Sep 08 10:19:03.940560 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 697/1381] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:19:03 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:03.943783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:03.944746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:03.963268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.964868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.965708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:03.967538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:03.968387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:03.969070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:04.155142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:04.168400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:04.169976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:04.176495 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c66a6e2-5e92-4d3d-8313-243d4806db0e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1537 microversion: 2.91 time: 0.239422 Sep 08 10:19:04.187495 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 698/1382] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:03 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:04.187495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3759726c-1818-450f-8739-925e11b294ac tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Calling method '.version_select at 0x7f235549c430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:04.209404 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3759726c-1818-450f-8739-925e11b294ac tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393660972" status: 202 len: 0 microversion: 2.1 time: 0.030696 Sep 08 10:19:04.210731 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 699/1383] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393660972 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:04.223369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16bc58f8-c7f8-4f92-bad5-cbc8a7562fc6 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f2355417dc0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOlP+hgFtw8NMQaD/PHLCIziuJfYSrdw2QmklOOuDEqgmEbTwVfOzQWpwprXmPOofWbMaDQFn9dltst96DeF5LxIbqH6mkO1G+IaGNvhA9D7CghUWnt3bega6TqVdCd3A=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16bc58f8-c7f8-4f92-bad5-cbc8a7562fc6 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 247 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOlP+hgFtw8NMQaD/PHLCIziuJfYSrdw2QmklOOuDEqgmEbTwVfOzQWpwprXmPOofWbMaDQFn9dltst96DeF5LxIbqH6mkO1G+IaGNvhA9D7CghUWnt3bega6TqVdCd3A=="}} Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOlP+hgFtw8NMQaD/PHLCIziuJfYSrdw2QmklOOuDEqgmEbTwVfOzQWpwprXmPOofWbMaDQFn9dltst96DeF5LxIbqH6mkO1G+IaGNvhA9D7CghUWnt3bega6TqVdCd3A=='}}} Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi '' Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:19:04.228039 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16bc58f8-c7f8-4f92-bad5-cbc8a7562fc6 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16bc58f8-c7f8-4f92-bad5-cbc8a7562fc6 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011734 Sep 08 10:19:04.232840 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 700/1384] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:19:04 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:19:04.237171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:04.240080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f235548e4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-608486384", "public_key": " "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:04.246533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da232e71-fe54-4452-b574-11cfa1addbb3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1541 microversion: 2.1 time: 0.545928 Sep 08 10:19:04.249790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 685/1385] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:03 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1541 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:04.266047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:04.270772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for user 801f686cdd484dbbba95c7b6df08208a and project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:04.289412 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 94 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-608486384", "public_key": " "}} Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-608486384', 'public_key': ' '}}} Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.292025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-09671563-9c34-48f2-a36d-734c290c63d3 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058039 Sep 08 10:19:04.297792 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 701/1386] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Sep 8 10:19:04 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:19:04.306921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b261dd6b-eac6-4408-b495-28f1bb7df418 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f2351a8ad30>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOeDUHaxAtVVCBQ37qJIZNMhSmGLCFS0FL+q/YNeXDIm2+12o+vmTbxKcAzm4cXl+jj0NiuKpyzHVcnjAiTvLr+h1ErNxOPIJgoysU379KyqlxJSuv52DUZbwtq58ioSQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b261dd6b-eac6-4408-b495-28f1bb7df418 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 507 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOeDUHaxAtVVCBQ37qJIZNMhSmGLCFS0FL+q/YNeXDIm2+12o+vmTbxKcAzm4cXl+jj0NiuKpyzHVcnjAiTvLr+h1ErNxOPIJgoysU379KyqlxJSuv52DUZbwtq58ioSQ=="}} Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOeDUHaxAtVVCBQ37qJIZNMhSmGLCFS0FL+q/YNeXDIm2+12o+vmTbxKcAzm4cXl+jj0NiuKpyzHVcnjAiTvLr+h1ErNxOPIJgoysU379KyqlxJSuv52DUZbwtq58ioSQ=='}}} Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 08 10:19:04.310905 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b261dd6b-eac6-4408-b495-28f1bb7df418 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b261dd6b-eac6-4408-b495-28f1bb7df418 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009600 Sep 08 10:19:04.315148 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 686/1387] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:19:04 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:19:04.322734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Action: 'create', calling method: .version_select at 0x7f235545a790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1699080004", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:04.340848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:04.346093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Getting quotas for user 801f686cdd484dbbba95c7b6df08208a and project ebc0cf7328424a97bcb83b929a918045. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:04.363332 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 118 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1699080004", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1699080004', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 10:19:04.365332 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca8f4b8b-e87d-4c0a-8d6f-da1edfc1bd46 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047895 Sep 08 10:19:04.370297 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 702/1388] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:19:04 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:19:04.381520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-522641de-0617-4432-8907-1288d04e1f82 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Calling method '.version_select at 0x7f235132f0d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:04.399687 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-522641de-0617-4432-8907-1288d04e1f82 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1355604955 not found for user 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-522641de-0617-4432-8907-1288d04e1f82 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Request method failure captured: Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1355604955 HTTP/1.1 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcGWFhJFOGoyLkDBOx_8EqEGLzJ004MrtZeaFiub9LtcvwDAyN_XCt2LBxMftFisv2Q0C1oZajMu9GkaOrGRBmwQ5hW62IGIE6h0DLD6XpHohXArgEBycWQL1Yw2AvvUPlHHo9kLlgXA8E11nTnYTClXql5QSgLTwOg12suKJsSlC0s Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ebc0cf7328424a97bcb83b929a918045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ebc0cf7328424a97bcb83b929a918045", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: ebc0cf7328424a97bcb83b929a918045 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-103229015 Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-KeyPairsNegativeTestJSON-103229015-project Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: exception: Keypair tempest-keypair-non-existent-1355604955 not found for user 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'tempest-keypair-non-existent-1355604955'} Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1355604955 not found for user 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.402152 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1355604955 not found for user 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1355604955 not found for user 801f686cdd484dbbba95c7b6df08208a Sep 08 10:19:04.406357 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:04.410618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-522641de-0617-4432-8907-1288d04e1f82 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1355604955 not found for user 801f686cdd484dbbba95c7b6df08208a {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:04.411750 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-522641de-0617-4432-8907-1288d04e1f82 tempest-KeyPairsNegativeTestJSON-103229015 tempest-KeyPairsNegativeTestJSON-103229015-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1355604955" status: 404 len: 145 microversion: 2.1 time: 0.037201 Sep 08 10:19:04.412893 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 687/1389] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1355604955 => generated 145 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:04.613145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:04.614110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:04.624454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:04.625225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:04.626491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:04.628967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:04.629714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:04.631480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:04.684657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:04.688621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:04.701334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:04.702189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:04.702849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:04.703889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:04.705337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:04.706139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.191797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.201755 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-84397999-521d-4e9d-8667-cd631b359546 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.592539 Sep 08 10:19:05.203128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 703/1390] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:04 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:05.218589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:05.219589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:05.244062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.244864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.245382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.246400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.247116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.247803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.250642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.266702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe2f084a-333c-49ce-832f-324ca0351a08 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.586771 Sep 08 10:19:05.268390 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 688/1391] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:04 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:05.285724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:05.286497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:05.302908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.304822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.306233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.311217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.311702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.312845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.410366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.421975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.423777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.429983 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ef1feb2-2abd-4aa6-a5f2-c9a44b9bce86 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1540 microversion: 2.91 time: 0.217351 Sep 08 10:19:05.430946 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 704/1392] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:05 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1540 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:05.514738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:05.525092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:05.534617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.535670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.536574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.537952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.538899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.539819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.621693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.646151 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-578e1e20-8ec2-4894-82c8-8fd8bd30725b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1473 microversion: 2.1 time: 0.375650 Sep 08 10:19:05.648804 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 689/1393] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:05 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:05.653175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-833090-19". {{(pid=122457) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:19:05.758063 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42f07022-53a4-42f1-8ab1-9eaa7139121f tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action" status: 202 len: 0 microversion: 2.91 time: 0.274811 Sep 08 10:19:05.759444 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 705/1394] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:19:05 2022] POST /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:19:05.770472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:05.773688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:05.785932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.811424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.812051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.812842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:05.813304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:05.814267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:05.925848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.935788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.937672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:05.948852 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-582ba751-9b25-420c-93b6-155f56e6a770 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1488 microversion: 2.91 time: 0.185032 Sep 08 10:19:05.949756 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 690/1395] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:05 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1488 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:06.227599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:06.228535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:06.242261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.242261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.242261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.242261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.249804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.249804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.285653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:06.296991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:06.298568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:06.310584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.311342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.313569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.316115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.317396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.318092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.840858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:06.844436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:06.850502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10b208db-6bbc-45c5-b1a5-803b93ed0273 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.629620 Sep 08 10:19:06.851229 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 706/1396] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:06 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:06.855451 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58f0ea28-9a79-4444-b9d2-f5e6ff4b8f36 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.564098 Sep 08 10:19:06.856831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:06.857846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 691/1397] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:06 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:06.859713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:06.867165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.867698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.868136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.869039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.869658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.870236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.871276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:06.873218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:06.881564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.882383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.882999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.883925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:06.884716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:06.885149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:06.929694 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-806ade77-9b9e-46ea-8537-647b214cbdc6 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077206 Sep 08 10:19:06.930740 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 707/1398] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:06 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:06.979437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:06.981680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:07.001147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:07.001566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:07.003179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:07.005301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:07.006395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:07.007526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:07.107561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:07.122191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:07.124257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:07.124815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:07.133541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df551396-12af-46f5-99db-494e6d240348 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1473 microversion: 2.1 time: 0.273407 Sep 08 10:19:07.134136 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 692/1399] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:06 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:07.150264 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-50596117-051b-44b9-9eb9-83a25ed9d12e tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1488 microversion: 2.91 time: 0.175649 Sep 08 10:19:07.151448 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 708/1400] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:06 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1488 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:19:07.878996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:07.881362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:07.883032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:07.883710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:07.893366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:07.893491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:07.893874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:07.894565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:07.895501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:07.897402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:07.897755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:07.898653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:07.899533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:07.901505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:07.902302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:07.902773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.223255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:08.237646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa82db5a-ff1d-4a56-9c13-0d904cd11a09 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.358615 Sep 08 10:19:08.240192 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 709/1401] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:07 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:08.253644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:08.257748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:08.268301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.269410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.270059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.271029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.272288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.272905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.289285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:08.297710 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18458209-67ec-48f7-b0d6-4597e21d5397 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.427976 Sep 08 10:19:08.301378 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 693/1402] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:07 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:08.306372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:08.306994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:08.315291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.316042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.318979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.326305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.330357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.330357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.453753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4553af24-8dba-4a1b-8fb9-f62c41d9cfd8 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.211570 Sep 08 10:19:08.455272 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 710/1403] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:08 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:19:08.472993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:08.475918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:08.490678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.493401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.495752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.496738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.498643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.501319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.690531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:08.696795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:08.712309 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93d2b9c4-af7b-4055-8f5e-a28c89b21072 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1473 microversion: 2.1 time: 0.408431 Sep 08 10:19:08.714524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 694/1404] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:08 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:08.715570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:08.717289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:08.722958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:08.723291 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51e12566-00dd-4dad-8ed9-6715baab6aa7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1488 microversion: 2.91 time: 0.260201 Sep 08 10:19:08.735485 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 711/1405] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:08 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1488 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:08.739224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:08.755570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.756552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.757282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.758258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.759033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.761000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.799358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84df1178-f09d-4cd7-9068-347a24439a5a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083438 Sep 08 10:19:08.817015 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 695/1406] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:08 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:19:08.882109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:08.882618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:08.896715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.897963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.898626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.901041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:08.901530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:08.901973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:08.936642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:19:09.118370 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e34ee953-d85b-4d4f-b66f-df4df58b08b2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 204 len: 0 microversion: 2.1 time: 0.240004 Sep 08 10:19:09.119552 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 712/1407] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:08 2022] DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:19:09.129564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:09.130984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:09.138058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.138660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.139176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.139932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.140389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.140824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.409449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7195fa12-7736-4513-ad69-55427febc60e tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1274074820", "id": 376558873, "os-flavor-access:is_public": "False"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:09.436364 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7195fa12-7736-4513-ad69-55427febc60e tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.250447 Sep 08 10:19:09.436992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 713/1408] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:09 2022] POST /compute/v2.1/flavors => generated 436 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:09.442823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:09.447802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:09.455995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.456495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.457126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.457847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.458303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.458955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.488179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:09.502235 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-705b2c60-fdfe-480f-8228-182aff2894e2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1682 microversion: 2.1 time: 0.376090 Sep 08 10:19:09.519324 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 696/1409] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:09 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1682 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:09.527110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:09.527799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:09.534151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.534981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.535559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.536335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.536992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.537617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.824410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:09.829188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:09.834497 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b42ea4a4-d6d7-4ae4-94a2-d7c242b685bb tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.396158 Sep 08 10:19:09.835312 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 714/1410] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:09 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:09.847758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79d12b24-16e1-466e-9345-13e246b209d7 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:09.850377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e27d1ba1-d07d-4d88-b4a7-29c9dffaeb85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.329122 Sep 08 10:19:09.850965 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 697/1411] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:09 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:09.862718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:09.863339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:09.870359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.870843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.871283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.872013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.872479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.872876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.901759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:09.926651 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79d12b24-16e1-466e-9345-13e246b209d7 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/376558873/action" status: 200 len: 96 microversion: 2.1 time: 0.089130 Sep 08 10:19:09.927372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 715/1412] 10.222.0.59 () {60 vars in 1197 bytes} [Thu Sep 8 10:19:09 2022] POST /compute/v2.1/flavors/376558873/action => generated 96 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:19:09.937654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:09.938884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:09.945753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.946283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.946735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:09.947483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:09.947965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:09.948399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.068031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:10.076771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:10.078229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:10.083696 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efcbcb5a-36e2-493c-904b-647e97bd36ef tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1490 microversion: 2.91 time: 0.154870 Sep 08 10:19:10.086416 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 716/1413] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:09 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1490 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:10.089228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-839f4af5-081d-478b-a847-d9c966d096f8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:10.101513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:10.110031 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a32ba80-b52b-4de1-8662-c005f6941164 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1470 microversion: 2.1 time: 0.251793 Sep 08 10:19:10.111154 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 698/1414] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:09 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1470 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:10.133787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:10.134973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:10.142120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:10.144072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.145141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.145832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.146807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.147519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.148170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.182428 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-839f4af5-081d-478b-a847-d9c966d096f8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 7dd8f3631bb9491a946802bf733b2fd5 combination. Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-839f4af5-081d-478b-a847-d9c966d096f8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Request method failure captured: Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/flavors/376558873/action HTTP/1.1 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 67 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGc-PVCkoIxtzsmwqm2_s5rHV0sF7pegiTrQyFyr_iv-Ty5NVuY3veLB7Ovs8QDoA8T-3YGb-5-U_pNVVMqTeAVQ9nGmlmp8p1VP117Fj5wCkhC92zBUn9pmQJv5ZBAL3r4KjiJoHJJ7ajacp8APagKYqpvPl4ON4oqijvHQu6stkI Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 335ff37f8e8a4d93890e2f85582fb9c7 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_335ff37f8e8a4d93890e2f85582fb9c7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 335ff37f8e8a4d93890e2f85582fb9c7 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 33aec32c89b640e59cc03dc1f01bd253 Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: {"addTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor access already exists for flavor 36 and project 7dd8f3631bb9491a946802bf733b2fd5 combination. Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '376558873', 'body': {'addTenantAccess': {'tenant': '7dd8f3631bb9491a946802bf733b2fd5'}}} Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-7dd8f3631bb9491a946802bf733b2fd5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.190924 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result.read() Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 10:19:10.195931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-7dd8f3631bb9491a946802bf733b2fd5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 10, 19, 10, 172226), 'updated_at': None, 'flavor_id': 36, 'project_id': '7dd8f3631bb9491a946802bf733b2fd5'}] Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 7dd8f3631bb9491a946802bf733b2fd5 combination. Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 7dd8f3631bb9491a946802bf733b2fd5 combination. Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 7dd8f3631bb9491a946802bf733b2fd5 combination. Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-839f4af5-081d-478b-a847-d9c966d096f8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 7dd8f3631bb9491a946802bf733b2fd5 combination. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:10.200646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-839f4af5-081d-478b-a847-d9c966d096f8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/376558873/action" status: 409 len: 152 microversion: 2.1 time: 0.107308 Sep 08 10:19:10.208974 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 717/1415] 10.222.0.59 () {60 vars in 1197 bytes} [Thu Sep 8 10:19:10 2022] POST /compute/v2.1/flavors/376558873/action => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:10.208974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf30e4f2-5dd8-4a8a-9c39-e0ef4db30d13 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:10.225002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.225664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.234347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.234347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.234617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.234935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.311216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:10.317981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for user 5f96685045b340b2a978ece9dd591640 and project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:10.345898 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf30e4f2-5dd8-4a8a-9c39-e0ef4db30d13 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/376558873/action" status: 200 len: 21 microversion: 2.1 time: 0.145624 Sep 08 10:19:10.348759 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 718/1416] 10.222.0.59 () {60 vars in 1197 bytes} [Thu Sep 8 10:19:10 2022] POST /compute/v2.1/flavors/376558873/action => generated 21 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:19:10.362107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a66cbc9-402f-4679-90d7-1abcb6249c78 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.402806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a66cbc9-402f-4679-90d7-1abcb6249c78 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/376558873" status: 202 len: 0 microversion: 2.1 time: 0.048062 Sep 08 10:19:10.404844 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 719/1417] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:19:10 2022] DELETE /compute/v2.1/flavors/376558873 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:10.424793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02e0170e-9ba7-4cf6-80dd-c7c0002e1901 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.461953 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02e0170e-9ba7-4cf6-80dd-c7c0002e1901 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052883 Sep 08 10:19:10.471427 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 720/1418] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:10.491781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1448e842-37f1-4857-afd8-22eb1cc89813 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-675147703", "id": 578883712, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:10.524659 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1448e842-37f1-4857-afd8-22eb1cc89813 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.036716 Sep 08 10:19:10.527052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 721/1419] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:10 2022] POST /compute/v2.1/flavors => generated 434 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:10.537556 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-13e9f50c-8fe5-43ab-8263-7656e941d682 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869/action" status: 202 len: 0 microversion: 2.1 time: 0.407410 Sep 08 10:19:10.539497 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 699/1420] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:19:10 2022] POST /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:19:10.545468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.546731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:10.546948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-460fe4ca-4d99-4af1-a506-1a44e31b7e53 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.554825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.555243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.556175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.557008 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-460fe4ca-4d99-4af1-a506-1a44e31b7e53 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-460fe4ca-4d99-4af1-a506-1a44e31b7e53 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Request method failure captured: Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/flavors/578883712/os-flavor-access HTTP/1.1 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcGc-PVCkoIxtzsmwqm2_s5rHV0sF7pegiTrQyFyr_iv-Ty5NVuY3veLB7Ovs8QDoA8T-3YGb-5-U_pNVVMqTeAVQ9nGmlmp8p1VP117Fj5wCkhC92zBUn9pmQJv5ZBAL3r4KjiJoHJJ7ajacp8APagKYqpvPl4ON4oqijvHQu6stkI Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 335ff37f8e8a4d93890e2f85582fb9c7 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_335ff37f8e8a4d93890e2f85582fb9c7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 335ff37f8e8a4d93890e2f85582fb9c7 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 33aec32c89b640e59cc03dc1f01bd253 Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: exception: Access list not available for public flavors. Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'flavor_id': '578883712'} Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 08 10:19:10.560670 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:10.566408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-460fe4ca-4d99-4af1-a506-1a44e31b7e53 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:10.567711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-460fe4ca-4d99-4af1-a506-1a44e31b7e53 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/578883712/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026800 Sep 08 10:19:10.568687 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 700/1421] 10.222.0.59 () {58 vars in 1206 bytes} [Thu Sep 8 10:19:10 2022] GET /compute/v2.1/flavors/578883712/os-flavor-access => generated 91 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:10.569573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.570547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.571237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.583108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.586690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:10.606679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.608627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.610769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.611931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.613726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.615803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.640110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:10.864337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:10.878588 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59e249c8-312f-4d4d-a48b-dd9ad84192fa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.307687 Sep 08 10:19:10.879734 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 701/1422] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:10 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:10.888939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8aa068d9-23b3-4f14-9365-03f3719f8326 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.916422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8aa068d9-23b3-4f14-9365-03f3719f8326 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/578883712" status: 202 len: 0 microversion: 2.1 time: 0.033296 Sep 08 10:19:10.918006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 702/1423] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:19:10 2022] DELETE /compute/v2.1/flavors/578883712 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:10.925220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.926811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:10.934515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.935298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.936014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.937706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.938973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.939664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.943666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:10.953077 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d49a5bab-bd12-4122-aff3-4768bd5cb50b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1682 microversion: 2.1 time: 0.420470 Sep 08 10:19:10.957362 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 722/1424] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:10 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1682 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:10.967792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:10.968729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:10.980113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.983443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.985655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:10.986405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:10.990096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:10.990542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.203419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:11.221906 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd849231-ec02-4473-83cd-d6dc4161f4ef tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.302099 Sep 08 10:19:11.230809 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 703/1425] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:10 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:11.243931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b86eface-a017-4dbe-ac71-ffd051208338 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.251525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:11.262936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f642c83a-9787-4e59-818e-62f9455b6798 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1307 microversion: 2.1 time: 0.303653 Sep 08 10:19:11.274152 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 723/1426] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:10 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:11.280321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b86eface-a017-4dbe-ac71-ffd051208338 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047610 Sep 08 10:19:11.280773 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 704/1427] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:11.282463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "name": "network-vif-plugged", "status": "completed", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:11.286776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.287655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:11.296315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.296889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.299166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.299606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.300319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.301029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.304520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.305323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.307106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.319448 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] Creating event network-vif-plugged:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h2-833090-19 Sep 08 10:19:11.327241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:19:11.341887 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9676824a-d6d5-4990-93ee-a08250b7b31d req-b3ec5f26-3a99-4879-8fb3-f7ccf08fa75a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065731 Sep 08 10:19:11.342564 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 724/1428] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:11.353574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.354611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:11.363893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.364505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.364946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.365916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.366751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.367299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.508727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:11.517333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:11.519060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:11.524676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b55d84d7-a60c-4c35-8997-3190ad6e1a3a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1490 microversion: 2.91 time: 0.177535 Sep 08 10:19:11.525505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 725/1429] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:11 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1490 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:11.529926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0134e7d8-478a-4efa-8f0c-3dfa30ebf694 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-9232141", "id": 1106498238, "os-flavor-access:is_public": "False"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:11.559348 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0134e7d8-478a-4efa-8f0c-3dfa30ebf694 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.032944 Sep 08 10:19:11.562263 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 726/1430] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:11 2022] POST /compute/v2.1/flavors => generated 436 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:11.678231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 7265635f-ed38-4363-84e1-d4f53815fb77 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:11.698194 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8391df1d-e013-4f4b-8855-132b4340d0f8 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 2349 microversion: 2.25 time: 0.416175 Sep 08 10:19:11.699136 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 705/1431] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:11 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 2349 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:11.731384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.735337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.738457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.738909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.739722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.742614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.745179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.765165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bcad8101-77c1-4a70-854c-0c0ef447ac53 tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:11.770973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bcad8101-77c1-4a70-854c-0c0ef447ac53 tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9762a34521c94a8d83af69d14a8ade84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd8f3631bb9491a946802bf733b2fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bcad8101-77c1-4a70-854c-0c0ef447ac53 tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Request method failure captured: Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/flavors/1106498238/action HTTP/1.1 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 67 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGbbMdUEVt3PB140qVDX_2xtlAg49kLSPQIn_6qJg3X30EjJwUJXTWE-HBRtSdy4-iSlgmbuWvKgXJ4nwveAxzJ9_jlUnbKJR6Fo23WvIMuu_QM-RJRGW5whtf4FMd80g-5ne0eKuoxBDOQqp0G8E1n0NemR6yLzvc5zN4Y35gOt08 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 7dd8f3631bb9491a946802bf733b2fd5 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1996131432 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd8f3631bb9491a946802bf733b2fd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd8f3631bb9491a946802bf733b2fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd8f3631bb9491a946802bf733b2fd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd8f3631bb9491a946802bf733b2fd5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1996131432 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 7dd8f3631bb9491a946802bf733b2fd5 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1996131432 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsAccessNegativeTestJSON-1996131432-project Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9762a34521c94a8d83af69d14a8ade84 Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1996131432-project Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: {"addTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '1106498238', 'body': {'addTenantAccess': {'tenant': '7dd8f3631bb9491a946802bf733b2fd5'}}} Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:19:11.773037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bcad8101-77c1-4a70-854c-0c0ef447ac53 tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bcad8101-77c1-4a70-854c-0c0ef447ac53 tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] 10.222.0.59 "POST /compute/v2.1/flavors/1106498238/action" status: 403 len: 130 microversion: 2.1 time: 0.203288 Sep 08 10:19:11.777738 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 727/1432] 10.222.0.59 () {60 vars in 1200 bytes} [Thu Sep 8 10:19:11 2022] POST /compute/v2.1/flavors/1106498238/action => generated 130 bytes in 205 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:11.784978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2227f20f-d850-4b3f-9dad-7bc0ccf13252 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.812562 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2227f20f-d850-4b3f-9dad-7bc0ccf13252 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1106498238" status: 202 len: 0 microversion: 2.1 time: 0.032231 Sep 08 10:19:11.814325 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 728/1433] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:19:11 2022] DELETE /compute/v2.1/flavors/1106498238 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:11.815749 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2796f6a-63d7-44f6-9a80-02602e8bee1d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.088875 Sep 08 10:19:11.816368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 706/1434] 10.222.0.59 () {60 vars in 1217 bytes} [Thu Sep 8 10:19:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:19:11.828204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5632cc7-04cd-4d96-afca-f354516fce52 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.853606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5632cc7-04cd-4d96-afca-f354516fce52 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034053 Sep 08 10:19:11.854627 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 729/1435] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:11.880002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef6ad31f-0887-46a0-85dd-83fc5d746a43 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1065251182", "id": 1863321964, "os-flavor-access:is_public": "False"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:11.908814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef6ad31f-0887-46a0-85dd-83fc5d746a43 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.033371 Sep 08 10:19:11.909272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:11.910043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:11.919071 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 707/1436] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:11 2022] POST /compute/v2.1/flavors => generated 439 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:11.925002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa5d1ec4-10aa-4a9b-ab3f-287d4c222744 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:11.926259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.931113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.931735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:11.934515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:11.941954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:11.942584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:12.089707 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa5d1ec4-10aa-4a9b-ab3f-287d4c222744 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1863321964/action" status: 200 len: 97 microversion: 2.1 time: 0.168437 Sep 08 10:19:12.097374 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 708/1437] 10.222.0.59 () {60 vars in 1200 bytes} [Thu Sep 8 10:19:11 2022] POST /compute/v2.1/flavors/1863321964/action => generated 97 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:19:12.103843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:12.104941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:12.112490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:12.113353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:12.113862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:12.114645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:12.115167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:12.115718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:12.999735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:13.014970 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d82a356a-72a8-4f85-9c3e-63bc2479e30c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 1.112253 Sep 08 10:19:13.015562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 730/1438] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:11 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:13.033066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0d9bb67-3f38-4b3d-84f6-42207d6b9cfe tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:13.047987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e0d9bb67-3f38-4b3d-84f6-42207d6b9cfe tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9762a34521c94a8d83af69d14a8ade84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd8f3631bb9491a946802bf733b2fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0d9bb67-3f38-4b3d-84f6-42207d6b9cfe tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Request method failure captured: Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/flavors/1863321964/action HTTP/1.1 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 70 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGbbMdUEVt3PB140qVDX_2xtlAg49kLSPQIn_6qJg3X30EjJwUJXTWE-HBRtSdy4-iSlgmbuWvKgXJ4nwveAxzJ9_jlUnbKJR6Fo23WvIMuu_QM-RJRGW5whtf4FMd80g-5ne0eKuoxBDOQqp0G8E1n0NemR6yLzvc5zN4Y35gOt08 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 7dd8f3631bb9491a946802bf733b2fd5 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1996131432 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd8f3631bb9491a946802bf733b2fd5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7dd8f3631bb9491a946802bf733b2fd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7dd8f3631bb9491a946802bf733b2fd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7dd8f3631bb9491a946802bf733b2fd5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1996131432 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 7dd8f3631bb9491a946802bf733b2fd5 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1996131432 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsAccessNegativeTestJSON-1996131432-project Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9762a34521c94a8d83af69d14a8ade84 Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1996131432-project Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: {"removeTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '1863321964', 'body': {'removeTenantAccess': {'tenant': '7dd8f3631bb9491a946802bf733b2fd5'}}} Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can( Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 10:19:13.050941 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 10:19:13.055128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:13.061114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0d9bb67-3f38-4b3d-84f6-42207d6b9cfe tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:13.073242 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e0d9bb67-3f38-4b3d-84f6-42207d6b9cfe tempest-FlavorsAccessNegativeTestJSON-1996131432 tempest-FlavorsAccessNegativeTestJSON-1996131432-project] 10.222.0.59 "POST /compute/v2.1/flavors/1863321964/action" status: 403 len: 133 microversion: 2.1 time: 0.055493 Sep 08 10:19:13.092273 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 731/1439] 10.222.0.59 () {60 vars in 1200 bytes} [Thu Sep 8 10:19:13 2022] POST /compute/v2.1/flavors/1863321964/action => generated 133 bytes in 76 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:13.110643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:13.112291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:13.124382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:13.125442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:13.126658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:13.127716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:13.128414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:13.129079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:13.153374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:13.164777 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-824e5631-8c1c-4324-bdee-9fc1fefb1011 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1682 microversion: 2.1 time: 1.065961 Sep 08 10:19:13.177157 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 709/1440] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:12 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1682 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:13.194772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:13.200129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:13.219208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:13.224216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:13.226912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:13.229253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:13.229855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:13.230668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:13.655201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:13.765777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:13.776630 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8d5856f6-fcff-4764-b54b-7f34a54d0637 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1487 microversion: 2.1 time: 0.588949 Sep 08 10:19:13.787149 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 710/1441] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:13 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1487 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:13.792209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:13.793075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:13.804561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:13.805070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:13.805698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:13.806446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:13.806902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:13.809214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:13.857806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:13.866576 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-695c4594-acfe-4d5c-a24e-e3d13b4cced3 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1717 microversion: 2.1 time: 0.772639 Sep 08 10:19:13.867303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 732/1442] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:13 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1717 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:13.874819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e4cdd76-a5d3-41bf-a182-0e08a6cb3e67 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7dd8f3631bb9491a946802bf733b2fd5"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:13.982337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:14.020530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:14.022105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:14.120322 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b1432777-cb24-4089-90d6-41a638be374f tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.275629 Sep 08 10:19:14.120322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 711/1443] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:13 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:14.121297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e4cdd76-a5d3-41bf-a182-0e08a6cb3e67 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1863321964/action" status: 200 len: 21 microversion: 2.1 time: 0.219686 Sep 08 10:19:14.121297 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 733/1444] 10.222.0.59 () {60 vars in 1200 bytes} [Thu Sep 8 10:19:13 2022] POST /compute/v2.1/flavors/1863321964/action => generated 21 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:19:14.121297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-233700468"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:14.121297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:14.131008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:14.132047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:14.132739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:14.133693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:14.134653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:14.135307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:14.171380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:14.224240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3574025-7c40-4d8a-9856-7e2998970885 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f2351916e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1863920533", "description": "tempest-description-1185546035"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:14.353539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:14.502542 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17571e65-a9dd-4aab-8045-13968387fdf9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "POST /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e/action" status: 202 len: 0 microversion: 2.1 time: 0.402003 Sep 08 10:19:14.509492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 734/1445] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:19:14 2022] POST /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:19:14.534011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:14.534774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:14.547962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:14.549200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:14.549946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:14.551344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:14.552103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:14.552839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:14.765449 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3574025-7c40-4d8a-9856-7e2998970885 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.684649 Sep 08 10:19:14.766632 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 712/1446] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:14 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:14.772269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39e7bde3-e424-4f53-a95c-38197d50d2b6 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:14.845705 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39e7bde3-e424-4f53-a95c-38197d50d2b6 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1863321964" status: 202 len: 0 microversion: 2.1 time: 0.077559 Sep 08 10:19:14.848032 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 713/1447] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:19:14 2022] DELETE /compute/v2.1/flavors/1863321964 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:14.859081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:14.871329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:14.894289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:14.899521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:14.900872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:14.902389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:14.903691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:14.906238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.115940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:15.125215 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ba996762-a21d-4ebe-8f10-ec90f9d10c3b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1614 microversion: 2.1 time: 0.275907 Sep 08 10:19:15.129520 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 714/1448] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:14 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1614 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:15.142750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17a0bfcb-1677-4adf-ab5a-4de45c3e660d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235163ab80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:15.207813 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17a0bfcb-1677-4adf-ab5a-4de45c3e660d tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2" status: 200 len: 1413 microversion: 2.1 time: 0.076460 Sep 08 10:19:15.208470 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 715/1449] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:19:15 2022] GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:15.225822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31e62985-f101-432a-9ecc-2356a80b141d", "device": "/dev/xvdb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:15.229196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:15.248509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:15.251865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:15.252564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.254107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:15.254808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:15.255402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.282525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:15.290864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e91abac-e9f7-45bf-82d9-fd9d8a9a84c1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.779933 Sep 08 10:19:15.292585 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 735/1450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:14 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:15.311396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2881649-49ac-4ff1-90bf-7118eb0e34c7 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f235110adc0>, body: {"security_group_rule": {"parent_group_id": "bfa062b2-9b19-4c54-9246-dffcc57f273b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:15.588432 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2881649-49ac-4ff1-90bf-7118eb0e34c7 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.294420 Sep 08 10:19:15.590059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 736/1451] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:19:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:15.601469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cb1eaed-b4eb-4510-848c-d2483e294de9 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:15.625443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cb1eaed-b4eb-4510-848c-d2483e294de9 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034067 Sep 08 10:19:15.635492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 737/1452] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:15.635492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:15.635492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:15.639283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:15.640075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:15.640864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.641838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:15.642536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:15.643139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.791733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:15.800420 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c754fe33-448d-4d74-b9b3-8d27918df274 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1707 microversion: 2.1 time: 0.172477 Sep 08 10:19:15.801030 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 738/1453] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:15 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1707 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:15.821865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:15.822487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:15.829252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:15.829747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:15.830193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.834434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:15.834921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:15.835365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:15.908097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:15.917488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:15.918979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:15.924288 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c16eaae-4042-4e2b-9a08-de7443490c43 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.107906 Sep 08 10:19:15.924874 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 739/1454] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:15 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:15.929663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-84ad0e0a-8602-40e4-86c7-7623f5b9af46 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2355472310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:15.980937 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-84ad0e0a-8602-40e4-86c7-7623f5b9af46 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2" status: 200 len: 1413 microversion: 2.1 time: 0.054827 Sep 08 10:19:15.981521 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 740/1455] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:19:15 2022] GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:15.989508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-095b4cdb-2ee1-4fe5-a713-4093389c9c20 req-277ab0fc-7460-407c-af36-2fd8ce02faf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f135a161-48ff-4d0e-b00c-41bf24ba6240", "name": "network-vif-deleted", "tag": "f0b3fee2-3af1-471a-b848-b24d91841bac"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:16.000949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-095b4cdb-2ee1-4fe5-a713-4093389c9c20 req-277ab0fc-7460-407c-af36-2fd8ce02faf7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:16.000949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-095b4cdb-2ee1-4fe5-a713-4093389c9c20 req-277ab0fc-7460-407c-af36-2fd8ce02faf7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:16.001409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-095b4cdb-2ee1-4fe5-a713-4093389c9c20 req-277ab0fc-7460-407c-af36-2fd8ce02faf7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:16.012529 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-095b4cdb-2ee1-4fe5-a713-4093389c9c20 req-277ab0fc-7460-407c-af36-2fd8ce02faf7 service nova] Creating event network-vif-deleted:f0b3fee2-3af1-471a-b848-b24d91841bac for instance f135a161-48ff-4d0e-b00c-41bf24ba6240 on n-h2-833090-19 Sep 08 10:19:16.018952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-095b4cdb-2ee1-4fe5-a713-4093389c9c20 req-277ab0fc-7460-407c-af36-2fd8ce02faf7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Sep 08 10:19:16.019424 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 741/1456] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:16.028132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-861d99be-a076-4e4c-8bd9-6a77244de800 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23553d9ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-343277717", "description": "tempest-description-1057007672"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:16.207302 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-861d99be-a076-4e4c-8bd9-6a77244de800 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.184022 Sep 08 10:19:16.216093 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 742/1457] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:16.216093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b2c57dae-e539-48d4-bd73-a9a021a5faf3 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-560166246", "id": 1958387760, "os-flavor-access:is_public": "False"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:16.237616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b2c57dae-e539-48d4-bd73-a9a021a5faf3 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028442 Sep 08 10:19:16.238410 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 743/1458] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:16 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:16.249879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8400586-104f-4d9f-8a63-b271936e7047 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '.version_select at 0x7f235547d790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:16.253765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8400586-104f-4d9f-8a63-b271936e7047 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:16.254251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8400586-104f-4d9f-8a63-b271936e7047 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:16.254696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8400586-104f-4d9f-8a63-b271936e7047 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:16.286240 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8400586-104f-4d9f-8a63-b271936e7047 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 3147 microversion: 2.1 time: 0.046931 Sep 08 10:19:16.297654 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 744/1459] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:19:16 2022] GET /compute/v2.1/os-migrations => generated 3147 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:16.302686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90682e15-b8e8-4eac-80d0-c2cb38612f85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235218e280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:16.533065 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90682e15-b8e8-4eac-80d0-c2cb38612f85 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2" status: 204 len: 0 microversion: 2.1 time: 0.234182 Sep 08 10:19:16.533718 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 745/1460] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:16 2022] DELETE /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:19:16.540374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:16.541433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:16.559119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:16.562046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:16.565963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:16.567258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:16.567860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:16.568389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:16.705620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:16.713995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e434d58-a903-4ac2-b4d7-7efce1dfe14a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1614 microversion: 2.1 time: 0.178968 Sep 08 10:19:16.727486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 746/1461] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:16 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1614 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:16.738046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a013684-e7c0-4405-b6c0-3a56bc069091 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23510deca0>, body: {"security_group_rule": {"parent_group_id": "ba2f751e-8a25-4d16-a128-a8b2d6133c07", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:17.094670 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a013684-e7c0-4405-b6c0-3a56bc069091 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.378558 Sep 08 10:19:17.095323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 747/1462] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:19:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:17.100185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3403789-487d-4dd5-a463-253bbf208a55 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bf41f310a59745de92f9225d8d58f754"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:17.172918 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a3403789-487d-4dd5-a463-253bbf208a55 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] HTTP exception thrown: Flavor access not found for 40 / bf41f310a59745de92f9225d8d58f754 combination. Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3403789-487d-4dd5-a463-253bbf208a55 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Request method failure captured: Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/flavors/1958387760/action HTTP/1.1 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 70 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGc-PVCkoIxtzsmwqm2_s5rHV0sF7pegiTrQyFyr_iv-Ty5NVuY3veLB7Ovs8QDoA8T-3YGb-5-U_pNVVMqTeAVQ9nGmlmp8p1VP117Fj5wCkhC92zBUn9pmQJv5ZBAL3r4KjiJoHJJ7ajacp8APagKYqpvPl4ON4oqijvHQu6stkI Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 335ff37f8e8a4d93890e2f85582fb9c7 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/335ff37f8e8a4d93890e2f85582fb9c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_335ff37f8e8a4d93890e2f85582fb9c7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 335ff37f8e8a4d93890e2f85582fb9c7 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 33aec32c89b640e59cc03dc1f01bd253 Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: {"removeTenantAccess": {"tenant": "bf41f310a59745de92f9225d8d58f754"}} Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor access not found for 40 / bf41f310a59745de92f9225d8d58f754 combination. Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '1958387760', 'body': {'removeTenantAccess': {'tenant': 'bf41f310a59745de92f9225d8d58f754'}}} Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / bf41f310a59745de92f9225d8d58f754 combination. Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:17.175088 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / bf41f310a59745de92f9225d8d58f754 combination. Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / bf41f310a59745de92f9225d8d58f754 combination. Sep 08 10:19:17.180813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.182181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3403789-487d-4dd5-a463-253bbf208a55 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Returning 404 to user: Flavor access not found for 40 / bf41f310a59745de92f9225d8d58f754 combination. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:17.182957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3403789-487d-4dd5-a463-253bbf208a55 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors/1958387760/action" status: 404 len: 124 microversion: 2.1 time: 0.086450 Sep 08 10:19:17.183858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 748/1463] 10.222.0.59 () {60 vars in 1200 bytes} [Thu Sep 8 10:19:17 2022] POST /compute/v2.1/flavors/1958387760/action => generated 124 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:17.191596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:17.194357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:17.201226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:17.202185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:17.203053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:17.204669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:17.205347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:17.206039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:17.403517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a12d6b07-1a70-457a-bdaf-2102a28ffdf7 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1860 microversion: 2.1 time: 0.218611 Sep 08 10:19:17.404792 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 749/1464] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:17 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1860 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:17.409704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:17.410604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:17.417304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:17.418154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:17.418837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:17.421033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:17.421746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:17.422953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:17.593656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:17.602616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-838a3e58-8b61-459b-a425-0964923a24ce tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.196531 Sep 08 10:19:17.603447 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 750/1465] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:17 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:17.609074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02d880f5-fbbb-4574-b008-6058f068b883 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235545ac10>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:17.645328 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-02d880f5-fbbb-4574-b008-6058f068b883 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Image not found. Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02d880f5-fbbb-4574-b008-6058f068b883 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 HTTP/1.1 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6460c5f3-c279-4399-a510-f11065dd89c2'} Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6460c5f3-c279-4399-a510-f11065dd89c2 Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:19:17.647452 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6460c5f3-c279-4399-a510-f11065dd89c2 could not be found. Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02d880f5-fbbb-4574-b008-6058f068b883 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02d880f5-fbbb-4574-b008-6058f068b883 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2" status: 404 len: 62 microversion: 2.1 time: 0.044239 Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 751/1466] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:19:17 2022] GET /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:17.655908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:17.667382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:17.668072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:17.668599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:17.669488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:17.670036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:17.670477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:17.746318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:17.754951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:17.756446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:17.762533 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de46a307-458e-4f9c-b0e6-ea4ab5b2fc28 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.111785 Sep 08 10:19:17.763299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 752/1467] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:17 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:17.788743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-545aea0f-abde-4c77-b5b5-87b7d7818fe7 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23510de3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-655723837", "description": "tempest-description-663540230"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:18.066580 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-545aea0f-abde-4c77-b5b5-87b7d7818fe7 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.281713 Sep 08 10:19:18.067556 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 753/1468] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:17 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:18.072406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c63e5cf6-2847-45fe-bfff-4927e4c468c8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:18.098946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:18.108348 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c63e5cf6-2847-45fe-bfff-4927e4c468c8 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1958387760" status: 202 len: 0 microversion: 2.1 time: 0.039019 Sep 08 10:19:18.113003 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 754/1469] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:19:18 2022] DELETE /compute/v2.1/flavors/1958387760 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:18.118299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:18.119226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:18.133338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:18.134174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:18.134807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:18.135786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:18.136439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:18.137056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:18.405831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc97bfc2-b746-4caf-84aa-4ffbb00071dd tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1860 microversion: 2.1 time: 0.291320 Sep 08 10:19:18.407763 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 755/1470] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:18 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1860 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:18.414308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:18.415150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:18.423042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:18.442335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:18.442814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:18.443608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:18.444083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:18.444520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:18.763223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:18.775309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ea787a0-f25d-41da-a102-b1e66f4451ef tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.366132 Sep 08 10:19:18.776128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 756/1471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:18 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:18.783327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:18.783979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:18.803046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:18.803590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:18.804049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:18.804794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:18.807558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:18.810739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:18.993491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:19.006301 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fd02f1cd-4298-417f-b022-40387052f1fb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1614 microversion: 2.1 time: 0.228518 Sep 08 10:19:19.010414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 757/1472] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:18 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1614 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:19.017640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b28d300-bc86-4f91-a29e-0a9dde17947f tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23510de700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2062852739", "description": "tempest-description-1320127442"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:19.270422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b28d300-bc86-4f91-a29e-0a9dde17947f tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.258528 Sep 08 10:19:19.278615 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 758/1473] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:19 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:19.278615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8956220d-168c-4b30-a11a-d66d4ad4d9c6 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:19.299662 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8956220d-168c-4b30-a11a-d66d4ad4d9c6 tempest-FlavorsAccessNegativeTestJSON-2034065934 tempest-FlavorsAccessNegativeTestJSON-2034065934-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026967 Sep 08 10:19:19.300532 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 759/1474] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:19.305381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:19.306023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:19.312547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:19.313378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:19.313923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:19.314749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:19.315317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:19.315875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:19.453830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lazy-loading 'services' on Instance uuid 48255b60-3703-431a-9b76-c65d2bc9966a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:19.580628 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01d4970d-eae1-4344-8c50-dbde755a515d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "DELETE /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments/ec69a2b5-8003-47da-bc69-0e80a29ff812" status: 202 len: 0 microversion: 2.1 time: 0.278817 Sep 08 10:19:19.584595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 760/1475] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:19:19 2022] DELETE /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments/ec69a2b5-8003-47da-bc69-0e80a29ff812 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:19.587059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:19.587799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:19.605720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:19.606892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:19.608383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:19.609172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:19.610185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:19.610615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:19.800527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:19.810969 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f379e5fc-9144-4a8c-9e31-4c8fee97364e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.228018 Sep 08 10:19:19.814071 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 761/1476] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:19 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:19.817403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:19.817913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:19.826150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:19.827336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:19.827336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:19.828007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:19.829043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:19.829492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:19.934479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:19.945035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:19.947248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:19.969970 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b74fd3a-798a-4942-8942-432afb407d6b tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.157218 Sep 08 10:19:19.971356 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 762/1477] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:19 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:19.982192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13265e8f-bba4-4b8f-b581-bec5955d2f2a tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23554ab5e0>, body: {"security_group_rule": {"parent_group_id": "bb94d325-71aa-4843-bebc-33ae1c2f537e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "99892357-13cb-4395-9e24-38231263a62b"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:20.466420 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-13265e8f-bba4-4b8f-b581-bec5955d2f2a tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.494460 Sep 08 10:19:20.467026 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 763/1478] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:19:19 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:20.472897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:20.475379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:20.483873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:20.484687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:20.486620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:20.488186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:20.489089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:20.489971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:20.533764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:20.538436 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-839c21bb-127d-476f-87ba-a1f77c62ebf1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069531 Sep 08 10:19:20.539500 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 764/1479] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:20 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:20.562086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:20.563825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:20.576270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:20.576872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:20.577394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:20.578732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:20.579279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:20.579817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:20.776632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:20.788587 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-992bc7df-2f21-46be-9d09-d47e52eabaac tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.243711 Sep 08 10:19:20.789253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 765/1480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:20 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:20.800020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:20.800020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:20.806949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:20.806949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:20.806949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:20.806949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:20.806949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:20.806949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:20.912419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:20.924320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a49b9bb-5680-4e4d-a94e-8ec39362281e tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1614 microversion: 2.1 time: 0.133184 Sep 08 10:19:20.944453 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 766/1481] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:20 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:20.950354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14bfd09c-e1fc-456a-bd1a-7b4e5b93f722 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23554171f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-42421043", "description": "tempest-description-580288787"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:21.329542 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14bfd09c-e1fc-456a-bd1a-7b4e5b93f722 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.383783 Sep 08 10:19:21.330673 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 767/1482] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:20 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:21.338068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:21.340728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:21.355150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:21.355847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:21.356780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:21.359065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:21.359730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:21.361218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:21.626259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:21.643660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b1a58ed-ede0-4dad-9ba4-20cb44cde65b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.310608 Sep 08 10:19:21.645169 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 768/1483] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:21 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:21.651787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:21.652567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:21.660553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:21.661225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:21.661913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:21.662777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:21.663677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:21.663990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:21.751234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=5 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:21.759567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:21.771047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:21.772681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:21.779271 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e8533523-be6b-4db3-9b28-a984b27f89ff tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.132399 Sep 08 10:19:21.780622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 769/1484] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:21 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:21.787344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b2da3108-a6b4-4207-b96b-7491f36dbfaa tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f2355417790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-562169390", "description": "tempest-description-768984004"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:22.111266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b2da3108-a6b4-4207-b96b-7491f36dbfaa tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.328632 Sep 08 10:19:22.111896 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 770/1485] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:22.117909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:22.128281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:22.137925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.140346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.141577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.143032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.143687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.144301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.192976 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03e7efd0-8a71-42fb-8c96-b759783592d1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078732 Sep 08 10:19:22.194736 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 771/1486] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:22 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:22.201461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:22.202372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:22.213016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.213830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.214365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.215317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.215894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.216416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.408194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:22.417761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df0457bf-f9ef-42c1-a8f3-9ec95ad3c6cb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.221486 Sep 08 10:19:22.434466 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 772/1487] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:22 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:22.434466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:22.435077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:22.443041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.444097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.444295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.445125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.445689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.446207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.544298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:22.554630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c61b648-073d-4d35-ad84-62f6e0098e9d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1326 microversion: 2.1 time: 0.124164 Sep 08 10:19:22.555898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 773/1488] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:22 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:22.560813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c3f27ae-4124-4c41-90f1-5bc922ff43a9 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23554175e0>, body: {"security_group_rule": {"parent_group_id": "344eca36-c7a1-498a-afb3-197546e5f534", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "181d919e-6f63-4143-b83e-39d931e623fd"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:22.964788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c3f27ae-4124-4c41-90f1-5bc922ff43a9 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.407588 Sep 08 10:19:22.968249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 774/1489] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:19:22 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:22.975140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:22.976427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:22.985827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.986566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.987147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:22.987913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:22.988434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:22.989002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:23.199260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:23.208588 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bbbf6f68-5733-4fcc-ae36-20114214b72d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.239077 Sep 08 10:19:23.224785 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 775/1490] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:22 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:23.230356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:23.237645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:23.251367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:23.251897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:23.252347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:23.253067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:23.253531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:23.253978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:23.379071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:23.389049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:23.390756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:23.398429 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f52e4844-071e-4fc2-a672-9c507b303f13 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.172463 Sep 08 10:19:23.411557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 776/1491] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:23 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:23.411557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-957e0fe8-7598-48b1-a1ab-980b0367d96c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f235110baf0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:23.768065 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-957e0fe8-7598-48b1-a1ab-980b0367d96c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/181d919e-6f63-4143-b83e-39d931e623fd" status: 202 len: 0 microversion: 2.1 time: 0.367371 Sep 08 10:19:23.772573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 777/1492] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:23 2022] DELETE /compute/v2.1/os-security-groups/181d919e-6f63-4143-b83e-39d931e623fd => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:23.779020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:23.783227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:23.804343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:23.806130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:23.807123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:23.808194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:23.808878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:23.809689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:23.879424 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb010313-4044-4ca0-aa69-e51f46dad6e7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105707 Sep 08 10:19:23.880307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 778/1493] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:23 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:23.888469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:23.889509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:23.896494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:23.897414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:23.898249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:23.899151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:23.899796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:23.900391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.095506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:24.107636 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-874b6383-fef8-4aa8-89dd-c66d0ed001bb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.222791 Sep 08 10:19:24.108236 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 779/1494] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:23 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:24.135358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:24.136645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:24.150669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.153153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.154732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.156830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.158762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.159219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.266574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:24.279352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0d885ca-1c00-4e85-a77e-43852a703c4c tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1326 microversion: 2.1 time: 0.169135 Sep 08 10:19:24.303490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 780/1495] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:24 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1326 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:24.303490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c679e9b-21f0-4bfc-a517-d76eb07d98d6 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f2355417c10>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:24.365788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c679e9b-21f0-4bfc-a517-d76eb07d98d6 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/344eca36-c7a1-498a-afb3-197546e5f534" status: 200 len: 245 microversion: 2.1 time: 0.076379 Sep 08 10:19:24.371318 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 781/1496] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:19:24 2022] GET /compute/v2.1/os-security-groups/344eca36-c7a1-498a-afb3-197546e5f534 => generated 245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:24.378301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:24.379090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:24.390609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.391317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.391801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.392551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.393008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.393494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.548671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:24.558007 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6e5fa4e-9d0e-4dce-a2dd-1d1b2c139482 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.184964 Sep 08 10:19:24.558595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 782/1497] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:24 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:24.571929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00eea176-aad2-4d1e-bac3-cac7ca8ef05d tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f2351086e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-947695729", "description": "tempest-description-1349353786"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:24.730337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00eea176-aad2-4d1e-bac3-cac7ca8ef05d tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.170109 Sep 08 10:19:24.731011 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 783/1498] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:24.740716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:24.741397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:24.747615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.748105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.748543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.749269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.749748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.750178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.816430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:24.824622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:24.826057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:24.831761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08943d43-edd3-4048-96a6-051f02b1f24d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.099702 Sep 08 10:19:24.832330 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 784/1499] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:24 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:24.966027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Calling method '.version_select at 0x7f235110a8b0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:24.967843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.968935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.969389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.984898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.985389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.986313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:24.996869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:24.997364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:24.997811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.004714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5dcdd5cc-de14-413c-ba76-0b6d0141bb95 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.171300 Sep 08 10:19:25.005392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 785/1500] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:19:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:19:25.010059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e6c7925f-64dc-4fbf-a5a1-859a5ba124cf tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f23553d9c10>, body: {"security_group_rule": {"parent_group_id": "cc4ed82f-e813-4b8c-a155-01d6e4bc34f1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:25.193539 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e6c7925f-64dc-4fbf-a5a1-859a5ba124cf tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.187131 Sep 08 10:19:25.194144 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 786/1501] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:19:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:25.199154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:25.201684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:25.208742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.209218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.209661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.210363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.210818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.211246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.233318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:25.246340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f3d7aec-fb6b-4a52-85e0-75c66d2d8983 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051062 Sep 08 10:19:25.246950 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 787/1502] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:25 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:25.252335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Calling method '.version_select at 0x7f23510864c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:25.254150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.254637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.255088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.268992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.269478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.269918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.273081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:25.278591 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b6d0b1a-20c4-467c-9e4d-61bb14320b94 tempest-HypervisorAdminV228Test-581846849 tempest-HypervisorAdminV228Test-581846849-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.030448 Sep 08 10:19:25.279202 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 788/1503] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:19:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:19:25.284202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:25.284812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:25.291442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.291979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.292443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.293165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.293614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.294040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.375686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=48 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:25.435084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:25.444214 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-43ce0c45-d163-46b9-83a7-035129117b59 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.163952 Sep 08 10:19:25.444791 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 789/1504] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:25 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:25.449356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f671497-cf05-4895-a8cb-89a54d3748d5 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Action: 'create', calling method: .version_select at 0x7f2351086dc0>, body: {"security_group_rule": {"parent_group_id": "cc4ed82f-e813-4b8c-a155-01d6e4bc34f1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:25.636277 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f671497-cf05-4895-a8cb-89a54d3748d5 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.190431 Sep 08 10:19:25.637107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 790/1505] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:19:25 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:25.642336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:25.642945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:25.649276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.649757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.650189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.650889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.651406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.651782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.720028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:25.727987 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eafae99c-fbdc-49d1-b6e3-c728fb2a447a tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1326 microversion: 2.1 time: 0.090100 Sep 08 10:19:25.728562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 791/1506] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:25 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1326 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:25.733390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:25.734069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:25.739996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.740668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.741111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.741993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:25.742269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:25.742703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:25.922408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:25.930517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-518843b5-823e-4d94-9f80-38b41a8e90f9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.200940 Sep 08 10:19:25.931386 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 792/1507] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:25 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:25.936051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd4d030f-e71c-472e-863b-22b0fc45521e tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f235110b820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.013274 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd4d030f-e71c-472e-863b-22b0fc45521e tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/cc4ed82f-e813-4b8c-a155-01d6e4bc34f1" status: 200 len: 664 microversion: 2.1 time: 0.080773 Sep 08 10:19:26.014092 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 793/1508] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:19:25 2022] GET /compute/v2.1/os-security-groups/cc4ed82f-e813-4b8c-a155-01d6e4bc34f1 => generated 664 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:26.019066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.019935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:26.026872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.027377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.028227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.028589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.029053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.029489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.103852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:26.113250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:26.114702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:26.120168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-47b1e66d-3274-4cce-bbff-b42e85c29995 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.105311 Sep 08 10:19:26.120921 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 794/1509] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:26 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:26.125699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f06119e2-276c-4763-9fd3-320c527c03c1 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f235559aca0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.304734 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f06119e2-276c-4763-9fd3-320c527c03c1 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-group-rules/cbe30a6d-af34-4341-861f-64ec35857319" status: 202 len: 0 microversion: 2.1 time: 0.180120 Sep 08 10:19:26.304734 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 795/1510] 10.222.0.59 () {58 vars in 1287 bytes} [Thu Sep 8 10:19:26 2022] DELETE /compute/v2.1/os-security-group-rules/cbe30a6d-af34-4341-861f-64ec35857319 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:26.313024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.315418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:26.322286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.322946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.323644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.324427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.324952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.325407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.362387 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5018fb6f-6d82-4392-9c4e-fc56834a4c78 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056984 Sep 08 10:19:26.363597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 796/1511] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:26 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:26.369208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2aef27bf-f791-450d-8ac2-52ceaadabd9d tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f235110a550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.595341 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2aef27bf-f791-450d-8ac2-52ceaadabd9d tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/cc4ed82f-e813-4b8c-a155-01d6e4bc34f1" status: 202 len: 0 microversion: 2.1 time: 0.229688 Sep 08 10:19:26.599547 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 797/1512] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:26 2022] DELETE /compute/v2.1/os-security-groups/cc4ed82f-e813-4b8c-a155-01d6e4bc34f1 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:26.602719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "name": "network-vif-unplugged", "status": "completed", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:26.616853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.617350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.617791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.633148 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] Creating event network-vif-unplugged:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h2-833090-19 Sep 08 10:19:26.640610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:19:26.653745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-036fe998-f1ff-4577-9c23-d2aa58ccc97c req-daf2eee3-347a-418e-b147-fc94dfe3e888 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056531 Sep 08 10:19:26.654969 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 798/1513] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:26.661198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.661943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:26.668213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.668889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.669374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.670068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.670517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.670988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.823907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:26.832119 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ccbc73ba-873e-4098-8f63-b4710639b3d6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.176029 Sep 08 10:19:26.832708 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 799/1514] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:26 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:26.851188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f23510def70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.875089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:19:26.875730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Neutron security group 181d919e-6f63-4143-b83e-39d931e623fd not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:19:26.876311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] HTTP exception thrown: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.876311 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Request method failure captured: Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/181d919e-6f63-4143-b83e-39d931e623fd HTTP/1.1 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGh4IQPQKMjyj9msVXXfi0e1sACJGnXU7tUAWk1M_G_4-kJNcTYzmLv_VeMkKXRwuVy4zS0KwzZnsu7JsRwdsV6K91xSGaSIP1SnBCv9rer-cz431WAiojbaC8QETTj8brYUEToNakNivaLZe41yon6J6SnDdWd_4eEzj0DfKcU91k Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: dec57463213648cca79596563961f1fa Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-876689808 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dec57463213648cca79596563961f1fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dec57463213648cca79596563961f1fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dec57463213648cca79596563961f1fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dec57463213648cca79596563961f1fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupRulesTestJSON-876689808 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: dec57463213648cca79596563961f1fa Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-876689808 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupRulesTestJSON-876689808-project Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5860572f5198447281ddae5642c28521 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupRulesTestJSON-876689808-project Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '181d919e-6f63-4143-b83e-39d931e623fd'} Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:19:26.892855 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Returning 404 to user: Security group 181d919e-6f63-4143-b83e-39d931e623fd does not exist Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-97e38986-c750-4e99-99ff-f6755f25f0b3'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:26.897540 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b09a4fe-3268-4f96-8a27-131f2127015c tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/181d919e-6f63-4143-b83e-39d931e623fd" status: 404 len: 194 microversion: 2.1 time: 0.047969 Sep 08 10:19:26.900638 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 800/1515] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:26 2022] DELETE /compute/v2.1/os-security-groups/181d919e-6f63-4143-b83e-39d931e623fd => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:26.904433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:26.905062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:26.913792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.917391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.917391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:26.917391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:26.917391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:26.917391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.021044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:27.033199 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff3762bc-0ca2-46cf-9ca1-6d834b605ba2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1326 microversion: 2.1 time: 0.131314 Sep 08 10:19:27.034577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 801/1516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:26 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:27.044944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18df4274-2fe4-46f8-9807-413cbcc294d4 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f23510dec10>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:27.228936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18df4274-2fe4-46f8-9807-413cbcc294d4 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/344eca36-c7a1-498a-afb3-197546e5f534" status: 202 len: 0 microversion: 2.1 time: 0.192954 Sep 08 10:19:27.229620 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 802/1517] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:27 2022] DELETE /compute/v2.1/os-security-groups/344eca36-c7a1-498a-afb3-197546e5f534 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:27.238679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:27.239619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:27.250122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:27.250971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:27.251631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.252535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:27.253151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:27.253865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.413056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:27.421077 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0dba3539-d1d4-4842-b780-f6213e4bd054 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.186959 Sep 08 10:19:27.421826 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 803/1518] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:27 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:27.430470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:27.431092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:27.438574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:27.439082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:27.439541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.440278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:27.440788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:27.441214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.508262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:27.517325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:27.518797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:27.524241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f59a587-a0a1-4118-9ca9-ced43f20e180 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.098846 Sep 08 10:19:27.524828 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 804/1519] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:27 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:27.537516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-822013b9-d177-42a3-98c7-1acab71ca946 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f235559a280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:27.736500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-822013b9-d177-42a3-98c7-1acab71ca946 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/99892357-13cb-4395-9e24-38231263a62b" status: 202 len: 0 microversion: 2.1 time: 0.203892 Sep 08 10:19:27.740635 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 805/1520] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:27 2022] DELETE /compute/v2.1/os-security-groups/99892357-13cb-4395-9e24-38231263a62b => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:27.745201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:27.747781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:27.755301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:27.755893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:27.756312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.757017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:27.757497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:27.757926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:27.795645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfde0936-b0bf-4eb4-b525-634d58b77f3c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056586 Sep 08 10:19:27.796749 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 806/1521] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:27 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:27.801493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0a1e5b3-bb0e-4628-955d-683ed25c5000 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f235547df70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:27.989845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0a1e5b3-bb0e-4628-955d-683ed25c5000 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/bb94d325-71aa-4843-bebc-33ae1c2f537e" status: 202 len: 0 microversion: 2.1 time: 0.191020 Sep 08 10:19:27.993853 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 807/1522] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:27 2022] DELETE /compute/v2.1/os-security-groups/bb94d325-71aa-4843-bebc-33ae1c2f537e => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:28.000886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:28.001586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:28.009298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.009789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.010231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.010947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.011400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.011882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.154484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:28.163164 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22dcf564-efd3-4dd4-bfb7-673a68fc052c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1499 microversion: 2.1 time: 0.168144 Sep 08 10:19:28.163858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 808/1523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:27 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:28.183255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5877d753-6e7f-4fc2-9df3-55da3cb48ebf tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f23511a9040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:28.366112 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5877d753-6e7f-4fc2-9df3-55da3cb48ebf tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/ba2f751e-8a25-4d16-a128-a8b2d6133c07" status: 202 len: 0 microversion: 2.1 time: 0.186402 Sep 08 10:19:28.369817 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 809/1524] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:28 2022] DELETE /compute/v2.1/os-security-groups/ba2f751e-8a25-4d16-a128-a8b2d6133c07 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:28.373062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:28.373937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:28.384949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.385849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.386448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.388871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.388871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.391531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.472197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:28.480381 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0d41085-8fc5-4f12-a4b1-a70a9c78a672 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1326 microversion: 2.1 time: 0.112248 Sep 08 10:19:28.481044 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 810/1525] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:28 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:28.622202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Calling method '.version_select at 0x7f23510de4c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:28.624006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.625053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.625614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.639973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.640445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.640878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.651121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.651613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.652141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.658066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7a0df5c9-0780-4473-a8cf-816d507905be tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.175961 Sep 08 10:19:28.658649 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 811/1526] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:28.665646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f941a0d5-53b7-44b8-894a-0d8655f98ec3 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] Calling method '.version_select at 0x7f23510de5e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:28.860571 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f941a0d5-53b7-44b8-894a-0d8655f98ec3 tempest-SecurityGroupRulesTestJSON-876689808 tempest-SecurityGroupRulesTestJSON-876689808-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/bfa062b2-9b19-4c54-9246-dffcc57f273b" status: 202 len: 0 microversion: 2.1 time: 0.200833 Sep 08 10:19:28.861618 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 812/1527] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:19:28 2022] DELETE /compute/v2.1/os-security-groups/bfa062b2-9b19-4c54-9246-dffcc57f273b => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:28.876689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:28.877557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:28.880715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=98 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:28.894254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.894850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.895365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:28.896417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:28.896932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:28.897417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.070756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.081697 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea45b239-7817-4697-a020-a2c8a2ee564a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.218660 Sep 08 10:19:29.082607 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 813/1528] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:28 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:29.089172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.089796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:29.097486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.097993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.099254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.100015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.100607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.100903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.177504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.187986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.190019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.195745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-33ba2f82-1542-4862-b284-3dbfb023233a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.111642 Sep 08 10:19:29.197334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 814/1529] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:29.332998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ff5e559-8b06-40c8-ab5f-b6211cdab338 tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Calling method '.version_select at 0x7f2351151820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.335011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9ff5e559-8b06-40c8-ab5f-b6211cdab338 tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f402a1b0116444dea205ac80a6518603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bffd042d6c49c6b65f1d06d810af4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ff5e559-8b06-40c8-ab5f-b6211cdab338 tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Request method failure captured: Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hypervisors/n-h1-833090-19/search HTTP/1.1 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGvneIiPaziyobvUaQLPtVKi9EBsYWroCJqDyhUYnswLZYnG_HKv7QC6JhdtvwNLKmg4b2oEB4Vasufv7BC4HjrpMG5_M_jhFfZ7KXlyx8VYxIigV0k38s14usNsDAK39mimjGpodxITriG67VqkaopXqY7Msg2y272vUZ0gxILZWw Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 82bffd042d6c49c6b65f1d06d810af4a Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1252258777 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/82bffd042d6c49c6b65f1d06d810af4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/82bffd042d6c49c6b65f1d06d810af4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/82bffd042d6c49c6b65f1d06d810af4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_82bffd042d6c49c6b65f1d06d810af4a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1252258777 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 82bffd042d6c49c6b65f1d06d810af4a Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1252258777 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: f402a1b0116444dea205ac80a6518603 Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'n-h1-833090-19'} Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:29.337527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 10:19:29.342447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.347087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ff5e559-8b06-40c8-ab5f-b6211cdab338 tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:29.348318 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9ff5e559-8b06-40c8-ab5f-b6211cdab338 tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/n-h1-833090-19/search" status: 403 len: 117 microversion: 2.1 time: 0.149556 Sep 08 10:19:29.353560 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 815/1530] 10.222.0.59 () {58 vars in 1212 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-19/search => generated 117 bytes in 154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:29.358993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.366669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:29.383124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.383643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.384080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.384821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.385428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.385858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.416152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:29.421966 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5f01a73-a94b-4ac4-aed7-3de506319b54 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068318 Sep 08 10:19:29.422595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 816/1531] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:29.427144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.427782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:29.433973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.434460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.434896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.435630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.436074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.436494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.447018 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6165a032-3692-4d83-af88-ebb4d7cdcf9e tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "POST /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 14.237417 Sep 08 10:19:29.451671 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 716/1532] 10.222.0.59 () {62 vars in 1364 bytes} [Thu Sep 8 10:19:15 2022] POST /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 194 bytes in 14243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:19:29.458630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Calling method '.version_select at 0x7f23512c6310>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.461255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.462202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.462818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.491953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Request method failure captured: Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcGwmUqE10uC4IrzPqAhJJZQ4ZnO0eZrY0OvxxN4IcFl_1gFmgK-Am1hyx9xT0Mmd6qUo6vGt7RaJfxY_S17Kwcyjd2JKod1cfXC9Jlq4FwX10TLEKDV-s1BKSkE_coKaZwrMtBwktnt7LWVL3ruRJ8c8W1LO19BtioiSvFzdGa3TSc Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9102e53b0a7c47778d829838302a5266 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1931226560 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9102e53b0a7c47778d829838302a5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9102e53b0a7c47778d829838302a5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9102e53b0a7c47778d829838302a5266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9102e53b0a7c47778d829838302a5266", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1931226560 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9102e53b0a7c47778d829838302a5266 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1931226560 Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c148c0661368495b8813cbe75399707e Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 10:19:29.501886 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.505828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:29.505828 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-377efb3f-3b66-4631-8dfe-a6416579a9a3 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.049150 Sep 08 10:19:29.505828 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 717/1533] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:29.513663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.514442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:29.523051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.523819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.524418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.525299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.526044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.526629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.565123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.565905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.566504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.567117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:29.623477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.636238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f1f27edb-bc1c-4bc3-ab08-967bbc21a088 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.130829 Sep 08 10:19:29.647815 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 718/1534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:29.647815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Calling method '.version_select at 0x7f235125a5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.647815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.647815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.647815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.648553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.656939 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55d5ccc1-a70b-46cb-a21f-1dd5dc6f95a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.233357 Sep 08 10:19:29.657624 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 817/1535] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:29.663252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.663760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.664356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.675528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.675939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.676409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.682555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0b3a3c5f-2714-4be4-86da-050df12cda81 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.044553 Sep 08 10:19:29.683171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 719/1536] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:29.694057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5248cee-38c9-4aec-a706-a04d6469e9fe tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Calling method '.version_select at 0x7f23512a2820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.696101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c5248cee-38c9-4aec-a706-a04d6469e9fe tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f402a1b0116444dea205ac80a6518603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82bffd042d6c49c6b65f1d06d810af4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5248cee-38c9-4aec-a706-a04d6469e9fe tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Request method failure captured: Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcGvneIiPaziyobvUaQLPtVKi9EBsYWroCJqDyhUYnswLZYnG_HKv7QC6JhdtvwNLKmg4b2oEB4Vasufv7BC4HjrpMG5_M_jhFfZ7KXlyx8VYxIigV0k38s14usNsDAK39mimjGpodxITriG67VqkaopXqY7Msg2y272vUZ0gxILZWw Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 82bffd042d6c49c6b65f1d06d810af4a Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1252258777 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/82bffd042d6c49c6b65f1d06d810af4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/82bffd042d6c49c6b65f1d06d810af4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/82bffd042d6c49c6b65f1d06d810af4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_82bffd042d6c49c6b65f1d06d810af4a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1252258777 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 82bffd042d6c49c6b65f1d06d810af4a Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1252258777 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: f402a1b0116444dea205ac80a6518603 Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '1'} Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:29.697717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5248cee-38c9-4aec-a706-a04d6469e9fe tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5248cee-38c9-4aec-a706-a04d6469e9fe tempest-HypervisorAdminNegativeUnderV252Test-1252258777 tempest-HypervisorAdminNegativeUnderV252Test-1252258777-project] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009938 Sep 08 10:19:29.702256 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 818/1537] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:29.711119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Calling method '.version_select at 0x7f235125a550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:29.712890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:29.713532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:29.714150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:29.721318 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] HTTP exception thrown: No hypervisor matching '11d581c7-e154-4fd3-8d75-680f033a4240' could be found. Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Request method failure captured: Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-hypervisors/11d581c7-e154-4fd3-8d75-680f033a4240/servers HTTP/1.1 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcGwmUqE10uC4IrzPqAhJJZQ4ZnO0eZrY0OvxxN4IcFl_1gFmgK-Am1hyx9xT0Mmd6qUo6vGt7RaJfxY_S17Kwcyjd2JKod1cfXC9Jlq4FwX10TLEKDV-s1BKSkE_coKaZwrMtBwktnt7LWVL3ruRJ8c8W1LO19BtioiSvFzdGa3TSc Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9102e53b0a7c47778d829838302a5266 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1931226560 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9102e53b0a7c47778d829838302a5266"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9102e53b0a7c47778d829838302a5266"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9102e53b0a7c47778d829838302a5266"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9102e53b0a7c47778d829838302a5266", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1931226560 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9102e53b0a7c47778d829838302a5266 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1931226560 Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c148c0661368495b8813cbe75399707e Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: exception: No hypervisor matching '11d581c7-e154-4fd3-8d75-680f033a4240' could be found. Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '11d581c7-e154-4fd3-8d75-680f033a4240'} Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '11d581c7-e154-4fd3-8d75-680f033a4240' could be found. Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '11d581c7-e154-4fd3-8d75-680f033a4240' could be found. Sep 08 10:19:29.722765 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:29.726994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] Returning 404 to user: No hypervisor matching '11d581c7-e154-4fd3-8d75-680f033a4240' could be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:29.726994 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-875deb8d-ba19-49c4-8455-cd19ea24b882 tempest-HypervisorAdminNegativeUnderV252Test-1931226560 tempest-HypervisorAdminNegativeUnderV252Test-1931226560-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors/11d581c7-e154-4fd3-8d75-680f033a4240/servers" status: 404 len: 123 microversion: 2.1 time: 0.017660 Sep 08 10:19:29.726994 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 720/1538] 10.222.0.59 () {58 vars in 1281 bytes} [Thu Sep 8 10:19:29 2022] GET /compute/v2.1/os-hypervisors/11d581c7-e154-4fd3-8d75-680f033a4240/servers => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:30.107131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:30.107778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:30.115537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.116035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.116655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.117551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.118169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.118915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.229779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:30.230662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:30.251395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.252047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.252767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.254569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.255211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.256243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.394981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:30.405871 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2982f4fb-7f77-4e23-8571-8901c36d1209 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.303136 Sep 08 10:19:30.406667 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 819/1539] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:30 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:30.429937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:30.439515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:30.442146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:30.450068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.450303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:30.450775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.451052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.451728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.451851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:30.452181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.452659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.474103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f41b22bd-20b1-4eb7-ae89-9c2c71f878a9 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.249528 Sep 08 10:19:30.477223 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 721/1540] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:30 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:19:30.490528 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfbc2be0-a1b3-4a45-8da7-690bd36ed3c7 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055715 Sep 08 10:19:30.495985 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 820/1541] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:30 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:30.566813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-bf07b582-fa78-4a46-a561-deae6430a213 req-d02f0c08-63ff-498f-a107-34b82fe7337f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cd6554-1319-4f7a-a52c-9c7bb059783e", "name": "network-vif-plugged", "status": "completed", "tag": "bbd4f58d-3540-4c63-8ba1-9a1f74b24a79"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:30.601798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bf07b582-fa78-4a46-a561-deae6430a213 req-d02f0c08-63ff-498f-a107-34b82fe7337f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.604046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bf07b582-fa78-4a46-a561-deae6430a213 req-d02f0c08-63ff-498f-a107-34b82fe7337f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.606842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bf07b582-fa78-4a46-a561-deae6430a213 req-d02f0c08-63ff-498f-a107-34b82fe7337f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.627091 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-bf07b582-fa78-4a46-a561-deae6430a213 req-d02f0c08-63ff-498f-a107-34b82fe7337f service nova] Creating event network-vif-plugged:bbd4f58d-3540-4c63-8ba1-9a1f74b24a79 for instance 71cd6554-1319-4f7a-a52c-9c7bb059783e on n-h2-833090-19 Sep 08 10:19:30.632752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-bf07b582-fa78-4a46-a561-deae6430a213 req-d02f0c08-63ff-498f-a107-34b82fe7337f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070129 Sep 08 10:19:30.633356 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 722/1542] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:30.668116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:30.668732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:30.675848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.675848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.676269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.676982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.677441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.677869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.683847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:30.684921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:30.705718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.708268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.708920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.709862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.711983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.713364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.718766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:30.719552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:30.720191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:30.720825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:30.773287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:30.782975 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-739730ea-2468-4f22-adb6-5385a5e23ab2 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.118703 Sep 08 10:19:30.783811 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 821/1543] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:30 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:30.919215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:30.933360 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aeec16c4-efaf-4490-8828-a47fe80aa184 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.255917 Sep 08 10:19:30.933967 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 723/1544] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:30 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:31.435996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:31.438729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:31.457875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.458701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.459219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.460775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.461341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.461887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.503726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:31.506929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:31.515950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.516786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.517182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.518144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.518835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.519496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.562223 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3463443-3005-42b8-8e52-79b7b2b372f5 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063175 Sep 08 10:19:31.568598 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 724/1545] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:31 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:31.580119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:31.580743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:31.587607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.588099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.588540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.589251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.589709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.590164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.635718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:31.645705 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f979ab89-edf9-42a7-b9ea-d385d66b3592 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.219336 Sep 08 10:19:31.646870 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 822/1546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:31 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:31.678439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:31.691633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:31.694034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:31.704493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e535a92-dbaa-4ccb-a273-675b5e0a26b6 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.128159 Sep 08 10:19:31.705733 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 725/1547] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:31 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:31.820588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:31.826181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:31.840345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.841212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.842194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.843757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.845383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.846188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.907840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.908425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.908938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.909631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:31.962762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:31.963834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:31.971993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.972660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.973366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:31.974192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:31.974751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:31.975282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.231810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:32.241335 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72cbaa3f-1056-46b7-8cab-b6780ee17176 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.435700 Sep 08 10:19:32.241943 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 823/1548] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:31 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:32.379252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:32.387947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-43c803e3-8549-4177-a555-3039776d22f1 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.430569 Sep 08 10:19:32.399394 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 726/1549] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:31 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:32.583609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:32.586383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:32.605961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:32.606472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:32.606911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.607669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:32.608460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:32.612693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.670575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:32.671892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:32.681013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e0d0ece3-c791-4ae7-b85e-ba4efa98f7f9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107819 Sep 08 10:19:32.681933 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 824/1550] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:32 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:32.685144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:32.687543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:32.689432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.703891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:32.704884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:32.705433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.733143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:32.734801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:32.746916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:32.747334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:32.747819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.749408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:32.751030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:32.751704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:32.922036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:32.935136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:32.939055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:32.956031 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22da3b26-fc99-48fb-baef-308b25f972d4 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.227620 Sep 08 10:19:32.961299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 825/1551] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:32 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:19:33.008178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:33.019541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11ff6f29-612b-4e9b-98bf-9e4ae8066727 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.353493 Sep 08 10:19:33.020140 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 727/1552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:32 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:33.267175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.268098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:33.279721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d25864d-3bd7-45bb-86de-9d1c299e9de8 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.282922 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-5d25864d-3bd7-45bb-86de-9d1c299e9de8 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 08 10:19:33.285221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.286520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.287330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.288606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.289063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.289488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d25864d-3bd7-45bb-86de-9d1c299e9de8 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin] Request method failure captured: Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcG0kukW_LQj1d1qTTRSC1-krlAWTOJ0XcgpFwcXMQ9ncQzYVRVJPx4Lr2TXP5othdTXjmYLzPF9J3wvqdp_wvD396uL0ZloKIv4s5_qwt1flPJbargsqq_fhzaKVfl8nUEtMphQhKsm4m0pPFEaCUUzyceR4lYkKC7AOWxjrIBmEwY Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ce43c56bf2cc460ba261cc8ef3bacb08 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ce43c56bf2cc460ba261cc8ef3bacb08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ce43c56bf2cc460ba261cc8ef3bacb08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ce43c56bf2cc460ba261cc8ef3bacb08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ce43c56bf2cc460ba261cc8ef3bacb08", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ce43c56bf2cc460ba261cc8ef3bacb08 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: a079c198fc2a478b8228976070130c06 Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid timestamp for date invalid_time Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'invalid_time'} Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:33.293992 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:33.299976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 08 10:19:33.299976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.308775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d25864d-3bd7-45bb-86de-9d1c299e9de8 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:33.312515 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d25864d-3bd7-45bb-86de-9d1c299e9de8 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024 tempest-InstanceUsageAuditLogNegativeTestJSON-43842024-project-admin] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.220809 Sep 08 10:19:33.317605 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 826/1553] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:19:33.334491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.335042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.335503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.336156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:33.388562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:33.398102 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10ccb013-bbe6-43da-9f76-742a228a50bb tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.134739 Sep 08 10:19:33.398929 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 728/1554] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:33.416831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.417451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:33.426753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.427251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.427717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.428418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.428870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.429293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.441348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-351f9f6f-adfa-4b6a-9ab0-93d0d682cf3e tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.443198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-351f9f6f-adfa-4b6a-9ab0-93d0d682cf3e tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a0b6eab6e8bb493b8554ab2e3e9550d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35835df8c346b5a24f0064e0677925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-351f9f6f-adfa-4b6a-9ab0-93d0d682cf3e tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Request method failure captured: Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcG0DBbwSPR_TJWOqyjihAVmAwiOrTWoOY7HgQFqW-PbN9fQ0MoYsYpd6fraOONG4z_yXdzoqbviM9BoRL4ZkNgnQm6tG7sZIh-FfNlk6Iz4Gj5tq3cMU9JDhEh0NcdoukVkCTBfqPhIvKKdZbT2EDV1kstfEW0VZ0FBCClFFXpH4q4 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: da35835df8c346b5a24f0064e0677925 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/da35835df8c346b5a24f0064e0677925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/da35835df8c346b5a24f0064e0677925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/da35835df8c346b5a24f0064e0677925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_da35835df8c346b5a24f0064e0677925", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: da35835df8c346b5a24f0064e0677925 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: a0b6eab6e8bb493b8554ab2e3e9550d4 Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: action_args: {} Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.444800 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-351f9f6f-adfa-4b6a-9ab0-93d0d682cf3e tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:33.448933 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-351f9f6f-adfa-4b6a-9ab0-93d0d682cf3e tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.128016 Sep 08 10:19:33.450862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 827/1555] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:19:33.458394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c23356c3-5b5f-44ed-9160-b22713dc9a3c tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.460997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c23356c3-5b5f-44ed-9160-b22713dc9a3c tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a0b6eab6e8bb493b8554ab2e3e9550d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35835df8c346b5a24f0064e0677925', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c23356c3-5b5f-44ed-9160-b22713dc9a3c tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Request method failure captured: Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2010:19:33 HTTP/1.1 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcG0DBbwSPR_TJWOqyjihAVmAwiOrTWoOY7HgQFqW-PbN9fQ0MoYsYpd6fraOONG4z_yXdzoqbviM9BoRL4ZkNgnQm6tG7sZIh-FfNlk6Iz4Gj5tq3cMU9JDhEh0NcdoukVkCTBfqPhIvKKdZbT2EDV1kstfEW0VZ0FBCClFFXpH4q4 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: da35835df8c346b5a24f0064e0677925 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/da35835df8c346b5a24f0064e0677925"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/da35835df8c346b5a24f0064e0677925"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/da35835df8c346b5a24f0064e0677925"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_da35835df8c346b5a24f0064e0677925", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: da35835df8c346b5a24f0064e0677925 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: a0b6eab6e8bb493b8554ab2e3e9550d4 Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '2022-09-08 10:19:33'} Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.463184 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c23356c3-5b5f-44ed-9160-b22713dc9a3c tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c23356c3-5b5f-44ed-9160-b22713dc9a3c tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166 tempest-InstanceUsageAuditLogNegativeTestJSON-1815288166-project] 10.222.0.59 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08 10:19:33" status: 403 len: 128 microversion: 2.1 time: 0.012584 Sep 08 10:19:33.468348 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 828/1556] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2010%3A19%3A33 => generated 128 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:33.585793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:33.597433 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a1d315f-4323-40a5-85af-7ab9283e18a6 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.184291 Sep 08 10:19:33.598522 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 729/1557] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:33.695141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.697527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:33.714563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.715335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.715813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.716567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:33.717033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:33.717462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:33.800833 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44eab462-a08b-4dcc-8401-db969c54cd1d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111428 Sep 08 10:19:33.807508 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 829/1558] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:33.991482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:33.992296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:34.024919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.025380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.025849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.026664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.027127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.027566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.042212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:34.043638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:34.060241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.060411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.068222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.069581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.070070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.070513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.344519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:34.372179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:34.381456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:34.396956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:34.402620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f971c3be-42aa-46d3-ad1a-6406d150cf59 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.416334 Sep 08 10:19:34.407170 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 730/1559] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:33 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:34.428731 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b86cac7-181c-474e-af10-b3a7266d2d22 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.390135 Sep 08 10:19:34.432930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:34.433775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:34.439692 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 830/1560] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:34 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:34.451807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.453607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.454409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.455386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.455967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.456666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.541438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.542256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.542945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.543681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:34.621506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:34.622403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:34.639803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.642511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.643743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.647768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.650250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.651102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.656618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:34.669359 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cd75665e-bf17-47c6-a5c3-4cb364d91a80 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.242848 Sep 08 10:19:34.672715 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 731/1561] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:34 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:34.816200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:34.818969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:34.833545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.834474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.835398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.836435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:34.839866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:34.856118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:34.880824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:34.896708 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e628fcc5-cbba-4217-a171-e4705770b308 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.277428 Sep 08 10:19:34.898693 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 831/1562] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:34 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:34.915831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2e09e54a-4e31-4566-a520-618e49c67150 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104081 Sep 08 10:19:34.918410 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 732/1563] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:34 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:19:35.430414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:35.431352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:35.458526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:35.459335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:35.464756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.469484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.470089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.472556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.473632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.474220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.474802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.475438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.480158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.481786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.482568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.485660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.542728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:35.622365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:35.631725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:35.633422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:35.639251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49979876-e967-4dcf-a695-f2922f67c371 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.212976 Sep 08 10:19:35.640405 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 832/1564] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:35 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:35.727292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:35.729845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:35.745957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.746679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.747599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.748597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.749328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.750321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.798642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.799147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.799620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.800097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:35.878126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:35.887669 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff66b6b6-7b96-4e77-876e-39af2626c5d3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1469 microversion: 2.1 time: 0.435197 Sep 08 10:19:35.888271 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 733/1565] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:35 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:35.909062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:35.916877 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac878381-7281-43dd-8231-6f52252ff785 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.221337 Sep 08 10:19:35.924118 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 833/1566] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:35 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:35.924508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:35.925426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:35.931812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.933109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.933736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.934612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.935224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.936564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.949861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:35.953243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:35.966007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.966507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.966946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:35.968220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:35.968685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:35.969115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:36.050123 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c57c430d-0ac6-4354-ac04-cc2882e5c929 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104653 Sep 08 10:19:36.055509 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 834/1567] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:35 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:19:36.245095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:36.260206 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d95a9c7-c5fb-477e-a891-0d559b33b114 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.341192 Sep 08 10:19:36.261029 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 734/1568] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:35 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:36.669310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:36.670207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:36.691248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:36.695526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:36.697692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:36.701746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:36.702728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:36.707675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:36.914186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:36.915227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:36.915694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:36.933676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:36.935291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:36.936135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:36.937628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:36.937903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:36.940876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:36.941531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:36.945337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:36.986884 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65d6ceb7-30ec-48a8-9d47-f85cc5ae563d tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.322727 Sep 08 10:19:36.987518 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 835/1569] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:36 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:36.997937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:36.999792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:37.041568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.043064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.044725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.046307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.046948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.048057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.099711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:37.124488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.125282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.126340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.127027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lazy-loading 'fault' on Instance uuid f135a161-48ff-4d0e-b00c-41bf24ba6240 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:37.306641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce637e46fb484ea5d46c0371206da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4054b9269fef44c0b434249584cbecf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:37.323696 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c61142cd-0cb5-400c-bbf7-dbe5a192861d tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 200 len: 1331 microversion: 2.1 time: 0.326001 Sep 08 10:19:37.335486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 836/1570] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:36 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 1331 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:37.343828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:37.355213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:37.380020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.381780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.383164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.384343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.389584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.390278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.463573 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2d88c4fd-aaa3-4c7e-9ab5-f8e0c2d4ae2f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136707 Sep 08 10:19:37.472249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 837/1571] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:37 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:37.478842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:37.479740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:37.502161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.502793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.503293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.504360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:37.505027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:37.508130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:37.725046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:37.747552 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11d07609-48ad-44d9-932a-a095bff974db tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1535 microversion: 2.1 time: 0.837928 Sep 08 10:19:37.763555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 735/1572] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:36 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1535 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:37.978676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:37.987696 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ecc1f15-45c7-4914-801e-76a163023009 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1505 microversion: 2.1 time: 0.513864 Sep 08 10:19:37.988524 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 838/1573] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:37 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:38.021286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:38.022046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:38.032076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.039425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.042314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.043246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.048832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.051358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.268702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:38.282473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:38.285441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:38.297170 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14551f1a-a43a-472c-9ea3-dda7abb7570a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1546 microversion: 2.91 time: 0.280883 Sep 08 10:19:38.328936 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 736/1574] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:38 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1546 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:38.353970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:38.358546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:38.378211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.385062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-375726282", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:38.393115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.393727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.397399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.398055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.399226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.428545 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] HTTP exception thrown: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Request method failure captured: Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 HTTP/1.1 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcCYjI7gMQ0g2GorhfRMq65BgfMpowX7-BV7fA-9SdeyTjs0mnGRpvkm0-IMs5YFmt_Vk5lmh-waEeNPyLm1as5SNS436-GddnenokNLDbpoxhl41psaKKlEz9-yW170Yme4nrYzUlJwi11WEqhq_jGPC89WbMn2XAMqIhJDPKs22tA Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 4054b9269fef44c0b434249584cbecf7 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4054b9269fef44c0b434249584cbecf7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 4054b9269fef44c0b434249584cbecf7 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachSCSIVolumeTestJSON-1895419734-project Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ccce637e46fb484ea5d46c0371206da6 Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1895419734-project Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f135a161-48ff-4d0e-b00c-41bf24ba6240'} Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:38.430474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Returning 404 to user: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:38.435379 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef425180-1e80-4f40-9683-e74ff9c28801 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 404 len: 111 microversion: 2.1 time: 0.085995 Sep 08 10:19:38.437971 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 737/1575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:38 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:19:38.443000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-efc33c7c-e3dd-4af7-adfd-76a5435d7fbd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '.version_select at 0x7f235125aa60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:38.489147 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-efc33c7c-e3dd-4af7-adfd-76a5435d7fbd tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598675092" status: 202 len: 0 microversion: 2.1 time: 0.050370 Sep 08 10:19:38.494114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:19:38.494545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:19:38.495020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:19:38.495144 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 738/1576] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598675092 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:19:38.495418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:19:38.505451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:19:38.505796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:38.508588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:38.518494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.519299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.520372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.520600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.521089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.521526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.521907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.522258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.522886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.523501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.527838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.528337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.593103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Getting quotas for project 499830c9b9964b189210930ee62dbaaa. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:38.607705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Getting quotas for user 5e8b6b83d23b47af956a9e719d72909d and project 499830c9b9964b189210930ee62dbaaa. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:38.642801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:19:38.645558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:19:38.649950 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11407f00-fed3-406b-a84e-d42082400b1a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148594 Sep 08 10:19:38.652904 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 739/1577] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:38 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:38.755652 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95185651-c0dc-4607-8fb4-b980ab2acddd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.645588 Sep 08 10:19:38.762565 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 839/1578] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 10:19:38.772954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:38.773640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:38.780531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b1ec9c6-cc9d-492b-bf93-15ae45045d9f tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:38.781481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.781969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.782404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:38.792722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:38.793203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:38.793493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b1ec9c6-cc9d-492b-bf93-15ae45045d9f tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:38.793737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:39.178633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b1ec9c6-cc9d-492b-bf93-15ae45045d9f tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.192216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b1ec9c6-cc9d-492b-bf93-15ae45045d9f tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.195807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b1ec9c6-cc9d-492b-bf93-15ae45045d9f tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.206385 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b1ec9c6-cc9d-492b-bf93-15ae45045d9f tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "PUT /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1358 microversion: 2.75 time: 0.430302 Sep 08 10:19:39.208200 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 840/1579] 10.222.0.59 () {62 vars in 1297 bytes} [Thu Sep 8 10:19:38 2022] PUT /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:39.229885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:39.230512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:39.243077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:39.243957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:39.244719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:39.246040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:39.246859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:39.247570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:39.577721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.600439 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b10833d-72d9-4f8f-b36f-8eac16ccc994 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1535 microversion: 2.1 time: 0.829633 Sep 08 10:19:39.602842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 740/1580] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:38 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1535 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:39.612880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d577945a-353e-44e9-b907-d8e8c99b0cf6 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:39.613502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d577945a-353e-44e9-b907-d8e8c99b0cf6 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:39.759944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d577945a-353e-44e9-b907-d8e8c99b0cf6 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.788773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d577945a-353e-44e9-b907-d8e8c99b0cf6 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.790540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d577945a-353e-44e9-b907-d8e8c99b0cf6 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:39.797797 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d577945a-353e-44e9-b907-d8e8c99b0cf6 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1358 microversion: 2.75 time: 0.193162 Sep 08 10:19:39.799025 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 741/1581] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:39 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:39.805675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:39.806655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:39.813848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:39.814572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:39.815210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:39.816306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:39.816929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:39.817527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.063333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:40.076283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:40.081130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:40.094118 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5feec375-09a8-4e40-bfd7-118ca95a57b7 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1533 microversion: 2.91 time: 0.293353 Sep 08 10:19:40.097048 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 742/1582] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:39 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1533 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:40.121154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:40.128132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:40.148976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.150487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.150487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.151084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.151583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.157269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.226081 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b170a6fa-f03c-4b25-a921-acc58cbda629 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127868 Sep 08 10:19:40.230130 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 743/1583] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:40 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:40.239105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:40.257910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.258629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.259256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.276425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] Creating event network-changed:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h1-833090-19 Sep 08 10:19:40.285528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:19:40.309316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:40.320131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-52bdf647-56f8-4b8b-9be0-71b233c8f974 req-d122c90b-d9c7-4685-a1e0-9ec6218eb7a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088462 Sep 08 10:19:40.326644 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90caca34-2e83-4938-ae87-42c86b00b8b0 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1500 microversion: 2.1 time: 1.114791 Sep 08 10:19:40.328319 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 744/1584] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:40.330229 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 841/1585] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:39 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1500 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:40.351970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:40.352677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:40.360453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.361234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.361855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.362765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.363388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.364006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.628361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:40.629155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:40.641205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.641720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.642164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.648525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.650365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.651000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.663760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] Lazy-loading 'services' on Instance uuid acacb00b-705f-4760-ba09-6c802380b190 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:40.705283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-037de41a-3bdc-48b6-abc8-c6ef912c48f7 tempest-UnshelveToHostMultiNodesTest-1472061639 tempest-UnshelveToHostMultiNodesTest-1472061639-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1940 microversion: 2.91 time: 0.375570 Sep 08 10:19:40.705885 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 745/1586] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:40 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1940 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:40.768570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:40.769075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:40.791581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.793673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.794350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.800321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:40.801134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:40.802295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:40.855483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:19:41.009432 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4d2722d-cc0e-4ab0-ba82-460e5a272f5a tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "DELETE /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 204 len: 0 microversion: 2.91 time: 0.238165 Sep 08 10:19:41.013367 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 746/1587] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:19:40 2022] DELETE /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:19:41.027581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:41.030041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:41.049813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.051159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.051809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.054674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.055362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.057032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.562864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.577089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.579533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.587067 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b93753a7-1d7a-4afb-bb98-86473e3aa451 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1428 microversion: 2.75 time: 0.570317 Sep 08 10:19:41.588568 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 747/1588] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:41 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1428 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:41.598389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:41.599684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:41.612605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.614503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.615323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.617342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.618194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.618878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.682730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.700911 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f46230b-bafc-4847-9911-9ce89c966205 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1535 microversion: 2.1 time: 1.077240 Sep 08 10:19:41.702210 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 842/1589] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:40 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1535 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:41.714862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:41.722718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:41.729347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.729840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.730283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.731017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.731493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.731910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.768797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61ceb570-5545-4cb5-bfe4-1196e45204ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063183 Sep 08 10:19:41.769546 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 843/1590] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:19:41 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:19:41.779654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:41.779791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.780985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:41.788164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.788332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.789080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.789624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:41.790760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.792542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:41.793329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:41.794640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:41.807775 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31e05ba2-b432-4afb-afe5-5679aa55abe3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.217535 Sep 08 10:19:41.808383 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 748/1591] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:41 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:42.135817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:42.155893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7d0baa0-355e-4115-b1b1-6cd516ced167 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1487 microversion: 2.1 time: 0.383222 Sep 08 10:19:42.171636 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 844/1592] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:41 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1487 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:42.178966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:42.179893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:42.189832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.190597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.191262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.192234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.194409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.195355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.240234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:19:42.319383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:42.377713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:42.411394 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f724ed8b-d6fe-4eb4-9b17-e0f0279d3689 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 204 len: 0 microversion: 2.1 time: 0.236059 Sep 08 10:19:42.413258 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 749/1593] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:42 2022] DELETE /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:19:42.425206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4b1cf64-b463-465a-9d6f-8eb8394163eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f23512863a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:42.492607 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e4b1cf64-b463-465a-9d6f-8eb8394163eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Image not found. Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4b1cf64-b463-465a-9d6f-8eb8394163eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 HTTP/1.1 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6460c5f3-c279-4399-a510-f11065dd89c2'} Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6460c5f3-c279-4399-a510-f11065dd89c2 to delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6460c5f3-c279-4399-a510-f11065dd89c2 could not be found. Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.495124 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4b1cf64-b463-465a-9d6f-8eb8394163eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:42.500798 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4b1cf64-b463-465a-9d6f-8eb8394163eb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2" status: 404 len: 62 microversion: 2.1 time: 0.077863 Sep 08 10:19:42.504348 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 845/1594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:42 2022] DELETE /compute/v2.1/images/6460c5f3-c279-4399-a510-f11065dd89c2 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:42.514364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:42.515657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:42.523749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.524560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.525271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.526575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.527419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.529173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.567078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:19:42.634401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:42.635622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:42.657613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.664317 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Instance is already in deleting state, ignoring this request Sep 08 10:19:42.665451 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82697234-7759-48ca-ae89-c232cfdf99ed tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 204 len: 0 microversion: 2.1 time: 0.159381 Sep 08 10:19:42.666504 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 750/1595] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:42 2022] DELETE /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:19:42.666946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.667891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.684123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.684879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.692223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.702518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:42.703836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:42.716446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.717804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.718425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.719367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.719987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.720858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.870652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:42.882889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:42.887497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:42.901035 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee2f27fa-b539-4d4f-b894-6dc9d1b4e83a tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1416 microversion: 2.75 time: 0.280059 Sep 08 10:19:42.907291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 846/1596] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:42 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1416 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:42.916880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:42.918846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:42.938035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.938850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.939536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:42.940631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:42.941427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:42.942274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:43.704808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:43.714319 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-138283b6-6678-4dcd-9396-e1b763196c40 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1493 microversion: 2.1 time: 1.025059 Sep 08 10:19:43.714914 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 751/1597] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:42 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1493 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:43.745897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:43.746811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:43.756859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:43.758972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:43.760339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:43.761175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:43.763578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:43.764348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:43.796174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:43.820547 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c855635f-1915-4c40-85ae-c186050bb9fe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1535 microversion: 2.1 time: 0.911619 Sep 08 10:19:43.823810 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 847/1598] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:42 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1535 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:43.828771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-20de1de8-00b6-4b4d-aaa6-7d01b88088e7 req-9dcc5100-19fb-409a-93ee-f680d5c7a0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cd6554-1319-4f7a-a52c-9c7bb059783e", "name": "network-vif-unplugged", "status": "completed", "tag": "bbd4f58d-3540-4c63-8ba1-9a1f74b24a79"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:43.856647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-20de1de8-00b6-4b4d-aaa6-7d01b88088e7 req-9dcc5100-19fb-409a-93ee-f680d5c7a0c4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:43.857147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-20de1de8-00b6-4b4d-aaa6-7d01b88088e7 req-9dcc5100-19fb-409a-93ee-f680d5c7a0c4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:43.859883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-20de1de8-00b6-4b4d-aaa6-7d01b88088e7 req-9dcc5100-19fb-409a-93ee-f680d5c7a0c4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:43.885213 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-20de1de8-00b6-4b4d-aaa6-7d01b88088e7 req-9dcc5100-19fb-409a-93ee-f680d5c7a0c4 service nova] Creating event network-vif-unplugged:bbd4f58d-3540-4c63-8ba1-9a1f74b24a79 for instance 71cd6554-1319-4f7a-a52c-9c7bb059783e on n-h2-833090-19 Sep 08 10:19:43.897739 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-20de1de8-00b6-4b4d-aaa6-7d01b88088e7 req-9dcc5100-19fb-409a-93ee-f680d5c7a0c4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072526 Sep 08 10:19:43.903217 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 848/1599] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:43.940217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:43.941231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:43.951549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:43.961848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:43.962948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:43.965636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:43.969638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:43.970885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:43.973002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.034907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.044688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.055595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.083656 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-643ba51b-72c3-490b-bca8-5dd1bbfc0528 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.348088 Sep 08 10:19:44.084898 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 752/1600] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:43 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:44.157036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.166367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.168339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.177244 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4dbfd731-6764-4f26-ab33-67c842ddcaef tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1437 microversion: 2.75 time: 0.242371 Sep 08 10:19:44.181141 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 849/1601] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:43 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1437 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:44.209787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:44.213886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:44.221375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.225818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.226596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.227677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.228379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.230416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.324834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:19:44.325683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:19:44.326941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:19:44.327646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:19:44.328275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:19:44.431047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:44.449984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.452181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.453727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.460829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.462728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.464080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.582577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.598656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.602732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.613567 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-327e8557-f2cc-499c-b1fc-8a54a5fb830c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "POST /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5/action" status: 202 len: 1494 microversion: 2.75 time: 0.408089 Sep 08 10:19:44.631676 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 753/1602] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:19:44 2022] POST /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5/action => generated 1494 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:19:44.645040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:44.646193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:44.655372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.663956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.666694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.669158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.671844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.673567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.752852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:44.754172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:44.770397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.771636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.772283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.773035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:44.775425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:44.776009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:44.910204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.928453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.951892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:44.980099 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fd8a821e-8637-475c-ac84-675b3045ac49 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.338526 Sep 08 10:19:44.991641 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 850/1603] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:44 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:45.006697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:45.007491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:45.026561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:45.027573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:45.029763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:45.030872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:45.032862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:45.033953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:45.349378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:45.360141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a3eb99f-c40e-4cdd-b7f2-e9f11f834dbb tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1493 microversion: 2.1 time: 0.623025 Sep 08 10:19:45.360729 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 754/1604] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:44 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1493 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:45.375443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:45.376413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:45.389463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:45.390874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:45.391727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:45.393751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:45.395133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:45.407966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:45.613272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:45.630594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:45.634745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29c7fd02e8314c9faf7da08dcd0d8be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36485dc6be9a4653b038ee4649e00390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:45.655369 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be16b92f-22cf-4d41-8610-a5139286a5ee tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 200 len: 1539 microversion: 2.91 time: 0.287923 Sep 08 10:19:45.657375 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 755/1605] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:45 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:45.912421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:45.924948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad6b88de-88e0-41cb-9472-33534a25e898 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1535 microversion: 2.1 time: 0.934655 Sep 08 10:19:45.925568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 851/1606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:44 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1535 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:46.009324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:46.009942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:46.026540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:46.027043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:46.027501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:46.028248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:46.028799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:46.029780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:46.200923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:46.214352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:46.216085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:46.222505 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de048338-f774-44b1-91e8-5f174ededc5e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.216971 Sep 08 10:19:46.243035 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 756/1607] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:46 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:46.387892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:46.388663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:46.400394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:46.400987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:46.401753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:46.402540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:46.403066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:46.403607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:46.690878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:46.691667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] [instance: acacb00b-705f-4760-ba09-6c802380b190] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:46.713255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:46.714417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:46.715501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:46.716806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:46.717683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:46.718514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:46.743884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] HTTP exception thrown: Instance acacb00b-705f-4760-ba09-6c802380b190 could not be found. Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Request method failure captured: Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 HTTP/1.1 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcEJVhEt7qdq9usjBnxYC6m0lETNqBKg7vlGT1wNGaoT0mFfO3vZoo-YpK-jqsehHalboHtaeScl6ZKyQQT65u51Veof4hdNr0gtWOgWZpB8DO_tj8kpxSK-h5807Uic6THhbR1TyQcNxySB4u75v4-lVLbFUzNblCNq0goEFKXE44g Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.91 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 36485dc6be9a4653b038ee4649e00390 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1107771863 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/36485dc6be9a4653b038ee4649e00390"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/36485dc6be9a4653b038ee4649e00390"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/36485dc6be9a4653b038ee4649e00390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_36485dc6be9a4653b038ee4649e00390", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1107771863 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 36485dc6be9a4653b038ee4649e00390 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1107771863 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-UnshelveToHostMultiNodesTest-1107771863-project Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 29c7fd02e8314c9faf7da08dcd0d8be8 Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1107771863-project Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance acacb00b-705f-4760-ba09-6c802380b190 could not be found. Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'acacb00b-705f-4760-ba09-6c802380b190'} Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acacb00b-705f-4760-ba09-6c802380b190 could not be found. Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acacb00b-705f-4760-ba09-6c802380b190 could not be found. Sep 08 10:19:46.746546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acacb00b-705f-4760-ba09-6c802380b190 could not be found. Sep 08 10:19:46.751317 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:46.754983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] Returning 404 to user: Instance acacb00b-705f-4760-ba09-6c802380b190 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:46.756429 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e701b7cb-c975-4713-85c8-40a26f08d7b3 tempest-UnshelveToHostMultiNodesTest-1107771863 tempest-UnshelveToHostMultiNodesTest-1107771863-project] 10.222.0.59 "GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190" status: 404 len: 111 microversion: 2.91 time: 0.071548 Sep 08 10:19:46.760700 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 757/1608] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:46 2022] GET /compute/v2.1/servers/acacb00b-705f-4760-ba09-6c802380b190 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:19:47.041741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38d6b4f4-1fb6-4759-8318-a77b0ea82e5c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f23554e2ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-479660469", "description": "tempest-description-1029133248"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:47.912892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:47.926414 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe8cecb6-c7f8-4422-88ef-065b37325e6a tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1493 microversion: 2.1 time: 1.541289 Sep 08 10:19:47.933337 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 852/1609] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:46 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1493 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:47.953362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:47.955493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:47.979316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:47.985983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:47.991555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:47.992958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:47.993688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:47.994346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:48.523974 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38d6b4f4-1fb6-4759-8318-a77b0ea82e5c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.623088 Sep 08 10:19:48.525529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 758/1610] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:46 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:48.533113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:48.535083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:48.559312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:48.572258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:48.574686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:48.575400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:48.578602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:48.580932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:48.583540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:48.749549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:48.761054 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0591cd98-16d6-4643-a39d-8fdfc490d48a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1528 microversion: 2.1 time: 0.825965 Sep 08 10:19:48.789544 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 853/1611] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:47 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1528 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:48.794154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db2aded7-73ed-4174-8de8-8e2af19f0f8c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f2351823160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-558831915", "description": "tempest-description-128289318"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:48.908418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:48.921553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:48.923077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:48.942870 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-661e99b0-3216-4b7e-9ed1-4a5ab0cdfc2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.416003 Sep 08 10:19:48.943512 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 759/1612] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:48 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:48.968511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:48.969133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:48.986216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:48.986337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:48.986720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:48.987437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:48.989891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:48.991595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:49.183613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:49.484896 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db2aded7-73ed-4174-8de8-8e2af19f0f8c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.694481 Sep 08 10:19:49.486146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 854/1613] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:19:48 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:49.491147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:49.491972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:49.543300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:49.549394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:49.554198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:49.570076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:49.575364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:49.576082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:49.604079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:49.658269 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86cc112e-0e5d-4bc8-aa20-1e2677172388 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1528 microversion: 2.1 time: 0.689700 Sep 08 10:19:49.673555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 760/1614] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:48 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1528 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:49.711826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-52778b51-959a-40e8-bf38-ab32c67119a5 req-57a70d47-3600-4b8b-842b-09a1496b1f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cd6554-1319-4f7a-a52c-9c7bb059783e", "name": "network-vif-deleted", "tag": "bbd4f58d-3540-4c63-8ba1-9a1f74b24a79"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:49.750556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-52778b51-959a-40e8-bf38-ab32c67119a5 req-57a70d47-3600-4b8b-842b-09a1496b1f2a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:49.751043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-52778b51-959a-40e8-bf38-ab32c67119a5 req-57a70d47-3600-4b8b-842b-09a1496b1f2a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:49.751536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-52778b51-959a-40e8-bf38-ab32c67119a5 req-57a70d47-3600-4b8b-842b-09a1496b1f2a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:49.770164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:49.770891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:49.774680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:49.777936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:49.779958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lazy-loading 'fault' on Instance uuid 71cd6554-1319-4f7a-a52c-9c7bb059783e {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:49.814271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-52778b51-959a-40e8-bf38-ab32c67119a5 req-57a70d47-3600-4b8b-842b-09a1496b1f2a service nova] Creating event network-vif-deleted:bbd4f58d-3540-4c63-8ba1-9a1f74b24a79 for instance 71cd6554-1319-4f7a-a52c-9c7bb059783e on n-h2-833090-19 Sep 08 10:19:49.855152 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-52778b51-959a-40e8-bf38-ab32c67119a5 req-57a70d47-3600-4b8b-842b-09a1496b1f2a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156688 Sep 08 10:19:49.857368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 761/1615] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:49.874537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da49272c-32da-4905-8655-f4b5958eaf0d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:49.889651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c08994220f44d5db166b899e80c2a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c692b738c8421786bac8be03a047a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:49.899201 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eabcd475-f533-4f73-bea4-7529e834572c tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 200 len: 1297 microversion: 2.1 time: 0.411774 Sep 08 10:19:49.908368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-da49272c-32da-4905-8655-f4b5958eaf0d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] HTTP exception thrown: Flavor 88df2ccb-a2a4-4719-a2f3-6ac61d383c22 could not be found. Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da49272c-32da-4905-8655-f4b5958eaf0d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Request method failure captured: Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/flavors/88df2ccb-a2a4-4719-a2f3-6ac61d383c22 HTTP/1.1 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDBsFfyucXz4-7xLoO9UFP12BGmqYM_uFoqABBh58QPyj96oSRx6ahh9ptSVBFw_wj2UCaX7P5xmi_yp7xogAwPPVO4abTjSD_Gdk8w5cSUlKvPyz5QZiLlQ9PkiMPR4LFKR8ayqurJKi6wWG8rbdRqTS27P7su_-336XA09-ghU4M Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 2517430e01d84442acc0384598fb5e63 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-MigrationsAdminTest-72405844 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2517430e01d84442acc0384598fb5e63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2517430e01d84442acc0384598fb5e63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2517430e01d84442acc0384598fb5e63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2517430e01d84442acc0384598fb5e63", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-MigrationsAdminTest-72405844 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 2517430e01d84442acc0384598fb5e63 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-MigrationsAdminTest-72405844 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-MigrationsAdminTest-72405844-project-admin Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 618a90a225464fd7a022f255ba971864 Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-MigrationsAdminTest-72405844-project-admin Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: exception: Flavor 88df2ccb-a2a4-4719-a2f3-6ac61d383c22 could not be found. Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '88df2ccb-a2a4-4719-a2f3-6ac61d383c22'} Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 88df2ccb-a2a4-4719-a2f3-6ac61d383c22 could not be found. Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 88df2ccb-a2a4-4719-a2f3-6ac61d383c22 could not be found. Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:49.915754 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 88df2ccb-a2a4-4719-a2f3-6ac61d383c22 could not be found. Sep 08 10:19:49.921360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:49.923067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da49272c-32da-4905-8655-f4b5958eaf0d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Returning 404 to user: Flavor 88df2ccb-a2a4-4719-a2f3-6ac61d383c22 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:49.924131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da49272c-32da-4905-8655-f4b5958eaf0d tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/88df2ccb-a2a4-4719-a2f3-6ac61d383c22" status: 404 len: 109 microversion: 2.1 time: 0.062102 Sep 08 10:19:49.925186 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 855/1616] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:49 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 1297 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:49.929926 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 762/1617] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:49 2022] DELETE /compute/v2.1/flavors/88df2ccb-a2a4-4719-a2f3-6ac61d383c22 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:49.937521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1664369969", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "cd2ecea7-1cb9-4c70-b690-4d2d69dbd7da"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:49.975731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:49.976771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:49.988821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:49.996563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:49.999562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:50.016102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:50.036295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:50.037058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:50.110634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] validate_networks() for [('cd2ecea7-1cb9-4c70-b690-4d2d69dbd7da', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:19:50.352782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:50.379123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:50.381318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:50.391970 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24681310-d4c8-427b-af2e-4cfdcdfc03db tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.420688 Sep 08 10:19:50.393210 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 763/1618] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:49 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:50.398366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5b165a22-96e1-4a84-9d11-8311dc992583 req-63cdd5ee-8ca6-4ee4-ab95-ba26db2033d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "name": "network-vif-plugged", "status": "completed", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:50.417133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5b165a22-96e1-4a84-9d11-8311dc992583 req-63cdd5ee-8ca6-4ee4-ab95-ba26db2033d4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:50.419505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5b165a22-96e1-4a84-9d11-8311dc992583 req-63cdd5ee-8ca6-4ee4-ab95-ba26db2033d4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:50.421994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5b165a22-96e1-4a84-9d11-8311dc992583 req-63cdd5ee-8ca6-4ee4-ab95-ba26db2033d4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:50.443860 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5b165a22-96e1-4a84-9d11-8311dc992583 req-63cdd5ee-8ca6-4ee4-ab95-ba26db2033d4 service nova] Creating event network-vif-plugged:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h1-833090-19 Sep 08 10:19:50.454067 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5b165a22-96e1-4a84-9d11-8311dc992583 req-63cdd5ee-8ca6-4ee4-ab95-ba26db2033d4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058764 Sep 08 10:19:50.457374 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 764/1619] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:19:50.469042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2129946170", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:50.584106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:19:51.398421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:19:51.399572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:19:51.401024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:19:51.401738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:19:51.402766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:19:51.430180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.434300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.436723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.440678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.444282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.445779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.455940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:19:51.456487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:19:51.456860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:19:51.457281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:19:51.457697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:19:51.468724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.469487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.470587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.471586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.472250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.472719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.500120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:51.506730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Getting quotas for user 5f96685045b340b2a978ece9dd591640 and project cafdc851cfa34429b274c120b9d9c8b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:51.522013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Getting quotas for project 3750bee2be364857b35ad908e8aa0f48. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:51.533655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:19:51.537080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:19:51.538975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Getting quotas for user dfe57507755d46889089a0b2b42aa45c and project 3750bee2be364857b35ad908e8aa0f48. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:51.573348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:19:51.576311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:19:51.627105 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-458a0f11-4a06-4f32-a5bf-5b9d88ea3d82 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164649 Sep 08 10:19:51.628884 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 765/1620] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:19:51.642685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:51.644949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 71cd6554-1319-4f7a-a52c-9c7bb059783e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:51.662686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.663194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.665283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.666871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.667343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.667810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.688191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a67607a9-2d6d-4d19-919b-46c56a54ed22 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761747 Sep 08 10:19:51.688924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 856/1621] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:19:51.694950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:51.695166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:51.702731 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance 71cd6554-1319-4f7a-a52c-9c7bb059783e could not be found. Sep 08 10:19:51.703986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.704903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e HTTP/1.1 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 71cd6554-1319-4f7a-a52c-9c7bb059783e could not be found. Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '71cd6554-1319-4f7a-a52c-9c7bb059783e'} Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cd6554-1319-4f7a-a52c-9c7bb059783e could not be found. Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cd6554-1319-4f7a-a52c-9c7bb059783e could not be found. Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.705628 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cd6554-1319-4f7a-a52c-9c7bb059783e could not be found. Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance 71cd6554-1319-4f7a-a52c-9c7bb059783e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:51.710448 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d3c4ab0-1481-4446-b72e-251b55938524 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e" status: 404 len: 111 microversion: 2.1 time: 0.078603 Sep 08 10:19:51.711507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 766/1622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:51 2022] GET /compute/v2.1/servers/71cd6554-1319-4f7a-a52c-9c7bb059783e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:51.715282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.716179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.718949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.719809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.721550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:51.722954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:51.738312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.739627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.741169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.743367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:51.744497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:51.748663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:51.785049 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] HTTP exception thrown: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Request method failure captured: Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 HTTP/1.1 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcCYjI7gMQ0g2GorhfRMq65BgfMpowX7-BV7fA-9SdeyTjs0mnGRpvkm0-IMs5YFmt_Vk5lmh-waEeNPyLm1as5SNS436-GddnenokNLDbpoxhl41psaKKlEz9-yW170Yme4nrYzUlJwi11WEqhq_jGPC89WbMn2XAMqIhJDPKs22tA Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 4054b9269fef44c0b434249584cbecf7 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4054b9269fef44c0b434249584cbecf7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 4054b9269fef44c0b434249584cbecf7 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachSCSIVolumeTestJSON-1895419734-project Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ccce637e46fb484ea5d46c0371206da6 Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1895419734-project Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f135a161-48ff-4d0e-b00c-41bf24ba6240'} Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:51.786799 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Returning 404 to user: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-909a082d-1b34-42bf-8a9c-325d62a69e0b tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 404 len: 111 microversion: 2.1 time: 0.098378 Sep 08 10:19:51.791570 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 857/1623] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:51 2022] DELETE /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:51.804644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:51.817073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbd65238-6fa5-4239-922a-da1a24ad5d47 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:51.817745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbd65238-6fa5-4239-922a-da1a24ad5d47 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:51.920205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbd65238-6fa5-4239-922a-da1a24ad5d47 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:51.923392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:51.934462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbd65238-6fa5-4239-922a-da1a24ad5d47 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1213 microversion: 2.1 time: 0.144007 Sep 08 10:19:51.938115 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 858/1624] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:51 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:51.943774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:51.944438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39d48e42-7174-466d-b012-5fc8adb899d9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:51.945055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39d48e42-7174-466d-b012-5fc8adb899d9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:51.959353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:51.977615 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8f98fcf-8764-45ce-967d-8a97cefc635b tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.264853 Sep 08 10:19:51.993675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 767/1625] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:51 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:52.016446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8717b757-4dde-4fa3-96a1-8d8e08216e47 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235550a820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.034625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-39d48e42-7174-466d-b012-5fc8adb899d9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:52.042209 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39d48e42-7174-466d-b012-5fc8adb899d9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1216 microversion: 2.1 time: 0.103095 Sep 08 10:19:52.042801 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 859/1626] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:51 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:52.074065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8717b757-4dde-4fa3-96a1-8d8e08216e47 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Image not found. Sep 08 10:19:52.075647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.079228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] [instance: f135a161-48ff-4d0e-b00c-41bf24ba6240] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8717b757-4dde-4fa3-96a1-8d8e08216e47 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf HTTP/1.1 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '66d486a3-baf5-4caa-bd1c-4f5beb560dcf'} Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 66d486a3-baf5-4caa-bd1c-4f5beb560dcf to delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66d486a3-baf5-4caa-bd1c-4f5beb560dcf could not be found. Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.084162 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8717b757-4dde-4fa3-96a1-8d8e08216e47 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8717b757-4dde-4fa3-96a1-8d8e08216e47 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf" status: 404 len: 62 microversion: 2.1 time: 0.091195 Sep 08 10:19:52.089807 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 768/1627] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:51 2022] DELETE /compute/v2.1/images/66d486a3-baf5-4caa-bd1c-4f5beb560dcf => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:52.096111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.096111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.100159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.110136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.110513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.110513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.111807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.120264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.126514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:19:52.130741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.137603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] HTTP exception thrown: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Request method failure captured: Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 HTTP/1.1 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcCYjI7gMQ0g2GorhfRMq65BgfMpowX7-BV7fA-9SdeyTjs0mnGRpvkm0-IMs5YFmt_Vk5lmh-waEeNPyLm1as5SNS436-GddnenokNLDbpoxhl41psaKKlEz9-yW170Yme4nrYzUlJwi11WEqhq_jGPC89WbMn2XAMqIhJDPKs22tA Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 4054b9269fef44c0b434249584cbecf7 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4054b9269fef44c0b434249584cbecf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4054b9269fef44c0b434249584cbecf7", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 4054b9269fef44c0b434249584cbecf7 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1895419734 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachSCSIVolumeTestJSON-1895419734-project Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ccce637e46fb484ea5d46c0371206da6 Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1895419734-project Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f135a161-48ff-4d0e-b00c-41bf24ba6240'} Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.139508 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. Sep 08 10:19:52.143562 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.144238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.144238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.144745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.145329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.145737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.150101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] Returning 404 to user: Instance f135a161-48ff-4d0e-b00c-41bf24ba6240 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.150985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-114a8237-4397-4995-a470-a836857f5618 tempest-AttachSCSIVolumeTestJSON-1895419734 tempest-AttachSCSIVolumeTestJSON-1895419734-project] 10.222.0.59 "GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240" status: 404 len: 111 microversion: 2.1 time: 0.090876 Sep 08 10:19:52.151573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 860/1628] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] GET /compute/v2.1/servers/f135a161-48ff-4d0e-b00c-41bf24ba6240 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.180345 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de HTTP/1.1 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '280de92f-4be7-49dc-a244-92b0106011de'} Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.191071 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.195971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.199822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.201680 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b4f1fc43-a2a4-40ac-b636-e6df10455605 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 404 len: 111 microversion: 2.1 time: 0.108220 Sep 08 10:19:52.204171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 769/1629] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:52 2022] DELETE /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.211014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.211918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 280de92f-4be7-49dc-a244-92b0106011de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.221646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.225288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.228360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.232356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.233600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.234284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.274957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de HTTP/1.1 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '280de92f-4be7-49dc-a244-92b0106011de'} Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.276902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.282382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.282382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.282382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.282382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.282382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. Sep 08 10:19:52.282382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.286899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance 280de92f-4be7-49dc-a244-92b0106011de could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.290231 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0c6739e-4a75-4425-9849-cfd6ba535043 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de" status: 404 len: 111 microversion: 2.1 time: 0.082917 Sep 08 10:19:52.291945 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 861/1630] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] GET /compute/v2.1/servers/280de92f-4be7-49dc-a244-92b0106011de => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.300658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23bee928-8e20-4f86-9d2b-c940da425d3e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f235113ed30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.346416 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-23bee928-8e20-4f86-9d2b-c940da425d3e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Image not found. Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23bee928-8e20-4f86-9d2b-c940da425d3e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 HTTP/1.1 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8c298ade-a691-4178-a36e-427d9c392593'} Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c298ade-a691-4178-a36e-427d9c392593 to delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c298ade-a691-4178-a36e-427d9c392593 could not be found. Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.348308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23bee928-8e20-4f86-9d2b-c940da425d3e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23bee928-8e20-4f86-9d2b-c940da425d3e tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593" status: 404 len: 62 microversion: 2.1 time: 0.053512 Sep 08 10:19:52.353999 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 770/1631] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] DELETE /compute/v2.1/images/8c298ade-a691-4178-a36e-427d9c392593 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:52.359242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.361338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.373312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.373815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.374264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.374977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.375438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.375905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.407992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 HTTP/1.1 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'eae4810a-a023-44d3-9497-d41ed8fe7914'} Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.410480 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.414812 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.417929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.419092 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44dcda3e-6124-4e44-b481-5000aebe5d5f tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 404 len: 111 microversion: 2.1 time: 0.064013 Sep 08 10:19:52.423585 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 862/1632] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:52 2022] DELETE /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.428430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.429884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: eae4810a-a023-44d3-9497-d41ed8fe7914] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.445923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.446431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.446879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.448414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.450372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.454645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.508094 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 HTTP/1.1 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'eae4810a-a023-44d3-9497-d41ed8fe7914'} Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.511717 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.516552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.516552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.516552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.516552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.516552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. Sep 08 10:19:52.516552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.520644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance eae4810a-a023-44d3-9497-d41ed8fe7914 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.529358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-842dcb1f-3b14-4ec6-81c3-4e97d0409346 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914" status: 404 len: 111 microversion: 2.1 time: 0.104642 Sep 08 10:19:52.532947 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 771/1633] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] GET /compute/v2.1/servers/eae4810a-a023-44d3-9497-d41ed8fe7914 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.540651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e133097b-1e83-48f1-b7ba-d8375f8ee5bf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '.version_select at 0x7f2352196700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.612721 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e133097b-1e83-48f1-b7ba-d8375f8ee5bf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Image not found. Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e133097b-1e83-48f1-b7ba-d8375f8ee5bf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 HTTP/1.1 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '43ae3215-cf3a-47e4-99db-07cef5b66fe2'} Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 43ae3215-cf3a-47e4-99db-07cef5b66fe2 to delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43ae3215-cf3a-47e4-99db-07cef5b66fe2 could not be found. Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.614743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e133097b-1e83-48f1-b7ba-d8375f8ee5bf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e133097b-1e83-48f1-b7ba-d8375f8ee5bf tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2" status: 404 len: 62 microversion: 2.1 time: 0.080231 Sep 08 10:19:52.620422 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 863/1634] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] DELETE /compute/v2.1/images/43ae3215-cf3a-47e4-99db-07cef5b66fe2 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:19:52.625694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.626343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.649812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.650346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.650789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.651827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.652285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.652713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.691830 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 HTTP/1.1 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '4c8cba7f-a173-4f5a-bb60-0732504ddf03'} Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.693593 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ace2c91-e81a-4e13-983e-d572db8fc137 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 404 len: 111 microversion: 2.1 time: 0.073915 Sep 08 10:19:52.697702 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 772/1635] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:19:52 2022] DELETE /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.703761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.704698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] [instance: 4c8cba7f-a173-4f5a-bb60-0732504ddf03] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.716267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.716998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.717191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.717906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.718357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.718783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.757468 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] HTTP exception thrown: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Request method failure captured: Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 HTTP/1.1 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDqbCEpkRlXoGtgj12u9nEPAT505t1hSCJTCVBzolQakGTNnPaEx6CIMLzUmYWpcOOq-fFbKRNo7qLu3150fjEenJoniYFbbldIrbyiFEGZqBi2hX-JArVsYh7BnG_MubhXW-lrRfbJmXRjylTqr4hYTNiiwwiqPdxYVnfaJ2TISjk Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92c692b738c8421786bac8be03a047a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92c692b738c8421786bac8be03a047a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92c692b738c8421786bac8be03a047a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 92c692b738c8421786bac8be03a047a5 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesTestJSON-1566181259 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 1c08994220f44d5db166b899e80c2a12 Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesTestJSON-1566181259-project Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '4c8cba7f-a173-4f5a-bb60-0732504ddf03'} Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.759095 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:19:52.763620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:19:52.763620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:19:52.763620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:19:52.763620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:19:52.763620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. Sep 08 10:19:52.763620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:19:52.764136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] Returning 404 to user: Instance 4c8cba7f-a173-4f5a-bb60-0732504ddf03 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:19:52.765106 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51b8039c-3f5e-438c-8475-52d50a050be9 tempest-ImagesTestJSON-1566181259 tempest-ImagesTestJSON-1566181259-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03" status: 404 len: 111 microversion: 2.1 time: 0.065389 Sep 08 10:19:52.776713 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 864/1636] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] GET /compute/v2.1/servers/4c8cba7f-a173-4f5a-bb60-0732504ddf03 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:19:52.961858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:52.962829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:52.977218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:52.977997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:52.991820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:52.996795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:53.000334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:53.002216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:53.012721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:53.013731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:53.027728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:53.028231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:53.029196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:53.029946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:53.030398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:53.045043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:53.428018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:53.443237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:53.448344 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3da70801-ab29-4257-bb9d-e8a4b369f83b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1209 microversion: 2.1 time: 0.492470 Sep 08 10:19:53.448941 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 773/1637] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:52 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1209 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:53.468820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:53.471985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:53.475328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:53.477091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:53.494131 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17f579ee-ad88-497c-b6cd-fa1eb4c3e868 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.485556 Sep 08 10:19:53.499573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 865/1638] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:53 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:19:53.499870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:53.499870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:53.503685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:53.504705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:53.505404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:53.506256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:53.670898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:53.680474 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a481d1af-1d31-4268-875e-3aa370c900e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1212 microversion: 2.1 time: 0.230490 Sep 08 10:19:53.685252 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 774/1639] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:53 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1212 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:53.724722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-841412099", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:53.810923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:19:54.245921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:19:54.246349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:19:54.246831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:19:54.247897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:19:54.248425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:19:54.302219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.303814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:54.307410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:54.309189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.312043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:54.314053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:54.355131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Getting quotas for project 938adcc0d60d4898b7ce601ac6e1ea90. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:19:54.361931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Getting quotas for user 5540d4b8c8fc495587d90f52090174e0 and project 938adcc0d60d4898b7ce601ac6e1ea90. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:19:54.387080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:19:54.390394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:19:54.474418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:54.475053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:54.489555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.490457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:54.491091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:54.493436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.494431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:54.494871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:54.500598 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7da1d3a8-7a0c-4b9f-b477-614f63219e19 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980543 Sep 08 10:19:54.533652 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 866/1640] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:19:54.552213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:54.561058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:54.608647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.618646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:54.622664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:54.628920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.628920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:54.629168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:54.693314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:54.723625 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dc9b3b5f-cd48-4011-8006-090f4004d5c5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1273 microversion: 2.1 time: 0.251381 Sep 08 10:19:54.727582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 775/1641] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:54 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:54.751957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ed1643d-13ef-45f4-93e1-8001984c3bb5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:54.754375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ed1643d-13ef-45f4-93e1-8001984c3bb5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:54.930199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:54.940351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:54.952803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:54.963922 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-110f5092-86b3-4271-bc39-ea7bbc87ae01 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.428986 Sep 08 10:19:54.965087 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 867/1642] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:54 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:54.970766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ed1643d-13ef-45f4-93e1-8001984c3bb5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:54.971396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:54.972264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:54.995497 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ed1643d-13ef-45f4-93e1-8001984c3bb5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1213 microversion: 2.1 time: 0.266745 Sep 08 10:19:54.997620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:54.999811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:55.001819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 776/1643] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:54 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1213 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:55.023143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:55.023946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:55.024255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:55.024695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:55.240519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:55.256331 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34ce6ebe-f2c2-472d-9610-d841c4e4e434 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1268 microversion: 2.1 time: 0.289777 Sep 08 10:19:55.259532 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 868/1644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:54 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:55.752506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:55.754623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:55.770359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:55.772193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:55.772922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:55.774003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:55.774835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:55.775494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:55.887309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:55.904354 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f1ca892a-c6d0-4635-b3ea-76109601750a tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1271 microversion: 2.1 time: 0.157961 Sep 08 10:19:55.912214 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 777/1645] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:55 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:55.998115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:55.998726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:56.014567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.015072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.015574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.019707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.021546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.022057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.026448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:56.027294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:56.039073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.040733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.041422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.042315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.042921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.048380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.656394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:56.669498 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f01e8cb2-24c9-423f-b0a4-b92ef76cefd8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1265 microversion: 2.1 time: 0.643670 Sep 08 10:19:56.689583 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 778/1646] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:56 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1265 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:56.716173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:56.716814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:56.758872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.759438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.762089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.763450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.764010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.764456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.804294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:56.835049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:56.843373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:56.869529 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22ce6d58-0fe4-4da2-9996-c1de1884e492 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.876127 Sep 08 10:19:56.870134 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 869/1647] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:55 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:56.882577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:56.883210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:56.898686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.899441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.900138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:56.901021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:56.901629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:56.902244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:57.100497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:57.110603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-491c1809-6541-45ee-a277-a15688f40dc1 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1274 microversion: 2.1 time: 0.419830 Sep 08 10:19:57.111588 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 779/1648] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:56 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1274 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:57.116743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:57.117793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:57.124595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:57.125344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:57.126031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:57.126917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:57.127567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:57.128186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:57.293619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:57.308799 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f2a56446-418b-4f24-babd-c441674b2098 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1271 microversion: 2.1 time: 0.195020 Sep 08 10:19:57.310568 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 780/1649] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:57 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:57.425631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 7265635f-ed38-4363-84e1-d4f53815fb77 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:57.455570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca19fa87-5306-4488-ba28-a401fd411828 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 2427 microversion: 2.25 time: 0.584252 Sep 08 10:19:57.457001 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 870/1650] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:56 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 2427 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:57.493223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-19", "block_migration": "auto"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:19:57.498969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:57.511135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:57.512868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:57.513986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:57.514880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:57.516149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:57.516772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:57.571352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'flavor' on Instance uuid 7265635f-ed38-4363-84e1-d4f53815fb77 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:19:57.604674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Going to try to live migrate instance to n-h1-833090-19 {{(pid=122456) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:19:57.696953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:57.697577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:57.734566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:57.735194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:57.735534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:57.736265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:57.736784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:57.737131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:58.021222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:58.034307 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15ea7571-f8f5-4293-9e36-baacd637bd24 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1271 microversion: 2.1 time: 0.341253 Sep 08 10:19:58.047937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 871/1651] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:57 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1271 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:19:58.058368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:58.063697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:58.081015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:58.081871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:58.082533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:58.083483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:58.084148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:58.084781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:58.516498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:58.527264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:58.534994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:58.562417 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ccb3231-eabc-4f39-9c1d-e35e0c7e24b0 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.512116 Sep 08 10:19:58.590638 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 872/1652] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:19:58 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:19:58.602722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:58.603609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:58.632569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:58.636988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:58.637662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:58.638607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:58.643333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:58.645076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:59.406152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:59.426028 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe91c9f0-7b77-4330-bfca-c1b350d5411d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.833802 Sep 08 10:19:59.432693 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 873/1653] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:58 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:59.437818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:59.438760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:59.445050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:59.445814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:59.446418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:59.447306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:59.447939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:59.448691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:59.838119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:19:59.848810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7311f06-eee7-4175-9303-bcf53c89f713 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.414723 Sep 08 10:19:59.849994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 874/1654] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:59 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:19:59.855082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:19:59.855931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:19:59.862426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:59.862911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:59.863343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:59.864081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:19:59.864531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:19:59.864950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:19:59.998448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:00.019970 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5e0ebb9-b33e-48f1-9833-bfee45aa1052 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1271 microversion: 2.1 time: 0.168597 Sep 08 10:20:00.021379 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 875/1655] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:19:59 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:00.032426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:00.033654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:00.044064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:00.044932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:00.045633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:00.046817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:00.047622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:00.049104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:00.235341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:00.246544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:00.248627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:00.265796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-867f684a-d08e-4af7-8cd9-17d71a9b87c3 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.243072 Sep 08 10:20:00.266410 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 876/1656] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:00 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:00.462015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:00.463817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:00.474800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:00.477230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:00.478588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:00.479813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:00.482001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:00.482902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:00.484124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:00.912676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98157f11-de2a-4f83-a27b-4ca4225c665c tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/action" status: 202 len: 0 microversion: 2.25 time: 3.429368 Sep 08 10:20:00.919942 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 781/1657] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:19:57 2022] POST /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/action => generated 0 bytes in 3438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:20:00.926723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:00.929122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:00.942823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:00.946291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:00.947743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:00.949054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:00.951190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:00.952543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:00.953800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:01.466383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:01.520200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:01.534431 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0ffd629-29af-4930-a28a-5c215cd8f7bf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 1.079404 Sep 08 10:20:01.536500 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 877/1658] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:00 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:01.544046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:01.545762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:01.558914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:01.560464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:01.562771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:01.566054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:01.568891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:01.570220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:01.829606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:01.871124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4141482b-d7a6-4da4-9028-b44a12776bb1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.949888 Sep 08 10:20:01.875759 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 782/1659] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:00 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:01.883197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:01.884383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:01.906173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:01.907567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:01.911560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:01.913456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:01.914029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:01.914566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.156623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.169811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.171281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.172551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8df16036-ce9f-467b-a1a5-f1ade61c6126 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.634704 Sep 08 10:20:02.173139 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 878/1660] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:01 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:02.187684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-82c283a8-ff80-4818-b41f-dc5e88ce548d req-247aeb5c-f039-4fed-b0e2-60a315648099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf724fb-3d3b-4882-9345-ca56885f613f", "tag": "fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:02.211922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-82c283a8-ff80-4818-b41f-dc5e88ce548d req-247aeb5c-f039-4fed-b0e2-60a315648099 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.212868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-82c283a8-ff80-4818-b41f-dc5e88ce548d req-247aeb5c-f039-4fed-b0e2-60a315648099 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.213088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-82c283a8-ff80-4818-b41f-dc5e88ce548d req-247aeb5c-f039-4fed-b0e2-60a315648099 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.237861 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-82c283a8-ff80-4818-b41f-dc5e88ce548d req-247aeb5c-f039-4fed-b0e2-60a315648099 service nova] Creating event network-changed:fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d for instance 5bf724fb-3d3b-4882-9345-ca56885f613f on n-h2-833090-19 Sep 08 10:20:02.252005 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-82c283a8-ff80-4818-b41f-dc5e88ce548d req-247aeb5c-f039-4fed-b0e2-60a315648099 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063585 Sep 08 10:20:02.252670 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 879/1661] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:02.269129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:02.271643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:02.289421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.292090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.292993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.294176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.306852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.307320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.545073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.560708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.561954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.569649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:02.572526 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c72b64ef-af1d-44f9-aaac-e594c95c7a58 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.693558 Sep 08 10:20:02.573799 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 783/1662] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:01 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:02.579319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d7140af1-61e2-4294-9bd9-0caa6bf0224a req-8502fefa-7ec4-4df7-8844-d491d3e34556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:02.592053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d7140af1-61e2-4294-9bd9-0caa6bf0224a req-8502fefa-7ec4-4df7-8844-d491d3e34556 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.593041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d7140af1-61e2-4294-9bd9-0caa6bf0224a req-8502fefa-7ec4-4df7-8844-d491d3e34556 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.594045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d7140af1-61e2-4294-9bd9-0caa6bf0224a req-8502fefa-7ec4-4df7-8844-d491d3e34556 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.607594 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec997988-a294-414b-b877-60d5d7238218 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.352095 Sep 08 10:20:02.610973 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 880/1663] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:02 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:02.611733 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d7140af1-61e2-4294-9bd9-0caa6bf0224a req-8502fefa-7ec4-4df7-8844-d491d3e34556 service nova] Creating event network-changed:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h2-833090-19 Sep 08 10:20:02.618624 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d7140af1-61e2-4294-9bd9-0caa6bf0224a req-8502fefa-7ec4-4df7-8844-d491d3e34556 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041946 Sep 08 10:20:02.618824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:02.619356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:02.625979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.627053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.627744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.628763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.628888 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 784/1664] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:02.629536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.630406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.662428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:02.905849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:02.908066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:02.919840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.921323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.922207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:02.923413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:02.924104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:02.924660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:03.025445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:03.038062 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f2c8a096-2613-4ba2-a393-fb19affbaff2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.424790 Sep 08 10:20:03.039022 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 881/1665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:02 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:03.202202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:03.204046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:03.213457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:03.214563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:03.215859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:03.220975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:03.221902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:03.223615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:03.263676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:03.290234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b584fb2f-82f2-45e0-a9bb-a4833e4ddd71 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.392332 Sep 08 10:20:03.291818 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 785/1666] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:02 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:03.603846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:03.605438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:03.616708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:03.617991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:03.618703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:03.619708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:03.620391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:03.621284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:03.813249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:03.835302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:03.840918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:03.845554 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ee24a68-629e-4e04-89b0-9b11489b1824 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.648815 Sep 08 10:20:03.846357 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 882/1667] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:03 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:03.857183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:03.858047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:03.886327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:03.887550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:03.888019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:03.888869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:03.889233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:03.889658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.134169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:04.150924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:04.152572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:04.171302 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f810a13-a39b-48c7-b930-f78c73d90dcd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.323401 Sep 08 10:20:04.185968 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 883/1668] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:03 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:04.209098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:04.220529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:04.232865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.233357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.233962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.235051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.235687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.236231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.305978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:04.318049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-015cd7b1-10fa-49bc-8863-05d6e18aac6b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.719190 Sep 08 10:20:04.320932 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 786/1669] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:03 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:04.328469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:04.329367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:04.345997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:04.349377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.350099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.350875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.351813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.357284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.357743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.371313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:04.722754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:04.736618 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ae8d69f-7713-4a03-b0c4-40f300c24a38 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.549141 Sep 08 10:20:04.737445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 884/1670] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:04 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:04.882185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:04.883412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:04.884154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:04.887024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:04.892910 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14c05ea2-c4ed-477b-90b5-deb98cafb204 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.570605 Sep 08 10:20:04.893821 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 787/1671] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:04 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:04.903214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.904164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.910213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.911371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.912106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.912513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5293ba1e-bf24-4dfd-a520-3e1e2e57c32e req-3830c447-e33b-4abd-85c9-56ff40f4257f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8905d0-7692-4019-a143-f003ceeeeac0", "tag": "7f528c70-80b4-4ab4-9dcb-c1a7aaff9367"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:04.913199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.961497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5293ba1e-bf24-4dfd-a520-3e1e2e57c32e req-3830c447-e33b-4abd-85c9-56ff40f4257f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:04.962463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5293ba1e-bf24-4dfd-a520-3e1e2e57c32e req-3830c447-e33b-4abd-85c9-56ff40f4257f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:04.963135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5293ba1e-bf24-4dfd-a520-3e1e2e57c32e req-3830c447-e33b-4abd-85c9-56ff40f4257f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:04.994440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:04.998279 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5293ba1e-bf24-4dfd-a520-3e1e2e57c32e req-3830c447-e33b-4abd-85c9-56ff40f4257f service nova] Creating event network-changed:7f528c70-80b4-4ab4-9dcb-c1a7aaff9367 for instance ff8905d0-7692-4019-a143-f003ceeeeac0 on n-h1-833090-19 Sep 08 10:20:05.017728 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5293ba1e-bf24-4dfd-a520-3e1e2e57c32e req-3830c447-e33b-4abd-85c9-56ff40f4257f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111492 Sep 08 10:20:05.023288 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 788/1672] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:05.207264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:05.208037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:05.214987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:05.220769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:05.221487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:05.222267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:05.222750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:05.223182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:05.367578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:05.384896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:05.389115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:05.427798 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b72fa1a-81eb-4bf2-8381-c0bab99a5b2c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.224663 Sep 08 10:20:05.428408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 789/1673] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:05 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:05.469775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:05.470404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:05.480449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:05.481483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:05.490245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:05.491535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:05.492691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:05.493297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:05.697488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:05.710560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:05.720447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:05.721722 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fbc75105-95a6-4e34-850c-c7ef77e0fac0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.847988 Sep 08 10:20:05.739958 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 885/1674] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:04 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:20:05.760784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:05.761522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:05.770523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:05.771023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:05.771475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:05.776367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:05.780818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:05.781547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:06.410482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:06.421287 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce88aa8c-8a86-4317-8ad6-cd15b3765036 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.664309 Sep 08 10:20:06.422882 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 886/1675] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:05 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:06.427591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:06.438625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:06.454614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:06.455321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:06.456375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:06.457365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:06.457986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:06.458650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:06.662921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:06.671821 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38e9798d-661a-4dc4-91f6-ce440ba5bc54 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 1.217888 Sep 08 10:20:06.693371 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 790/1676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:05 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:06.723109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:06.724030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:06.754057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:06.755198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:06.758634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:06.764300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:06.765992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:06.767723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:06.769304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:06.775838 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d7785d8-ac45-492d-acb4-7fc2c1b6a70f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.345774 Sep 08 10:20:06.776665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 887/1677] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:06 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:06.789119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:06.793632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:06.841691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:06.842300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:06.846052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:06.849455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:06.849808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:06.850303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.057064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.077523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.134826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.168860 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f2da668-405e-4603-8550-137496e031b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.458080 Sep 08 10:20:07.174455 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 791/1678] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:06 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:07.363256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.375091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.376958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.379652 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8775c7dd-afcb-4934-adad-afe2041fce25 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.602020 Sep 08 10:20:07.381829 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 888/1679] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:06 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:07.445200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:07.445822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:07.458235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:07.458994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:07.460113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.461012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:07.461639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:07.462994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.716023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.718475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:07.719101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:07.734965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:07.735518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:07.735942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.736643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:07.737097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:07.737726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.741214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db5c7fe7-a711-458c-bce1-32cfa254ff1f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.299588 Sep 08 10:20:07.743896 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 792/1680] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:07 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:07.804194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:07.805083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:07.826940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:07.828272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:07.828886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.832007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:07.832646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:07.833249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:07.937663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:07.952287 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c9bb1c2-db93-4b17-83f4-ecfae3677e75 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.237587 Sep 08 10:20:07.953577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 889/1681] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:07 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:08.182785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.194910 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97e1fb31-7047-44e3-a14c-7c6faba0b24e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.394641 Sep 08 10:20:08.202580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 793/1682] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:07 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:08.215304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:08.216216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:08.232636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.234294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.234915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.236396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.237107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.237796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.411031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:08.411686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:08.419293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.419820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.420254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.432479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.433212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.434385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.439882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.463982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.469033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.479215 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-952c0e16-dec2-4d59-87ae-fb129ee6a6dd tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.273670 Sep 08 10:20:08.485493 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 890/1683] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:08 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:08.772228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:08.774567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:08.787192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.794854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.797912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.798915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.801411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.802427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.903280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.922964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.924405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:08.925727 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-773ffcb3-909d-485e-8ce7-1dfd24430351 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.518757 Sep 08 10:20:08.930790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 794/1684] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:08 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:20:08.977717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:08.978608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:08.993289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.995505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:08.996893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:08.997854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:08.999792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:09.000839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:09.624912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:09.641166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09753258-6685-43b7-a5a2-6df430f7111b tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.662982 Sep 08 10:20:09.642909 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 795/1685] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:08 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:09.660211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:09.662383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:09.680572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:09.681073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:09.681516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:09.682236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:09.682848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:09.684045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:09.746282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:09.757264 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d727456-88b1-41d6-aaf7-8ad5d56a5db7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.991607 Sep 08 10:20:09.760411 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 891/1686] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:08 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:10.114200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.125485 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-591bef72-9472-4677-a15a-f221229627aa tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.476967 Sep 08 10:20:10.128941 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 796/1687] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:09 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:10.139765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:10.139765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:10.161702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.161702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.161702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.161702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.161702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.161702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.241071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.251920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.254951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.260312 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-47d325a4-a1d1-4b99-8785-7003825d3e5c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.130324 Sep 08 10:20:10.261254 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 797/1688] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:10 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:10.265841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:10.266453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:10.272473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.273243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.273894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.274893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.275555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.276161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.426430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-787081205", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:10.468448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.483344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.484827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.486428 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e579bfd-3e94-405c-ba99-e65b04ffd5d9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.223823 Sep 08 10:20:10.489276 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 798/1689] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:10 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:10.500053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-67113066-8291-481b-aa68-5c4081fcc2e0 req-7818659f-4370-426c-a212-f66986995f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf724fb-3d3b-4882-9345-ca56885f613f", "name": "network-vif-plugged", "status": "completed", "tag": "fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:10.514714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:20:10.515143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-67113066-8291-481b-aa68-5c4081fcc2e0 req-7818659f-4370-426c-a212-f66986995f6a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.515676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-67113066-8291-481b-aa68-5c4081fcc2e0 req-7818659f-4370-426c-a212-f66986995f6a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.516107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-67113066-8291-481b-aa68-5c4081fcc2e0 req-7818659f-4370-426c-a212-f66986995f6a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.540425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-67113066-8291-481b-aa68-5c4081fcc2e0 req-7818659f-4370-426c-a212-f66986995f6a service nova] Creating event network-vif-plugged:fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d for instance 5bf724fb-3d3b-4882-9345-ca56885f613f on n-h2-833090-19 Sep 08 10:20:10.547414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-67113066-8291-481b-aa68-5c4081fcc2e0 req-7818659f-4370-426c-a212-f66986995f6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053028 Sep 08 10:20:10.551807 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 799/1690] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:10.666244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:10.666945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:10.679697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.688681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.689650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.690610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.691341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.693031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.939326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:10.947867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d7aad74-4824-463f-92dc-a55a019e3a16 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.286206 Sep 08 10:20:10.954788 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 800/1691] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:10 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:10.971022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:10.971927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:10.978413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.979110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.979814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:10.980770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:10.981384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:10.981966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.071713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:20:11.072320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:20:11.072963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:20:11.073590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:20:11.074729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:20:11.095497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.097239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.097696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.098451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.098916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.099349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.122028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Getting quotas for project 0ad2b637afd44869ba29070b2ad92f98. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:11.131574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Getting quotas for user ddc1e291586e46adb2e198b0668953c4 and project 0ad2b637afd44869ba29070b2ad92f98. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:11.149429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:20:11.152192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:20:11.236302 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6811bc28-eeb5-465b-9313-fd2558f7d1e2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473452 Sep 08 10:20:11.237605 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 892/1692] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:20:11.251595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:11.253360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:11.266097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.266597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.267031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.267984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.268649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.271790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.278224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.299405 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d46a5d44-578d-48d7-8a42-03f08f6e4530 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.343408 Sep 08 10:20:11.302484 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 801/1693] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:10 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:11.316675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27aa063a-f17c-4aa9-9c6b-37425139bb00 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:11.320577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27aa063a-f17c-4aa9-9c6b-37425139bb00 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:11.482484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27aa063a-f17c-4aa9-9c6b-37425139bb00 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.491200 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27aa063a-f17c-4aa9-9c6b-37425139bb00 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1216 microversion: 2.1 time: 0.187615 Sep 08 10:20:11.494919 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 802/1694] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:11 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:11.503055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:11.504753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:11.528583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.529426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.529965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.530714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.531371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.531994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.552604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.564533 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca1800b5-1432-4e8a-bbf2-130c35b8244c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.325592 Sep 08 10:20:11.565138 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 893/1695] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:11 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:11.580604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:11.583775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:11.604618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.605848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.606226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.609237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:11.611009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:11.611487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:11.700708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.723365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.726649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.742263 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e262d72c-7892-4262-81a7-66399e74aed7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.246129 Sep 08 10:20:11.747426 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 803/1696] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:11 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:11.910671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.921485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.923222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:11.925074 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef8644f4-e9d3-4bef-bd1b-6f0f594781cd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.358510 Sep 08 10:20:11.926070 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 894/1697] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:11 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:11.974086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d5bbbbd-4d47-4f4b-9000-b4a87bb16855 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f23554c5040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:11.986638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:11.987270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:12.005608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.006382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.006848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.007641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.008175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.008759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.057634 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d5bbbbd-4d47-4f4b-9000-b4a87bb16855 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba" status: 200 len: 637 microversion: 2.1 time: 0.089898 Sep 08 10:20:12.063958 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 804/1698] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:11 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba => generated 637 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:12.074014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17cd65c1-541e-4516-b7ac-482910dddf96 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f23554bc790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:12.152284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-17cd65c1-541e-4516-b7ac-482910dddf96 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:12.163668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-17cd65c1-541e-4516-b7ac-482910dddf96 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:12.247555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:12.259159 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-019227fe-d9ec-4d0d-b685-26f39d92a6d8 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.279185 Sep 08 10:20:12.259960 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 895/1699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:11 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:12.339212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:12.340997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:12.354076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.354839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.355934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.356964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.357708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.358325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.595910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:12.606796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f31a18c4-6a36-455b-94ef-07d10887e1bb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1316 microversion: 2.1 time: 0.284217 Sep 08 10:20:12.607977 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 896/1700] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:12 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:12.612982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:12.613847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:12.622330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.623248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.623678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.624398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.624855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.625493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.764213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:12.777958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef8217bb-1cae-46a2-928b-2dd15a6981f6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1268 microversion: 2.1 time: 0.168639 Sep 08 10:20:12.781198 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 897/1701] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:12 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:12.795368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:12.796276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:12.809984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.810489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.810935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.811722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.812196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.812755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.939009 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17cd65c1-541e-4516-b7ac-482910dddf96 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.869182 Sep 08 10:20:12.947669 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 805/1702] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:12 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:12.960344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:12.962215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:12.978902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.979429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.979918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:12.981449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:12.981993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:12.982909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.101092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.106975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.111676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.118212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:13.126404 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b3faa68-7527-4c36-bb99-a713de3f0d3d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.344043 Sep 08 10:20:13.128070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.133799 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 898/1703] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:12 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:13.141597 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02bd828a-f170-40d9-bd8b-919ad045055c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.190602 Sep 08 10:20:13.142424 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 806/1704] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:12 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:13.144599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8c42bc8-73b4-4d3c-bcd7-426a252c7b6c tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f2351d39160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:13.148329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:13.148950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:13.162012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:13.162506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:13.163129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.164038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:13.164660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:13.165279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.361744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.374181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.375808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.377322 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a7dae7c-9e17-47fc-9902-98fe3ad864c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.233956 Sep 08 10:20:13.378260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 807/1705] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:13 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:13.383259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:13.383937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:13.390851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:13.391729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:13.392494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.393427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:13.394144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:13.394782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.534077 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8c42bc8-73b4-4d3c-bcd7-426a252c7b6c tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "DELETE /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.398530 Sep 08 10:20:13.534723 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 899/1706] 10.222.0.59 () {58 vars in 1296 bytes} [Thu Sep 8 10:20:13 2022] DELETE /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata/os_version => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:20:13.544966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-118308b5-2197-49b6-b012-9871aff459ae tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f2351df89d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:13.607828 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-118308b5-2197-49b6-b012-9871aff459ae tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 37 microversion: 2.1 time: 0.068659 Sep 08 10:20:13.608474 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 900/1707] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:20:13 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 37 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:20:13.625146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d583d939-03ab-42e4-a42f-61a33849504e tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f2351d39c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:13.690255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d583d939-03ab-42e4-a42f-61a33849504e tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:13.696530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d583d939-03ab-42e4-a42f-61a33849504e tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:13.758462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:13.767800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:13.772188 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a129b146-c9d7-4278-b4e3-3c37ba7aa0a1 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.392665 Sep 08 10:20:13.779590 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 808/1708] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:13 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:13.788506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:13.789125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:13.805613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:13.806402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:13.806847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.807597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:13.808092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:13.808519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:13.999523 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d583d939-03ab-42e4-a42f-61a33849504e tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.384389 Sep 08 10:20:14.000136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 901/1709] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:13 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:20:14.005312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-55372857-a606-4726-b32e-0675689a9d62 req-e7c05c02-b2d5-4cfb-a20a-ddf9fe0b0474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8905d0-7692-4019-a143-f003ceeeeac0", "name": "network-vif-plugged", "status": "completed", "tag": "7f528c70-80b4-4ab4-9dcb-c1a7aaff9367"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:14.016112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-55372857-a606-4726-b32e-0675689a9d62 req-e7c05c02-b2d5-4cfb-a20a-ddf9fe0b0474 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.016595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-55372857-a606-4726-b32e-0675689a9d62 req-e7c05c02-b2d5-4cfb-a20a-ddf9fe0b0474 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.017083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-55372857-a606-4726-b32e-0675689a9d62 req-e7c05c02-b2d5-4cfb-a20a-ddf9fe0b0474 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.028765 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-55372857-a606-4726-b32e-0675689a9d62 req-e7c05c02-b2d5-4cfb-a20a-ddf9fe0b0474 service nova] Creating event network-vif-plugged:7f528c70-80b4-4ab4-9dcb-c1a7aaff9367 for instance ff8905d0-7692-4019-a143-f003ceeeeac0 on n-h1-833090-19 Sep 08 10:20:14.034772 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-55372857-a606-4726-b32e-0675689a9d62 req-e7c05c02-b2d5-4cfb-a20a-ddf9fe0b0474 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033121 Sep 08 10:20:14.035319 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 902/1710] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:14.041755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:14.043164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:14.050502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.050995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.051681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.053593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.054231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.054848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.093823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:14.107725 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ba4ade5-de1d-4285-9e31-a1f663619f1b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1504 microversion: 2.1 time: 0.323802 Sep 08 10:20:14.119946 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 809/1711] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:13 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:14.128297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb5799a6-0c55-4cca-bf01-822a738d03e1 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f23554c4b80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:14.182058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:14.194663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc4a85bc-acb0-483f-a823-b666c397b5d9 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1274 microversion: 2.1 time: 0.157872 Sep 08 10:20:14.198414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 903/1712] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:14 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:14.207103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb5799a6-0c55-4cca-bf01-822a738d03e1 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.092304 Sep 08 10:20:14.207872 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 810/1713] 10.222.0.59 () {58 vars in 1290 bytes} [Thu Sep 8 10:20:14 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata/os_distro => generated 33 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:14.215922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-479660469"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:14.217000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:14.218742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:14.219723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:14.230534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.230934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.231088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.231519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.231663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.232151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.232383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.232839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.233007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.233425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.233630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.233954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.584508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:14.595139 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Adding security group 8d19e16e-58ad-400e-972a-ad6659a76872 to port fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d Sep 08 10:20:14.595553 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-175dd3e8-308e-43db-a814-1042e60fbbf3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.385156 Sep 08 10:20:14.596459 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 811/1714] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:14 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:14.606984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:14.607622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:14.624433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.624926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.625360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.626354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.626845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.627283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.720269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:14.729951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:14.732094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:14.738120 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91a7c17d-753f-4591-b782-7e430f5f56e5 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.135749 Sep 08 10:20:14.738736 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 812/1715] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:14 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:14.743718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-433ee2cc-a708-4a3b-a06f-55196c2428b1 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f23554e7280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:14.801467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-433ee2cc-a708-4a3b-a06f-55196c2428b1 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:14.810475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-433ee2cc-a708-4a3b-a06f-55196c2428b1 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:14.975079 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-433ee2cc-a708-4a3b-a06f-55196c2428b1 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.234817 Sep 08 10:20:14.975875 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 813/1716] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:14 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:14.981941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:14.982770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:14.989876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.990707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.991156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:14.991911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:14.992367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:14.992797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:15.571641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:15.583314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:15.584779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:15.585960 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dbdfcdf9-6303-44af-8a8b-eaa353081e43 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.609130 Sep 08 10:20:15.599495 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 814/1717] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:14 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:15.599495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-785638738", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4a01de9c-22cd-443f-9615-bc8a1f2b2669"}], "block_device_mapping_v2": [{"uuid": "d81b2d73-15d9-40a3-aa74-8a83284cada4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:15.614204 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4dcc3bda-b8d3-4b1d-a4bd-58be953ddb99 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f/action" status: 202 len: 0 microversion: 2.1 time: 1.413815 Sep 08 10:20:15.616418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 904/1718] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:14 2022] POST /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f/action => generated 0 bytes in 1417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:15.629215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:15.630086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:15.641451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:15.642337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:15.643432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:15.645458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:15.645948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:15.647445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:15.690304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] validate_networks() for [('4a01de9c-22cd-443f-9615-bc8a1f2b2669', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:20:15.926728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:15.936045 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-247b8e4e-a201-47aa-923c-4ebcdd5e8994 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1313 microversion: 2.1 time: 0.312061 Sep 08 10:20:15.943111 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 905/1719] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:15 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:15.949096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29e3085c-bf33-47a7-873b-802058dd13a2 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f2351e3fdc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:15.997038 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29e3085c-bf33-47a7-873b-802058dd13a2 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.052170 Sep 08 10:20:15.997914 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 906/1720] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:20:15 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:16.003590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:16.004429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:16.015363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.016100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.016707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.017772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.018237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.018670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.224403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:16.233625 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a996329c-b8a6-4b8a-a766-8d0b1963e55b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.233918 Sep 08 10:20:16.247832 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 907/1721] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:15 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:16.253273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:16.254148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:16.260590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.261482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.261980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.262790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.263307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.263840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.391626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:20:16.392045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:20:16.392515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:20:16.392967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:20:16.393373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:20:16.402495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.402975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.403404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.404148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.404607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.405024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.422465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:16.422617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:16.427406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Getting quotas for user 46a59f79e24b4644a167dc0a4d2c4af9 and project e0721ab63dc349cb99bdb42d4c5e1732. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:16.430367 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14ac4a00-0b3a-4d56-afbf-474a807d7e37 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.181231 Sep 08 10:20:16.430924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 908/1722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:16 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:16.435399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2e3a8f27-52f7-4ee4-9186-0fa398581eb0 req-99b0065f-38ae-4614-b2ff-76bb614394d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf724fb-3d3b-4882-9345-ca56885f613f", "tag": "fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:16.444795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2e3a8f27-52f7-4ee4-9186-0fa398581eb0 req-99b0065f-38ae-4614-b2ff-76bb614394d2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.445276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2e3a8f27-52f7-4ee4-9186-0fa398581eb0 req-99b0065f-38ae-4614-b2ff-76bb614394d2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.445704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2e3a8f27-52f7-4ee4-9186-0fa398581eb0 req-99b0065f-38ae-4614-b2ff-76bb614394d2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.458669 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2e3a8f27-52f7-4ee4-9186-0fa398581eb0 req-99b0065f-38ae-4614-b2ff-76bb614394d2 service nova] Creating event network-changed:fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d for instance 5bf724fb-3d3b-4882-9345-ca56885f613f on n-h2-833090-19 Sep 08 10:20:16.464603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2e3a8f27-52f7-4ee4-9186-0fa398581eb0 req-99b0065f-38ae-4614-b2ff-76bb614394d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032026 Sep 08 10:20:16.465554 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 909/1723] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:16.470893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-558831915"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:16.471539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:16.477837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.478323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.478757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.479451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.480521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.480946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.492495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:20:16.494624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d81b2d73-15d9-40a3-aa74-8a83284cada4',volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:20:16.595206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:16.633468 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec5fb83c-d6c1-4772-94b8-b73f6f2ded4e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044733 Sep 08 10:20:16.634596 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 815/1724] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:20:16.641621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:16.642512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:16.654094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.655361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.655529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.656255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:16.656958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:16.657398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:16.704643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Adding security group ad1f3c50-10d5-471e-9d97-0807be70a8fb to port fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d Sep 08 10:20:16.758831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:16.770653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:16.770653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:16.777475 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b264312-9183-45b8-9b17-561c9edcf4a8 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1446 microversion: 2.75 time: 0.141022 Sep 08 10:20:16.778870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 816/1725] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:16 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:16.789540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a8330de6-62cd-4ec2-a12a-bfbe1174ef5f tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f2351204940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:16.861703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a8330de6-62cd-4ec2-a12a-bfbe1174ef5f tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:16.866434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a8330de6-62cd-4ec2-a12a-bfbe1174ef5f tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:17.072245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a8330de6-62cd-4ec2-a12a-bfbe1174ef5f tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.290360 Sep 08 10:20:17.072752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 817/1726] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:16 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:17.077948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9dbb239c-a2f4-4d0f-a612-c778c176d883 req-3f530f8f-ac09-47b0-90c6-9432f33b3b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "name": "network-vif-plugged", "status": "completed", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:17.095358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9dbb239c-a2f4-4d0f-a612-c778c176d883 req-3f530f8f-ac09-47b0-90c6-9432f33b3b5d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.096247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9dbb239c-a2f4-4d0f-a612-c778c176d883 req-3f530f8f-ac09-47b0-90c6-9432f33b3b5d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.096997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9dbb239c-a2f4-4d0f-a612-c778c176d883 req-3f530f8f-ac09-47b0-90c6-9432f33b3b5d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.112783 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9dbb239c-a2f4-4d0f-a612-c778c176d883 req-3f530f8f-ac09-47b0-90c6-9432f33b3b5d service nova] Creating event network-vif-plugged:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h2-833090-19 Sep 08 10:20:17.121156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9dbb239c-a2f4-4d0f-a612-c778c176d883 req-3f530f8f-ac09-47b0-90c6-9432f33b3b5d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046481 Sep 08 10:20:17.121595 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 818/1727] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:17.130705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:17.131719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:17.139174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.139689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.140313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.141211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.141827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.142308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.547671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:17.556925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:17.559307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:17.560577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ba126a0-fd6c-4747-9bfe-f6c9ee3018a6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.434212 Sep 08 10:20:17.561146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 819/1728] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:17 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:17.576074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:17.576691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:17.582581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.583060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.583516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.584219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.584673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.585798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.688244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:17.696726 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-878fb506-71fd-471c-a5e9-2695d1c25cfd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1094 microversion: 2.1 time: 0.134561 Sep 08 10:20:17.697303 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 820/1729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:17 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:17.701731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:17.702328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:17.708187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.708669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.709110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.710356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:17.710816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:17.711235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:17.803527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00abe88a-bfdd-41b8-a4f3-44468f4d4bff tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f/action" status: 202 len: 0 microversion: 2.1 time: 1.334430 Sep 08 10:20:17.803527 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 910/1730] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:16 2022] POST /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f/action => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:17.808394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-347b14a3-640c-4271-975d-e402ce5f0da5 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f23512901f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:17.863641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-347b14a3-640c-4271-975d-e402ce5f0da5 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:17.868771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-347b14a3-640c-4271-975d-e402ce5f0da5 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:18.078891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:18.090310 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2e0b5cba-a532-410e-96c4-bb867e5f76bd tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1462 microversion: 2.1 time: 0.390750 Sep 08 10:20:18.091262 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 821/1731] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:17 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1462 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:18.098105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.098984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:18.108168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.109539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.111535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.112501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.113683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.114340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.239893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-347b14a3-640c-4271-975d-e402ce5f0da5 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 64 microversion: 2.1 time: 0.436169 Sep 08 10:20:18.240711 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 911/1732] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:17 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 64 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:18.247954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.248935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:18.255576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.256062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.256816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.257696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.258148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.258732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.402211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:18.410664 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-497db1f0-8711-42f9-bfb2-7579c6296414 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.317127 Sep 08 10:20:18.411002 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 822/1733] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:18.417657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.418272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:18.425706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.426279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.426785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.428523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.429075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.429913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.601817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:18.610443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:18.611362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:18.618902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b4ae879-9ee5-4b49-8e87-ec3d3f7d628f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1313 microversion: 2.1 time: 0.375881 Sep 08 10:20:18.619053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:18.619511 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 912/1734] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:18.624487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.624970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:18.631136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.631684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.632127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.632822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.633444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.634077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.640263 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-90e8aa17-f7c5-412f-9378-3e4e6e0b9a25 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1452 microversion: 2.75 time: 0.227970 Sep 08 10:20:18.641088 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 823/1735] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:18.790729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a18cdc5-b1ca-41d4-b01a-119144c46124 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.169979 Sep 08 10:20:18.791373 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 913/1736] 10.222.0.59 () {58 vars in 1293 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f/os-security-groups => generated 1156 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:18.796575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60cdb838-2746-4688-b56b-3848bc0389c7 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f235207f1f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.842093 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60cdb838-2746-4688-b56b-3848bc0389c7 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 64 microversion: 2.1 time: 0.049112 Sep 08 10:20:18.842660 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 914/1737] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 64 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:18.847331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf724fb-3d3b-4882-9345-ca56885f613f", "tag": "fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d"}, {"name": "network-changed", "server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:18.854553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:18.860524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Calling method '.version_select at 0x7f23554c4b80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.861077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.861194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.861529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.872369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.872831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.873266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.874145 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] Creating event network-changed:fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d for instance 5bf724fb-3d3b-4882-9345-ca56885f613f on n-h2-833090-19 Sep 08 10:20:18.874655 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] Creating event network-changed:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:20:18.882768 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2cb31058-f8bf-4237-a927-b6ffaeee9036 req-0a9aa199-75ea-4095-8eda-c4c449170746 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038856 Sep 08 10:20:18.883372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 915/1738] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:18.889870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.890569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:18.891343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.891859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.892298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.896763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.897243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.897678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.898374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.898836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.899267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.911055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0aef4701-e096-44b4-94ea-b0d9dcafe2bf tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/938adcc0d60d4898b7ce601ac6e1ea90?start=2022-09-07T10%3A20%3A18.110646&end=2022-09-09T10%3A20%3A18.110646" status: 200 len: 694 microversion: 2.1 time: 0.253079 Sep 08 10:20:18.911675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 824/1739] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/os-simple-tenant-usage/938adcc0d60d4898b7ce601ac6e1ea90?start=2022-09-07T10%3A20%3A18.110646&end=2022-09-09T10%3A20%3A18.110646 => generated 694 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:18.916174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:18.916781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:18.924193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.924689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.925234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:18.925832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:18.926289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:18.926720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.003454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:19.012183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-caf4307a-acea-4d05-a2e0-364b8c7cc07a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1150 microversion: 2.1 time: 0.099476 Sep 08 10:20:19.012989 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 825/1740] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:19.023586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1a21dbab-2b97-42ca-8c6a-92a81b079748 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f2351758670>, body: {"security_group": {"name": " tempest-securitygroup -1270454654 ", "description": "tempest-description-135905225"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:19.086315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:19.095544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:19.097067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:19.098321 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a353eb3-0d2b-4cb2-b20a-027553c42f28 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.213815 Sep 08 10:20:19.098895 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 916/1741] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:18 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:19.104059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82f24951-78f9-4fa9-b472-98d2412d2b97 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f235161e700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:19.170951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-82f24951-78f9-4fa9-b472-98d2412d2b97 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:19.176451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-82f24951-78f9-4fa9-b472-98d2412d2b97 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:19.271167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1a21dbab-2b97-42ca-8c6a-92a81b079748 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.251183 Sep 08 10:20:19.271644 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 826/1742] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:20:19 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:19.276857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '.version_select at 0x7f23554c4940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:19.295863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:19.296581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:19.298197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.310688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:19.311770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:19.312398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.326341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5dbba467-83f1-49cd-b2e7-3876d55bdc7d tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/938adcc0d60d4898b7ce601ac6e1ea90?start=2022-09-07T10%3A20%3A18.110646&end=2022-09-09T10%3A20%3A18.110646" status: 200 len: 690 microversion: 2.1 time: 0.053465 Sep 08 10:20:19.326991 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 827/1743] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Sep 8 10:20:19 2022] GET /compute/v2.1/os-simple-tenant-usage/938adcc0d60d4898b7ce601ac6e1ea90?start=2022-09-07T10%3A20%3A18.110646&end=2022-09-09T10%3A20%3A18.110646 => generated 690 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:19.332315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c29412ec-dd94-4975-b760-8b4ccf1b06b0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2355415dc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:19.448052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c29412ec-dd94-4975-b760-8b4ccf1b06b0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d" status: 200 len: 223 microversion: 2.1 time: 0.119448 Sep 08 10:20:19.450085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 828/1744] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:20:19 2022] GET /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d => generated 223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:19.455311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Calling method '.version_select at 0x7f2355415160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:19.466358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:19.467108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:19.467775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.489534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:19.489816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:19.490159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.610083 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82f24951-78f9-4fa9-b472-98d2412d2b97 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.510098 Sep 08 10:20:19.616360 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58fc1037-7d18-4525-b9c8-f8115edb1249 tempest-TenantUsagesTestJSON-2140257065 tempest-TenantUsagesTestJSON-2140257065-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A20%3A18.110646&end=2022-09-09T10%3A20%3A18.110646&detailed=1" status: 200 len: 16140 microversion: 2.1 time: 0.163441 Sep 08 10:20:19.616555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 829/1745] 10.222.0.59 () {58 vars in 1335 bytes} [Thu Sep 8 10:20:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A20%3A18.110646&end=2022-09-09T10%3A20%3A18.110646&detailed=1 => generated 16140 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:19.617280 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 917/1746] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:19 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:19.621927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:19.622530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:19.623134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ffbcdad3-b27a-44d5-9c42-4478b7d2b578 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f235140d790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:19.628626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:19.629108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:19.629536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.630221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:19.630809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:19.631236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:19.992558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:20.001374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db8bf30e-ccbb-42d5-8ba8-0faff9fa3a5f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.383437 Sep 08 10:20:20.003498 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 830/1747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:19 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:20.007939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20b6c5d9-ec41-47a7-a6ee-a59a0addbe58 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update', calling method: .version_select at 0x7f235540f1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:20.078322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-20b6c5d9-ec41-47a7-a6ee-a59a0addbe58 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:20.083418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-20b6c5d9-ec41-47a7-a6ee-a59a0addbe58 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:20.167612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ffbcdad3-b27a-44d5-9c42-4478b7d2b578 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d" status: 202 len: 0 microversion: 2.1 time: 0.548235 Sep 08 10:20:20.168344 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 918/1748] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:20:19 2022] DELETE /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:20.176602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:20.177221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:20.188409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.190043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.190487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.191206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.192452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.192890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.440702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20b6c5d9-ec41-47a7-a6ee-a59a0addbe58 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.437400 Sep 08 10:20:20.441691 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 831/1749] 10.222.0.59 () {60 vars in 1313 bytes} [Thu Sep 8 10:20:20 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata/os_version => generated 31 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:20.446523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:20.446931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:20.453537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.454027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.454464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.455177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.455653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.456348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.486518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:20:20.577881 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e268db2-344d-4e13-8a5e-8c7c774f5303 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 204 len: 0 microversion: 2.1 time: 0.134487 Sep 08 10:20:20.582224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 832/1750] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:20:20 2022] DELETE /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:20:20.589250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:20.589963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:20.597341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.598077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.598517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.599662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.599993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.600417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.607774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:20.855944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:20.876682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:20.878331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:20.884138 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f115b4e-8bc5-447b-b146-a70e5047f479 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1452 microversion: 2.75 time: 0.300421 Sep 08 10:20:20.898911 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 833/1751] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:20 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1452 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:20.898911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-43cf5fae-c65c-4c34-837d-46280b84aa36 req-781d0a69-c2ea-4c46-96e4-e48feb4a8dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7265635f-ed38-4363-84e1-d4f53815fb77", "name": "network-vif-unplugged", "status": "completed", "tag": "d0564e9f-ad94-40f2-a233-8c2e9ea93b6a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:20.914653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43cf5fae-c65c-4c34-837d-46280b84aa36 req-781d0a69-c2ea-4c46-96e4-e48feb4a8dc4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.927176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43cf5fae-c65c-4c34-837d-46280b84aa36 req-781d0a69-c2ea-4c46-96e4-e48feb4a8dc4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.928345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43cf5fae-c65c-4c34-837d-46280b84aa36 req-781d0a69-c2ea-4c46-96e4-e48feb4a8dc4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.942663 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-43cf5fae-c65c-4c34-837d-46280b84aa36 req-781d0a69-c2ea-4c46-96e4-e48feb4a8dc4 service nova] Creating event network-vif-unplugged:d0564e9f-ad94-40f2-a233-8c2e9ea93b6a for instance 7265635f-ed38-4363-84e1-d4f53815fb77 on n-h2-833090-19 Sep 08 10:20:20.948337 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-43cf5fae-c65c-4c34-837d-46280b84aa36 req-781d0a69-c2ea-4c46-96e4-e48feb4a8dc4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062178 Sep 08 10:20:20.949258 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 834/1752] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:20.954711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:20.955564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:20.961958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.962603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.963133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.965498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:20.966166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:20.966705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:20.987129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:20.994956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4f04f21-3bba-4f04-96dd-396d37093300 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1463 microversion: 2.1 time: 0.822480 Sep 08 10:20:20.995820 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 919/1753] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:20 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1463 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:21.004603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:21.005764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:21.013209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.013932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.014373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.015085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.015564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.016203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.047820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.057930 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca24168d-ede3-425f-8382-8e9af70b96a2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1158 microversion: 2.1 time: 0.107479 Sep 08 10:20:21.059437 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 835/1754] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:20 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1158 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:21.064535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23554c5430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:21.108509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:20:21.109161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.security_group_api [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 7b34d62d-287a-4325-92c3-4de4ef9a332d not found {{(pid=122456) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:20:21.109815 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.109815 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] Sep 08 10:20:21.111227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d HTTP/1.1 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: exception: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7b34d62d-287a-4325-92c3-4de4ef9a332d'} Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:20:21.112779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-202f9a15-1de8-44c7-a62f-ea879900d612'] {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:21.117933 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c63d2c2-7d44-40f7-b9e3-2e0d4800f94a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d" status: 404 len: 194 microversion: 2.1 time: 0.053824 Sep 08 10:20:21.121454 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 836/1755] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:20:21 2022] GET /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:20:21.125251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c47787ae-b516-45de-ba38-45a6fafb5948 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f23554c4550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:21.169579 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c47787ae-b516-45de-ba38-45a6fafb5948 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 58 microversion: 2.1 time: 0.048439 Sep 08 10:20:21.169996 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 837/1756] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:20:21 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 58 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:21.174934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:21.175907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:21.182230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.182763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.183211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.183959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.184422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.184853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.194399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.204109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.205831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.207227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61c532c2-ce48-4303-8890-08ac3e3ac75f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.210331 Sep 08 10:20:21.208170 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 920/1757] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:20 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:21.217297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:21.218328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:21.225748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.226663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.230501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.231328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.231851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.232284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.361096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.369454 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec2793f2-bb38-4ebd-aa6b-f770a599ab38 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1468 microversion: 2.1 time: 0.198256 Sep 08 10:20:21.380345 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 838/1758] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:21 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:21.387716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:21.388343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:21.394010 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7caad12-d9f9-4322-b6be-769224e51937 tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1616 microversion: 2.1 time: 0.181312 Sep 08 10:20:21.394531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.394673 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 921/1759] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:21 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1616 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:21.395347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.395976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.396683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.397311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.397741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.405406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18a44af8-3bed-4623-b272-fc5696b541cb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f23516f71f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-834835510", "description": "tempest-description-283191903"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:21.586441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.596896 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3bb4f89-7aa9-4e84-8853-04388020ff1d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.214934 Sep 08 10:20:21.597490 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 839/1760] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:21 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:21.602669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50a2a709-8e46-4ecd-9569-d1707fd1d35b tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'update_all', calling method: .version_select at 0x7f235540f940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:21.659069 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18a44af8-3bed-4623-b272-fc5696b541cb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.263426 Sep 08 10:20:21.660264 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 922/1761] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:20:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:21.666634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-50a2a709-8e46-4ecd-9569-d1707fd1d35b tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:21.674435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:21.674848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:21.675028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-50a2a709-8e46-4ecd-9569-d1707fd1d35b tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:21.681967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.682575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.683069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.683877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:21.684342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:21.684775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:21.773238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '618a90a225464fd7a022f255ba971864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2517430e01d84442acc0384598fb5e63', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:21.773829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] flavor_id is None. Assuming migration. {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 10:20:21.774268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:20:21.946263 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50a2a709-8e46-4ecd-9569-d1707fd1d35b tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 61 microversion: 2.1 time: 0.347355 Sep 08 10:20:21.946948 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 840/1762] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:20:21 2022] PUT /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 61 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:21.952757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d0c3f22-a226-4870-98dd-4e214fab7112 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f235540f430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-225735451", "description": "tempest-description-1141965727"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:22.103283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8a56352-64c6-44dd-ae4c-9d1106969cbb tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23/action" status: 202 len: 0 microversion: 2.1 time: 0.440767 Sep 08 10:20:22.104088 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 923/1763] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:21 2022] POST /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:22.109458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:22.110277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:22.117424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.117924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.118408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.119266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.119767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.121514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.231752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d0c3f22-a226-4870-98dd-4e214fab7112 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.283545 Sep 08 10:20:22.240108 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 841/1764] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:20:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:22.245436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a09ea73f-3203-4031-94e0-dcb194aff277 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Action: 'create', calling method: .version_select at 0x7f23553f9670>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:22.310751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a09ea73f-3203-4031-94e0-dcb194aff277 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:22.318063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a09ea73f-3203-4031-94e0-dcb194aff277 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Getting quotas for user 3a05aaa85f334a1f852c28b9d6618bf8 and project 1c938b726d4a4bb38111bf6a974b3bc3. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:22.322581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:22.332137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:22.333711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:22.341391 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce9e1447-fd5e-412f-a78c-36ff2260c0b7 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1437 microversion: 2.75 time: 0.236157 Sep 08 10:20:22.343167 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 924/1765] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:22 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1437 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:22.348868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:22.349701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:22.362402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.362972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.363499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.364512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.365249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.366213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.434378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:22.438985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:22.444390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8745420d-2ced-42fd-ba96-ea1dd75313ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1168 microversion: 2.1 time: 0.099917 Sep 08 10:20:22.445023 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 925/1766] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:22 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1168 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:22.450903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:22.451717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:22.458874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.459714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.460443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.461740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.462199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.462612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.816765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:22.826089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9ded34d5-b985-4196-9c88-9251d2673782 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1472 microversion: 2.1 time: 0.379647 Sep 08 10:20:22.841659 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 926/1767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:22 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1472 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:22.859492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:22.860434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:22.868953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.869727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.870928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.871853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:22.872476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:22.873367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:22.888259 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a09ea73f-3203-4031-94e0-dcb194aff277 tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "POST /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 85 microversion: 2.1 time: 0.654600 Sep 08 10:20:22.889338 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 842/1768] 10.222.0.59 () {60 vars in 1281 bytes} [Thu Sep 8 10:20:22 2022] POST /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 85 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:22.893915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2497037-f1bb-4184-a6b2-4a930bdbb1b3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f23553f9ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-580221995", "description": "tempest-description-1342130919"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:23.140940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:23.157789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:23.162079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:23.163660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b5855bf-2e4d-4f66-bbca-bdc8a208baeb tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.320895 Sep 08 10:20:23.173237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 927/1769] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:22 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:23.232386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2497037-f1bb-4184-a6b2-4a930bdbb1b3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.342269 Sep 08 10:20:23.233865 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 843/1770] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:20:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:23.245899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:23.247185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:23.257863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.263037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.263899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.264899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.265588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.269678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.439936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:23.443941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:23.451626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.452135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.452677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.454100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.454561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.454986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.507906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:23.537852 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b020278e-b4f8-4410-9df0-d8b5a283ab7e tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1468 microversion: 2.1 time: 0.300720 Sep 08 10:20:23.538505 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 844/1771] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:23 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:23.557744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:23.568436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:23.578029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:20:23.578426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:20:23.578894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:20:23.579305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:20:23.579748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:20:23.585167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.586927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.587380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.588139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.592904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.593756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.717123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:23.724781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.725282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.725718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.727762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:23.728422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:23.729024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:23.874828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:23.888771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6542cb31-d924-479a-b98f-e8f8b2a32277 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.346469 Sep 08 10:20:23.909173 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 845/1772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:23 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:23.921307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62f8cbfa-80c2-4d22-9739-b164170d61fc tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] Calling method '.version_select at 0x7f2355415820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:23.966093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:23.987558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62f8cbfa-80c2-4d22-9739-b164170d61fc tempest-ImagesMetadataTestJSON-1347987528 tempest-ImagesMetadataTestJSON-1347987528-project] 10.222.0.59 "GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata" status: 200 len: 85 microversion: 2.1 time: 0.076143 Sep 08 10:20:23.988234 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 846/1773] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:20:23 2022] GET /compute/v2.1/images/25f98736-f020-421c-ab35-899d7e1d9bba/metadata => generated 85 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:23.992928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1ba43ee1-c503-45d1-a33b-2587730521d0 req-1c29e6c2-abfc-4f0c-bb40-07c477d4c15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7265635f-ed38-4363-84e1-d4f53815fb77", "tag": "d0564e9f-ad94-40f2-a233-8c2e9ea93b6a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:24.003641 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-26eddc9a-ab64-4bfb-8720-3e18c47c00b1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5/action" status: 202 len: 1942 microversion: 2.75 time: 0.828892 Sep 08 10:20:24.004823 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 928/1774] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:20:23 2022] POST /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5/action => generated 1942 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:20:24.005691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ba43ee1-c503-45d1-a33b-2587730521d0 req-1c29e6c2-abfc-4f0c-bb40-07c477d4c15f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:24.007416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ba43ee1-c503-45d1-a33b-2587730521d0 req-1c29e6c2-abfc-4f0c-bb40-07c477d4c15f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:24.008060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ba43ee1-c503-45d1-a33b-2587730521d0 req-1c29e6c2-abfc-4f0c-bb40-07c477d4c15f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:24.021039 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1ba43ee1-c503-45d1-a33b-2587730521d0 req-1c29e6c2-abfc-4f0c-bb40-07c477d4c15f service nova] Creating event network-changed:d0564e9f-ad94-40f2-a233-8c2e9ea93b6a for instance 7265635f-ed38-4363-84e1-d4f53815fb77 on n-h2-833090-19 Sep 08 10:20:24.023528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81d42c9f-32a1-4cd0-8aeb-722a218afa5c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23515e4dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:24.026911 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1ba43ee1-c503-45d1-a33b-2587730521d0 req-1c29e6c2-abfc-4f0c-bb40-07c477d4c15f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037076 Sep 08 10:20:24.029036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 847/1775] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:24.041148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:24.042842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:24.067617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:24.068631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:24.069286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:24.070232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:24.070734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:24.071127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:24.742044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:24.758015 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5059066a-e4e2-41b7-9493-699fb704e034 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1210 microversion: 2.1 time: 0.724720 Sep 08 10:20:24.758631 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 848/1776] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:24 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1210 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:24.771280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:24.776545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:24.792416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:24.794226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:24.795759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:24.797131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:24.798553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:24.799330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.159218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81d42c9f-32a1-4cd0-8aeb-722a218afa5c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.153179 Sep 08 10:20:25.160268 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 929/1777] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:20:24 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:25.174483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:25.175359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:25.195752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.196260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.196709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.197436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.198467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.198906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.209757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:25.223283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f82cef5d-3594-4ad2-90bb-2a715c1b0fa9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1472 microversion: 2.1 time: 0.461313 Sep 08 10:20:25.225772 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 849/1778] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:24 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:25.253228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:25.256132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:25.273798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.274305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.275073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.275510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.276037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.276475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.391054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:25.443277 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b2b40a8-5070-425b-b9a6-59e671ff0729 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.281364 Sep 08 10:20:25.461012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 930/1779] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:25 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:25.461012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:25.461012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:25.464929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.465796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.466518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.467562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.468240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.468888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.531239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.531886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.532337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.533295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lazy-loading 'fault' on Instance uuid ff8905d0-7692-4019-a143-f003ceeeeac0 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:25.610760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5540d4b8c8fc495587d90f52090174e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938adcc0d60d4898b7ce601ac6e1ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:25.624239 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3bff6e0c-97ed-4a52-b1cc-190a080c9ba5 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 200 len: 1303 microversion: 2.1 time: 0.170498 Sep 08 10:20:25.625562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 931/1780] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:25 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:25.632757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:25.633785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:25.649078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.652717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.653990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:25.654171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.655539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:25.657296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:25.658217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:25.680244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:25.682143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:25.683387 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-733a77f1-b661-41d2-bdca-062c685794d8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.456297 Sep 08 10:20:25.684003 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 850/1781] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:25 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:25.702011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0b1d1f5-de4f-405d-a457-55d56aca7948 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f235540fee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.030784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:26.048170 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e3039560-4ad9-4263-bf19-632b2227c7c8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.418662 Sep 08 10:20:26.064123 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 932/1782] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:25 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:26.070301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.070927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:26.085539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.086042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.086483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.087201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.087707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.088121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.318508 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0b1d1f5-de4f-405d-a457-55d56aca7948 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd" status: 202 len: 0 microversion: 2.1 time: 0.633409 Sep 08 10:20:26.322274 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 851/1783] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:20:25 2022] DELETE /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:26.324298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8905d0-7692-4019-a143-f003ceeeeac0", "name": "network-vif-deleted", "tag": "7f528c70-80b4-4ab4-9dcb-c1a7aaff9367"}, {"name": "network-changed", "server_uuid": "a63066b7-480f-4376-94da-0fccd625bf8e", "tag": "3cb48e05-a1a1-4d09-961c-be42377068c3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:26.346644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:26.349187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.349676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.350110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.355498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a53f79a-a98f-4b93-8643-bcf355a70114 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1210 microversion: 2.1 time: 0.294070 Sep 08 10:20:26.364363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 933/1784] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1210 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:26.369510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.370675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:26.377056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.377793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.378229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.378989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.379625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.380417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.396419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] Creating event network-vif-deleted:7f528c70-80b4-4ab4-9dcb-c1a7aaff9367 for instance ff8905d0-7692-4019-a143-f003ceeeeac0 on n-h1-833090-19 Sep 08 10:20:26.397166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] Creating event network-changed:3cb48e05-a1a1-4d09-961c-be42377068c3 for instance a63066b7-480f-4376-94da-0fccd625bf8e on n-h1-833090-19 Sep 08 10:20:26.406356 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f12ceb68-e217-4127-9b5d-30bc163b34f0 req-da18c5bc-f331-4b6e-a52c-1371b09a40e9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.085295 Sep 08 10:20:26.406588 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 852/1785] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:26.423887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23553dfa60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.487844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:20:26.489923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.security_group_api [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 58526712-7abf-4d74-8216-fe45b967dbfd not found {{(pid=122456) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:20:26.490870 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.490870 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd HTTP/1.1 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: exception: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '58526712-7abf-4d74-8216-fe45b967dbfd'} Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:20:26.493669 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-eb62eec3-f8ce-4af3-a297-57d3cc2019d5'] {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a65ad9d-8870-4e3f-b53c-01c6296b106e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd" status: 404 len: 194 microversion: 2.1 time: 0.086928 Sep 08 10:20:26.500380 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 853/1786] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:20:26.512591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39fdb331-cbf4-4d51-aba9-25e4d0ce120c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23554151f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.624692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:26.657185 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6877307d-8d42-4315-8337-c6496ae47eaf tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1472 microversion: 2.1 time: 0.291579 Sep 08 10:20:26.657813 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 934/1787] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1472 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:26.680768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.682584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:26.690330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.691050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.692012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.692915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.693543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.694709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.891197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:26.921674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-538e2290-aa7f-4040-82df-336fda1e9e1b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.246246 Sep 08 10:20:26.923009 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 935/1788] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:26.929491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:26.930501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] [instance: ff8905d0-7692-4019-a143-f003ceeeeac0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:26.937848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.939522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.940240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.944540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:26.945110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:26.945882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:26.985080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] HTTP exception thrown: Instance ff8905d0-7692-4019-a143-f003ceeeeac0 could not be found. Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Request method failure captured: Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 HTTP/1.1 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHHoey0hTF-oMu2VJwCEY3VO1O5LIe75jlY7ehczAHYsbawyFHBocb4QjLBU2K1jB51JuHc_L5jLAz9UimOLjF5u5H3G1ZuWNiqntWccq0LBhsi8iJQpgDSzYQFTNcdgf2rJzcsWYvTzxXMf1_WDx59EukanNYcbdQLU2FXKUtEVwI Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 938adcc0d60d4898b7ce601ac6e1ea90 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TenantUsagesTestJSON-1194976440 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/938adcc0d60d4898b7ce601ac6e1ea90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/938adcc0d60d4898b7ce601ac6e1ea90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/938adcc0d60d4898b7ce601ac6e1ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_938adcc0d60d4898b7ce601ac6e1ea90", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TenantUsagesTestJSON-1194976440 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 938adcc0d60d4898b7ce601ac6e1ea90 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1194976440 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TenantUsagesTestJSON-1194976440-project Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5540d4b8c8fc495587d90f52090174e0 Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TenantUsagesTestJSON-1194976440-project Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ff8905d0-7692-4019-a143-f003ceeeeac0 could not be found. Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ff8905d0-7692-4019-a143-f003ceeeeac0'} Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8905d0-7692-4019-a143-f003ceeeeac0 could not be found. Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8905d0-7692-4019-a143-f003ceeeeac0 could not be found. Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:26.987394 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8905d0-7692-4019-a143-f003ceeeeac0 could not be found. Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] Returning 404 to user: Instance ff8905d0-7692-4019-a143-f003ceeeeac0 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe13c17e-9b49-4964-b1c0-ace731bb0e65 tempest-TenantUsagesTestJSON-1194976440 tempest-TenantUsagesTestJSON-1194976440-project] 10.222.0.59 "GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0" status: 404 len: 111 microversion: 2.1 time: 0.064528 Sep 08 10:20:26.991806 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 936/1789] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/servers/ff8905d0-7692-4019-a143-f003ceeeeac0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:20:26.993849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39fdb331-cbf4-4d51-aba9-25e4d0ce120c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c" status: 202 len: 0 microversion: 2.1 time: 0.491840 Sep 08 10:20:26.998426 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 854/1790] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:20:26 2022] DELETE /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:27.011195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23554e7940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:27.028784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:27.030114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:27.048066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:27.048066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:27.048066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:27.048066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:27.048066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:27.048066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:27.078942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:20:27.079589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.security_group_api [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c not found {{(pid=122456) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:20:27.080131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.080131 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c HTTP/1.1 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: exception: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '37ce1905-4213-43f4-9c3c-cc7edbe1c53c'} Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:20:27.081956 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-5f169fbb-bb64-421b-ac77-7e934a228d1e'] {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ae2cec68-adea-4049-babe-117c304cf584 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c" status: 404 len: 194 microversion: 2.1 time: 0.083939 Sep 08 10:20:27.087447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 855/1791] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:20:27.091777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:27.091777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:27.123294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:27.123821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:27.124265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:27.135797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:27.136204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:27.136660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:27.497040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:27.511685 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c251834-6103-4ef9-baa8-0b32a733dbdb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.425388 Sep 08 10:20:27.516925 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 856/1792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:27 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:27.530565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4763ebf8-2990-47e9-88fc-4d281fda1521 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2355415e50>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:27.586433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:27.616239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:27.618078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:27.620746 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8dfcc57-93a4-4181-849d-530596d08e81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.630077 Sep 08 10:20:27.628954 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 937/1793] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:26 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:27.653585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:27.654737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:27.671422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:27.674217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:27.674985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:27.678491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:27.679289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:27.680388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.132148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:28.145748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c179849-8cae-43f0-ae17-919698b5832e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1210 microversion: 2.1 time: 0.515562 Sep 08 10:20:28.161972 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 938/1794] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:27 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1210 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:28.172786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:28.173418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:28.185715 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4763ebf8-2990-47e9-88fc-4d281fda1521 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47" status: 202 len: 0 microversion: 2.1 time: 0.666685 Sep 08 10:20:28.186426 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 857/1795] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:20:27 2022] DELETE /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:28.190891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.191398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.191880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.193085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.193085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.193445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.194001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:28.194740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:28.201478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:28.208808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.210019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.211455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.212317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.213125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.213943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.329044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:28.395783 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fcc519f7-512c-45b8-8ec4-8729460dd1f8 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.207045 Sep 08 10:20:28.396414 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 858/1796] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:28 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:28.410072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f235545a4c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:28.488801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:28.504052 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fb0609a3-6314-4caa-a94f-a82a38c53465 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1472 microversion: 2.1 time: 0.352502 Sep 08 10:20:28.504939 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 939/1797] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:28 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1472 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:28.521101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:20:28.522442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.security_group_api [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 not found {{(pid=122456) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:20:28.522970 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.522970 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47 HTTP/1.1 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: exception: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '59fabba1-b074-452e-8e5e-b98f9bbaab47'} Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:20:28.524921 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-a5fe86ee-e1f8-40c9-8883-33bfd66c1869'] {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ec04f30-d82f-4f85-9685-21b961ba92c8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47" status: 404 len: 194 microversion: 2.1 time: 0.127971 Sep 08 10:20:28.529860 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 859/1798] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:20:28 2022] GET /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47 => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:20:28.538076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85bd468f-7ea4-46b5-9ade-f95e83f328b3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2351cd9940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:28.550129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:28.551071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:28.574507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.575097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.575584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.576305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.576757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.577178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.788701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:28.801556 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b5480fc-6ee9-4bcf-b467-8cd8221efcfb tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.259730 Sep 08 10:20:28.803111 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 860/1799] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:28 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:28.828451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:28.829694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:28.840596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.841197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.844406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.845556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:28.846191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:28.846942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:28.860154 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85bd468f-7ea4-46b5-9ade-f95e83f328b3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.326928 Sep 08 10:20:28.873363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 940/1800] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:20:28 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:28.881591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-748c2361-a7c2-4004-877a-12a2e2dbbb1d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f23511a9160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1197274491", "description": "tempest-description-896743451"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:29.130806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:29.149199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:29.151605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:29.153451 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-30a5d158-d880-4919-bc7a-3cc203181be8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.348606 Sep 08 10:20:29.171593 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 861/1801] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:28 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:29.184309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=18 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:29.188443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:29.189074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:29.196331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:29.196817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:29.197474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:29.198409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:29.199034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:29.199660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:29.240049 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-748c2361-a7c2-4004-877a-12a2e2dbbb1d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.362027 Sep 08 10:20:29.241375 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 941/1802] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:20:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:20:29.255701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61d1a21e-f251-4bfa-a6c6-552eff681b3c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f23512fadc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-706502963", "description": "tempest-description-1626782360"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:29.479794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:29.559721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:29.595873 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d3f7c68-04f9-47de-b982-a5edce984baf tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1210 microversion: 2.1 time: 0.409329 Sep 08 10:20:29.596245 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61d1a21e-f251-4bfa-a6c6-552eff681b3c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.344992 Sep 08 10:20:29.597161 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 942/1803] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:20:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:20:29.601674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:29.602605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:29.604370 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 862/1804] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:29 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1210 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:29.617460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:29.618299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:29.619020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:29.619908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:29.620366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:29.620896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:29.647341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:29.712456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:29.745227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee48e724-7fe9-4a6a-b273-bfd1af24b8e3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.146946 Sep 08 10:20:29.746480 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 943/1805] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:29 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:29.781502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1112285533", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "cd2ecea7-1cb9-4c70-b690-4d2d69dbd7da"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:29.883313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] validate_networks() for [('cd2ecea7-1cb9-4c70-b690-4d2d69dbd7da', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:20:30.296463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:30.297064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:30.304548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.305253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.305855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.306748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.307358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.307967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.768186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:20:30.768609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:20:30.769079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:20:30.769484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:20:30.770194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:20:30.780307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.780791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.781693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.782459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.782913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.783341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.798802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:30.807394 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b69f601-56cf-4c32-9c44-fc8bfa514d64 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 1.200608 Sep 08 10:20:30.808026 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 863/1806] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:29 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:30.813064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Getting quotas for project 3750bee2be364857b35ad908e8aa0f48. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:30.813961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:30.814756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:30.819562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Getting quotas for user dfe57507755d46889089a0b2b42aa45c and project 3750bee2be364857b35ad908e8aa0f48. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:30.821133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.821780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.822428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.823323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.824106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.824702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.835970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:20:30.838939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:20:30.845581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:30.895296 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7273fdd-bd53-4626-bb21-8833b20da51e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124189 Sep 08 10:20:30.897091 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 944/1807] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:20:30.908126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ee9fd5e4-da27-49b4-8b52-5f258c6bbe9e req-12899462-1234-450f-8a6e-8e3c1ddb8ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "name": "network-vif-plugged", "status": "completed", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:30.920551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ee9fd5e4-da27-49b4-8b52-5f258c6bbe9e req-12899462-1234-450f-8a6e-8e3c1ddb8ed4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:30.921325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ee9fd5e4-da27-49b4-8b52-5f258c6bbe9e req-12899462-1234-450f-8a6e-8e3c1ddb8ed4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:30.922006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ee9fd5e4-da27-49b4-8b52-5f258c6bbe9e req-12899462-1234-450f-8a6e-8e3c1ddb8ed4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:30.942142 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ee9fd5e4-da27-49b4-8b52-5f258c6bbe9e req-12899462-1234-450f-8a6e-8e3c1ddb8ed4 service nova] Creating event network-vif-plugged:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:20:30.948401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ee9fd5e4-da27-49b4-8b52-5f258c6bbe9e req-12899462-1234-450f-8a6e-8e3c1ddb8ed4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049825 Sep 08 10:20:30.949737 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 945/1808] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:30.956694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7fbe8dc-07a4-4968-adf7-1b0fee341453 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23516f7dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.013285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:31.021750 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-701d449f-9c1b-4cb0-871b-7d805ef330ec tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.212213 Sep 08 10:20:31.022044 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 864/1809] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:30 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.031378 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7fbe8dc-07a4-4968-adf7-1b0fee341453 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/9013a880-2048-4f70-98dc-4ff6ab2a3331" status: 200 len: 661 microversion: 2.1 time: 0.080130 Sep 08 10:20:31.036557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.037372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:31.046105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.047183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.047667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.048386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.048845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.049280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.055071 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 946/1810] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:30 2022] GET /compute/v2.1/images/9013a880-2048-4f70-98dc-4ff6ab2a3331 => generated 661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.246361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-675b6b9f-9d19-4058-ae75-fd7b86fb0ad8 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.257008 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-675b6b9f-9d19-4058-ae75-fd7b86fb0ad8 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.200507 Sep 08 10:20:31.257664 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 947/1811] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.258348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:31.263352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.264397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:31.269683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:31.271159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:31.272400 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f6ad39e-2254-4eeb-b47b-95abbf9c5f49 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.239993 Sep 08 10:20:31.273647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.274352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.275035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.276007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.276663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.277288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.288195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 865/1812] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:31.296573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.297192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:31.303595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.304097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.304537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.305628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.306092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.306678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.424493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:31.449528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89b2209f-08c8-4aa9-999c-45e3713317c6 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.160029 Sep 08 10:20:31.455212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:31.464348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 866/1813] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:31.468195 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-263c26ab-d459-4620-a97c-04d2673e16dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.208671 Sep 08 10:20:31.469219 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 948/1814] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.476343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c01c583-38a2-4cf4-a7f0-b5bddaa29beb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.477345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c01c583-38a2-4cf4-a7f0-b5bddaa29beb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:31.492401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce84d4b1-0feb-4f59-9527-6d2f7daaf955 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23518085e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.543825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c01c583-38a2-4cf4-a7f0-b5bddaa29beb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:31.552649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c01c583-38a2-4cf4-a7f0-b5bddaa29beb tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1216 microversion: 2.1 time: 0.087008 Sep 08 10:20:31.553579 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 867/1815] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.557660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce84d4b1-0feb-4f59-9527-6d2f7daaf955 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/9013a880-2048-4f70-98dc-4ff6ab2a3331" status: 200 len: 661 microversion: 2.1 time: 0.085768 Sep 08 10:20:31.558291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 949/1816] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/images/9013a880-2048-4f70-98dc-4ff6ab2a3331 => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.567070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e4f5edb-2555-454d-af6a-ad5287c39833 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.586234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e4f5edb-2555-454d-af6a-ad5287c39833 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.031296 Sep 08 10:20:31.587078 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 868/1817] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.602644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56714304-3f76-462c-8610-e33d08fa2738 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.611396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56714304-3f76-462c-8610-e33d08fa2738 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012785 Sep 08 10:20:31.626720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f585556f-f709-4ef2-98ca-6fd665b7993c tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.630191 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 950/1818] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.635449 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f585556f-f709-4ef2-98ca-6fd665b7993c tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013638 Sep 08 10:20:31.650920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5a749d8-2cc0-41bc-945c-5134c5271392 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.651628 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 869/1819] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:20:31.685603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5a749d8-2cc0-41bc-945c-5134c5271392 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.040600 Sep 08 10:20:31.686203 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 951/1820] 10.222.0.59 () {58 vars in 1165 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.703292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5880b58c-daac-4a51-8c15-993e2e3eb2fc tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.711190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5880b58c-daac-4a51-8c15-993e2e3eb2fc tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011935 Sep 08 10:20:31.711901 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 870/1821] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.724324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a8fc1e91-8a2e-4650-9bee-c48d159df566 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.749837 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a8fc1e91-8a2e-4650-9bee-c48d159df566 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029365 Sep 08 10:20:31.750431 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 952/1822] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.766531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b09b47f-098e-416d-b3a0-e12b9ebc9007 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.780527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b09b47f-098e-416d-b3a0-e12b9ebc9007 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017747 Sep 08 10:20:31.781105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 871/1823] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.795974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5f50faf-bfd5-40b2-a8ee-c9260bcedf36 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.806411 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5f50faf-bfd5-40b2-a8ee-c9260bcedf36 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015548 Sep 08 10:20:31.807036 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 953/1824] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.819055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc5f2692-985c-40d2-b9c4-3207595046d5 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.830196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.830936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:31.835357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:31.841951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.842444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.842887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.843786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:31.844357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:31.844852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:31.861757 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc5f2692-985c-40d2-b9c4-3207595046d5 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046311 Sep 08 10:20:31.862577 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 872/1825] 10.222.0.59 () {58 vars in 1167 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:31.879345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fcdbf6d2-e0a7-4b6f-9ab7-14d8ea53fb31 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.887888 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fcdbf6d2-e0a7-4b6f-9ab7-14d8ea53fb31 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012544 Sep 08 10:20:31.888628 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 873/1826] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.901772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5276d2ca-ccf1-4b64-ba66-358aac348583 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.932004 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5276d2ca-ccf1-4b64-ba66-358aac348583 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.034616 Sep 08 10:20:31.932836 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 874/1827] 10.222.0.59 () {58 vars in 1144 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:31.950776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9083bbbc-28c2-4c69-9e8c-3b2e716148af tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:31.961624 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9083bbbc-28c2-4c69-9e8c-3b2e716148af tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016844 Sep 08 10:20:31.962568 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 875/1828] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:31.977498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cca9f63-61ae-43b3-a6db-e9115c6397a2 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.003484 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cca9f63-61ae-43b3-a6db-e9115c6397a2 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.031894 Sep 08 10:20:32.004781 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 876/1829] 10.222.0.59 () {58 vars in 1148 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:32.020628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67f4d02a-8d72-41d8-8081-50bd8d0aff39 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.032844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.038139 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67f4d02a-8d72-41d8-8081-50bd8d0aff39 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022575 Sep 08 10:20:32.038772 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 877/1830] 10.222.0.59 () {58 vars in 1140 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:32.041389 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-71134784-24b0-43f9-afab-356ab35897f0 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.214954 Sep 08 10:20:32.041952 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 954/1831] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:31 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:32.049592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.050477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:32.058031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.058509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.059264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.060059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.060520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.060941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.063914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acf9ad7f-6395-430e-94a7-024cb477a00a tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.074944 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-acf9ad7f-6395-430e-94a7-024cb477a00a tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021391 Sep 08 10:20:32.075551 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 955/1832] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:20:32.090696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-162bba1b-2463-45f2-b99e-aa31a5813108 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.133406 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-162bba1b-2463-45f2-b99e-aa31a5813108 tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.046783 Sep 08 10:20:32.134200 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 956/1833] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:32.149429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc01e3ae-0b44-4cdf-a0fe-5b46ef6d31aa tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.171724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc01e3ae-0b44-4cdf-a0fe-5b46ef6d31aa tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026483 Sep 08 10:20:32.172321 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 957/1834] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:32.192823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dd1432fa-abc3-4068-930d-17d4f2d0736b tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.202311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dd1432fa-abc3-4068-930d-17d4f2d0736b tempest-FlavorsV2TestJSON-1855417249 tempest-FlavorsV2TestJSON-1855417249-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014414 Sep 08 10:20:32.203011 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 958/1835] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:20:32.261094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.270670 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8856f081-8c30-4345-afc7-692fd6b9ba5e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1316 microversion: 2.1 time: 0.228454 Sep 08 10:20:32.271320 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 878/1836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:32.304154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.304953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:32.315397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.316358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.317671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.319307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.323397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.324047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.488622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.489255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:32.502171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.508239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.508886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.510487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.510948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.511385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.627689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.643159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.644632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.645906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72e6526b-f2ab-4a1a-839a-b72f17be3402 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.347671 Sep 08 10:20:32.646361 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 959/1837] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:32.664938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.665596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:32.666993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:32.674689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.675256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.675827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.676420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.676873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.677296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.737884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd430424-90e0-4ddc-905d-72cb81f86c22 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.260338 Sep 08 10:20:32.751507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 879/1838] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:32.756393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:32.757840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:32.771273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.771914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.772567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.774377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:32.775376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:32.776218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:32.910220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.911454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:32.922879 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-667bf941-4bb1-4b98-8545-97787b7bbe4d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.275425 Sep 08 10:20:32.926125 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cde8a12d-ba04-429e-8355-9d68f7b9652e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1268 microversion: 2.1 time: 0.184512 Sep 08 10:20:32.926969 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 880/1839] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:32.940857 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 960/1840] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:32 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:33.067088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:33.067960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:33.075651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.076658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.077583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.078737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.079739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.080522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.230612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-242cc4cd-59af-4474-b833-ce2940859c5e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351338d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:33.281361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-242cc4cd-59af-4474-b833-ce2940859c5e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/91a72a2b-38ad-4908-a049-722d21d30b22" status: 200 len: 662 microversion: 2.1 time: 0.055575 Sep 08 10:20:33.282124 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 961/1841] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:33 2022] GET /compute/v2.1/images/91a72a2b-38ad-4908-a049-722d21d30b22 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:33.298822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff73910d-3a15-4f62-b8d6-c58a0da3313a tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351e9c310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:33.354304 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff73910d-3a15-4f62-b8d6-c58a0da3313a tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/91a72a2b-38ad-4908-a049-722d21d30b22" status: 200 len: 662 microversion: 2.1 time: 0.060094 Sep 08 10:20:33.354877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 962/1842] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:33 2022] GET /compute/v2.1/images/91a72a2b-38ad-4908-a049-722d21d30b22 => generated 662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:33.360544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:33.361624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:33.386548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.387039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.387500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.388213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.388654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.389276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.461192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:33.470297 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9885d282-7b68-49a3-bde4-ce48fcafc517 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.407446 Sep 08 10:20:33.488056 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 881/1843] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:33 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:33.593543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:33.606339 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b020b86c-ba06-4d3d-b1a4-4ae213fe4df8 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1466 microversion: 2.1 time: 0.249709 Sep 08 10:20:33.607080 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 963/1844] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:33 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1466 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:33.629533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-885628556", "metadata": {"image_type": "test"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:33.632073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:33.639578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.640497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.641133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.642088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.642709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.643291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.682291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:33.683253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:33.689429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Getting quotas for project 0ad2b637afd44869ba29070b2ad92f98. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:33.690644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.691418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.691987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.692967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.693530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.694061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.695107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Getting quotas for user ddc1e291586e46adb2e198b0668953c4 and project 0ad2b637afd44869ba29070b2ad92f98. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:33.895942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:33.907204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:33.908923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:33.910201 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c477c3c5-fa40-4b9e-a8cd-cc2473b32ef0 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.235820 Sep 08 10:20:33.923491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 964/1845] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:33 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:20:33.923491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:33.923491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:33.923491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.923491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.923491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:33.924464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:33.924975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:33.925677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.005749 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d75cfb07-427a-45ae-92c7-0cf506570f4c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "POST /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.379518 Sep 08 10:20:34.014586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:34.015730 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 882/1846] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:33 2022] POST /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:20:34.025303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:34.026008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:34.033312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.034074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.034831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.035780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.036408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.037060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.058211 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-483fdf18-1e24-4871-b83c-a883bc84cabb tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.145723 Sep 08 10:20:34.059201 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 965/1847] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:33 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:34.077394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:34.078012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:34.100451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.102151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.103252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.106063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.106811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.107905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.275731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:34.294183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c251cb9f-5e9b-41c7-bbd4-b5a8aa18fe79 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.273219 Sep 08 10:20:34.294797 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 883/1848] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:34 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:34.312499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:34.315953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3fc7546-d3db-4066-bb7d-7fb508348950 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235535cee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:34.324464 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f83d98dc-d1d8-42d8-998a-bb990bf5f74c tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.263879 Sep 08 10:20:34.328107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 966/1849] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:34 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:34.400855 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3fc7546-d3db-4066-bb7d-7fb508348950 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.103594 Sep 08 10:20:34.409832 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 884/1850] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:34 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:34.499262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:34.500529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:34.515217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.516486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.517018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.517895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.518429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.519011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.746475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:34.754805 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0478561-40ca-4b6b-a63d-6722e521ab89 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.263041 Sep 08 10:20:34.783544 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 967/1851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:34 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:34.941751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:34.942368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:34.954058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.955105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.955664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:34.956597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:34.957165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:34.957745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.090617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.091225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:35.111274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.112246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.112851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.113931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.114558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.115142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.243155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:35.248541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:35.255643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:35.258933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:35.261530 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54fef45a-8b79-46b1-9fc1-1c5456871868 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1816 microversion: 2.25 time: 0.324080 Sep 08 10:20:35.263439 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 885/1852] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:34 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1816 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:35.268471 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5658eae2-6745-4a29-8e66-bc902067c506 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.182007 Sep 08 10:20:35.279498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 968/1853] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:35.280894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57dfc7a6-87df-4781-9bc8-c5cd2ffb7c12 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235535c8b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.318211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.319440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:35.325916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.325916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.327542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.329074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.333884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.334821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.375200 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-57dfc7a6-87df-4781-9bc8-c5cd2ffb7c12 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/f7f10891-fa47-4cc2-9bf8-dde482dde96e" status: 200 len: 662 microversion: 2.1 time: 0.109359 Sep 08 10:20:35.380934 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 886/1854] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/images/f7f10891-fa47-4cc2-9bf8-dde482dde96e => generated 662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:35.391929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.392867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:35.400587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.401610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.402353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.403345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.404898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.406543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.705621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:35.719041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-144947cc-ab00-4606-966f-23a1180ef560 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.404656 Sep 08 10:20:35.729735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 969/1855] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:35.739760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:35.744334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45efc1d0-427c-4688-ba64-c0002d753aae tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351cd9ee0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.752648 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a8b2631f-0b29-4ebf-96e0-6638b4dde49a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.370214 Sep 08 10:20:35.753280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 887/1856] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:35.761273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ad4f1be-a88b-426a-9ad6-7f5e1d88dc8e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2355415160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.797395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45efc1d0-427c-4688-ba64-c0002d753aae tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/f7f10891-fa47-4cc2-9bf8-dde482dde96e" status: 200 len: 662 microversion: 2.1 time: 0.064703 Sep 08 10:20:35.799303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 970/1857] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/images/f7f10891-fa47-4cc2-9bf8-dde482dde96e => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:35.815950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:35.816880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:35.843272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.844344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.845129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.846164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:35.847714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:35.848832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:35.849210 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ad4f1be-a88b-426a-9ad6-7f5e1d88dc8e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.094969 Sep 08 10:20:35.857892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 888/1858] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:35.980202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1732229173", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:36.037245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:20:36.262217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:36.278584 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-203642a0-3d8e-4551-b744-a471e0a53262 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.477884 Sep 08 10:20:36.281385 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 971/1859] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:35 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:36.291574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c6a7985a-26df-4c59-9df0-f16476161298 req-71d00723-f0a0-4b05-ba9a-fd1534395247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e615c95-7c58-431a-972b-c72445dc6d95", "tag": "b8d4e261-8c7a-40a5-a35f-7873e227bcfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:36.307304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c6a7985a-26df-4c59-9df0-f16476161298 req-71d00723-f0a0-4b05-ba9a-fd1534395247 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.308119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c6a7985a-26df-4c59-9df0-f16476161298 req-71d00723-f0a0-4b05-ba9a-fd1534395247 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.309183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c6a7985a-26df-4c59-9df0-f16476161298 req-71d00723-f0a0-4b05-ba9a-fd1534395247 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.340092 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c6a7985a-26df-4c59-9df0-f16476161298 req-71d00723-f0a0-4b05-ba9a-fd1534395247 service nova] Creating event network-changed:b8d4e261-8c7a-40a5-a35f-7873e227bcfd for instance 6e615c95-7c58-431a-972b-c72445dc6d95 on n-h1-833090-19 Sep 08 10:20:36.347059 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c6a7985a-26df-4c59-9df0-f16476161298 req-71d00723-f0a0-4b05-ba9a-fd1534395247 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064198 Sep 08 10:20:36.348367 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 972/1860] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:36.358620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:36.359348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:36.366396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.367142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.367785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.368679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.369817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.370414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.447429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:20:36.449244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:20:36.449952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:20:36.453779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:20:36.454716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:20:36.471743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=35 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:36.475852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.476859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.478470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.479400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.480192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.480809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.513992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Getting quotas for project 6f9f8699f1cf44af92b4a93458fb7a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:36.520184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Getting quotas for user 8b792020285b49f4a67a2eb5a74e3824 and project 6f9f8699f1cf44af92b4a93458fb7a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:36.548401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:20:36.553732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:20:36.582956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:36.593212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:36.595587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:36.598998 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5192bca-c900-4fbf-a8b5-6545cff3363a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1806 microversion: 2.25 time: 0.249305 Sep 08 10:20:36.600658 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 973/1861] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:36 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:36.605687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:36.606523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:36.617106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.618586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.619662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.620618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.621820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.622425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.636471 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f199dcc2-418e-4756-b997-d33a5204f62b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661861 Sep 08 10:20:36.648429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 889/1862] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:20:36.654283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c192807e-7db7-4e70-ad3a-7509f12762b5 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '.version_select at 0x7f2355415280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:36.659060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c192807e-7db7-4e70-ad3a-7509f12762b5 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.659598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c192807e-7db7-4e70-ad3a-7509f12762b5 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.660041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c192807e-7db7-4e70-ad3a-7509f12762b5 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.680372 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c192807e-7db7-4e70-ad3a-7509f12762b5 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 4510 microversion: 2.25 time: 0.030535 Sep 08 10:20:36.681198 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 890/1863] 10.222.0.59 () {60 vars in 1184 bytes} [Thu Sep 8 10:20:36 2022] GET /compute/v2.1/os-migrations => generated 4510 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:36.700509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:36.701108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:36.707704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.708510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.709223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.710883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.711536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.712411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.773307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:36.778382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:36.796832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3aa2e95-4235-4601-abfd-cb20635c7ebe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.194582 Sep 08 10:20:36.797803 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 974/1864] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:36 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:36.817146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:36.820037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:36.829966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.830654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.831195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.832037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:36.832567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:36.833125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:36.975278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 7265635f-ed38-4363-84e1-d4f53815fb77 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:36.996524 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d2ea170-1d72-4cd7-b787-a647169faf5b tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 2427 microversion: 2.25 time: 0.300117 Sep 08 10:20:36.997020 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 891/1865] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:36 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 2427 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:20:37.023631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1640430050", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:37.065238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:37.077948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-819fa122-cd58-4c4e-9e2d-34997ba61a56 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.278489 Sep 08 10:20:37.078393 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 975/1866] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:36 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:37.092284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:37.092284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:37.092284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.092284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.092284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.093536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.096047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.096047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.126255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:20:37.505236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:37.518757 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9c93fb6-34e9-4816-bd42-c178210709aa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.438773 Sep 08 10:20:37.528286 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 976/1867] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:37 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:37.542064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0a36c13-ee3b-4676-9f30-5c0b0b0d841b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23512faaf0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:37.630386 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0a36c13-ee3b-4676-9f30-5c0b0b0d841b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.095986 Sep 08 10:20:37.632588 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 977/1868] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:37 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:37.648076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:37.649088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:37.658861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.659722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.668285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.669356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.670228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.671131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.694417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:20:37.694894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:20:37.695538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:20:37.696045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:20:37.696456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:20:37.719001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.719415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.724225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.725193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.725669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.726105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.779969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Getting quotas for project 6f9f8699f1cf44af92b4a93458fb7a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:20:37.785226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Getting quotas for user 8b792020285b49f4a67a2eb5a74e3824 and project 6f9f8699f1cf44af92b4a93458fb7a8f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:20:37.801201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:20:37.803854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:20:37.844113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:37.878438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eaafde47-96b9-4f70-b327-f2b2c463d1f5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863903 Sep 08 10:20:37.883175 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 892/1869] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:20:37.898499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:37.899396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:37.923771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.938219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.938845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 7265635f-ed38-4363-84e1-d4f53815fb77 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:37.939120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.941027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:37.943697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:37.947648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:37.968947 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9599b781-cff4-43af-b6f3-3edb2850d525 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 2427 microversion: 2.25 time: 0.324594 Sep 08 10:20:37.969705 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 978/1870] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:37 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 2427 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:37.998901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:38.003976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:38.019531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.020845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.022567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.023559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.028728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.030152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.235481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:38.286017 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e8b626a0-f26b-4578-bf4b-64266e1d6a8b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.299421 Sep 08 10:20:38.296374 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 979/1871] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:37 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:38.305666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9695e5ad-e8c1-4b12-ad57-104b2083e02b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:38.309515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9695e5ad-e8c1-4b12-ad57-104b2083e02b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:38.456721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:38.468215 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20431c08-3033-4962-a14b-04ab6c46f600 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.582351 Sep 08 10:20:38.468866 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 893/1872] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:37 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:38.473022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9695e5ad-e8c1-4b12-ad57-104b2083e02b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:38.481924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:38.482607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:38.490032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.490733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.491320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.492336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.492859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.494534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.495487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9695e5ad-e8c1-4b12-ad57-104b2083e02b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1218 microversion: 2.1 time: 0.202527 Sep 08 10:20:38.497573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 980/1873] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:38 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:38.514368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:38.522408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:38.526057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:38.548321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.549608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.551531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.552792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.556145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.558059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.728299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:38.740735 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08e51372-1a29-40c7-bd79-171b45203818 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.269203 Sep 08 10:20:38.741335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 894/1874] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:38 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:38.743735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lazy-loading 'services' on Instance uuid 7265635f-ed38-4363-84e1-d4f53815fb77 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:38.748228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:38.760547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:38.768219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.768972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.769581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.770680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:38.771294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:38.771912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:38.914029 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cff5d619-4a86-495e-aac2-be253f5890fd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments/31e62985-f101-432a-9ecc-2356a80b141d" status: 202 len: 0 microversion: 2.25 time: 0.410101 Sep 08 10:20:38.914793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 981/1875] 10.222.0.59 () {60 vars in 1457 bytes} [Thu Sep 8 10:20:38 2022] DELETE /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments/31e62985-f101-432a-9ecc-2356a80b141d => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:20:38.947574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b984bd00-f439-449e-8a8e-680a1b6aa967 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2351808160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:39.075612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b984bd00-f439-449e-8a8e-680a1b6aa967 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.150002 Sep 08 10:20:39.076548 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 982/1876] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:38 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:39.086401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:39.094589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:39.111056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.113224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.116386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.117460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.118153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.121022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.199076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:39.208314 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-77a1f3f7-4c00-4b2a-bc04-ae451d6a615b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130400 Sep 08 10:20:39.209312 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 983/1877] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:39 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:39.215500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-290be035-207f-4b76-9806-e9d09517930f tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.472600 Sep 08 10:20:39.224118 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 895/1878] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:38 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:39.318876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:39.319961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:39.333895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.341366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.342800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.345734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.346568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.350978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.484726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:39.497445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:39.498267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:39.514695 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a360a24-97c7-457f-9ee5-bfd885d8498f tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.199943 Sep 08 10:20:39.516469 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 984/1879] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:39 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:39.521788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:39.522906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:39.530142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.530794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.531350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.532126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.532766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.533711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.548991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.552382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.552968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.554004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.554556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.555074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.723070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:39.733353 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b689bd3-30b8-45bb-84a3-f2d0d6c087aa tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1214 microversion: 2.1 time: 0.215798 Sep 08 10:20:39.738714 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 985/1880] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:39 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:39.775155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:39.787252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:39.797492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.798295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.798905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.799853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:39.800479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:39.801068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:39.941658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:39.952371 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11f12211-1659-4c87-9763-32c339195c6d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.461894 Sep 08 10:20:39.972734 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 896/1881] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:39 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:40.030609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:40.039009 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1b6873e-a6fd-464c-99ed-6dc2be702659 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.277714 Sep 08 10:20:40.060414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 986/1882] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:39 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:40.093553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ddca32a-cf0f-4368-a074-b1f195dac536 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2350bf70d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:40.164784 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ddca32a-cf0f-4368-a074-b1f195dac536 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.075911 Sep 08 10:20:40.168936 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 897/1883] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:40 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:40.222482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:40.224815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:40.252858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:40.255823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:40.266632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:40.267503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:40.268215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:40.272069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:40.272653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:40.276096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:40.279545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:40.282949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:40.283512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:40.286907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:40.292034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:40.292845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:40.427546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-458ebe57-86d4-4dfc-aa2d-363e0a1fd7e4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.209755 Sep 08 10:20:40.433900 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 987/1884] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:40 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:40.552620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:40.553504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:40.586678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:40.592653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:40.593827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:40.596574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:40.598593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:40.605709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:40.792579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:41.039551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:41.098270 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b212363-922e-472e-b27c-2ae01e1fdac9 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.551728 Sep 08 10:20:41.112490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 988/1885] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:40 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:20:41.122865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:41.122865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:41.126868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.127360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.127836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:41.128559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.129059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.138968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:41.406800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:41.442780 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d9e23a3-0420-4972-becc-af3a302c39c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1270 microversion: 2.1 time: 0.341722 Sep 08 10:20:41.453974 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 989/1886] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:41 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1270 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:41.468817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ab4ed925-e8fb-4af0-b580-cb76182d5eae req-3c9fbf6e-472f-4aed-aae8-9b308cd614f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "name": "network-vif-plugged", "status": "completed", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:41.499438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ab4ed925-e8fb-4af0-b580-cb76182d5eae req-3c9fbf6e-472f-4aed-aae8-9b308cd614f7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.500245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ab4ed925-e8fb-4af0-b580-cb76182d5eae req-3c9fbf6e-472f-4aed-aae8-9b308cd614f7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.500868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ab4ed925-e8fb-4af0-b580-cb76182d5eae req-3c9fbf6e-472f-4aed-aae8-9b308cd614f7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:41.523639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ab4ed925-e8fb-4af0-b580-cb76182d5eae req-3c9fbf6e-472f-4aed-aae8-9b308cd614f7 service nova] Creating event network-vif-plugged:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:20:41.539494 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ab4ed925-e8fb-4af0-b580-cb76182d5eae req-3c9fbf6e-472f-4aed-aae8-9b308cd614f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083956 Sep 08 10:20:41.541070 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 990/1887] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:41.547283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:41.560545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:41.567965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.568737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.569404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:41.570678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.572121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.573134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:41.715344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:41.733769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-762bdc94-4bb1-46fb-8cb4-5e8481f77501 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 1.488113 Sep 08 10:20:41.735322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 898/1888] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:40 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:41.757065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:41.757679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:41.768623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.769192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.769659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:41.770643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:41.771990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:41.772594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.241312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:42.264151 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8c10254-a2e9-451a-a4a8-2d22b096c284 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.721586 Sep 08 10:20:42.267030 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 991/1889] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:41 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:42.273557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e51a4485-5956-4862-87e9-f7ddf7eccb3e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2351788ee0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:42.360980 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e51a4485-5956-4862-87e9-f7ddf7eccb3e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.092609 Sep 08 10:20:42.366206 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 992/1890] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:42 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:42.377068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:42.379744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:42.398323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.399077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.399767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.400668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.401283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.402005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.446474 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fc3710e-f9d2-47cb-8627-92ff6abd5e29 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076613 Sep 08 10:20:42.447354 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 993/1891] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:42 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:42.455019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:42.459168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:42.475150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.480900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.481666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.483629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.484270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.486171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.499547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:42.577899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:42.596980 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc9ad806-6500-4353-be27-3435a8d0bab8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.859049 Sep 08 10:20:42.598697 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 899/1892] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:41 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:42.607439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:42.608681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:42.623685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.624502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.625454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.626883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.628091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.628784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.684038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:42.709324 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf64e6a6-7e3e-4114-b034-486b7d3117fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.260553 Sep 08 10:20:42.732178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 994/1893] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:42 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:42.765174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:42.765930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:42.785244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.787674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.789454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.791518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:42.796317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:42.798046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:42.908665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:42.918119 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d91c7a56-29d9-4079-b853-b3b8a7943df5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1276 microversion: 2.1 time: 0.317851 Sep 08 10:20:42.921965 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 900/1894] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:42 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:43.251594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:43.275251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-94a06636-a0dd-4945-abf4-0e45be60eb40 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.520805 Sep 08 10:20:43.279180 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 995/1895] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:42 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:43.294639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:43.295552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:43.318092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:43.321730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:43.324245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:43.326684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:43.334033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:43.338058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:43.381885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-541daa87-79d8-4778-bddf-8f57dcefbd37 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235178b1f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:43.469042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-541daa87-79d8-4778-bddf-8f57dcefbd37 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.090998 Sep 08 10:20:43.477384 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 996/1896] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:43 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:43.482810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:43.487420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:43.516983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:43.517500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:43.518009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:43.518767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:43.519237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:43.526887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:43.593733 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4d966da4-751e-40dc-82bb-f3d0142230d1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118593 Sep 08 10:20:43.595053 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 997/1897] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:43 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:43.623110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:43.624203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:43.630877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:43.631373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:43.638117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:43.638926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:43.639399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:43.639866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:44.136246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:44.145711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28a387c3-8f98-409b-a416-8dcdf0706f9c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.856276 Sep 08 10:20:44.148580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 901/1898] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:43 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:44.154203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:44.155087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:44.162430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:44.163287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:44.163937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:44.164826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:44.165487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:44.166129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:44.618726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:44.653683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:44.672325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2975aa61-03fb-4a0c-9ad9-e9c6260761dd tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 1.053751 Sep 08 10:20:44.673725 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 998/1899] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:43 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:20:44.709079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:44.710467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:44.714814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d7723f8-f796-44af-bff2-2707ff904ed1 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.564885 Sep 08 10:20:44.723125 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 902/1900] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:44 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:44.731816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:44.746236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:44.746740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:44.747185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:44.747943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:44.748399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:44.759904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:44.773451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:44.780966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:44.781468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:44.781923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:44.782637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:44.783096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:44.804216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.297722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:45.311841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8017d7c7-67ed-478b-a4a5-101063d68444 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 0.631831 Sep 08 10:20:45.316098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 999/1901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:44 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:45.320858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7033f2dd-b124-48a0-a130-9b2fe9485587 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235538c430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:45.420084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7033f2dd-b124-48a0-a130-9b2fe9485587 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.102848 Sep 08 10:20:45.420684 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1000/1902] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:45 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:45.430142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4ccbc9b8-3895-4966-a4e0-ebf1a6e74e12 req-710fa854-1ea0-45eb-a551-571694089ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63066b7-480f-4376-94da-0fccd625bf8e", "name": "network-vif-plugged", "status": "completed", "tag": "3cb48e05-a1a1-4d09-961c-be42377068c3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:45.452555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4ccbc9b8-3895-4966-a4e0-ebf1a6e74e12 req-710fa854-1ea0-45eb-a551-571694089ad3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.453039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4ccbc9b8-3895-4966-a4e0-ebf1a6e74e12 req-710fa854-1ea0-45eb-a551-571694089ad3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.453479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4ccbc9b8-3895-4966-a4e0-ebf1a6e74e12 req-710fa854-1ea0-45eb-a551-571694089ad3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.464047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:45.472103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0a73f08-64b8-43ca-bbab-cd3d75f0b436 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.747537 Sep 08 10:20:45.472693 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 903/1903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:44 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:45.503835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:45.506069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:45.516130 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4ccbc9b8-3895-4966-a4e0-ebf1a6e74e12 req-710fa854-1ea0-45eb-a551-571694089ad3 service nova] Creating event network-vif-plugged:3cb48e05-a1a1-4d09-961c-be42377068c3 for instance a63066b7-480f-4376-94da-0fccd625bf8e on n-h1-833090-19 Sep 08 10:20:45.531582 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4ccbc9b8-3895-4966-a4e0-ebf1a6e74e12 req-710fa854-1ea0-45eb-a551-571694089ad3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109642 Sep 08 10:20:45.536097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.536598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.537036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.537449 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1001/1904] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:45.551727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.552123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.552584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.556896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:45.557601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:45.583719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.584485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.585127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.586046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.586687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.587877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.650434 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-601a2b0b-5432-4f56-8d0e-5edcb8226ba6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.148953 Sep 08 10:20:45.654961 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 904/1905] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:45 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:45.702961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:45.704507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:45.725851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.727160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.729310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:45.730845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:45.732043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:45.735845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.408939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:46.417978 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-665156bb-8edb-406e-89a2-e144860b8e07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1198 microversion: 2.1 time: 0.718798 Sep 08 10:20:46.425833 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 905/1906] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:45 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1198 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:46.434796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:46.435852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:46.450564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.451637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.453142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.463765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.464804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.465488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.479842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:46.494546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba5da691-2802-4b09-89c4-71e4d2f00047 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.955500 Sep 08 10:20:46.500571 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1002/1907] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:45 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:46.519622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3bdbe38a-c1a1-46ab-ad00-a70e893df8d2 req-be6f05cb-0b9f-47b1-9f4b-0f8256297fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d485bf32-a51c-4748-9c53-3c5d643fd273", "tag": "69a878c2-2b18-44bb-a936-0eec42248f2e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:46.553843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3bdbe38a-c1a1-46ab-ad00-a70e893df8d2 req-be6f05cb-0b9f-47b1-9f4b-0f8256297fa3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.554333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3bdbe38a-c1a1-46ab-ad00-a70e893df8d2 req-be6f05cb-0b9f-47b1-9f4b-0f8256297fa3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.562551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3bdbe38a-c1a1-46ab-ad00-a70e893df8d2 req-be6f05cb-0b9f-47b1-9f4b-0f8256297fa3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.575123 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3bdbe38a-c1a1-46ab-ad00-a70e893df8d2 req-be6f05cb-0b9f-47b1-9f4b-0f8256297fa3 service nova] Creating event network-changed:69a878c2-2b18-44bb-a936-0eec42248f2e for instance d485bf32-a51c-4748-9c53-3c5d643fd273 on n-h2-833090-19 Sep 08 10:20:46.593263 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3bdbe38a-c1a1-46ab-ad00-a70e893df8d2 req-be6f05cb-0b9f-47b1-9f4b-0f8256297fa3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091351 Sep 08 10:20:46.593921 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1003/1908] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:46.602991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:46.616574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:46.619528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:46.626301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.627083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.640208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.641243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.641887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.642488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.704031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:46.756833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bbbccb1e-5013-485f-8cab-08e8fbd4245b tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.328741 Sep 08 10:20:46.758187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 906/1909] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:46 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:46.766473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7d93141f-e035-45c5-91bb-ce7c46db3c8c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2355370e50>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:46.870558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7d93141f-e035-45c5-91bb-ce7c46db3c8c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.110058 Sep 08 10:20:46.871267 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 907/1910] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:46 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:46.884172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:46.885203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:46.904418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.905138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.905762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:46.906657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:46.907299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:46.908902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:47.646565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:47.656004 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0dab0833-1d33-4882-8f71-a8189382e52e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 1.060575 Sep 08 10:20:47.656598 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1004/1911] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:46 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:47.673228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:47.693604 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38265c03-5947-4a90-8884-fafc32436d47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.816272 Sep 08 10:20:47.694139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:47.704526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:47.707937 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 908/1912] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:46 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:47.713386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:47.713996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:47.726445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:47.726939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:47.727420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:47.727698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:47.728168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:47.728624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:47.729054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:47.731519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:47.732045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:47.732776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:47.733705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:47.734142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:47.747651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:47.797664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=11 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:47.805992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8ab2f93-df02-4ab9-a712-2aeb0e9b2687 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125152 Sep 08 10:20:47.806604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1005/1913] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:47 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:47.812119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:47.813310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:47.822696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:47.823493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:47.824311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:47.825326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:47.825948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:47.826545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.293959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:48.303277 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ba83a4c-dbf6-44f8-9f80-75f37f171941 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.494943 Sep 08 10:20:48.311614 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1006/1914] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:47 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:48.314558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:48.321641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:48.322521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:48.326777 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5fb923a-b87f-4c8e-ae8e-56bfeafea37c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1381 microversion: 2.1 time: 0.616314 Sep 08 10:20:48.328128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 909/1915] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:47 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1381 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:48.332881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.333630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.334235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.335119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.335403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f09f30d6-c289-4112-87ad-f8a52bcc6d10 req-b5f50db2-b8f2-4410-9e1c-f9af57a142f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e615c95-7c58-431a-972b-c72445dc6d95", "name": "network-vif-plugged", "status": "completed", "tag": "b8d4e261-8c7a-40a5-a35f-7873e227bcfd"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:48.335970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.337115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.354212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f09f30d6-c289-4112-87ad-f8a52bcc6d10 req-b5f50db2-b8f2-4410-9e1c-f9af57a142f7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.355080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f09f30d6-c289-4112-87ad-f8a52bcc6d10 req-b5f50db2-b8f2-4410-9e1c-f9af57a142f7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.355914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f09f30d6-c289-4112-87ad-f8a52bcc6d10 req-b5f50db2-b8f2-4410-9e1c-f9af57a142f7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.408398 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f09f30d6-c289-4112-87ad-f8a52bcc6d10 req-b5f50db2-b8f2-4410-9e1c-f9af57a142f7 service nova] Creating event network-vif-plugged:b8d4e261-8c7a-40a5-a35f-7873e227bcfd for instance 6e615c95-7c58-431a-972b-c72445dc6d95 on n-h1-833090-19 Sep 08 10:20:48.417563 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f09f30d6-c289-4112-87ad-f8a52bcc6d10 req-b5f50db2-b8f2-4410-9e1c-f9af57a142f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087013 Sep 08 10:20:48.422161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 910/1916] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:48.432841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82356562-b4cd-4de8-88ca-e7a1ca642fd6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235535c040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:48.478202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:48.511370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:48.520444 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82356562-b4cd-4de8-88ca-e7a1ca642fd6 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.096679 Sep 08 10:20:48.521579 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 911/1917] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:48 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:48.527597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:48.528572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:48.537108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.538531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.539280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.543652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.544411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.545008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.559220 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e06b85d-4792-447c-b8df-0fe889edd21c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.246403 Sep 08 10:20:48.576273 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1007/1918] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:48 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:48.835582 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1789935-3f8d-4447-8538-cbe4785dc4c0 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1534 microversion: 2.1 time: 0.312120 Sep 08 10:20:48.843853 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 912/1919] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:48 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1534 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:48.844964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ab9f668-c7f2-4b5e-89c3-5f4bac675919 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Calling method '.version_select at 0x7f23512fa940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:48.858043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:48.858043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:48.874408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.874990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.875443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.876211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.876664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.877248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.896424 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ab9f668-c7f2-4b5e-89c3-5f4bac675919 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.317951 Sep 08 10:20:48.897704 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1008/1920] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:20:48 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:20:48.909733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:48.910608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:48.917918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.918895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.919532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:48.920399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:48.921017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:48.921604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.179653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:49.185298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:49.196354 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c252d271-21a8-4fa2-a5e3-55fea752ff14 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 0.350464 Sep 08 10:20:49.216638 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 913/1921] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:48 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:49.223924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.228056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:49.243409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.244372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.244998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.245905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.246530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.247150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.256832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:49.269517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4328504f-2cae-4ea5-9ae7-3917e6c8ecd0 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1316 microversion: 2.1 time: 0.370480 Sep 08 10:20:49.271795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1009/1922] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:48 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:49.279624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.280466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:49.286733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.287507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.289040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.290914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.291918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.292552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.303568 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8479c791-5868-455a-b122-4d8f73c6879b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085356 Sep 08 10:20:49.309856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 914/1923] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:49 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:20:49.321566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11e3d3e6-c8cc-46ae-8319-78990b0e0508 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Action: 'create', calling method: .version_select at 0x7f2350c0b8b0>, body: {"pool": "non_exist_pool"} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:49.373626 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-11e3d3e6-c8cc-46ae-8319-78990b0e0508 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] HTTP exception thrown: Floating IP pool not found. Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11e3d3e6-c8cc-46ae-8319-78990b0e0508 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Request method failure captured: Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 26 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcIAhonFHmoe1f1J4Oyu96DMD0mB2UCqgpb0xI1dS1jaSXe_bRJ97SIiw6MHcqK1g43HuQUX1ezVL99jM5qN0VUZV9J9foaH9nJ02HGHHbwUAQncT5ToA4MLF-Ig51fOW9W0kXMRZSbrYiaQqYzGAuRTkuaZX3P8Okx3qWSWX2SMP1o Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 2c072ae219884e5d8ff8984ef06b24a5 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-110478554 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c072ae219884e5d8ff8984ef06b24a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c072ae219884e5d8ff8984ef06b24a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c072ae219884e5d8ff8984ef06b24a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c072ae219884e5d8ff8984ef06b24a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-110478554 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 2c072ae219884e5d8ff8984ef06b24a5 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-110478554 Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsNegativeTestJSON-110478554-project Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c516b22c63654edb92731bf4309bab2a Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-110478554-project Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: {"pool": "non_exist_pool"} Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: exception: Floating IP pool not found. Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:49.375656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:49.380556 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 08 10:20:49.380556 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.380556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11e3d3e6-c8cc-46ae-8319-78990b0e0508 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Returning 404 to user: Floating IP pool not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:49.380556 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11e3d3e6-c8cc-46ae-8319-78990b0e0508 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.064719 Sep 08 10:20:49.380556 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 915/1924] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:20:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:20:49.392336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.400141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:49.414036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.414584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.415035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.415800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.416237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.416666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.539615 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb340a59-86c7-43ff-9572-266f98341e81 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1534 microversion: 2.1 time: 0.266479 Sep 08 10:20:49.540787 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1010/1925] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:49 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1534 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:49.546366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16ee263d-dacf-4778-8045-4f50393907d0 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Calling method '.version_select at 0x7f2350a34ca0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.600561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-16ee263d-dacf-4778-8045-4f50393907d0 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 could not be found", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:20:49.601654 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-16ee263d-dacf-4778-8045-4f50393907d0 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] HTTP exception thrown: Floating IP not found for ID 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16ee263d-dacf-4778-8045-4f50393907d0 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Request method failure captured: Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-floating-ips/9c9c1e04-0172-4dd1-bec6-8f8324150cf6 HTTP/1.1 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcIAhonFHmoe1f1J4Oyu96DMD0mB2UCqgpb0xI1dS1jaSXe_bRJ97SIiw6MHcqK1g43HuQUX1ezVL99jM5qN0VUZV9J9foaH9nJ02HGHHbwUAQncT5ToA4MLF-Ig51fOW9W0kXMRZSbrYiaQqYzGAuRTkuaZX3P8Okx3qWSWX2SMP1o Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 2c072ae219884e5d8ff8984ef06b24a5 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-110478554 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c072ae219884e5d8ff8984ef06b24a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c072ae219884e5d8ff8984ef06b24a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c072ae219884e5d8ff8984ef06b24a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c072ae219884e5d8ff8984ef06b24a5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-110478554 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 2c072ae219884e5d8ff8984ef06b24a5 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-110478554 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FloatingIPsNegativeTestJSON-110478554-project Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: c516b22c63654edb92731bf4309bab2a Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-110478554-project Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: exception: Floating IP not found for ID 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9c9c1e04-0172-4dd1-bec6-8f8324150cf6'} Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 could not be found Sep 08 10:20:49.603710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84eebca9-7d14-424a-9e6e-ea5e8044a7ba'] Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9c9c1e04-0172-4dd1-bec6-8f8324150cf6. Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16ee263d-dacf-4778-8045-4f50393907d0 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] Returning 404 to user: Floating IP not found for ID 9c9c1e04-0172-4dd1-bec6-8f8324150cf6 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:49.610407 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16ee263d-dacf-4778-8045-4f50393907d0 tempest-FloatingIPsNegativeTestJSON-110478554 tempest-FloatingIPsNegativeTestJSON-110478554-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/9c9c1e04-0172-4dd1-bec6-8f8324150cf6" status: 404 len: 111 microversion: 2.1 time: 0.063189 Sep 08 10:20:49.623013 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1011/1926] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:20:49 2022] DELETE /compute/v2.1/os-floating-ips/9c9c1e04-0172-4dd1-bec6-8f8324150cf6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:20:49.625704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8595469c-69dd-4592-8966-391b468ec06e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235538c670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.663441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:49.672091 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-329c69ee-5c8a-45dd-9c72-751b6ec7acf2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.293360 Sep 08 10:20:49.676560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 916/1927] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:49 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:49.686654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.690525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.691013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.706590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.707671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.708146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.708569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.738072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8595469c-69dd-4592-8966-391b468ec06e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.118948 Sep 08 10:20:49.740050 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1012/1928] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:49 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:49.748996 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5305c813-3104-4708-83c7-34ee0aced031 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.071261 Sep 08 10:20:49.752281 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 917/1929] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:20:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:49.754693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:49.755501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:49.774823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.775315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.775778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.776335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-19", "block_migration": false, "disk_over_commit": false}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:49.776493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.776928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.777352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.778781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:49.784880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.785649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.786377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.787487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:49.788223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:49.788832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:49.840495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lazy-loading 'flavor' on Instance uuid a63066b7-480f-4376-94da-0fccd625bf8e {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:49.868771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Going to try to live migrate instance to n-h2-833090-19 {{(pid=122456) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:20:49.891365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:49.918132 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a41e1a52-cf05-403d-bd06-1e302e20d4f3 tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.176535 Sep 08 10:20:49.932852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1013/1930] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:49 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:50.221591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:50.222814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:50.237669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:50.238510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:50.239136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:50.241103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:50.243033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:50.245788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:50.733983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:50.760725 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e4779d1-1a1e-4cbb-9fc7-780ca598cbd4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 0.542132 Sep 08 10:20:50.797338 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1014/1931] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:50 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:50.831583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:50.837745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:50.852331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:50.854610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:50.855382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:50.856488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:50.857336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:50.858120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:51.256857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:51.267735 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9fb4791-6573-4deb-8bc3-61c8729cc878 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1504 microversion: 2.1 time: 0.466253 Sep 08 10:20:51.273306 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1015/1932] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:50 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:51.282585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:51.299003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:51.323037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:51.323037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:51.323387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:51.324077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:51.324533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:51.324966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:51.346846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:51.421903 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-346e50dd-28be-47f3-a544-3bfb05ab6b7f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.146697 Sep 08 10:20:51.431221 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1016/1933] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:20:51 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:51.436416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:51.441646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:51.454351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:51.454858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:51.455298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:51.456108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:51.456563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:51.456987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:52.087360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:52.103910 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc7d6a50-6464-4524-8a86-7c9f1e887a4f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.671187 Sep 08 10:20:52.105072 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1017/1934] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:51 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:52.115590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-330e389e-6117-42bd-b806-3e45500b1c55 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23512a4a60>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:52.205829 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-330e389e-6117-42bd-b806-3e45500b1c55 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1421 microversion: 2.1 time: 0.099501 Sep 08 10:20:52.214744 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1018/1935] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:52 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:52.228416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:52.228899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:52.261827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:52.263246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:52.263892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:52.264834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:52.268158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:52.268888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:52.454653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:52.503948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-493d0b4a-b4f0-430d-8907-9efde261376c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.287791 Sep 08 10:20:52.507975 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1019/1936] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:52 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:52.520720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1197274491"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:52.522628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:52.538954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:52.540604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:52.542101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:52.543129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:52.544249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:52.545203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:52.864075 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Adding security group 04ea77a0-14bb-43c9-addc-68059490603a to port b8d4e261-8c7a-40a5-a35f-7873e227bcfd Sep 08 10:20:53.226777 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6eb4926f-104a-47c1-bf20-74d194435e50 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e/action" status: 202 len: 0 microversion: 2.1 time: 3.456266 Sep 08 10:20:53.227412 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 918/1937] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:49 2022] POST /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e/action => generated 0 bytes in 3458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:53.234846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:53.236400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:53.306787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:53.313278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:53.316079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:53.323804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:53.325901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:53.327636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:53.516245 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2be178ac-3ebb-4a2b-9d80-205139d3cf85 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95/action" status: 202 len: 0 microversion: 2.1 time: 1.006690 Sep 08 10:20:53.518131 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1020/1938] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:52 2022] POST /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95/action => generated 0 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:53.525844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-48852611-d238-42dd-9f27-120878bb3dc9 req-e5679b5a-fa19-4e22-b818-05b32327030c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:53.551076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-48852611-d238-42dd-9f27-120878bb3dc9 req-e5679b5a-fa19-4e22-b818-05b32327030c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:53.554041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-48852611-d238-42dd-9f27-120878bb3dc9 req-e5679b5a-fa19-4e22-b818-05b32327030c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:53.559149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-48852611-d238-42dd-9f27-120878bb3dc9 req-e5679b5a-fa19-4e22-b818-05b32327030c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:53.593541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-48852611-d238-42dd-9f27-120878bb3dc9 req-e5679b5a-fa19-4e22-b818-05b32327030c service nova] Creating event network-changed:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:20:53.614323 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-48852611-d238-42dd-9f27-120878bb3dc9 req-e5679b5a-fa19-4e22-b818-05b32327030c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091251 Sep 08 10:20:53.615586 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1021/1939] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:53.635642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:53.636828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:53.652561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:53.653370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:53.656842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:53.658814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:53.660004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:53.661194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:54.131493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:54.153404 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2c3c8f0e-d738-4be5-a618-fdb50812d877 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 0.922275 Sep 08 10:20:54.164240 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 919/1940] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:53 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:54.188812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cde24a13-42af-4fe0-a052-36bdfc645935 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23553c5940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:54.192415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:54.204239 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e6a924b-4e48-4e19-a57e-165ff8f593f8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.586172 Sep 08 10:20:54.204862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1022/1941] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:53 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:54.436240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:54.437152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:54.446262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:54.447045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:54.447696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:54.448655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:54.449304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:54.449913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:54.692249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:54.701611 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d10e8075-a924-47ee-b2a5-664fe272f4c2 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.495511 Sep 08 10:20:54.702201 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1023/1942] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:54 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:54.715707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ba372de-91f7-4afe-957d-3fb6a9a91d7b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23512a4a60>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:54.945491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-3ba372de-91f7-4afe-957d-3fb6a9a91d7b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use.", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:20:54.946350 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3ba372de-91f7-4afe-957d-3fb6a9a91d7b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.946350 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ba372de-91f7-4afe-957d-3fb6a9a91d7b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a HTTP/1.1 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: exception: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '04ea77a0-14bb-43c9-addc-68059490603a'} Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:20:54.951355 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] Sep 08 10:20:54.958903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:20:54.970732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ba372de-91f7-4afe-957d-3fb6a9a91d7b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 400 to user: Security Group 04ea77a0-14bb-43c9-addc-68059490603a in use. Sep 08 10:20:54.970732 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-86992dd2-55fa-4828-a17d-650c71362868'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:20:54.972692 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ba372de-91f7-4afe-957d-3fb6a9a91d7b tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a" status: 400 len: 185 microversion: 2.1 time: 0.265209 Sep 08 10:20:54.976159 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1024/1943] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:20:54 2022] DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a => generated 185 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:20:54.985625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:54.986731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:54.999950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.001702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.002517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.006018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.007092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.008248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.142707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:55.171575 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58decdc7-323d-4b55-a598-420f21ab428d tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1929 microversion: 2.75 time: 0.191468 Sep 08 10:20:55.173600 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1025/1944] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:54 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:55.180515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:55.183751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:55.194108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.195025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.196284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.197294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.198036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.198715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.356619 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4987dd05-b4bb-4d2a-ae26-b9ffdee74c84 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95/action" status: 202 len: 0 microversion: 2.1 time: 0.180871 Sep 08 10:20:55.360253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1026/1945] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:20:55 2022] POST /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:20:55.366108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:55.366862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:55.384969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.385594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.386044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.386787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.387253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.388047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.638987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:55.648745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f8c1585-e8df-4af8-bd86-517f0811be07 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 0.286611 Sep 08 10:20:55.650665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1027/1946] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:55 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:55.656195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:55.659144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:55.683141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.685296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.685296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.685670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.689409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.689409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.930999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:55.946117 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d14d2595-cd57-420f-a621-18c9e47e831b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.293784 Sep 08 10:20:55.959818 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1028/1947] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:55 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:55.959818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:55.959818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:55.976245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.977479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.978030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:55.979251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:55.979839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:55.980403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:56.361261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:56.377692 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81a166e8-9430-4c54-8e3b-35f61c97a2b6 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1575 microversion: 2.1 time: 0.428321 Sep 08 10:20:56.379066 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1029/1948] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:55 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1575 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:56.386976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8045a6df-62f4-4968-aede-b8c0ccbae28f req-8c50b6f4-7e9e-415c-9c90-9a039c3e0ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e615c95-7c58-431a-972b-c72445dc6d95", "tag": "b8d4e261-8c7a-40a5-a35f-7873e227bcfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:56.402366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8045a6df-62f4-4968-aede-b8c0ccbae28f req-8c50b6f4-7e9e-415c-9c90-9a039c3e0ae9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:56.402845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8045a6df-62f4-4968-aede-b8c0ccbae28f req-8c50b6f4-7e9e-415c-9c90-9a039c3e0ae9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:56.403278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8045a6df-62f4-4968-aede-b8c0ccbae28f req-8c50b6f4-7e9e-415c-9c90-9a039c3e0ae9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:56.421147 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8045a6df-62f4-4968-aede-b8c0ccbae28f req-8c50b6f4-7e9e-415c-9c90-9a039c3e0ae9 service nova] Creating event network-changed:b8d4e261-8c7a-40a5-a35f-7873e227bcfd for instance 6e615c95-7c58-431a-972b-c72445dc6d95 on n-h1-833090-19 Sep 08 10:20:56.428174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8045a6df-62f4-4968-aede-b8c0ccbae28f req-8c50b6f4-7e9e-415c-9c90-9a039c3e0ae9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046610 Sep 08 10:20:56.429068 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1030/1949] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:56.434702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e2fedb90-c678-4e91-ad15-f6a2b316c65c req-95dfba8d-06b4-4e83-a58d-e83decdb6982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d485bf32-a51c-4748-9c53-3c5d643fd273", "name": "network-vif-plugged", "status": "completed", "tag": "69a878c2-2b18-44bb-a936-0eec42248f2e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:20:56.448759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e2fedb90-c678-4e91-ad15-f6a2b316c65c req-95dfba8d-06b4-4e83-a58d-e83decdb6982 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:56.449182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e2fedb90-c678-4e91-ad15-f6a2b316c65c req-95dfba8d-06b4-4e83-a58d-e83decdb6982 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:56.449606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e2fedb90-c678-4e91-ad15-f6a2b316c65c req-95dfba8d-06b4-4e83-a58d-e83decdb6982 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:56.461519 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e2fedb90-c678-4e91-ad15-f6a2b316c65c req-95dfba8d-06b4-4e83-a58d-e83decdb6982 service nova] Creating event network-vif-plugged:69a878c2-2b18-44bb-a936-0eec42248f2e for instance d485bf32-a51c-4748-9c53-3c5d643fd273 on n-h2-833090-19 Sep 08 10:20:56.466596 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e2fedb90-c678-4e91-ad15-f6a2b316c65c req-95dfba8d-06b4-4e83-a58d-e83decdb6982 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035530 Sep 08 10:20:56.470300 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1031/1950] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:20:56.475692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:56.476698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:56.483538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:56.483970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:56.484413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:56.485120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:56.485572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:56.485997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:57.276274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:57.293579 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78bf36c3-904e-4de5-b69b-5e59ac480ed9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.821890 Sep 08 10:20:57.295901 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1032/1951] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:56 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:57.308831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:57.310160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:57.328314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:57.328314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:57.332156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:57.342488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:57.344113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:57.344797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:57.552698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:20:57.592267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c89f623-f021-4c2b-8d9d-87f02834396c tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1935 microversion: 2.75 time: 0.294831 Sep 08 10:20:57.593059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1033/1952] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:20:57 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1935 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:20:57.629190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:57.629808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:57.649445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:57.650156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:57.650953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:57.651860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:57.652695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:57.653123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:58.585035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:58.612988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9849b4f-6449-482f-ab0d-109b075772e4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1318 microversion: 2.1 time: 1.001468 Sep 08 10:20:58.615971 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1034/1953] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:57 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1318 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:58.633409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:58.635012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:58.643626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:58.644370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:58.644969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:58.645843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:58.646633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:58.650246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:58.676430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:59.491617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:59.502663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8adffb71-62be-470d-848f-85d9ebffc3f4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.884142 Sep 08 10:20:59.510771 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1035/1954] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:58 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:59.524146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:59.527000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:59.546797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:59.549546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:59.551048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:59.552629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:59.555233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:59.556127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:59.725976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:20:59.892950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:20:59.902279 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f623fa34-7bcc-4bb4-bbff-dfceff4bb697 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1575 microversion: 2.1 time: 0.390065 Sep 08 10:20:59.903722 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1036/1955] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:59 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1575 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:20:59.909418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:20:59.910225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:20:59.918135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:59.919612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:59.920782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:20:59.921839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:20:59.923173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:20:59.923806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.169654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:00.181278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-934050a4-402e-4728-8df3-31f2467b98ed tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.275751 Sep 08 10:21:00.183819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1037/1956] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:20:59 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:00.205743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:00.206356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:00.236212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:00.236212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:00.236212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.236739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:00.237136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:00.237444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.381056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] Lazy-loading 'services' on Instance uuid 4399d283-8a13-4330-be5a-b03761ea28a5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:21:00.434779 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc98581b-baab-4a4f-aab7-d5cf0c0886fe tempest-ServersAdmin275Test-1354514665 tempest-ServersAdmin275Test-1354514665-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1920 microversion: 2.75 time: 0.250187 Sep 08 10:21:00.437658 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1038/1957] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:00 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1920 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:00.447073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:00.452667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:00.466230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:00.466942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:00.467723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.468873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:00.469483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:00.470065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.810388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:00.819098 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b8d40ed-f1d9-4fc6-89b2-6f3412796161 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1467 microversion: 2.1 time: 0.380479 Sep 08 10:21:00.821546 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1039/1958] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:00 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1467 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:00.826250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:00.826741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:00.833726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:00.834212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:00.834643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.835344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:00.836408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:00.836874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:00.885604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:01.043186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a64e421b-4bf5-4a0c-88c0-54db17297f2e tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 204 len: 0 microversion: 2.75 time: 0.220229 Sep 08 10:21:01.047276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1040/1959] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:21:00 2022] DELETE /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:21:01.175512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:01.175512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:01.192817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.199220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.199220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.199220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.199220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.199220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.440886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:01.450854 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cf183f29-e60b-47a0-af90-e9556f295f6e tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.404891 Sep 08 10:21:01.474443 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1041/1960] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:01 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:01.476689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-053c3d27-08ac-45da-9ae0-fd7e7b03187d req-7242dad4-9f8a-42da-bf6a-3436e173cc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "name": "network-vif-plugged", "status": "completed", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:01.488724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-053c3d27-08ac-45da-9ae0-fd7e7b03187d req-7242dad4-9f8a-42da-bf6a-3436e173cc06 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.489209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-053c3d27-08ac-45da-9ae0-fd7e7b03187d req-7242dad4-9f8a-42da-bf6a-3436e173cc06 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.489718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-053c3d27-08ac-45da-9ae0-fd7e7b03187d req-7242dad4-9f8a-42da-bf6a-3436e173cc06 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.503447 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-053c3d27-08ac-45da-9ae0-fd7e7b03187d req-7242dad4-9f8a-42da-bf6a-3436e173cc06 service nova] Creating event network-vif-plugged:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:21:01.525052 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-053c3d27-08ac-45da-9ae0-fd7e7b03187d req-7242dad4-9f8a-42da-bf6a-3436e173cc06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055187 Sep 08 10:21:01.525994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1042/1961] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:01.531134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:01.540277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:01.550116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.550908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.551367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.552786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.553879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.555008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.712980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:01.727023 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4bcd6f0-ac48-4ca2-b230-30512c936960 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1318 microversion: 2.1 time: 0.199804 Sep 08 10:21:01.727955 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1043/1962] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:01 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:01.740443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:01.745651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:01.756686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.757849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.758545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.759340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:01.759912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:01.760403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:01.955651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:01.965175 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecec0718-836d-48fd-bdc9-ff644e0fb974 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1580 microversion: 2.1 time: 0.235111 Sep 08 10:21:01.981444 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1044/1963] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:01 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1580 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:02.002604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:02.004698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:02.031582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.034587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.035267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.037721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.041266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.041911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.165592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:02.176863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:02.179005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:02.186675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16d07833-6cd2-4828-9191-c88171ca361c tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1443 microversion: 2.75 time: 0.203446 Sep 08 10:21:02.200289 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1045/1964] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:01 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:02.214165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:02.214723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:02.222372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.222872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.223365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.224366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.224836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.225292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.430341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:02.439229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-101eb61b-0e7a-4217-872f-8f1bb54ec0d6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.237372 Sep 08 10:21:02.442329 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1046/1965] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:02 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:02.623385 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51e88e2f-8aba-416d-a808-ab7ebe52a259 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] 10.222.0.59 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.173885 Sep 08 10:21:02.624187 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1047/1966] 10.222.0.59 () {58 vars in 1128 bytes} [Thu Sep 8 10:21:02 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:21:02.649097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:02.653673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:02.664017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.664616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.665495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.667092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.668044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.668657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.870009 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cde24a13-42af-4fe0-a052-36bdfc645935 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1430 microversion: 2.1 time: 8.693024 Sep 08 10:21:02.870690 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 920/1967] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:20:54 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1430 bytes in 8706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:02.880772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fb8a597-dae1-48ff-be74-e306ce0ad9d3 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Calling method '.version_select at 0x7f23553dfaf0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:02.910446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:02.935546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7208243-09e2-403b-8690-6d4c98c6d452 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1477 microversion: 2.1 time: 0.298743 Sep 08 10:21:02.944372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1048/1968] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:02 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:02.959353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:02.960881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:02.962579 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1fb8a597-dae1-48ff-be74-e306ce0ad9d3 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] HTTP exception thrown: Image not found. Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fb8a597-dae1-48ff-be74-e306ce0ad9d3 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Request method failure captured: Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcIM_1554D-i_90s9BicLM0AU8w7JtZi2esJ21hbhGokMt1IBPizNpl6aV4WJSim2C9s-uGf4MtuuHDfNBIfqbocAMSgUON_bHHGuZZwMfKnTu0_Bhwr20-m_E6TQK2nPAPRevpKsJu_0Rszk8Ea9KeX6gxOlhR2R3Eywh5KgKJtppc Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_acfc6e481d68434daaa7fde8a16a2f1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: be81285ddb974227b990dee062a84a25 Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '-1'} Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.965927 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fb8a597-dae1-48ff-be74-e306ce0ad9d3 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1fb8a597-dae1-48ff-be74-e306ce0ad9d3 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] 10.222.0.59 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.096263 Sep 08 10:21:02.971859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 921/1969] 10.222.0.59 () {58 vars in 1134 bytes} [Thu Sep 8 10:21:02 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:02.976313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3af4346c-4a8a-485e-ab82-10f2480ab3f0 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2355357940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:02.979275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.980027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.980756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:02.981644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:02.982252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:02.982881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.061143 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3af4346c-4a8a-485e-ab82-10f2480ab3f0 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 200 len: 1430 microversion: 2.1 time: 0.086644 Sep 08 10:21:03.076186 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 922/1970] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:02 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 1430 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:03.084971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d87a59d-179f-47bb-b4d1-bc870f319708 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Calling method '.version_select at 0x7f23553df940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.111373 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-5d87a59d-179f-47bb-b4d1-bc870f319708 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] HTTP exception thrown: Image not found. Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d87a59d-179f-47bb-b4d1-bc870f319708 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Request method failure captured: Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/images/e1a4a63a-080d-41d8-93f8-e4f33a60dc2j HTTP/1.1 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcIM_1554D-i_90s9BicLM0AU8w7JtZi2esJ21hbhGokMt1IBPizNpl6aV4WJSim2C9s-uGf4MtuuHDfNBIfqbocAMSgUON_bHHGuZZwMfKnTu0_Bhwr20-m_E6TQK2nPAPRevpKsJu_0Rszk8Ea9KeX6gxOlhR2R3Eywh5KgKJtppc Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_acfc6e481d68434daaa7fde8a16a2f1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: be81285ddb974227b990dee062a84a25 Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'e1a4a63a-080d-41d8-93f8-e4f33a60dc2j'} Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e1a4a63a-080d-41d8-93f8-e4f33a60dc2j to delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1a4a63a-080d-41d8-93f8-e4f33a60dc2j could not be found. Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.117236 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d87a59d-179f-47bb-b4d1-bc870f319708 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:03.122457 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d87a59d-179f-47bb-b4d1-bc870f319708 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] 10.222.0.59 "DELETE /compute/v2.1/images/e1a4a63a-080d-41d8-93f8-e4f33a60dc2j" status: 404 len: 62 microversion: 2.1 time: 0.041635 Sep 08 10:21:03.126683 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 923/1971] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:03 2022] DELETE /compute/v2.1/images/e1a4a63a-080d-41d8-93f8-e4f33a60dc2j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:03.133333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.133963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:03.143981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.144550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.144967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.145750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.146436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.146882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.254714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.266508 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eaf7fa20-3afc-41af-b575-c283f85a123c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1318 microversion: 2.1 time: 0.320277 Sep 08 10:21:03.285179 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1049/1972] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:02 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:03.293223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.294069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:03.301229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:03.303832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.305415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.306021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.306929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.307768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.308377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.444695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.454372 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e2c9398-9db5-42cb-ae33-453d19af8524 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1580 microversion: 2.1 time: 0.326226 Sep 08 10:21:03.455689 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 924/1973] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:03 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1580 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:03.461102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c8f4977-ede6-463d-a56f-6a1239d12b12 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Calling method '.version_select at 0x7f23553df160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.479800 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-5c8f4977-ede6-463d-a56f-6a1239d12b12 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] HTTP exception thrown: Image not found. Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c8f4977-ede6-463d-a56f-6a1239d12b12 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Request method failure captured: Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/images/2f886322-f789-407e-ae54-f69831bfbdc11 HTTP/1.1 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcIM_1554D-i_90s9BicLM0AU8w7JtZi2esJ21hbhGokMt1IBPizNpl6aV4WJSim2C9s-uGf4MtuuHDfNBIfqbocAMSgUON_bHHGuZZwMfKnTu0_Bhwr20-m_E6TQK2nPAPRevpKsJu_0Rszk8Ea9KeX6gxOlhR2R3Eywh5KgKJtppc Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_acfc6e481d68434daaa7fde8a16a2f1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: be81285ddb974227b990dee062a84a25 Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '2f886322-f789-407e-ae54-f69831bfbdc11'} Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f886322-f789-407e-ae54-f69831bfbdc11 to delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f886322-f789-407e-ae54-f69831bfbdc11 could not be found. Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.481568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c8f4977-ede6-463d-a56f-6a1239d12b12 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c8f4977-ede6-463d-a56f-6a1239d12b12 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] 10.222.0.59 "DELETE /compute/v2.1/images/2f886322-f789-407e-ae54-f69831bfbdc11" status: 404 len: 62 microversion: 2.1 time: 0.026094 Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 925/1974] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:03 2022] DELETE /compute/v2.1/images/2f886322-f789-407e-ae54-f69831bfbdc11 => generated 62 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.492329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:03.496870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.497365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.497846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.498540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.498998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.499432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.615605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.629384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.631167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e8b6b83d23b47af956a9e719d72909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499830c9b9964b189210930ee62dbaaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.642303 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96e073c6-6293-46ef-8f34-70a3bfa69cd1 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 200 len: 1443 microversion: 2.75 time: 0.157399 Sep 08 10:21:03.644291 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 926/1975] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:03 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:03.649479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.650348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:03.662397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.665894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.667275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.668283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.669710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.672332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.672728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.689158 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e47248c-fec7-4544-bbb2-8676ca6973f5 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1479 microversion: 2.1 time: 0.401716 Sep 08 10:21:03.701657 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1050/1976] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:03 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1479 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:03.709396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-389d2a15-1430-45c4-8706-85b3f374cee7 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Calling method '.version_select at 0x7f23512a4d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.745639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-389d2a15-1430-45c4-8706-85b3f374cee7 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] HTTP exception thrown: Image not found. Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-389d2a15-1430-45c4-8706-85b3f374cee7 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Request method failure captured: Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/tempest-invalid-1139600827 HTTP/1.1 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcIM_1554D-i_90s9BicLM0AU8w7JtZi2esJ21hbhGokMt1IBPizNpl6aV4WJSim2C9s-uGf4MtuuHDfNBIfqbocAMSgUON_bHHGuZZwMfKnTu0_Bhwr20-m_E6TQK2nPAPRevpKsJu_0Rszk8Ea9KeX6gxOlhR2R3Eywh5KgKJtppc Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_acfc6e481d68434daaa7fde8a16a2f1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: be81285ddb974227b990dee062a84a25 Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'tempest-invalid-1139600827'} Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1139600827 to delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1139600827 could not be found. Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.754460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-389d2a15-1430-45c4-8706-85b3f374cee7 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-389d2a15-1430-45c4-8706-85b3f374cee7 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] 10.222.0.59 "DELETE /compute/v2.1/images/tempest-invalid-1139600827" status: 404 len: 62 microversion: 2.1 time: 0.053156 Sep 08 10:21:03.765682 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1051/1977] 10.222.0.59 () {58 vars in 1206 bytes} [Thu Sep 8 10:21:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1139600827 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:03.769363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dee2fc-f1d5-4c1f-be2a-fd0d2f69ef77 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Calling method '.version_select at 0x7f2350a4fe50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.826157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-44dee2fc-f1d5-4c1f-be2a-fd0d2f69ef77 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] HTTP exception thrown: Image not found. Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dee2fc-f1d5-4c1f-be2a-fd0d2f69ef77 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Request method failure captured: Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/f640729b-ce85-462f-b19e-1e8addb2fab6 HTTP/1.1 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcIM_1554D-i_90s9BicLM0AU8w7JtZi2esJ21hbhGokMt1IBPizNpl6aV4WJSim2C9s-uGf4MtuuHDfNBIfqbocAMSgUON_bHHGuZZwMfKnTu0_Bhwr20-m_E6TQK2nPAPRevpKsJu_0Rszk8Ea9KeX6gxOlhR2R3Eywh5KgKJtppc Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/acfc6e481d68434daaa7fde8a16a2f1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_acfc6e481d68434daaa7fde8a16a2f1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: acfc6e481d68434daaa7fde8a16a2f1b Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: be81285ddb974227b990dee062a84a25 Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1017635155-project Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f640729b-ce85-462f-b19e-1e8addb2fab6'} Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f640729b-ce85-462f-b19e-1e8addb2fab6 to delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f640729b-ce85-462f-b19e-1e8addb2fab6 could not be found. Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.828065 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dee2fc-f1d5-4c1f-be2a-fd0d2f69ef77 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44dee2fc-f1d5-4c1f-be2a-fd0d2f69ef77 tempest-ImagesDeleteNegativeTestJSON-1017635155 tempest-ImagesDeleteNegativeTestJSON-1017635155-project] 10.222.0.59 "DELETE /compute/v2.1/images/f640729b-ce85-462f-b19e-1e8addb2fab6" status: 404 len: 62 microversion: 2.1 time: 0.065861 Sep 08 10:21:03.833789 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1052/1978] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:03 2022] DELETE /compute/v2.1/images/f640729b-ce85-462f-b19e-1e8addb2fab6 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:03.963939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:03.964830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:03.974100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.974672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.975318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.976452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:03.976910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:03.977331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:03.986225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:03.997996 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-56319031-23d8-4c2f-8a57-78f0becf7588 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.349887 Sep 08 10:21:04.016113 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 927/1979] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:03 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:04.027015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:04.232694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:04.245696 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f72efca-8cfc-4e3a-9877-bd4a5c972bb7 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1476 microversion: 2.1 time: 0.285775 Sep 08 10:21:04.246737 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1053/1980] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:03 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:21:04.294065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:04.294736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:04.309333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.312501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.313967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.316183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.318270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.318907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.483397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:04.484909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:04.506607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.508943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.512648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.514232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.515986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.518344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.686558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:04.703352 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9fe4de1d-98da-4012-9501-4cf84a30e71f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1318 microversion: 2.1 time: 0.413483 Sep 08 10:21:04.704238 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 928/1981] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:04 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:04.709489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "name": "network-vif-unplugged", "status": "completed", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:04.724357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.724835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.727205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.745958 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] Creating event network-vif-unplugged:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h1-833090-19 Sep 08 10:21:04.755829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] Instance 1751b777-f1de-4f70-9350-d14d80890f23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:21:04.791194 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a2d4e11b-5d7b-4a54-8f77-6f5fd219c21d req-dd800371-c02c-439f-a877-ae8797287d22 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084434 Sep 08 10:21:04.793769 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 929/1982] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:04.812202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:04.817385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] [instance: 4399d283-8a13-4330-be5a-b03761ea28a5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:04.840857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.841392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.841858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.842602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.843066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.843518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.881899 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] HTTP exception thrown: Instance 4399d283-8a13-4330-be5a-b03761ea28a5 could not be found. Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Request method failure captured: Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 HTTP/1.1 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcG42Jctz-1X3IWq5ucwgJkr-F157R2u-3tuHkOUKmK3sBW15e-96oY7kZOY3D_DZRP7ftEej8PHs1ahNPuibdTnm2u2dy98t5d70dxHXMas9OXkKAHdfKDY3lX1y841L5KoHu69BL0Zom_395mR1XFtuB30jiqiCn74Dx4pVSkOgXU Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.75 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 499830c9b9964b189210930ee62dbaaa Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdmin275Test-1930417958 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/499830c9b9964b189210930ee62dbaaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/499830c9b9964b189210930ee62dbaaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/499830c9b9964b189210930ee62dbaaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_499830c9b9964b189210930ee62dbaaa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdmin275Test-1930417958 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 499830c9b9964b189210930ee62dbaaa Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdmin275Test-1930417958 Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdmin275Test-1930417958-project Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 5e8b6b83d23b47af956a9e719d72909d Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdmin275Test-1930417958-project Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 4399d283-8a13-4330-be5a-b03761ea28a5 could not be found. Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '4399d283-8a13-4330-be5a-b03761ea28a5'} Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d283-8a13-4330-be5a-b03761ea28a5 could not be found. Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d283-8a13-4330-be5a-b03761ea28a5 could not be found. Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:04.883677 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d283-8a13-4330-be5a-b03761ea28a5 could not be found. Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] Returning 404 to user: Instance 4399d283-8a13-4330-be5a-b03761ea28a5 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7d05d72-4235-43c2-9a0b-60c3b1e10271 tempest-ServersAdmin275Test-1930417958 tempest-ServersAdmin275Test-1930417958-project] 10.222.0.59 "GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5" status: 404 len: 111 microversion: 2.75 time: 0.089980 Sep 08 10:21:04.889085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 930/1983] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:04 2022] GET /compute/v2.1/servers/4399d283-8a13-4330-be5a-b03761ea28a5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:21:04.902453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:04.903123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:04.910868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.915155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.915676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:04.916437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:04.916900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:04.917332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.009335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:05.023502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-41b1cad1-b804-48f9-b262-a05109dbf856 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1573 microversion: 2.1 time: 0.542828 Sep 08 10:21:05.024126 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1054/1984] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:04 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1573 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:21:05.031587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:05.041032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:05.048091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:05.055608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:05.056881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.069035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:05.071546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:05.079447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.496555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:05.505905 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-409c85f9-11f0-4a55-98ab-16fc58712085 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1466 microversion: 2.1 time: 0.618639 Sep 08 10:21:05.521497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:05.525772 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 931/1985] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:04 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1466 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:05.532197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-706502963"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:05.533287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:05.541168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:05.541334 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-685fcfa7-e285-489b-8ec0-ca1b8004aeee tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.515935 Sep 08 10:21:05.541943 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1055/1986] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:05 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:05.542344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:05.543091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.544077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:05.544781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:05.545433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.550918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:05.551568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:05.576929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:05.578054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:05.579374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.585668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:05.587096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:05.588213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:05.904903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.network.security_group_api [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Adding security group 35b68fd9-e6e2-47bf-992e-b427ba466fad to port b8d4e261-8c7a-40a5-a35f-7873e227bcfd Sep 08 10:21:06.023287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:06.035837 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ead957c-d883-4099-a8e9-ef2fb4ff2259 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1476 microversion: 2.1 time: 0.486905 Sep 08 10:21:06.047634 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1056/1987] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:05 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1476 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:06.058777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ffea6dd-e97b-4bb9-b236-54025facff48 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2350aa6a60>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:06.133686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9ffea6dd-e97b-4bb9-b236-54025facff48 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/fe14f6a4-d144-40d8-8fee-904fb43a30eb" status: 200 len: 784 microversion: 2.1 time: 0.079992 Sep 08 10:21:06.135249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1057/1988] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:06 2022] GET /compute/v2.1/images/fe14f6a4-d144-40d8-8fee-904fb43a30eb => generated 784 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:06.140603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:06.141726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:06.154866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:06.155687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:06.156582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:06.157864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:06.158729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:06.160275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:06.464967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:06.478234 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-442c4fce-f13d-4e96-82b9-f92637ff73b0 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1468 microversion: 2.1 time: 0.342011 Sep 08 10:21:06.478840 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1058/1989] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:06 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:06.483554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0647e698-cb31-4bf5-a4c8-1671fa6b343c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:06.502401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0647e698-cb31-4bf5-a4c8-1671fa6b343c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022467 Sep 08 10:21:06.503612 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1059/1990] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:21:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:06.509854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-10697166"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:06.513094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:06.521647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:06.523552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:06.524260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:06.525228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:06.525922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:06.526586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:06.796281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28eb53bb-bcfb-4816-be38-f917d057cd52 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95/action" status: 202 len: 0 microversion: 2.1 time: 1.269192 Sep 08 10:21:06.797457 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 932/1991] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:21:05 2022] POST /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95/action => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:06.802772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a0f142c-bb1a-49e2-9b6c-2ae6642463d4 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23553dfb80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:06.891271 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69ef1824-8b13-488c-bfec-ecd640bcfdb6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "POST /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558/action" status: 202 len: 0 microversion: 2.1 time: 0.384568 Sep 08 10:21:06.903873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1060/1992] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:21:06 2022] POST /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:21:06.912030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:06.913618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:06.929883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:06.930796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:06.932652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:06.936724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:06.939555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:06.940221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:07.343126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:07.359778 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11d5d995-f02d-4d36-9fce-eddfde26f924 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.452681 Sep 08 10:21:07.362032 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1061/1993] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:06 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:07.375890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cf96c53-9185-4109-b71f-51813f466f33 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23509f4790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:07.609150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-9cf96c53-9185-4109-b71f-51813f466f33 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use.", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:07.610107 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9cf96c53-9185-4109-b71f-51813f466f33 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.610107 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cf96c53-9185-4109-b71f-51813f466f33 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad HTTP/1.1 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: exception: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '35b68fd9-e6e2-47bf-992e-b427ba466fad'} Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:07.613968 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cf96c53-9185-4109-b71f-51813f466f33 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 400 to user: Security Group 35b68fd9-e6e2-47bf-992e-b427ba466fad in use. Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-38ec4dc9-31b1-4251-b15d-ccabd88ac7cd'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9cf96c53-9185-4109-b71f-51813f466f33 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad" status: 400 len: 185 microversion: 2.1 time: 0.250315 Sep 08 10:21:07.619802 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1062/1994] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:07 2022] DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad => generated 185 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:21:07.636830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:07.688267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:07.690493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:07.692015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:07.736403 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] Creating event network-changed:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h1-833090-19 Sep 08 10:21:07.753948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] Instance 1751b777-f1de-4f70-9350-d14d80890f23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:21:07.770859 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2ddd3233-a022-447e-b765-24493214adad req-3d348793-0f5c-48eb-a7c1-c53f33feb945 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151537 Sep 08 10:21:07.771854 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1063/1995] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:07.798063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c15d39a0-fc43-497e-8662-502954972871 req-61af3173-e5b3-4e91-b353-40964815bd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e615c95-7c58-431a-972b-c72445dc6d95", "tag": "b8d4e261-8c7a-40a5-a35f-7873e227bcfd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:07.814322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c15d39a0-fc43-497e-8662-502954972871 req-61af3173-e5b3-4e91-b353-40964815bd6b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:07.814733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c15d39a0-fc43-497e-8662-502954972871 req-61af3173-e5b3-4e91-b353-40964815bd6b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:07.815167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c15d39a0-fc43-497e-8662-502954972871 req-61af3173-e5b3-4e91-b353-40964815bd6b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:07.833028 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c15d39a0-fc43-497e-8662-502954972871 req-61af3173-e5b3-4e91-b353-40964815bd6b service nova] Creating event network-changed:b8d4e261-8c7a-40a5-a35f-7873e227bcfd for instance 6e615c95-7c58-431a-972b-c72445dc6d95 on n-h1-833090-19 Sep 08 10:21:07.840380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c15d39a0-fc43-497e-8662-502954972871 req-61af3173-e5b3-4e91-b353-40964815bd6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065942 Sep 08 10:21:07.844671 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1064/1996] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:07.851374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80f0d4c8-d36c-4111-a8dd-6ce2d0468a8d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350aa6940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:08.511196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a0f142c-bb1a-49e2-9b6c-2ae6642463d4 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "DELETE /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 204 len: 0 microversion: 2.1 time: 1.712499 Sep 08 10:21:08.513936 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 933/1997] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:06 2022] DELETE /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 0 bytes in 1714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:08.519063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:08.520445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:08.530190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=73 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:08.534761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:08.542686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:08.544533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:08.546522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:08.548896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:08.551327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:08.628525 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80f0d4c8-d36c-4111-a8dd-6ce2d0468a8d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.782484 Sep 08 10:21:08.630499 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1065/1998] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:07 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:08.637374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:08.638206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:08.647489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:08.649237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:08.649885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:08.651052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:08.651776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:08.652510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:08.696016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:08.894808 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3274b20d-2c04-4cc4-82f9-d3dd9a524df4 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 204 len: 0 microversion: 2.1 time: 0.262120 Sep 08 10:21:08.896077 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1066/1999] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:08 2022] DELETE /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:08.906586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:08.908191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:08.923745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:08.924836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:08.926270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:08.927608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:08.928854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:08.933604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.213059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:09.217775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:09.228757 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e27602f4-a76f-4529-a651-27037103df54 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1471 microversion: 2.1 time: 0.715130 Sep 08 10:21:09.229165 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20c3229b-e7b8-4ed7-aeae-199d04fe5344 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.329861 Sep 08 10:21:09.230167 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 934/2000] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:08 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1471 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:09.236876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-66211571-9798-47bc-ac43-629a0e6dd79b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235540fc10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:09.245474 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1067/2001] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:08 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:09.253638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-dd60dac9-dda3-471b-adb0-de39c494c219 req-2fdf8b20-f2b4-46d5-95e8-13f6c71e72ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:09.268302 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-66211571-9798-47bc-ac43-629a0e6dd79b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] HTTP exception thrown: Image not found. Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-66211571-9798-47bc-ac43-629a0e6dd79b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Request method failure captured: Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 HTTP/1.1 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHZydfZuRD56CUlxd6wlQg87IIapC-diz-g3olM7bGB5W9sk82s1PLDcDT6buVabBkITl_iG_hkLds1FvSqegkzzi9PVr5uXwBXmmg1CHMMj93KjDF8KvXE9gr84NgmRyD0FHFecdYpoxrBIgB0_tFdGgHXuND5P7QISN2IygA9DgM Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0ad2b637afd44869ba29070b2ad92f98 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ad2b637afd44869ba29070b2ad92f98", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0ad2b637afd44869ba29070b2ad92f98 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerTestJSON-604502723-project Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ddc1e291586e46adb2e198b0668953c4 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerTestJSON-604502723-project Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'cdfae3b8-f41f-4059-9010-a131a89b2616'} Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cdfae3b8-f41f-4059-9010-a131a89b2616 Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:21:09.273185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cdfae3b8-f41f-4059-9010-a131a89b2616 could not be found. Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-66211571-9798-47bc-ac43-629a0e6dd79b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:09.278615 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-66211571-9798-47bc-ac43-629a0e6dd79b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 404 len: 62 microversion: 2.1 time: 0.044640 Sep 08 10:21:09.289436 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 935/2002] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:09 2022] GET /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:09.292686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dd60dac9-dda3-471b-adb0-de39c494c219 req-2fdf8b20-f2b4-46d5-95e8-13f6c71e72ec service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.294605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:09.295247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:09.298739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dd60dac9-dda3-471b-adb0-de39c494c219 req-2fdf8b20-f2b4-46d5-95e8-13f6c71e72ec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.299216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dd60dac9-dda3-471b-adb0-de39c494c219 req-2fdf8b20-f2b4-46d5-95e8-13f6c71e72ec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.306777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.307935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.308938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.310378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.311186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.311860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.314410 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-dd60dac9-dda3-471b-adb0-de39c494c219 req-2fdf8b20-f2b4-46d5-95e8-13f6c71e72ec service nova] Creating event network-vif-unplugged:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:21:09.321805 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-dd60dac9-dda3-471b-adb0-de39c494c219 req-2fdf8b20-f2b4-46d5-95e8-13f6c71e72ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074425 Sep 08 10:21:09.323656 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1068/2003] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:09.341288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:09.341928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:09.354821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.355324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.357249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.362594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.363130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.363651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.619186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:09.621952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-306a346b-3801-438a-bf9d-3d1ccc433b76 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "POST /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23/action" status: 202 len: 0 microversion: 2.1 time: 0.293201 Sep 08 10:21:09.627601 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1069/2004] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:21:09 2022] POST /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:09.636275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1107533567"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:09.642672 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a65c11aa-8c1d-479f-9dd3-350b389aa13e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1647 microversion: 2.1 time: 0.357217 Sep 08 10:21:09.643639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:09.644102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 936/2005] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:09 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1647 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:09.651384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:09.652319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:09.658371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.659208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.660436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.662093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.662621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.663185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.670908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.671696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.672695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.673909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:09.674696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:09.675295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:09.964509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:09.972862 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f54bc3d-5331-4332-ae9d-66ebb04138f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 0.327153 Sep 08 10:21:09.973649 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 937/2006] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:09 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:10.008526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86e9fb66-4816-41be-bd90-2148d3d04c0b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23553df8b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:10.041534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:10.113458 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86e9fb66-4816-41be-bd90-2148d3d04c0b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.138705 Sep 08 10:21:10.114578 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a5d72a02-1da5-4286-ab7f-33c4dac39ee2 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "POST /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.485136 Sep 08 10:21:10.122958 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 938/2007] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:09 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:10.129823 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1070/2008] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:21:09 2022] POST /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:21:10.136750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8b10f93-1559-4012-a6b3-c5f251be788c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23553c5b80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:10.210438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8b10f93-1559-4012-a6b3-c5f251be788c tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.079214 Sep 08 10:21:10.215447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 939/2009] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:10 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:10.257535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:10.258239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:10.273904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:10.274464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:10.274875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:10.275793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:10.276449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:10.279549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:10.502670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:10.516548 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8de0b851-bfeb-4d2a-b8f3-84c415da838e tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.261898 Sep 08 10:21:10.540295 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1071/2010] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:10 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:10.672886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:10.674994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:10.697934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:10.708310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:10.709064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:10.712427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:10.714636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:10.720127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:10.781580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:10.998649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:11.000261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:11.007354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:11.008219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:11.008883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:11.010211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:11.010895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:11.011573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:11.344275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:11.352831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fd4826c0-0024-4313-892e-769e91da2ebc tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 0.358680 Sep 08 10:21:11.353418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1072/2011] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:10 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:11.368151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9af000b3-a2fd-4111-b78b-09705d13e867 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509f4940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:11.460171 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9af000b3-a2fd-4111-b78b-09705d13e867 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.105675 Sep 08 10:21:11.461816 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1073/2012] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:11 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:11.474911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8be1b3b8-b348-4f51-b97b-78e3b58f383e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23509ffaf0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:11.573045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:11.583770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8be1b3b8-b348-4f51-b97b-78e3b58f383e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.119224 Sep 08 10:21:11.584227 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-698411d4-921e-456f-8e2b-f50e823d8e90 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1647 microversion: 2.1 time: 0.915193 Sep 08 10:21:11.597682 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1074/2013] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:11 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:11.598169 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 940/2014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:10 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1647 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:11.605934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:11.605934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:11.612707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:11.613273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:11.614024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:11.615121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:11.617578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:11.618033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:11.932955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:11.943437 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa60003b-8401-4da9-b84c-79693e023799 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.346178 Sep 08 10:21:11.944297 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1075/2015] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:11 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:12.275896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "name": "network-vif-plugged", "status": "completed", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:12.295357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.298419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.298912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:12.326559 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] Creating event network-vif-plugged:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h1-833090-19 Sep 08 10:21:12.347758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] Instance 1751b777-f1de-4f70-9350-d14d80890f23 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:21:12.378909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:12.379562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:12.385680 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b8fd1148-6781-4b1b-bb19-e9fe18bbf954 req-6e260e5a-c054-455e-bffa-a4fe87167579 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115732 Sep 08 10:21:12.391291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.396365 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 941/2016] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:12.401560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.402436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:12.403478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.404152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.406622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:12.477256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0cbaeef2-7a5a-4228-b8b0-189645c100b3 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350c034c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:12.563571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0cbaeef2-7a5a-4228-b8b0-189645c100b3 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.090655 Sep 08 10:21:12.564560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 942/2017] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:12 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:12.604408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e6902ee-5cde-4135-a77e-4faff5a5785e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235540f160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:12.735331 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e6902ee-5cde-4135-a77e-4faff5a5785e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.135858 Sep 08 10:21:12.736195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 943/2018] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:12 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:21:12.742020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:12.748401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:12.767296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.767772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.768286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:12.769005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.769461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.769882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:12.804107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:12.816762 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ad8d4d8-d7f2-4008-80ec-37a5560df148 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 0.442348 Sep 08 10:21:12.831619 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1076/2019] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:12 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:12.969579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:12.970535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:12.983410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.984345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.986001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:12.986963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:12.989397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:12.990064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:13.091742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:13.106704 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f5d798a-33c3-4434-87c7-ab0e62759e0e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1647 microversion: 2.1 time: 0.369203 Sep 08 10:21:13.111856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 944/2020] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:12 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1647 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:13.246408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-dfbaabea-8562-4123-8c4a-d21e831c46f5 req-74711a89-e9e5-470c-817d-6872b8766164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e615c95-7c58-431a-972b-c72445dc6d95", "name": "network-vif-deleted", "tag": "b8d4e261-8c7a-40a5-a35f-7873e227bcfd"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:13.264498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dfbaabea-8562-4123-8c4a-d21e831c46f5 req-74711a89-e9e5-470c-817d-6872b8766164 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:13.267430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:13.281638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dfbaabea-8562-4123-8c4a-d21e831c46f5 req-74711a89-e9e5-470c-817d-6872b8766164 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:13.284060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dfbaabea-8562-4123-8c4a-d21e831c46f5 req-74711a89-e9e5-470c-817d-6872b8766164 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:13.304237 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-131d7238-f581-4690-ab15-7ee7ea030efa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.335830 Sep 08 10:21:13.305191 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-dfbaabea-8562-4123-8c4a-d21e831c46f5 req-74711a89-e9e5-470c-817d-6872b8766164 service nova] Creating event network-vif-deleted:b8d4e261-8c7a-40a5-a35f-7873e227bcfd for instance 6e615c95-7c58-431a-972b-c72445dc6d95 on n-h1-833090-19 Sep 08 10:21:13.323487 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1077/2021] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:12 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:21:13.324486 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-dfbaabea-8562-4123-8c4a-d21e831c46f5 req-74711a89-e9e5-470c-817d-6872b8766164 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070479 Sep 08 10:21:13.325392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 945/2022] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:13.583682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2c1211af-a6b9-49ec-a66e-33f291aefb9d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509f4790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:13.678178 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2c1211af-a6b9-49ec-a66e-33f291aefb9d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.099682 Sep 08 10:21:13.682443 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1078/2023] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:13 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:13.753740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ebd138-b679-487a-8f84-f6bdde6c6fce tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f235535c700>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:13.827696 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9ebd138-b679-487a-8f84-f6bdde6c6fce tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.078649 Sep 08 10:21:13.836631 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 946/2024] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:13 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:13.845633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:13.847002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:13.860971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:13.866274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:13.877601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:13.878692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:13.879400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:13.880079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:14.140483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:14.140967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:14.141259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:14.152395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00097dc5-0410-4021-88bd-529d94cfcbfb tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 0.311098 Sep 08 10:21:14.153570 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1079/2025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:13 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:14.160099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:14.160861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:14.161631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:14.164250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:14.164953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:14.166385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:14.220788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:14.221589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:14.222429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:14.223857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lazy-loading 'fault' on Instance uuid 6e615c95-7c58-431a-972b-c72445dc6d95 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:21:14.278525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:14.288952 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a8cc7e5b-13c4-412c-b1b7-732d1e2899ad tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 200 len: 1306 microversion: 2.1 time: 0.154445 Sep 08 10:21:14.292430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 947/2026] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:14 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:14.337175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:14.338732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:14.348235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:14.349119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:14.349835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:14.351078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:14.351829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:14.353070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:14.574987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:14.585685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7ba3992-c2e1-4533-98fa-f8d377cce800 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.254112 Sep 08 10:21:14.587422 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1080/2027] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:14 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:14.694503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10472e4f-98a1-4853-b05f-2763b6c70891 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350c20310>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:14.745878 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10472e4f-98a1-4853-b05f-2763b6c70891 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.055396 Sep 08 10:21:14.755249 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 948/2028] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:14 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:14.844737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34982c3c-2921-417e-9af4-704a8262a235 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2350a4f790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:14.925643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34982c3c-2921-417e-9af4-704a8262a235 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.085074 Sep 08 10:21:14.926614 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1081/2029] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:14 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:15.178892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:15.180020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:15.193371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:15.195510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:15.197128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:15.198612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:15.200684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:15.201736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:15.319276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:15.320415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:15.342474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:15.343257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:15.343918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:15.348053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:15.349649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:15.358830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:15.392461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 HTTP/1.1 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6e615c95-7c58-431a-972b-c72445dc6d95'} Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:15.394577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:15.401207 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:15.402701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:15.404017 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da7a4019-6cca-4707-a90c-2abe03d2ccb8 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 404 len: 111 microversion: 2.1 time: 0.092432 Sep 08 10:21:15.404606 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1082/2030] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:15 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:21:15.414040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccffd140-f90c-40ca-af9f-8c64addd3af2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23512a4280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:15.566834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:15.578139 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e40f1bea-b9dd-49a3-966e-8440bfad6004 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 0.402332 Sep 08 10:21:15.581463 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 949/2031] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:15 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:15.610571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:15.611184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:15.625901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:15.625901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:15.625901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:15.625901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:15.626389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:15.626389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:15.981245 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ccffd140-f90c-40ca-af9f-8c64addd3af2 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a" status: 202 len: 0 microversion: 2.1 time: 0.572039 Sep 08 10:21:15.983605 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1083/2032] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:15 2022] DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:15.989587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f641e676-9c12-4869-b8be-1324fa4bbd5e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350a54940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:16.062365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f641e676-9c12-4869-b8be-1324fa4bbd5e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.077126 Sep 08 10:21:16.063900 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1084/2033] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:15 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:16.070664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8464a9e-2fd5-4825-b547-efc85201a2b0 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2350aa6940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:16.175802 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8464a9e-2fd5-4825-b547-efc85201a2b0 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.109400 Sep 08 10:21:16.177075 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1085/2034] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:16 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:16.182967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5822959-1306-4d13-b1d9-740bc476eb47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2350a32310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:16.198167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:16.212024 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6da817c-eff1-4c03-8aa4-2e4fd393234d tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 0.605752 Sep 08 10:21:16.223484 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 950/2035] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:15 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:21:16.611721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:16.613577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:16.629045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:16.629919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:16.632927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:16.635856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:16.638803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:16.639618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:17.105016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:17.161787 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38933764-b871-4537-8c64-904b427fabde tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 0.557375 Sep 08 10:21:17.176039 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 951/2036] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:16 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:17.197856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e4dc1607-88e4-4811-9f06-898968071a95 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23553c54c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:17.440916 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5822959-1306-4d13-b1d9-740bc476eb47 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad" status: 202 len: 0 microversion: 2.1 time: 1.263025 Sep 08 10:21:17.441812 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1086/2037] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:16 2022] DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad => generated 0 bytes in 1265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:17.449626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5c0b77c-0290-4835-9bdb-45161dc8e6ff tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23509b9160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:17.684788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e4dc1607-88e4-4811-9f06-898968071a95 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1453 microversion: 2.1 time: 0.502148 Sep 08 10:21:17.685391 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 952/2038] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:17 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1453 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:17.694145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:17.694902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:17.713371 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5c0b77c-0290-4835-9bdb-45161dc8e6ff tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 0.268355 Sep 08 10:21:17.723254 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1087/2039] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:17 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:17.723254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee7f4010-8d7c-4e72-8eef-851096d5e8c7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'create', calling method: .version_select at 0x7f2350a32ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1087871640", "description": "tempest-description-600005717"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:17.742150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:17.742658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:17.743104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:17.743875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:17.744335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:17.744766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:19.552060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:19.561598 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1a56f5a4-8310-47e8-842f-ee5fa011406c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1391 microversion: 2.1 time: 1.875169 Sep 08 10:21:19.569880 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 953/2040] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:17 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1391 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:19.604153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b4855211-fd64-4e9e-85dd-6b985132506f req-2a02379b-2a8c-416d-99e9-fe353bd1bfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "name": "network-vif-plugged", "status": "completed", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:19.626305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b4855211-fd64-4e9e-85dd-6b985132506f req-2a02379b-2a8c-416d-99e9-fe353bd1bfac service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:19.627186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b4855211-fd64-4e9e-85dd-6b985132506f req-2a02379b-2a8c-416d-99e9-fe353bd1bfac service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:19.627958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b4855211-fd64-4e9e-85dd-6b985132506f req-2a02379b-2a8c-416d-99e9-fe353bd1bfac service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:19.660344 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b4855211-fd64-4e9e-85dd-6b985132506f req-2a02379b-2a8c-416d-99e9-fe353bd1bfac service nova] Creating event network-vif-plugged:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:21:19.687995 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b4855211-fd64-4e9e-85dd-6b985132506f req-2a02379b-2a8c-416d-99e9-fe353bd1bfac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116424 Sep 08 10:21:19.695085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 954/2041] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:19.712211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-92f59a49-cdec-426f-a860-51c424bab51e req-7808fff0-06a8-46f3-8786-504bd7bbcba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63066b7-480f-4376-94da-0fccd625bf8e", "name": "network-vif-unplugged", "status": "completed", "tag": "3cb48e05-a1a1-4d09-961c-be42377068c3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:19.735543 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee7f4010-8d7c-4e72-8eef-851096d5e8c7 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.011249 Sep 08 10:21:19.737915 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1088/2042] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:21:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:19.744606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:19.745623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:19.780408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-92f59a49-cdec-426f-a860-51c424bab51e req-7808fff0-06a8-46f3-8786-504bd7bbcba8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:19.789591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-92f59a49-cdec-426f-a860-51c424bab51e req-7808fff0-06a8-46f3-8786-504bd7bbcba8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:19.790612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:19.796314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:19.797169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-92f59a49-cdec-426f-a860-51c424bab51e req-7808fff0-06a8-46f3-8786-504bd7bbcba8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:19.803738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:19.804893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:19.807140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:19.810698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:19.844972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-92f59a49-cdec-426f-a860-51c424bab51e req-7808fff0-06a8-46f3-8786-504bd7bbcba8 service nova] Creating event network-vif-unplugged:3cb48e05-a1a1-4d09-961c-be42377068c3 for instance a63066b7-480f-4376-94da-0fccd625bf8e on n-h1-833090-19 Sep 08 10:21:19.874738 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-92f59a49-cdec-426f-a860-51c424bab51e req-7808fff0-06a8-46f3-8786-504bd7bbcba8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173800 Sep 08 10:21:19.883172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 955/2043] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:19.914010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-30088af7-c81c-48d3-a539-87c39de88931 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23553c5820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:22.662202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:22.680241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1fc8c37-d2f1-4d41-94ae-8515f7268ac1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1470 microversion: 2.1 time: 2.937210 Sep 08 10:21:22.683360 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1089/2044] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:19 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1470 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:22.708133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93da46d5-4124-4871-9d32-c7c5cd215d1f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23509e8f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:29.779804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:29.787837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:29.843599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=50 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:32.673862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:39.458031 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-30088af7-c81c-48d3-a539-87c39de88931 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1462 microversion: 2.1 time: 19.571452 Sep 08 10:21:39.469631 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 956/2045] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:19 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1462 bytes in 19576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:39.469631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28e3875a-428f-447b-ade1-0e4315a3eff5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Action: 'update', calling method: .version_select at 0x7f2350bbfe50>, body: {"security_group": {"name": "tempest-sg-hth-1367423506", "description": "tempest-description-hth-735615196"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:39.485156 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93da46d5-4124-4871-9d32-c7c5cd215d1f tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1427 microversion: 2.1 time: 16.800351 Sep 08 10:21:39.486929 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1090/2046] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:22 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1427 bytes in 16803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:39.498292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:39.498986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:39.505729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.506220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.506662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.507380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.507918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.508567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.719365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:39.729581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc2a6bed-035f-4d7f-a7da-3a0bf7a3fb22 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1381 microversion: 2.1 time: 0.241782 Sep 08 10:21:39.731479 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1091/2047] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:39 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1381 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:39.736300 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28e3875a-428f-447b-ade1-0e4315a3eff5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "PUT /compute/v2.1/os-security-groups/e5b97258-4f28-434f-a60f-5ab7eed39214" status: 200 len: 217 microversion: 2.1 time: 0.275093 Sep 08 10:21:39.736886 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 957/2048] 10.222.0.59 () {60 vars in 1290 bytes} [Thu Sep 8 10:21:39 2022] PUT /compute/v2.1/os-security-groups/e5b97258-4f28-434f-a60f-5ab7eed39214 => generated 217 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:39.741669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-da1e243f-d921-4c8e-b4a1-e14e751fb048 req-489b8358-0746-4030-aa30-7494dbdbe300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63066b7-480f-4376-94da-0fccd625bf8e", "tag": "3cb48e05-a1a1-4d09-961c-be42377068c3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:39.751783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-44caa861-4ee9-4cd4-a842-cc97d15ebf35 req-1c604073-cd8f-4879-822b-b91958b2e9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "name": "network-vif-plugged", "status": "completed", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:39.762285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da1e243f-d921-4c8e-b4a1-e14e751fb048 req-489b8358-0746-4030-aa30-7494dbdbe300 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.762756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da1e243f-d921-4c8e-b4a1-e14e751fb048 req-489b8358-0746-4030-aa30-7494dbdbe300 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.763432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da1e243f-d921-4c8e-b4a1-e14e751fb048 req-489b8358-0746-4030-aa30-7494dbdbe300 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.764391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-44caa861-4ee9-4cd4-a842-cc97d15ebf35 req-1c604073-cd8f-4879-822b-b91958b2e9bb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.765791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-44caa861-4ee9-4cd4-a842-cc97d15ebf35 req-1c604073-cd8f-4879-822b-b91958b2e9bb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.766617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-44caa861-4ee9-4cd4-a842-cc97d15ebf35 req-1c604073-cd8f-4879-822b-b91958b2e9bb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.781143 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-da1e243f-d921-4c8e-b4a1-e14e751fb048 req-489b8358-0746-4030-aa30-7494dbdbe300 service nova] Creating event network-changed:3cb48e05-a1a1-4d09-961c-be42377068c3 for instance a63066b7-480f-4376-94da-0fccd625bf8e on n-h2-833090-19 Sep 08 10:21:39.782380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-44caa861-4ee9-4cd4-a842-cc97d15ebf35 req-1c604073-cd8f-4879-822b-b91958b2e9bb service nova] Creating event network-vif-plugged:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:21:39.786618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-da1e243f-d921-4c8e-b4a1-e14e751fb048 req-489b8358-0746-4030-aa30-7494dbdbe300 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048262 Sep 08 10:21:39.787241 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 958/2049] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:39.787361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-44caa861-4ee9-4cd4-a842-cc97d15ebf35 req-1c604073-cd8f-4879-822b-b91958b2e9bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054088 Sep 08 10:21:39.787978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1092/2050] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:39.793244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:39.793775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-25b93420-4b58-40f4-b614-e3b9ee2a9572 req-1deacb22-4f75-4b82-bff3-4fa86d6f74bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "name": "network-vif-unplugged", "status": "completed", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:39.793926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:39.800456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.800948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.801386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.802100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.802557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.802989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.803782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-25b93420-4b58-40f4-b614-e3b9ee2a9572 req-1deacb22-4f75-4b82-bff3-4fa86d6f74bb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:39.804268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-25b93420-4b58-40f4-b614-e3b9ee2a9572 req-1deacb22-4f75-4b82-bff3-4fa86d6f74bb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:39.804703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-25b93420-4b58-40f4-b614-e3b9ee2a9572 req-1deacb22-4f75-4b82-bff3-4fa86d6f74bb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:39.816557 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-25b93420-4b58-40f4-b614-e3b9ee2a9572 req-1deacb22-4f75-4b82-bff3-4fa86d6f74bb service nova] Creating event network-vif-unplugged:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h2-833090-19 Sep 08 10:21:39.822545 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-25b93420-4b58-40f4-b614-e3b9ee2a9572 req-1deacb22-4f75-4b82-bff3-4fa86d6f74bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032346 Sep 08 10:21:39.823277 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1093/2051] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:39.941974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2007701968", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "313ab5a8-9ad4-4dd2-a9fe-46aa0dfdf2be"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:39.981650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:39.990255 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-415bb946-4b80-4996-895c-6346d994d54f tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1463 microversion: 2.1 time: 0.201727 Sep 08 10:21:39.991069 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 959/2052] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:39 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1463 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:39.997939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] validate_networks() for [('313ab5a8-9ad4-4dd2-a9fe-46aa0dfdf2be', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:21:40.051547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f36dc4fb-c668-4400-be2b-a130d689a064 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Action: 'create', calling method: .version_select at 0x7f23553c5b80>, body: {"pool": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:41.235517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:21:41.236027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:21:41.236433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:21:41.236837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:21:41.237363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:21:41.246083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:41.246565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:41.246998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:41.247805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:41.248256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:41.248675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:41.266602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Getting quotas for project dea416d64c664fb2864e2d42c8fa8306. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:21:41.271357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Getting quotas for user 4afdfe9915e34589a5c126b25d228e95 and project dea416d64c664fb2864e2d42c8fa8306. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:21:41.286005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Going to run 3 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:21:41.288660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:21:41.328612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=42850fd4-9c12-4dca-a639-6f4cebdcf399,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:21:41.365385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=9e79c97b-cc74-4562-bd3f-e4d4ee9b6826,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:21:41.432336 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d10ef204-badf-4c5a-8ccb-b6f08c5c9b5c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607711 Sep 08 10:21:41.440277 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1094/2053] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:21:41.446001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1058275833", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a201f7b1-2b10-4321-b5d2-383c4b92fcf0"}], "block_device_mapping_v2": [{"uuid": "fea020e9-438a-4c18-9f6b-d4df17fed431", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:41.517870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] validate_networks() for [('a201f7b1-2b10-4321-b5d2-383c4b92fcf0', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:21:42.208965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:21:42.209717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:21:42.211342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:21:42.212073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:21:42.212944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:21:42.226233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.227266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.227990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.229128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.229754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.230386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.255553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:21:42.264758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Getting quotas for user 448b7c1cb3eb4b63a427a3d7b7d6eb13 and project 7fcb031b760e4b5fbdcc1adb626aa462. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:21:42.341461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:21:42.343596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fea020e9-438a-4c18-9f6b-d4df17fed431',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:21:42.472255 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f36dc4fb-c668-4400-be2b-a130d689a064 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.480254 Sep 08 10:21:42.484787 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 960/2054] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:21:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:42.494784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc2cbcf5-45ba-4b1f-a3a2-37c66d4de51d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350bd00d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:42.559765 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2109e504-caf7-401f-bcf5-e746bd92ca81 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.118710 Sep 08 10:21:42.564352 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc2cbcf5-45ba-4b1f-a3a2-37c66d4de51d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 200 len: 1462 microversion: 2.1 time: 0.076997 Sep 08 10:21:42.565153 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 961/2055] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:42 2022] GET /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 1462 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:42.572088 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1095/2056] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:21:42.577791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f976dae-4f8c-4261-be76-ab082e15702e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23553df8b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:42.582441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6da92d6c-4cb1-4e2c-93ab-f825ce47c8b8 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '.version_select at 0x7f23512a4280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:42.585956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6da92d6c-4cb1-4e2c-93ab-f825ce47c8b8 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.586501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6da92d6c-4cb1-4e2c-93ab-f825ce47c8b8 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.586942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6da92d6c-4cb1-4e2c-93ab-f825ce47c8b8 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.604026 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6da92d6c-4cb1-4e2c-93ab-f825ce47c8b8 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 4320 microversion: 2.1 time: 0.030543 Sep 08 10:21:42.619010 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1096/2057] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:21:42 2022] GET /compute/v2.1/os-migrations => generated 4320 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:42.669755 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f976dae-4f8c-4261-be76-ab082e15702e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/e5b97258-4f28-434f-a60f-5ab7eed39214" status: 200 len: 217 microversion: 2.1 time: 0.102410 Sep 08 10:21:42.671193 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 962/2058] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:21:42 2022] GET /compute/v2.1/os-security-groups/e5b97258-4f28-434f-a60f-5ab7eed39214 => generated 217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:42.681814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85d17f6b-5efe-49f2-931a-7d340a11580d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23553c5940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:42.767089 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85d17f6b-5efe-49f2-931a-7d340a11580d tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1436 microversion: 2.1 time: 0.094098 Sep 08 10:21:42.767680 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 963/2059] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:42 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1436 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:42.779964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:42.789254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:42.791174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:21:42.806334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.808262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.808792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.810528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.811094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.811724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.831291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:42.831927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:42.841194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.841965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.842585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.843507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:42.844463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:42.845692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:42.914165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:21:43.003800 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c55f343c-402d-4906-a7c7-47b3eed0c35c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.230360 Sep 08 10:21:43.004882 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 964/2060] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:21:42 2022] GET /compute/v2.1/servers => generated 1018 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:43.010507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-172a481c-116a-4331-ab44-b7140ff482ba req-278b062f-8b3f-4874-b369-1d57000687af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "name": "network-vif-plugged", "status": "completed", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:43.021440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-172a481c-116a-4331-ab44-b7140ff482ba req-278b062f-8b3f-4874-b369-1d57000687af service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:43.022437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-172a481c-116a-4331-ab44-b7140ff482ba req-278b062f-8b3f-4874-b369-1d57000687af service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:43.022951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-172a481c-116a-4331-ab44-b7140ff482ba req-278b062f-8b3f-4874-b369-1d57000687af service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:43.036837 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-172a481c-116a-4331-ab44-b7140ff482ba req-278b062f-8b3f-4874-b369-1d57000687af service nova] Creating event network-vif-plugged:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h2-833090-19 Sep 08 10:21:43.042564 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-172a481c-116a-4331-ab44-b7140ff482ba req-278b062f-8b3f-4874-b369-1d57000687af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036003 Sep 08 10:21:43.050984 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60377d68-f19f-4a32-99e8-46ed476ffb6e tempest-MigrationsAdminTest-72405844 tempest-MigrationsAdminTest-72405844-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1616 microversion: 2.1 time: 0.430539 Sep 08 10:21:43.052750 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 965/2061] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:43.060888 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1097/2062] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:42 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1616 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:43.071575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8bfd0c30-49f7-40ca-a158-5cd352ce1faf tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Action: 'create', calling method: .version_select at 0x7f2350972e50>, body: {"pool": null} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:43.072673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-53b9448b-c18a-4b46-83c0-46fc7197a0df req-18ec9763-964f-4297-a6f5-1c3e77066c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:43.083225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-53b9448b-c18a-4b46-83c0-46fc7197a0df req-18ec9763-964f-4297-a6f5-1c3e77066c5e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:43.084606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-53b9448b-c18a-4b46-83c0-46fc7197a0df req-18ec9763-964f-4297-a6f5-1c3e77066c5e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:43.084606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-53b9448b-c18a-4b46-83c0-46fc7197a0df req-18ec9763-964f-4297-a6f5-1c3e77066c5e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:43.096735 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-53b9448b-c18a-4b46-83c0-46fc7197a0df req-18ec9763-964f-4297-a6f5-1c3e77066c5e service nova] Creating event network-changed:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h2-833090-19 Sep 08 10:21:43.101838 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-53b9448b-c18a-4b46-83c0-46fc7197a0df req-18ec9763-964f-4297-a6f5-1c3e77066c5e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047445 Sep 08 10:21:43.102441 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 966/2063] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:43.109539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c84ec818-f5fc-48e0-970b-8335f8618a18 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:43.109836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c84ec818-f5fc-48e0-970b-8335f8618a18 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:43.188510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c84ec818-f5fc-48e0-970b-8335f8618a18 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:43.196085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c84ec818-f5fc-48e0-970b-8335f8618a18 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:43.197578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c84ec818-f5fc-48e0-970b-8335f8618a18 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:43.198689 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c84ec818-f5fc-48e0-970b-8335f8618a18 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1104 microversion: 2.25 time: 0.094972 Sep 08 10:21:43.199255 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 967/2064] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:43 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1104 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:43.204326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:43.204927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:43.211447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:43.211959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:43.212397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:43.213098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:43.213638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:43.214069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:43.564588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:43.573250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27cee130-ea6c-40f8-87f1-5a3f27efec66 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1468 microversion: 2.1 time: 0.372097 Sep 08 10:21:43.574247 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 968/2065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:43 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1468 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:43.584992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:43.586339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:43.597897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:43.598392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:43.598833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:43.599573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:43.610551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:43.624187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:44.009252 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ebc16de9-9674-45d5-a3bd-ed8060c0dc36 tempest-LiveMigrationTest-510967517 tempest-LiveMigrationTest-510967517-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1534 microversion: 2.1 time: 0.431715 Sep 08 10:21:44.010496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 969/2066] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:43 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1534 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:44.017175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f579594-10d9-42fd-a44c-7eacd27a1158 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2355404430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:44.493485 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f579594-10d9-42fd-a44c-7eacd27a1158 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/e5b97258-4f28-434f-a60f-5ab7eed39214" status: 202 len: 0 microversion: 2.1 time: 0.481520 Sep 08 10:21:44.495086 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 970/2067] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:44 2022] DELETE /compute/v2.1/os-security-groups/e5b97258-4f28-434f-a60f-5ab7eed39214 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:44.501756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-338ebe5d-4cb6-4f8d-b5d5-1a47e82da51b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2350c0bc10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:44.615677 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-338ebe5d-4cb6-4f8d-b5d5-1a47e82da51b tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 200 len: 1436 microversion: 2.1 time: 0.119068 Sep 08 10:21:44.621204 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 971/2068] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:44 2022] GET /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 1436 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:44.631014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:44.632081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:44.646334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:44.652422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:44.653309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:44.654313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:44.655179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:44.656068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.063497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:45.082143 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7965bf32-537e-45aa-8060-9c0c7819fa54 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1281 microversion: 2.1 time: 0.458850 Sep 08 10:21:45.083052 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 972/2069] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:44 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:45.088023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:45.088729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.098893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.100156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.102833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.103636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.104109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.104690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.146988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:45.240958 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d27fe3e-f3e0-4f4c-b03b-579f47dd7378 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 204 len: 0 microversion: 2.1 time: 0.155975 Sep 08 10:21:45.241676 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 973/2070] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:45 2022] DELETE /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:45.247628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2145981353"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:45.250399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.257027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.257795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.258447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.259178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.259657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.260093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.533214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ffcbf35-46df-445f-91a1-255d2055fcb5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "POST /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273/action" status: 202 len: 0 microversion: 2.1 time: 0.289038 Sep 08 10:21:45.536093 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 974/2071] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:21:45 2022] POST /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:21:45.546340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:45.547431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.561592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.562440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.562954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.563776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.564366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.564814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.596021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:45.693953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb74ede2-701c-4410-b10d-7d22fab0bf74 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 204 len: 0 microversion: 2.1 time: 0.154345 Sep 08 10:21:45.694859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 975/2072] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:45 2022] DELETE /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:45.700939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:45.701760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.708891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.709377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.709808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.711149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.711149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.711380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.756616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8bfd0c30-49f7-40ca-a158-5cd352ce1faf tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.694135 Sep 08 10:21:45.759745 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1098/2073] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:21:43 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:45.766159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:45.767668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.776023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.776830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.777277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.778014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.779350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.780201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.800448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:45.804675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 HTTP/1.1 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6e615c95-7c58-431a-972b-c72445dc6d95'} Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:45.806481 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f970f67b-ef26-43fa-8081-7ee6528177f9 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 404 len: 111 microversion: 2.1 time: 0.048193 Sep 08 10:21:45.818894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1099/2074] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:45 2022] DELETE /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:45.820982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:45.820982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:45.821466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:45.821634 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a75272cd-b82b-438d-b6a9-3b58d78c783f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1241 microversion: 2.25 time: 0.122051 Sep 08 10:21:45.821806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.821973 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 976/2075] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:45 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:45.825774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.825930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}, {"server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "name": "network-vif-unplugged", "status": "completed", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:45.826886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.827343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.828848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.829317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.829807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.838187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.839011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.839652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.854325 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] Creating event network-vif-unplugged:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:21:45.855168 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] Creating event network-vif-unplugged:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:21:45.873322 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d33cdb6b-ca8c-478f-a6c4-3fe139f43982 req-dd93a365-50e0-4147-ae17-b91e0d1e2e1e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.051054 Sep 08 10:21:45.877306 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 977/2076] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:45.882956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:45.883695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:45.891047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.891499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.892681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:45.892681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:45.893106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:45.893527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:46.023755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:46.039603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d343fa6c-ba3d-4704-850c-43b17fbcbabc tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1466 microversion: 2.1 time: 0.227902 Sep 08 10:21:46.040570 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1100/2077] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:45 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1466 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:46.046275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-029ba2f1-5f3e-44f5-a262-9234aa817b21 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509f4dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:46.109319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:46.110582 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-029ba2f1-5f3e-44f5-a262-9234aa817b21 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.068758 Sep 08 10:21:46.111559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1101/2078] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:46 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:46.116654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:46.117475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:46.125081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:46.126043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:46.126486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:46.126931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-06ec57bd-2b70-4644-9a7c-a4439c911aa3 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1469 microversion: 2.1 time: 0.248530 Sep 08 10:21:46.127337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:46.127562 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 978/2079] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:45 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:46.131947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:46.132472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:46.143849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88fdcf86-fd50-43f0-bcf0-f9a1f554ff70 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Action: 'create', calling method: .version_select at 0x7f23554150d0>, body: {"pool": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:46.371882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:46.383735 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-adfd32a2-b820-4b99-8298-b275872d96a4 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1387 microversion: 2.1 time: 0.271010 Sep 08 10:21:46.384766 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1102/2080] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:46 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1387 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:46.390216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:46.390900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 6e615c95-7c58-431a-972b-c72445dc6d95] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:46.397581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:46.398285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:46.399035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:46.400157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:46.400623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:46.401092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:46.417278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 HTTP/1.1 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6e615c95-7c58-431a-972b-c72445dc6d95'} Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:46.418987 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Instance 6e615c95-7c58-431a-972b-c72445dc6d95 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2d9b266-4985-4cc5-a370-a44f8f3f4492 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95" status: 404 len: 111 microversion: 2.1 time: 0.036374 Sep 08 10:21:46.425498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1103/2081] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:46 2022] GET /compute/v2.1/servers/6e615c95-7c58-431a-972b-c72445dc6d95 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:46.430134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56640380-44ea-4633-9583-61dc3c14d45a tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f2350a4fd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.020452 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56640380-44ea-4633-9583-61dc3c14d45a tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "DELETE /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1" status: 204 len: 0 microversion: 2.1 time: 0.594741 Sep 08 10:21:47.021260 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1104/2082] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:46 2022] DELETE /compute/v2.1/images/e0b9291b-5c6b-4e6f-ae00-6d8d4d6457a1 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:47.028900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.033747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:47.065231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.073662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.074731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.081190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.082608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.083140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.439030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:47.449161 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6871c850-f60a-432d-bf3c-a4f9b016b0ad tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.426702 Sep 08 10:21:47.463917 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1105/2083] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:47 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:47.471001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f235135fc10>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.533076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:47.534729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 35b68fd9-e6e2-47bf-992e-b427ba466fad not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:21:47.535740 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.535740 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad HTTP/1.1 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '35b68fd9-e6e2-47bf-992e-b427ba466fad'} Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:47.538973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] Sep 08 10:21:47.543653 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.548948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 35b68fd9-e6e2-47bf-992e-b427ba466fad does not exist Sep 08 10:21:47.548948 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-0e478ddf-faa9-4ec1-aefe-2fdcdecff700'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:47.549815 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69b024cd-2195-4e3d-ba20-1e6e3fba41f3 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad" status: 404 len: 194 microversion: 2.1 time: 0.084589 Sep 08 10:21:47.550571 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1106/2084] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:47 2022] DELETE /compute/v2.1/os-security-groups/35b68fd9-e6e2-47bf-992e-b427ba466fad => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:47.558363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.559087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:47.569370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.569864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.570298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.571530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.571969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.572394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.677861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:47.690336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:47.691956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:47.693601 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b2be8a2a-02fb-4209-a1cd-979ffa034b8d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1251 microversion: 2.25 time: 0.141914 Sep 08 10:21:47.708731 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1107/2085] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:47 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1251 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:47.714468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715ee4a1-cf05-4d64-b6a1-238a89431876 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '.version_select at 0x7f23509f4940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.773170 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-715ee4a1-cf05-4d64-b6a1-238a89431876 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] HTTP exception thrown: Image not found. Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715ee4a1-cf05-4d64-b6a1-238a89431876 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Request method failure captured: Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 HTTP/1.1 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHZydfZuRD56CUlxd6wlQg87IIapC-diz-g3olM7bGB5W9sk82s1PLDcDT6buVabBkITl_iG_hkLds1FvSqegkzzi9PVr5uXwBXmmg1CHMMj93KjDF8KvXE9gr84NgmRyD0FHFecdYpoxrBIgB0_tFdGgHXuND5P7QISN2IygA9DgM Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0ad2b637afd44869ba29070b2ad92f98 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ad2b637afd44869ba29070b2ad92f98", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0ad2b637afd44869ba29070b2ad92f98 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerTestJSON-604502723-project Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ddc1e291586e46adb2e198b0668953c4 Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerTestJSON-604502723-project Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'cdfae3b8-f41f-4059-9010-a131a89b2616'} Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cdfae3b8-f41f-4059-9010-a131a89b2616 to delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cdfae3b8-f41f-4059-9010-a131a89b2616 could not be found. Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.775182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715ee4a1-cf05-4d64-b6a1-238a89431876 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:47.781401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-715ee4a1-cf05-4d64-b6a1-238a89431876 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "DELETE /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616" status: 404 len: 62 microversion: 2.1 time: 0.068859 Sep 08 10:21:47.784004 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1108/2086] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:47 2022] DELETE /compute/v2.1/images/cdfae3b8-f41f-4059-9010-a131a89b2616 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:21:47.789400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-495d4940-9a21-4134-9b3c-9f031e51012f req-8a0e576c-39f3-4ce0-944e-0332409afa47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42850fd4-9c12-4dca-a639-6f4cebdcf399", "tag": "09b0b766-dfe3-4e32-be88-12f2942d36e3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:47.805108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-495d4940-9a21-4134-9b3c-9f031e51012f req-8a0e576c-39f3-4ce0-944e-0332409afa47 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.805108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-495d4940-9a21-4134-9b3c-9f031e51012f req-8a0e576c-39f3-4ce0-944e-0332409afa47 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.806155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-495d4940-9a21-4134-9b3c-9f031e51012f req-8a0e576c-39f3-4ce0-944e-0332409afa47 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.816455 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-495d4940-9a21-4134-9b3c-9f031e51012f req-8a0e576c-39f3-4ce0-944e-0332409afa47 service nova] Creating event network-changed:09b0b766-dfe3-4e32-be88-12f2942d36e3 for instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 on n-h1-833090-19 Sep 08 10:21:47.821593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-495d4940-9a21-4134-9b3c-9f031e51012f req-8a0e576c-39f3-4ce0-944e-0332409afa47 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 Sep 08 10:21:47.822306 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1109/2087] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:47.828191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-12b7029a-512d-427f-9e6c-28271ed071c2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509ff550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.876797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-12b7029a-512d-427f-9e6c-28271ed071c2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.053041 Sep 08 10:21:47.877689 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1110/2088] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:47 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:47.882552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.883568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:47.890214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.890700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.891132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.891870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.892316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.892736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.902320 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88fdcf86-fd50-43f0-bcf0-f9a1f554ff70 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.773714 Sep 08 10:21:47.903014 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 979/2089] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:21:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:47.908610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:47.910515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:47.918896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.920657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.921257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.922130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:47.922745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:47.923331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:47.942519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:48.118039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:48.125902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5764bd89-89b1-4cc5-be79-318703641a30 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1469 microversion: 2.1 time: 0.247011 Sep 08 10:21:48.127052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1111/2090] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:47 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:48.132302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2350a4f940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:48.163297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:48.164232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 04ea77a0-14bb-43c9-addc-68059490603a not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:21:48.165332 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.165332 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a HTTP/1.1 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '04ea77a0-14bb-43c9-addc-68059490603a'} Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:48.167677 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] Sep 08 10:21:48.172596 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.178006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:48.178006 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b78967d3-fdc3-482b-a841-13173252306c tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1387 microversion: 2.1 time: 0.271778 Sep 08 10:21:48.179418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 04ea77a0-14bb-43c9-addc-68059490603a does not exist Sep 08 10:21:48.179418 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-2c0cddb9-d62d-483a-ab22-4f120e554bad'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:48.180889 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f48c9606-8262-4158-a41c-2f1bd8482a4e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a" status: 404 len: 194 microversion: 2.1 time: 0.052530 Sep 08 10:21:48.181938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1112/2091] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:48 2022] DELETE /compute/v2.1/os-security-groups/04ea77a0-14bb-43c9-addc-68059490603a => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:48.187011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:48.187859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 980/2092] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:47 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1387 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:48.188089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:48.195642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:48.196519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:48.197202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:48.198152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:48.199119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:48.199947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:48.203166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddc17c67-dc69-4620-8705-91866858331b tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Action: 'create', calling method: .version_select at 0x7f2350c03e50>, body: {"pool": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:48.228882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:48.324200 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e58da971-a425-4a5d-bfb0-bb7b19a6438e tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 204 len: 0 microversion: 2.1 time: 0.140531 Sep 08 10:21:48.329620 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1113/2093] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:48 2022] DELETE /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:48.337081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2351d39700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:48.482080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:48.484536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:21:48.486625 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.486625 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47 HTTP/1.1 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '59fabba1-b074-452e-8e5e-b98f9bbaab47'} Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:48.490891 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] Sep 08 10:21:48.496334 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:48.530262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 59fabba1-b074-452e-8e5e-b98f9bbaab47 does not exist Sep 08 10:21:48.530262 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-cb208181-bb4f-4a72-a4e7-2f9500c758c5'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:48.538727 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52a3b89a-66fb-4f26-b7a9-4e4be9cbc281 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47" status: 404 len: 194 microversion: 2.1 time: 0.206405 Sep 08 10:21:48.551357 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1114/2094] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:48 2022] DELETE /compute/v2.1/os-security-groups/59fabba1-b074-452e-8e5e-b98f9bbaab47 => generated 194 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:48.569701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:48.570502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:48.584746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:48.586251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:48.586857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:48.587776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:48.588237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:48.588663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:49.074447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:49.083722 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78c2c9e5-c6c1-4da2-a5da-e8b2f3b927ef tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1472 microversion: 2.1 time: 0.530360 Sep 08 10:21:49.090634 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1115/2095] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:48 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:49.096521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:49.100894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:49.117178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:49.117996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:49.118612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:49.119986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:49.120827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:49.121432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:49.896845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:49.908805 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a7ded7c-727d-4999-ba21-fadb7a4ae5e6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.816357 Sep 08 10:21:49.924421 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1116/2096] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:49 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:49.930758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f235096e310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:49.943174 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:21:49.943635 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 10:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c (ip 10.222.0.59) !!! Sep 08 10:21:49.998048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:49.998991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:21:49.999775 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:49.999775 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c HTTP/1.1 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '37ce1905-4213-43f4-9c3c-cc7edbe1c53c'} Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:50.002042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] Sep 08 10:21:50.006810 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:50.016024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 37ce1905-4213-43f4-9c3c-cc7edbe1c53c does not exist Sep 08 10:21:50.016024 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-8dfcefd1-a90a-405d-8f0f-511a452c3cb5'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:50.017518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eaf92819-1d71-492d-991a-aece684e6cdf tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c" status: 404 len: 194 microversion: 2.1 time: 0.091996 Sep 08 10:21:50.018697 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1117/2097] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:49 2022] DELETE /compute/v2.1/os-security-groups/37ce1905-4213-43f4-9c3c-cc7edbe1c53c => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:50.032356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:50.033441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:50.059742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.060622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.061316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.062784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.063784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.064587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.214709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:50.227705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:50.229582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:50.231959 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-13b8a6bb-ecd4-4391-9a78-304124081d4b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1251 microversion: 2.25 time: 0.211436 Sep 08 10:21:50.232758 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1118/2098] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:50 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1251 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:50.246818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b4d0985-8712-4077-b87d-f4108520c8f8 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350a4f790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:50.323540 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b4d0985-8712-4077-b87d-f4108520c8f8 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.089389 Sep 08 10:21:50.324837 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1119/2099] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:50 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:50.331524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:50.341910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:50.350124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.350967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.351543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.352510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.353242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.354136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.680057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:50.691246 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f800dc0b-1211-4f5f-8417-c1b49a0eb4a9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1427 microversion: 2.1 time: 0.362118 Sep 08 10:21:50.696851 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1120/2100] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:50 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1427 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:50.707452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:50.708129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:50.715059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.715987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.716607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.717929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.718701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.719316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.730858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:50.832105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:50.843855 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3f66634-9e27-4583-8ddc-f095207ccd34 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1183 microversion: 2.1 time: 0.146000 Sep 08 10:21:50.846449 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1121/2101] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:50 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:50.864372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d54b3ce-40c1-4410-be63-a9ab59f67519", "tag": "225b9ccd-539b-42ac-b643-c167c9862616"}, {"name": "network-changed", "server_uuid": "9e79c97b-cc74-4562-bd3f-e4d4ee9b6826", "tag": "ddf5ae5a-4ced-4792-a02a-f3ce00e7bbdd"}, {"server_uuid": "a63066b7-480f-4376-94da-0fccd625bf8e", "name": "network-vif-deleted", "tag": "3cb48e05-a1a1-4d09-961c-be42377068c3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:50.884730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:50.888402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:50.896236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:50.915383 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Creating event network-changed:225b9ccd-539b-42ac-b643-c167c9862616 for instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 on n-h1-833090-19 Sep 08 10:21:50.916386 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Creating event network-changed:ddf5ae5a-4ced-4792-a02a-f3ce00e7bbdd for instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 on n-h2-833090-19 Sep 08 10:21:50.917513 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] Creating event network-vif-deleted:3cb48e05-a1a1-4d09-961c-be42377068c3 for instance a63066b7-480f-4376-94da-0fccd625bf8e on n-h2-833090-19 Sep 08 10:21:50.949839 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c816b827-269c-4f2b-9e32-eb61e9f8a88e req-74b61324-0d64-4094-a355-8f44eeecbd8f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.101064 Sep 08 10:21:50.951311 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1122/2102] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:50.968356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2350a639d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.003794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:51.005054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 58526712-7abf-4d74-8216-fe45b967dbfd not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:21:51.005755 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.005755 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd HTTP/1.1 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '58526712-7abf-4d74-8216-fe45b967dbfd'} Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:51.008892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] Sep 08 10:21:51.014841 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.019817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 58526712-7abf-4d74-8216-fe45b967dbfd does not exist Sep 08 10:21:51.019817 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-b0aae05f-7e35-4bb4-a37f-2e019b906411'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:51.020992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9c0e5a5-84e4-41f9-981d-a24aadd2214e tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd" status: 404 len: 194 microversion: 2.1 time: 0.064058 Sep 08 10:21:51.022078 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1123/2103] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:50 2022] DELETE /compute/v2.1/os-security-groups/58526712-7abf-4d74-8216-fe45b967dbfd => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:51.030453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.031677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:51.047913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.048630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.049662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.050427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.052737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.052977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.318608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:51.330361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd0be03a-34f1-4e09-9cb2-773cc9022225 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1472 microversion: 2.1 time: 0.306967 Sep 08 10:21:51.331783 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1124/2104] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:51 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:51.337320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ed1ad42c-3fb4-42ba-9a03-1e3159aafa38 req-79cb715a-0dd3-4145-963e-722e1b285f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1751b777-f1de-4f70-9350-d14d80890f23", "name": "network-vif-deleted", "tag": "a739cecd-581f-4cc6-9147-4d40034e4c69"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:51.349342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ed1ad42c-3fb4-42ba-9a03-1e3159aafa38 req-79cb715a-0dd3-4145-963e-722e1b285f75 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.350106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ed1ad42c-3fb4-42ba-9a03-1e3159aafa38 req-79cb715a-0dd3-4145-963e-722e1b285f75 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.350817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ed1ad42c-3fb4-42ba-9a03-1e3159aafa38 req-79cb715a-0dd3-4145-963e-722e1b285f75 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.365280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ed1ad42c-3fb4-42ba-9a03-1e3159aafa38 req-79cb715a-0dd3-4145-963e-722e1b285f75 service nova] Creating event network-vif-deleted:a739cecd-581f-4cc6-9147-4d40034e4c69 for instance 1751b777-f1de-4f70-9350-d14d80890f23 on n-h2-833090-19 Sep 08 10:21:51.371842 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ed1ad42c-3fb4-42ba-9a03-1e3159aafa38 req-79cb715a-0dd3-4145-963e-722e1b285f75 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038521 Sep 08 10:21:51.372819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1125/2105] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:51.378549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.380263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:51.390014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.390845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.392317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.394064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.395076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.395738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.495157 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ddc17c67-dc69-4620-8705-91866858331b tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.306129 Sep 08 10:21:51.496414 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 981/2106] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:21:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:51.510889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23553c5af0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.548750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:21:51.549268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.security_group_api [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Neutron security group 7b34d62d-287a-4325-92c3-4de4ef9a332d not found {{(pid=122456) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:21:51.549811 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.549811 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d HTTP/1.1 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: exception: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7b34d62d-287a-4325-92c3-4de4ef9a332d'} Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:21:51.551859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] Sep 08 10:21:51.556692 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:51.560866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Security group 7b34d62d-287a-4325-92c3-4de4ef9a332d does not exist Sep 08 10:21:51.560866 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-96c2e68f-c1cc-425d-8fb4-9ca9d31ce49b'] {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:51.562045 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28a902cd-8d4d-45ad-9182-976e39902baa tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d" status: 404 len: 194 microversion: 2.1 time: 0.055280 Sep 08 10:21:51.563103 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 982/2107] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:51 2022] DELETE /compute/v2.1/os-security-groups/7b34d62d-287a-4325-92c3-4de4ef9a332d => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:51.568096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.568959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:51.577592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.578319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.578944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.579884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.580774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.581381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.602183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:51.613668 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-205c7aa9-ee7a-4829-9dc2-4c695163ae51 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.239227 Sep 08 10:21:51.614631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1126/2108] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:51 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:51.620357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-385c4761-f975-4284-8bce-fe0d14835268 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2355475430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.682521 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-385c4761-f975-4284-8bce-fe0d14835268 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.066538 Sep 08 10:21:51.683378 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1127/2109] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:51 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:51.688888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ada9fa4-8ec6-4db1-89aa-b165f4ba7c7c tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f23509e89d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.822853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:51.832320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:51.834072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:51.835443 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca06e35e-95b7-4c89-b2d6-18f6a82124e8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1293 microversion: 2.25 time: 0.271148 Sep 08 10:21:51.855372 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 983/2110] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:51 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1293 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:51.861784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.862333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:51.873593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.874610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.875375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.880117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.880968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.881695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.941833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:51.950685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ada9fa4-8ec6-4db1-89aa-b165f4ba7c7c tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/359b4a06-60c7-4c2b-ab9f-4318e16e5278" status: 200 len: 142 microversion: 2.1 time: 0.265905 Sep 08 10:21:51.952157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1128/2111] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:21:51 2022] GET /compute/v2.1/os-floating-ips/359b4a06-60c7-4c2b-ab9f-4318e16e5278 => generated 142 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:51.957422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:51.958133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:51.967314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.967314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.968213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:51.968726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:51.969184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:51.969607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.039489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:52.058211 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f8408e6-5d58-4612-b66a-1037a0ac6ce8 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1427 microversion: 2.1 time: 0.104795 Sep 08 10:21:52.061055 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1129/2112] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:51 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:52.071656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:52.072378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:52.073391 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-40f1a022-3305-4f38-a1dc-a4a3ac51097d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 204 len: 0 microversion: 2.1 time: 0.216063 Sep 08 10:21:52.075218 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 984/2113] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:51 2022] DELETE /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:52.081987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.082640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.083180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.084026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.084603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.085157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.089523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf2645c7-fcad-45cd-af7f-429576ab34bf tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f23553c5af0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:52.190435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:52.199016 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9378a9f2-d560-4d11-a832-af1bf9d96898 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1183 microversion: 2.1 time: 0.138594 Sep 08 10:21:52.199632 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1130/2114] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:52 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:52.205618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:52.206461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:52.212814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.215361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.215912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.217606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.218602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.219041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.242730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:52.279168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:52.560122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:52.571415 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4185ef94-3401-4666-8a1c-a970d1de7a46 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1646 microversion: 2.1 time: 0.370519 Sep 08 10:21:52.573247 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1131/2115] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:52 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1646 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:52.583381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:52.584565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:52.597863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.601565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.602133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.602989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.606450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.607133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.725122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc1e291586e46adb2e198b0668953c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2b637afd44869ba29070b2ad92f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:52.736724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4d6a3225-de11-47c5-bea6-52ebe4978f42 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 200 len: 1430 microversion: 2.1 time: 0.157121 Sep 08 10:21:52.737325 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1132/2116] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:52 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 1430 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:52.759825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:52.767855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:52.778233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:52.782741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.783867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.784466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.788104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:52.789035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:52.789990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:52.863992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:53.131876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:53.142102 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-736e3ee1-7952-455a-b0c8-6904957f7742 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.403678 Sep 08 10:21:53.144445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1133/2117] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:52 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:53.165420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e07f618-01c1-46b3-83d0-2ff25daaabd9 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235096e4c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:53.193068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:53.246697 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e07f618-01c1-46b3-83d0-2ff25daaabd9 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.089350 Sep 08 10:21:53.247662 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1134/2118] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:53 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:53.253258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:53.254085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:53.261040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.261716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.262328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.263197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.263841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.264434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.450183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf2645c7-fcad-45cd-af7f-429576ab34bf tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/359b4a06-60c7-4c2b-ab9f-4318e16e5278" status: 202 len: 0 microversion: 2.1 time: 1.372747 Sep 08 10:21:53.451343 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 985/2119] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:21:52 2022] DELETE /compute/v2.1/os-floating-ips/359b4a06-60c7-4c2b-ab9f-4318e16e5278 => generated 0 bytes in 1375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:53.458906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-08c906f5-8e29-49cc-a64d-613d5b054257 req-c382b2f6-840c-492d-9fa9-b114dddeda97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9deea626-8df2-47fe-a5a1-cbe1c63ba1d3", "name": "network-vif-deleted", "tag": "2604b690-ecfc-4a2a-854d-4561979447aa"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:53.470354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08c906f5-8e29-49cc-a64d-613d5b054257 req-c382b2f6-840c-492d-9fa9-b114dddeda97 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.471041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08c906f5-8e29-49cc-a64d-613d5b054257 req-c382b2f6-840c-492d-9fa9-b114dddeda97 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.471789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08c906f5-8e29-49cc-a64d-613d5b054257 req-c382b2f6-840c-492d-9fa9-b114dddeda97 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.483348 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-08c906f5-8e29-49cc-a64d-613d5b054257 req-c382b2f6-840c-492d-9fa9-b114dddeda97 service nova] Creating event network-vif-deleted:2604b690-ecfc-4a2a-854d-4561979447aa for instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 on n-h1-833090-19 Sep 08 10:21:53.487245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:53.489775 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-08c906f5-8e29-49cc-a64d-613d5b054257 req-c382b2f6-840c-492d-9fa9-b114dddeda97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036104 Sep 08 10:21:53.490412 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 986/2120] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:53.496458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:53.497372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:53.541747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.542704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.543351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.544051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:53.544877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.547547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:53.548367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.548619 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61e93e56-4e9e-4941-b1ad-e2c91d32a084 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1293 microversion: 2.25 time: 0.299646 Sep 08 10:21:53.549235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.550616 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1135/2121] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:53 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1293 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:53.559589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:53.560275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:53.567396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.575609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.576086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.576828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.577324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.577763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.685880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:53.694676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9436944d-0514-48d5-a5ab-88ce71df11d4 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1427 microversion: 2.1 time: 0.202736 Sep 08 10:21:53.695225 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 987/2122] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:53 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:53.719443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:53.721849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08179d5d-3472-4428-9f5d-935bd9c3acc5 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f235540fdc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:53.728081 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ad94f80-fd36-47a7-8d50-5042f03579e0 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1183 microversion: 2.1 time: 0.176013 Sep 08 10:21:53.729041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1136/2123] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:53 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:53.733763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:53.735720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:53.742147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.742791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.743236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:53.744774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:53.745390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:53.745827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.198774 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08179d5d-3472-4428-9f5d-935bd9c3acc5 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.498009 Sep 08 10:21:54.199411 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 988/2124] 10.222.0.59 () {58 vars in 1164 bytes} [Thu Sep 8 10:21:53 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:21:54.205117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:54.205996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] [instance: 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:54.213220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.213865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.214309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.215030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.215502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.215933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.231721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] HTTP exception thrown: Instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 could not be found. Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Request method failure captured: Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 HTTP/1.1 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHZydfZuRD56CUlxd6wlQg87IIapC-diz-g3olM7bGB5W9sk82s1PLDcDT6buVabBkITl_iG_hkLds1FvSqegkzzi9PVr5uXwBXmmg1CHMMj93KjDF8KvXE9gr84NgmRyD0FHFecdYpoxrBIgB0_tFdGgHXuND5P7QISN2IygA9DgM Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0ad2b637afd44869ba29070b2ad92f98 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ad2b637afd44869ba29070b2ad92f98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ad2b637afd44869ba29070b2ad92f98", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0ad2b637afd44869ba29070b2ad92f98 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-604502723 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerTestJSON-604502723-project Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ddc1e291586e46adb2e198b0668953c4 Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerTestJSON-604502723-project Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 could not be found. Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9deea626-8df2-47fe-a5a1-cbe1c63ba1d3'} Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 could not be found. Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 could not be found. Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:54.233463 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 could not be found. Sep 08 10:21:54.239353 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:54.241061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] Returning 404 to user: Instance 9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:54.242119 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b3db127-09d7-46e3-ad47-050dcd740611 tempest-ImagesOneServerTestJSON-604502723 tempest-ImagesOneServerTestJSON-604502723-project] 10.222.0.59 "GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3" status: 404 len: 111 microversion: 2.1 time: 0.041736 Sep 08 10:21:54.243200 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 989/2125] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:54 2022] GET /compute/v2.1/servers/9deea626-8df2-47fe-a5a1-cbe1c63ba1d3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:54.248539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:54.249023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:54.256425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.257186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.257865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.258792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.259419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.260034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.299981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:54.312818 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45829e16-6fc9-477d-baa9-23955cd5cade tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1646 microversion: 2.1 time: 0.582103 Sep 08 10:21:54.313415 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1137/2126] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:53 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1646 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:54.331491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-26c86b5b-5636-4790-b292-61fb28d87afe tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f23509cd550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:54.666467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:54.676787 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f629227f-e7ed-4b65-80ed-6812949db63f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.431921 Sep 08 10:21:54.677038 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 990/2127] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:54 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:54.696619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97bbe315-2cf1-44f2-9ea3-00a0eede2239 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351758ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:54.786824 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97bbe315-2cf1-44f2-9ea3-00a0eede2239 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.108795 Sep 08 10:21:54.787611 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 991/2128] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:54 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:54.796108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:54.797431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:54.800957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-26c86b5b-5636-4790-b292-61fb28d87afe tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.486488 Sep 08 10:21:54.801547 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1138/2129] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:21:54 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:54.806404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:54.807255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:54.826752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.827246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.838965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.840077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.840745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.841705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.842369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.843135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.844616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.845244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.845893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.849372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.947845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:54.956480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:54.957221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:54.957856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lazy-loading 'fault' on Instance uuid 1751b777-f1de-4f70-9350-d14d80890f23 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:21:55.083242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:55.101180 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa57ba47-78ca-4338-9ba4-34d8def2f753 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 200 len: 1303 microversion: 2.1 time: 0.294245 Sep 08 10:21:55.102680 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1139/2130] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:54 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:55.113281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:55.124399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:55.131333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:55.132171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:55.132795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:55.133701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:55.134331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:55.134948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:55.518028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:55.540154 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecc1125c-69d6-48cb-a9f3-1a8697c050ff tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1183 microversion: 2.1 time: 0.436245 Sep 08 10:21:55.541179 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1140/2131] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:55 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:55.546177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4e4ad4a-eb99-4267-9c43-73acf3a3b233 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f23509cd550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:55.702835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:55.730620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:55.758185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:55.759365 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-60606309-67e5-4ba1-8cbe-13af61093049 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1293 microversion: 2.25 time: 0.970855 Sep 08 10:21:55.775331 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 992/2132] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:54 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1293 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:55.779652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0f8431f7-d6b6-4ca2-9339-5ecac7045a66 req-eb3602df-ccd0-4d46-88b1-64e2bd71c6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42850fd4-9c12-4dca-a639-6f4cebdcf399", "name": "network-vif-plugged", "status": "completed", "tag": "09b0b766-dfe3-4e32-be88-12f2942d36e3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:55.825300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f8431f7-d6b6-4ca2-9339-5ecac7045a66 req-eb3602df-ccd0-4d46-88b1-64e2bd71c6c4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:55.827723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f8431f7-d6b6-4ca2-9339-5ecac7045a66 req-eb3602df-ccd0-4d46-88b1-64e2bd71c6c4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:55.829917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f8431f7-d6b6-4ca2-9339-5ecac7045a66 req-eb3602df-ccd0-4d46-88b1-64e2bd71c6c4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:55.890318 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0f8431f7-d6b6-4ca2-9339-5ecac7045a66 req-eb3602df-ccd0-4d46-88b1-64e2bd71c6c4 service nova] Creating event network-vif-plugged:09b0b766-dfe3-4e32-be88-12f2942d36e3 for instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 on n-h1-833090-19 Sep 08 10:21:55.913534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0f8431f7-d6b6-4ca2-9339-5ecac7045a66 req-eb3602df-ccd0-4d46-88b1-64e2bd71c6c4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149184 Sep 08 10:21:55.916386 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 993/2133] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:55.931247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:55.955132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:55.984850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:55.985462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:55.987999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:55.988837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:55.992109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:55.993684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:56.814260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe57507755d46889089a0b2b42aa45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3750bee2be364857b35ad908e8aa0f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:56.824319 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f10f9147-cdcc-4e99-9a82-c7d55b89497d tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 200 len: 1646 microversion: 2.1 time: 0.906527 Sep 08 10:21:56.826388 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 994/2134] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:55 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 1646 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:56.833634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:56.834639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:56.853043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:56.853851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:56.854472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:56.855193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:56.855973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:56.856163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.333926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:57.343685 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d855302-695a-4650-bffc-65905cb24057 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.515805 Sep 08 10:21:57.356534 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 995/2135] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:56 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:57.370095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-391ef2e0-ad51-4d2e-83c1-430ac4d08855 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23553dfee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:57.420923 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-391ef2e0-ad51-4d2e-83c1-430ac4d08855 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.062865 Sep 08 10:21:57.421720 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 996/2136] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:57 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:57.426645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:57.427362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 1751b777-f1de-4f70-9350-d14d80890f23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:57.434169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.434658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.435095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.435832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.436358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.436803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.454394 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] HTTP exception thrown: Instance 1751b777-f1de-4f70-9350-d14d80890f23 could not be found. Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Request method failure captured: Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 HTTP/1.1 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcC_JTF4YNZ_BHMFcX7DiFarHB0tM-673Hq415jjJKTj1PjE__nOE9VgYm5a3B7_tRj6RCtnVXM2How5wEcIO_Eq74bdVPKFfXDhwlUlZHnTV8t1cndQsvxZ6cpwE3PzDm_l3SP7W4SBMidTWy8zxUuH__TlxYQ7uHb5VwszmXa1fM8 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cafdc851cfa34429b274c120b9d9c8b6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-MigrationsAdminTest-636933970 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-MigrationsAdminTest-636933970-project Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 5f96685045b340b2a978ece9dd591640 Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-MigrationsAdminTest-636933970-project Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 1751b777-f1de-4f70-9350-d14d80890f23 could not be found. Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1751b777-f1de-4f70-9350-d14d80890f23'} Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1751b777-f1de-4f70-9350-d14d80890f23 could not be found. Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1751b777-f1de-4f70-9350-d14d80890f23 could not be found. Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:57.456084 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1751b777-f1de-4f70-9350-d14d80890f23 could not be found. Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Returning 404 to user: Instance 1751b777-f1de-4f70-9350-d14d80890f23 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-faab7c79-8c87-439a-9313-50f78e76ab39 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23" status: 404 len: 111 microversion: 2.1 time: 0.034563 Sep 08 10:21:57.462365 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 997/2137] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:57 2022] GET /compute/v2.1/servers/1751b777-f1de-4f70-9350-d14d80890f23 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:57.465236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0f0bb840-acce-4c5c-bd64-1a2ae49b1f97 req-ac3c291c-5c66-4484-97ba-13c2b433c73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b35549a-0f59-4a78-bcf5-fa13562fe95f", "tag": "5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:57.473550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f0bb840-acce-4c5c-bd64-1a2ae49b1f97 req-ac3c291c-5c66-4484-97ba-13c2b433c73b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.474032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f0bb840-acce-4c5c-bd64-1a2ae49b1f97 req-ac3c291c-5c66-4484-97ba-13c2b433c73b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.474461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f0bb840-acce-4c5c-bd64-1a2ae49b1f97 req-ac3c291c-5c66-4484-97ba-13c2b433c73b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.486414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0f0bb840-acce-4c5c-bd64-1a2ae49b1f97 req-ac3c291c-5c66-4484-97ba-13c2b433c73b service nova] Creating event network-changed:5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0 for instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f on n-h2-833090-19 Sep 08 10:21:57.491320 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0f0bb840-acce-4c5c-bd64-1a2ae49b1f97 req-ac3c291c-5c66-4484-97ba-13c2b433c73b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031707 Sep 08 10:21:57.491939 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 998/2138] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:57.663666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4e4ad4a-eb99-4267-9c43-73acf3a3b233 tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/9f7e6bd5-d121-467a-9b2d-6c8384a14b82" status: 202 len: 0 microversion: 2.1 time: 2.120901 Sep 08 10:21:57.665003 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1141/2139] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:21:55 2022] DELETE /compute/v2.1/os-floating-ips/9f7e6bd5-d121-467a-9b2d-6c8384a14b82 => generated 0 bytes in 2123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:57.674865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:57.675731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:57.684443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.686099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.686668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.687547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.688873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.689423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.743372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5c4b0c4-badc-4f40-9f55-21d117076d87 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Action: 'create', calling method: .version_select at 0x7f2350c0bf70>, body: {"keypair": {"name": "tempest-keypair-1585836320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwvUcTsCiivY4ErzE2iibwm0BmiEzxZEWHZ0nBK6UF1t2a9n6eGSzHwI/5Lo6wzv0m/35hjYS3oLguDgTm7/uZ860BlxWQ/F1B0Gg0VcFyCaHlje/7vElDqHJRtWsYTig=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:57.761914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a5c4b0c4-badc-4f40-9f55-21d117076d87 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:21:57.780587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a5c4b0c4-badc-4f40-9f55-21d117076d87 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for user 09232e137e1b45f69549ab735e600a46 and project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:21:57.806665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:57.820533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5c4b0c4-badc-4f40-9f55-21d117076d87 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.327007 Sep 08 10:21:57.824251 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 999/2140] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:21:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:57.827905 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7724a59-011e-4dd6-86e3-3cda41b08a9b tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 200 len: 1183 microversion: 2.1 time: 0.156024 Sep 08 10:21:57.828563 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1142/2141] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:57 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 1183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:57.840052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cf54a235-2371-471c-ac00-f82abb293d33 req-20705b87-3e41-4d87-b7eb-5e7dd094de40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf724fb-3d3b-4882-9345-ca56885f613f", "name": "network-vif-deleted", "tag": "fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:57.842588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:57.843208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:57.864570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.875272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.875937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.876725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.883312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cf54a235-2371-471c-ac00-f82abb293d33 req-20705b87-3e41-4d87-b7eb-5e7dd094de40 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.883838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cf54a235-2371-471c-ac00-f82abb293d33 req-20705b87-3e41-4d87-b7eb-5e7dd094de40 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.884292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cf54a235-2371-471c-ac00-f82abb293d33 req-20705b87-3e41-4d87-b7eb-5e7dd094de40 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.885568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.886013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.914764 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cf54a235-2371-471c-ac00-f82abb293d33 req-20705b87-3e41-4d87-b7eb-5e7dd094de40 service nova] Creating event network-vif-deleted:fba1063a-fa69-4e18-8bd6-97fd4a0f4b4d for instance 5bf724fb-3d3b-4882-9345-ca56885f613f on n-h2-833090-19 Sep 08 10:21:57.941887 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cf54a235-2371-471c-ac00-f82abb293d33 req-20705b87-3e41-4d87-b7eb-5e7dd094de40 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110391 Sep 08 10:21:57.947831 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1000/2142] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:57.960332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:57.962447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:57.975591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.977504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.978178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:57.980788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:57.982262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:57.983877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:58.068675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:21:58.189563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:58.200863 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4629b35b-e6a7-415f-99bd-0e00343ea0d5 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "DELETE /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 204 len: 0 microversion: 2.1 time: 0.250464 Sep 08 10:21:58.204625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:58.204842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1001/2143] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:21:57 2022] DELETE /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:21:58.210732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5d4f2f2-0129-4498-8ad1-90e8934d8ccb tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f23553c5e50>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:58.215908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:58.217516 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7273c97e-549f-4e07-9c0e-d5f2d7a49b6c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1293 microversion: 2.25 time: 0.386176 Sep 08 10:21:58.218377 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1143/2144] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:57 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1293 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:21:58.241634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1c4313d-c6e3-4014-8c87-85ca4540967e tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f235098e9d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:58.253697 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1c4313d-c6e3-4014-8c87-85ca4540967e tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1585836320" status: 200 len: 498 microversion: 2.1 time: 0.023996 Sep 08 10:21:58.254342 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1144/2145] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:21:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1585836320 => generated 498 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:58.265715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:58.266448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] [instance: 5bf724fb-3d3b-4882-9345-ca56885f613f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:58.275412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:58.276240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:58.277124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:58.278185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:58.279010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:58.279939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:58.298232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] HTTP exception thrown: Instance 5bf724fb-3d3b-4882-9345-ca56885f613f could not be found. Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Request method failure captured: Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f HTTP/1.1 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHC8eOStXrBeyjlZFREh8wEGkp9KxP8askIgtF5Kp2c3lrJZz_qBIhavP0xGZcOsekmkorjaQQC21J6y9xg8zJurPjywta2lkT2Uif1ltlaEv7OyHZbnu9IdMMnYxxqDAIACie8Az4O9tSmZVQlyED0bdg4ceisVfPnO7UdjQx6Vog Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3750bee2be364857b35ad908e8aa0f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3750bee2be364857b35ad908e8aa0f48", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3750bee2be364857b35ad908e8aa0f48 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-575934079 Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfe57507755d46889089a0b2b42aa45c Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsTestJSON-575934079-project Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 5bf724fb-3d3b-4882-9345-ca56885f613f could not be found. Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '5bf724fb-3d3b-4882-9345-ca56885f613f'} Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf724fb-3d3b-4882-9345-ca56885f613f could not be found. Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf724fb-3d3b-4882-9345-ca56885f613f could not be found. Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:58.300403 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf724fb-3d3b-4882-9345-ca56885f613f could not be found. Sep 08 10:21:58.306238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:58.308083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Returning 404 to user: Instance 5bf724fb-3d3b-4882-9345-ca56885f613f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:58.309311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7995070-4203-401f-94b3-cc70b42a4051 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f" status: 404 len: 111 microversion: 2.1 time: 0.053641 Sep 08 10:21:58.313968 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1145/2146] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:58 2022] GET /compute/v2.1/servers/5bf724fb-3d3b-4882-9345-ca56885f613f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:58.322077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-87118ab9-9ce9-4801-b113-364c43eb4f04 req-7381cac5-75d6-4cb1-8614-aad72246bb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d485bf32-a51c-4748-9c53-3c5d643fd273", "name": "network-vif-plugged", "status": "completed", "tag": "69a878c2-2b18-44bb-a936-0eec42248f2e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:58.332862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-87118ab9-9ce9-4801-b113-364c43eb4f04 req-7381cac5-75d6-4cb1-8614-aad72246bb26 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:58.333697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-87118ab9-9ce9-4801-b113-364c43eb4f04 req-7381cac5-75d6-4cb1-8614-aad72246bb26 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:58.334341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-87118ab9-9ce9-4801-b113-364c43eb4f04 req-7381cac5-75d6-4cb1-8614-aad72246bb26 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:58.361932 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-87118ab9-9ce9-4801-b113-364c43eb4f04 req-7381cac5-75d6-4cb1-8614-aad72246bb26 service nova] Creating event network-vif-plugged:69a878c2-2b18-44bb-a936-0eec42248f2e for instance d485bf32-a51c-4748-9c53-3c5d643fd273 on n-h2-833090-19 Sep 08 10:21:58.371814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-87118ab9-9ce9-4801-b113-364c43eb4f04 req-7381cac5-75d6-4cb1-8614-aad72246bb26 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055971 Sep 08 10:21:58.373495 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1146/2147] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:58.385722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:58.386488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:58.396566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:58.397242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:58.397707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:58.398807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:58.399278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:58.399767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:58.407635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:58.832704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:58.840689 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-362e585f-de3f-40a7-9b39-84a5cd5be7e9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1534 microversion: 2.1 time: 0.465791 Sep 08 10:21:58.841285 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1147/2148] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:58 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1534 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:58.847110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b523ba8-0b53-49d6-a969-b8ad335c8be3 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f23509d7d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:58.875938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b523ba8-0b53-49d6-a969-b8ad335c8be3 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585836320" status: 202 len: 0 microversion: 2.1 time: 0.032678 Sep 08 10:21:58.883372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1148/2149] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:21:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585836320 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:58.883372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b114ea5-ffab-426b-bc8d-bde77894224a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f2350984430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:59.373016 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b114ea5-ffab-426b-bc8d-bde77894224a tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/ad1f3c50-10d5-471e-9d97-0807be70a8fb" status: 202 len: 0 microversion: 2.1 time: 0.494660 Sep 08 10:21:59.373628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1149/2150] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:58 2022] DELETE /compute/v2.1/os-security-groups/ad1f3c50-10d5-471e-9d97-0807be70a8fb => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:59.381616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:59.382231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:59.390699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:59.392035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:59.392672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:59.393537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:59.394154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:59.394592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:59.649574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:21:59.666820 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5d4f2f2-0129-4498-8ad1-90e8934d8ccb tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/aa590795-c570-40e0-aa03-655e2f9140a7" status: 202 len: 0 microversion: 2.1 time: 1.460463 Sep 08 10:21:59.667647 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1002/2151] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:21:58 2022] DELETE /compute/v2.1/os-floating-ips/aa590795-c570-40e0-aa03-655e2f9140a7 => generated 0 bytes in 1462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:21:59.671204 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-676fd4d2-0fa6-4604-9e2e-d261f21196a3 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.292705 Sep 08 10:21:59.671874 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1150/2152] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:59 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:59.673588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7db2f1a9-80ef-42cf-aa99-accd753d2ccd tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350c03dc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:59.688998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:59.690948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a63066b7-480f-4376-94da-0fccd625bf8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:59.699209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:59.699788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:59.700271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:59.701130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:59.701584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:59.703408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:59.722945 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] HTTP exception thrown: Instance a63066b7-480f-4376-94da-0fccd625bf8e could not be found. Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Request method failure captured: Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e HTTP/1.1 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDFv46tDoz9G8sK6qXhrUNLEQcNscYg3-Ui6ckSMfgwf_S-GyOdfida5puevu4eRmdmu0JSVs2jezidjVu4X5Idozso0VxRBolwggMaFoQxKQSbPEbv6aT7hAUpnjotvCbIUY_S0wdwb1qdipwvG3QtTLKkH57_uqIOznBAe6QIiOc Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e0721ab63dc349cb99bdb42d4c5e1732", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-LiveMigrationTest-135334318 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-LiveMigrationTest-135334318-project Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 46a59f79e24b4644a167dc0a4d2c4af9 Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-LiveMigrationTest-135334318-project Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance a63066b7-480f-4376-94da-0fccd625bf8e could not be found. Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'a63066b7-480f-4376-94da-0fccd625bf8e'} Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63066b7-480f-4376-94da-0fccd625bf8e could not be found. Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63066b7-480f-4376-94da-0fccd625bf8e could not be found. Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:21:59.724899 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63066b7-480f-4376-94da-0fccd625bf8e could not be found. Sep 08 10:21:59.730137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:21:59.730794 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7db2f1a9-80ef-42cf-aa99-accd753d2ccd tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.060588 Sep 08 10:21:59.731930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Returning 404 to user: Instance a63066b7-480f-4376-94da-0fccd625bf8e could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:21:59.733216 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6fec8fc-e1c7-4097-9650-3a81fa7eb848 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e" status: 404 len: 111 microversion: 2.1 time: 0.059492 Sep 08 10:21:59.733947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1151/2153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:21:59 2022] GET /compute/v2.1/servers/a63066b7-480f-4376-94da-0fccd625bf8e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:21:59.738290 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1003/2154] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:21:59 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:21:59.740173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38a87cb6-bbb3-4814-9842-4484f29a8c32 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Action: 'create', calling method: .version_select at 0x7f235098e4c0>, body: {"keypair": {"name": "tempest-keypair-1720996891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhQMh3EkNWE8S4bFU041hC3znU+JD9TqwvYTeet1uFUawatMysGDG9ygZzd19h1q4jDBqhZMcQNVhD0YiOaTJYWEApaXIAP4/Y3SdJWVCw+oYJOUT80JA7UaDVikNgcxw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:21:59.745099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:21:59.745840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:21:59.755778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:21:59.757901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:59.758565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:59.759019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:59.759766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:21:59.760232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:21:59.760651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:21:59.769761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-38a87cb6-bbb3-4814-9842-4484f29a8c32 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:21:59.781637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-38a87cb6-bbb3-4814-9842-4484f29a8c32 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for user 09232e137e1b45f69549ab735e600a46 and project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:21:59.844475 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38a87cb6-bbb3-4814-9842-4484f29a8c32 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109177 Sep 08 10:21:59.845069 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1152/2155] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:21:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:21:59.864911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9d03f439-df39-4db4-8a73-b577c71db2e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] Calling method '.version_select at 0x7f23509cd5e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:00.057717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:00.071847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:00.073279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:00.075017 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b945fb75-7317-4d52-a0a8-e8074e32cc0b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1293 microversion: 2.25 time: 0.333403 Sep 08 10:22:00.088385 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1004/2156] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:21:59 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1293 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:00.101412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d30df8a-dfe2-41d4-aff7-85ff02f404ec tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] Calling method '.version_select at 0x7f2350b62040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:00.665804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9d03f439-df39-4db4-8a73-b577c71db2e5 tempest-SecurityGroupsTestJSON-575934079 tempest-SecurityGroupsTestJSON-575934079-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/8d19e16e-58ad-400e-972a-ad6659a76872" status: 202 len: 0 microversion: 2.1 time: 0.812893 Sep 08 10:22:00.666758 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1153/2157] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:21:59 2022] DELETE /compute/v2.1/os-security-groups/8d19e16e-58ad-400e-972a-ad6659a76872 => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:00.671656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-582e449a-7d0c-4b21-ac61-ae6e72e4c8b6 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f235096e040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:00.714310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-582e449a-7d0c-4b21-ac61-ae6e72e4c8b6 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720996891" status: 202 len: 0 microversion: 2.1 time: 0.046444 Sep 08 10:22:00.714903 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1154/2158] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:22:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720996891 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:00.721104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:00.721943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:00.728597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:00.732523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:00.732970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:00.740128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:00.740128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:00.740128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:00.801395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:00.801882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:00.802428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:00.802882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lazy-loading 'fault' on Instance uuid 67a9590e-2b8d-45d6-ade1-492b360c0869 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:00.958899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:00.974082 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5f0545b-1e34-457e-b546-be4debc9d04b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 200 len: 1368 microversion: 2.1 time: 0.257878 Sep 08 10:22:00.974665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1155/2159] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:00 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:00.981164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c541df4d-82bc-4b00-af2d-5532dc139d26 req-f59236b7-4252-4c08-a875-38e688043a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a9590e-2b8d-45d6-ade1-492b360c0869", "name": "network-vif-deleted", "tag": "2f77965f-d064-4af7-88b8-f7f7f4840e4a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:01.000771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c541df4d-82bc-4b00-af2d-5532dc139d26 req-f59236b7-4252-4c08-a875-38e688043a96 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:01.001573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c541df4d-82bc-4b00-af2d-5532dc139d26 req-f59236b7-4252-4c08-a875-38e688043a96 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:01.002179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c541df4d-82bc-4b00-af2d-5532dc139d26 req-f59236b7-4252-4c08-a875-38e688043a96 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:01.018947 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c541df4d-82bc-4b00-af2d-5532dc139d26 req-f59236b7-4252-4c08-a875-38e688043a96 service nova] Creating event network-vif-deleted:2f77965f-d064-4af7-88b8-f7f7f4840e4a for instance 67a9590e-2b8d-45d6-ade1-492b360c0869 on n-h1-833090-19 Sep 08 10:22:01.031667 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c541df4d-82bc-4b00-af2d-5532dc139d26 req-f59236b7-4252-4c08-a875-38e688043a96 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055676 Sep 08 10:22:01.033083 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1156/2160] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:01.038291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e79c97b-cc74-4562-bd3f-e4d4ee9b6826", "name": "network-vif-plugged", "status": "completed", "tag": "ddf5ae5a-4ced-4792-a02a-f3ce00e7bbdd"}, {"server_uuid": "0d54b3ce-40c1-4410-be63-a9ab59f67519", "name": "network-vif-plugged", "status": "completed", "tag": "225b9ccd-539b-42ac-b643-c167c9862616"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:01.095336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:01.097146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:01.097146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:01.129306 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] Creating event network-vif-plugged:ddf5ae5a-4ced-4792-a02a-f3ce00e7bbdd for instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 on n-h2-833090-19 Sep 08 10:22:01.129736 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] Creating event network-vif-plugged:225b9ccd-539b-42ac-b643-c167c9862616 for instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 on n-h1-833090-19 Sep 08 10:22:01.153895 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9316e425-f80f-48d1-95a3-a577e1aa43d2 req-2fde2e28-1d08-4d27-b349-5d60fbb4d825 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119226 Sep 08 10:22:01.154824 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1157/2161] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:01.160705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:01.161407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:01.177227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:01.179943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:01.181087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:01.183229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:01.183903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:01.185990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:01.481115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:01.496993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27002bd6-6383-4dce-bf30-91b3c833ba84 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.340901 Sep 08 10:22:01.512783 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1158/2162] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:01 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:01.521361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-953f2a21-854a-4289-a733-2935b6c86caf tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Action: 'create', calling method: .version_select at 0x7f2355475430>, body: {"keypair": {"name": "tempest-keypair-181522990", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:01.538953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-953f2a21-854a-4289-a733-2935b6c86caf tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:01.544557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-953f2a21-854a-4289-a733-2935b6c86caf tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for user 09232e137e1b45f69549ab735e600a46 and project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:01.573926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-953f2a21-854a-4289-a733-2935b6c86caf tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.059247 Sep 08 10:22:01.581102 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1159/2163] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:01 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:01.588564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-255c36f1-1c37-4b61-808f-ae69be6675db tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350987dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:01.659206 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-255c36f1-1c37-4b61-808f-ae69be6675db tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.076575 Sep 08 10:22:01.660362 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1160/2164] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:01 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:01.665725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:01.667623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:01.675959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:01.677784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:01.678467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:01.679543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:01.680246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:01.680887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:01.926289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:01.940274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:01.942619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:01.946873 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81062634-6178-4ff9-9faf-f8153c279d7b tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.285272 Sep 08 10:22:01.950214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d30df8a-dfe2-41d4-aff7-85ff02f404ec tempest-FloatingIPDetailsTestJSON-1580432494 tempest-FloatingIPDetailsTestJSON-1580432494-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/d3059d52-803c-4caa-a76f-0b8aee16772c" status: 202 len: 0 microversion: 2.1 time: 1.852843 Sep 08 10:22:01.951676 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1005/2165] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:22:00 2022] DELETE /compute/v2.1/os-floating-ips/d3059d52-803c-4caa-a76f-0b8aee16772c => generated 0 bytes in 1862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:01.957371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ff397f0-a411-4dfe-a1bb-d666d8e707b3 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f23553c5d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:01.961291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1161/2166] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:01 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:02.003688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.004556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 67a9590e-2b8d-45d6-ade1-492b360c0869] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:02.028946 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ff397f0-a411-4dfe-a1bb-d666d8e707b3 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-181522990" status: 202 len: 0 microversion: 2.1 time: 0.076045 Sep 08 10:22:02.034415 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1006/2167] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-181522990 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:02.039654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:02.041479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:02.044704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:02.046746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:02.049165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:02.050263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:02.052954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09a27521-a013-4074-bfdf-0584adc324db tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Action: 'create', calling method: .version_select at 0x7f2350aecf70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2136600538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNoTg0Vm/nc97eIzRQIjvHn8qzT4u53cHPb3D6NDHDlyxr3ESxAo9Ha1qzQhiHYHrqxfu3GnHQKpAxKjGvRpgFMy1ZcimpSvBlrR4GjKyeg3s4s+dt87d0UO2feIz8Rkg=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:02.099811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-09a27521-a013-4074-bfdf-0584adc324db tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:02.101007 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] HTTP exception thrown: Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 could not be found. Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Request method failure captured: Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 HTTP/1.1 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcC_JTF4YNZ_BHMFcX7DiFarHB0tM-673Hq415jjJKTj1PjE__nOE9VgYm5a3B7_tRj6RCtnVXM2How5wEcIO_Eq74bdVPKFfXDhwlUlZHnTV8t1cndQsvxZ6cpwE3PzDm_l3SP7W4SBMidTWy8zxUuH__TlxYQ7uHb5VwszmXa1fM8 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cafdc851cfa34429b274c120b9d9c8b6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-MigrationsAdminTest-636933970-project Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5f96685045b340b2a978ece9dd591640 Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-MigrationsAdminTest-636933970-project Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 could not be found. Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '67a9590e-2b8d-45d6-ade1-492b360c0869'} Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 could not be found. Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 could not be found. Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:02.102696 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 could not be found. Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:02.107940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Returning 404 to user: Instance 67a9590e-2b8d-45d6-ade1-492b360c0869 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:02.112869 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa4a246f-c289-41ff-ad8f-3c2e1c9ef121 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869" status: 404 len: 111 microversion: 2.1 time: 0.106068 Sep 08 10:22:02.113514 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1162/2168] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:01 2022] GET /compute/v2.1/servers/67a9590e-2b8d-45d6-ade1-492b360c0869 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:22:02.113861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-09a27521-a013-4074-bfdf-0584adc324db tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for user 09232e137e1b45f69549ab735e600a46 and project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:02.123925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad0a48f5-544e-4033-bf2c-ca8c0d15a655 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '.version_select at 0x7f235096e5e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.170365 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09a27521-a013-4074-bfdf-0584adc324db tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.127124 Sep 08 10:22:02.171698 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1007/2169] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:02.183100 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad0a48f5-544e-4033-bf2c-ca8c0d15a655 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165698989" status: 202 len: 0 microversion: 2.1 time: 0.062766 Sep 08 10:22:02.183982 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1163/2170] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165698989 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:02.186260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c44b07c7-71a9-442b-859a-42aec3e41b35 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Action: 'create', calling method: .version_select at 0x7f2350b62ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-325306900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMJrb6pLAKQd5/lUqpzjKrUWvlOFNbzKSCpWvX7+SXuW+R5+InVi6BLfcb12i6l0C2xb19BAX1MDGmZDZ+j4HK9eVFd9jZ4k4AE+x6P6MuohKYGagQBTrdeO4DdR3Oj+A=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:02.216909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c44b07c7-71a9-442b-859a-42aec3e41b35 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:02.226136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c44b07c7-71a9-442b-859a-42aec3e41b35 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for user 09232e137e1b45f69549ab735e600a46 and project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:02.278310 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c44b07c7-71a9-442b-859a-42aec3e41b35 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.096622 Sep 08 10:22:02.280213 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1008/2171] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:02.293544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6c2f4150-c1ce-43cf-a47d-eabf8b6588a1 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Action: 'create', calling method: .version_select at 0x7f23509d7820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1085186366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDulR9cCz7jPpnlGQEd+maRLLr6BqHkU4Va6VujG2Y3ej4gjsBQQs50T0EFpGvNVFxgnYyV/Kvtz7+uaOLgU19OC5rrbO6oTH/p9dtfwQ4G+lmWG+mVV99JkbVfnpACspg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:02.334275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6c2f4150-c1ce-43cf-a47d-eabf8b6588a1 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:02.346924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6c2f4150-c1ce-43cf-a47d-eabf8b6588a1 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Getting quotas for user 09232e137e1b45f69549ab735e600a46 and project a7140144234741cc9a032b2d92fe6c95. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:02.403122 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6c2f4150-c1ce-43cf-a47d-eabf8b6588a1 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.113870 Sep 08 10:22:02.403895 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1164/2172] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:02.415164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a45153c-7380-4e07-8d9f-dee53501fada tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f2355415160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.419829 n-d-833090-19 devstack@n-api.service[122456]: WARNING oslo_db.sqlalchemy.utils [None req-5a45153c-7380-4e07-8d9f-dee53501fada tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:22:02.437230 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a45153c-7380-4e07-8d9f-dee53501fada tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.026720 Sep 08 10:22:02.438240 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1009/2173] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:22:02 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:02.451001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f204210f-bf5b-453c-a235-8e4a03c1a83a tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f23509d7d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.500675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f204210f-bf5b-453c-a235-8e4a03c1a83a tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1085186366" status: 202 len: 0 microversion: 2.1 time: 0.053878 Sep 08 10:22:02.501865 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1165/2174] 10.222.0.59 () {58 vars in 1278 bytes} [Thu Sep 8 10:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1085186366 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:02.510054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57ebb77f-717d-4c1e-bdf6-953654fa9520 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f2350aec820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.528814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.532014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:02.565206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:02.570226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:02.571202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:02.572309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:02.572892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:02.577927 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-57ebb77f-717d-4c1e-bdf6-953654fa9520 tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-325306900" status: 202 len: 0 microversion: 2.1 time: 0.071656 Sep 08 10:22:02.578156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:02.581298 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1010/2175] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-325306900 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:02.591908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-919c49cc-c6c2-4ea0-8da2-dba0041fc64d tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] Calling method '.version_select at 0x7f2350b5fd30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.643574 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-919c49cc-c6c2-4ea0-8da2-dba0041fc64d tempest-KeyPairsV2TestJSON-810030100 tempest-KeyPairsV2TestJSON-810030100-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2136600538" status: 202 len: 0 microversion: 2.1 time: 0.055271 Sep 08 10:22:02.644338 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1011/2176] 10.222.0.59 () {58 vars in 1278 bytes} [Thu Sep 8 10:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2136600538 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:02.698985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-605e14f3-1eac-4f98-b0ac-c92703cdda6b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350aec940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:02.783630 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-605e14f3-1eac-4f98-b0ac-c92703cdda6b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.101997 Sep 08 10:22:02.791537 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1012/2177] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:02 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:03.001453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:03.002177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:03.019803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:03.020015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:03.020738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:03.021915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:03.022826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:03.023449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:03.044049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:03.053968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2801b433-adf2-49e9-930c-1876b2f14367 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1323 microversion: 2.1 time: 0.531035 Sep 08 10:22:03.064432 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1166/2178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:02 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:03.530290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:03.543980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:03.545444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:03.547917 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a1f4bd3-75b5-4c7f-a67a-602b3052a900 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.550651 Sep 08 10:22:03.553083 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1013/2179] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:02 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:03.799716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5ec0a27-d899-471e-ad4c-40cf87f21965 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509e81f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:03.903993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5ec0a27-d899-471e-ad4c-40cf87f21965 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.107975 Sep 08 10:22:03.913179 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1167/2180] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:03 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:04.082524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:04.083147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:04.101722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.106742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.112873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.114663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.115628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.116353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.170564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:04.233773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:04.234273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:04.263253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.264534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.265606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.267344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.273362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.274047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.368504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:04.513461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:04.553490 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05063e89-a2cd-4349-84f3-7020364fcc21 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "DELETE /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 204 len: 0 microversion: 2.1 time: 0.317775 Sep 08 10:22:04.559034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1168/2181] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:04 2022] DELETE /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:04.583502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:04.587343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:04.617559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.619935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.626934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.628189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.628848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.629874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.705378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:04.726884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3fc4752f-30d2-425b-9145-7fe10acde4b0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 200 len: 1516 microversion: 2.1 time: 0.648889 Sep 08 10:22:04.759349 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1014/2182] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:04 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 1516 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:04.780147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:04.782961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:04.812572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.814060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.815346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:04.817434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:04.818212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:04.818953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:05.185527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:05.202851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5bb89f2d-0685-4ae1-a6dc-717a01961477 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1469 microversion: 2.1 time: 0.634569 Sep 08 10:22:05.203506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1169/2183] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:04 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1469 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:05.238037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:05.238982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:05.258406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:05.261284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:05.262025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:05.263028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:05.265058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:05.267273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:05.294305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:05.310767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:05.318155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:05.320292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e9fc8c4-4941-4628-9050-19952aeae12a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.559616 Sep 08 10:22:05.326861 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1015/2184] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:04 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:05.344516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee680f04-db48-4305-8696-2702890f1251 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350aec430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:05.438725 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee680f04-db48-4305-8696-2702890f1251 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.108761 Sep 08 10:22:05.457007 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1016/2185] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:05 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:05.744439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:05.765989 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f1026be-e6da-443d-8a60-15dd55cffa2d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 200 len: 1515 microversion: 2.1 time: 0.543514 Sep 08 10:22:05.766941 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1170/2186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:05 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 1515 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:05.807064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:05.807742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:05.833015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:05.839153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:05.842965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:05.846850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:05.847347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:05.847825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.208016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:06.229455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:06.230194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:06.235851 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4de3e66e-f906-4879-968d-c60340913946 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 200 len: 1515 microversion: 2.1 time: 0.433323 Sep 08 10:22:06.237609 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1017/2187] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:05 2022] GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:06.245721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.247591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.248130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.248949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.253672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.254743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.263106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:06.263866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:06.286062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.289369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.289942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.292982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.293821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.294508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.369823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:06.536558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-853f1e8a-b407-480c-ab9f-59a05b01fc76 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 204 len: 0 microversion: 2.1 time: 0.277929 Sep 08 10:22:06.537723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1018/2188] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:06 2022] DELETE /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:22:06.547027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:06.550601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:06.560111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.560944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.561550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.562732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.563421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.564213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.716688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:06.739630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02d0c6fa-f726-4fb0-9352-5263a9a12b10 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1469 microversion: 2.1 time: 0.513011 Sep 08 10:22:06.742406 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1171/2189] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:06 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:22:06.749767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61da4c90-b052-484e-a110-adef382d770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350984670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:06.804896 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61da4c90-b052-484e-a110-adef382d770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.060181 Sep 08 10:22:06.808777 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1172/2190] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:06 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:06.816624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:06.818553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:06.825675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.827141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.828074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.829146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.829806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:06.830481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:06.923245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:06.938135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:06.950205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:06.952042 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-555c8377-1a2f-45b8-871c-6e4320a920ac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.412153 Sep 08 10:22:06.952959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1019/2191] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:06 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:06.974428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:06.985073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:06.998302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:06.998798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.019504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.020438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.022604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.023159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.122730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:07.266115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:07.289084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4477092f-e782-44f6-8eee-a31ffef693d6 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 200 len: 1521 microversion: 2.1 time: 0.478275 Sep 08 10:22:07.294060 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1173/2192] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:06 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:07.312545 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7321fc7-42fe-42ea-98db-f5c7afedf4ac tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "DELETE /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 204 len: 0 microversion: 2.1 time: 0.355012 Sep 08 10:22:07.312545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1020/2193] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:06 2022] DELETE /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:07.321517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:07.322551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:07.333241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.334020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.335333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.336690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.337358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.338509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.555029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Calling method '.version_select at 0x7f2350c20820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:07.569059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.569552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.569980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.570895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.571557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.572232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.578666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:07.588796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7ae3afd-d728-4f9f-bd46-71ee27249fb6 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1667 microversion: 2.1 time: 0.271458 Sep 08 10:22:07.589708 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1174/2194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:07 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1667 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:07.604415 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c1de300-0d38-4ea7-9e13-139e3788c35c tempest-AbsoluteLimitsTestJSON-1315561455 tempest-AbsoluteLimitsTestJSON-1315561455-project] 10.222.0.59 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.290291 Sep 08 10:22:07.613667 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1021/2195] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Sep 8 10:22:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:07.766293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:07.767647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:07.795306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.795908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.799757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.801719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.802321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.802860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.823233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0dfd6a5a-9b2c-464f-9c69-82b6c8e5db4d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350b133a0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:07.893754 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0dfd6a5a-9b2c-464f-9c69-82b6c8e5db4d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.074186 Sep 08 10:22:07.894702 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1022/2196] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:07 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:07.977260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:07.978121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:07.986835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.987365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.987825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:07.988541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:07.989208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:07.989632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:08.157758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:08.172645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6f0cb64-f65a-4da8-be2f-bb129888694b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1469 microversion: 2.1 time: 0.409278 Sep 08 10:22:08.191405 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1175/2197] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:07 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:08.321565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:08.323675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:08.339286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:08.341338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:08.342301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:08.345541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:08.346283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:08.348225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:08.379187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:08.396102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:08.403813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:08.410379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:08.417508 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0bf5e443-51cb-4fa4-99d4-997ae2f280da tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.443786 Sep 08 10:22:08.419436 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1023/2198] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:07 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:22:08.615355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:08.615989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:08.630170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:08.630872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:08.632512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:08.633251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:08.633720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:08.634117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:08.862872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:08.881347 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b65d4f4-0cdf-44c4-b216-f43d9e27f57f tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 200 len: 1521 microversion: 2.1 time: 0.564590 Sep 08 10:22:08.883094 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1176/2199] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:08 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:08.914526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c62cb1f8-da0b-4fd5-80a4-b4c76b7becc6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509473a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:08.982690 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c62cb1f8-da0b-4fd5-80a4-b4c76b7becc6 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.076532 Sep 08 10:22:08.984358 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1177/2200] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:08 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:09.070907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:09.082402 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec53a86b-8b00-4fa7-a66a-b3e3183aef35 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1667 microversion: 2.1 time: 0.471549 Sep 08 10:22:09.083012 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1024/2201] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:08 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1667 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:09.204284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:09.204898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:09.216902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:09.220460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:09.220922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:09.221707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:09.228206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:09.231362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:09.452076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:09.453468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:09.470579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:09.472048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:09.473317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:09.474328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:09.477345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:09.478115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:10.185864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:10.205682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:10.215780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:10.219436 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a7d52c2-ae35-4048-ba30-9e111e407e10 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.772969 Sep 08 10:22:10.226367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:10.234663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1025/2202] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:09 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:22:10.249445 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed2e06eb-f38b-4741-9fa2-42ea688ee61b tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 200 len: 1469 microversion: 2.1 time: 1.041490 Sep 08 10:22:10.250092 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1178/2203] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:09 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 1469 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:10.262227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:10.262827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:10.265826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-8240e09a-5b14-4d52-94ff-990c9c5be48d req-33d944c5-58cf-4ca0-a753-54f0867f92b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257df6a9-a628-4d96-9e8c-b040c5681437", "name": "network-vif-deleted", "tag": "a498a092-4c03-4501-a24d-1264d184487c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:10.299447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:10.310982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8240e09a-5b14-4d52-94ff-990c9c5be48d req-33d944c5-58cf-4ca0-a753-54f0867f92b0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:10.311571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8240e09a-5b14-4d52-94ff-990c9c5be48d req-33d944c5-58cf-4ca0-a753-54f0867f92b0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:10.312016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8240e09a-5b14-4d52-94ff-990c9c5be48d req-33d944c5-58cf-4ca0-a753-54f0867f92b0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:10.312601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:10.313182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:10.316429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:10.316915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:10.317351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:10.347523 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-8240e09a-5b14-4d52-94ff-990c9c5be48d req-33d944c5-58cf-4ca0-a753-54f0867f92b0 service nova] Creating event network-vif-deleted:a498a092-4c03-4501-a24d-1264d184487c for instance 257df6a9-a628-4d96-9e8c-b040c5681437 on n-h1-833090-19 Sep 08 10:22:10.366753 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-8240e09a-5b14-4d52-94ff-990c9c5be48d req-33d944c5-58cf-4ca0-a753-54f0867f92b0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112983 Sep 08 10:22:10.372288 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1026/2204] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:10.392427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cab35bb9-5e62-49a0-9246-9d1f61b1f870 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350b62940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:10.476718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:10.512573 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb5ce93d-0baa-40af-a4ae-aacf1d8f5671 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 200 len: 1479 microversion: 2.1 time: 0.254384 Sep 08 10:22:10.514110 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1179/2205] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:10 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 1479 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:10.532834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:10.536802 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cab35bb9-5e62-49a0-9246-9d1f61b1f870 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.163098 Sep 08 10:22:10.537703 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1027/2206] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:10 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:10.538057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:10.566993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:10.567845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:10.571071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:10.573691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:10.585656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:10.586759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.257576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:11.258405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:11.289128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.289450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.289893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.300789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.304489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.305690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.363162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:11.372161 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19538395-7149-43fc-8961-bdc0a1757403 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1667 microversion: 2.1 time: 0.856481 Sep 08 10:22:11.380794 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1180/2207] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:10 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1667 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:11.386265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:11.411114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 257df6a9-a628-4d96-9e8c-b040c5681437] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:11.435712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.436203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.441679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.442761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.444768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.447527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.486295 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] HTTP exception thrown: Instance 257df6a9-a628-4d96-9e8c-b040c5681437 could not be found. Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Request method failure captured: Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 HTTP/1.1 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcC_JTF4YNZ_BHMFcX7DiFarHB0tM-673Hq415jjJKTj1PjE__nOE9VgYm5a3B7_tRj6RCtnVXM2How5wEcIO_Eq74bdVPKFfXDhwlUlZHnTV8t1cndQsvxZ6cpwE3PzDm_l3SP7W4SBMidTWy8zxUuH__TlxYQ7uHb5VwszmXa1fM8 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cafdc851cfa34429b274c120b9d9c8b6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-MigrationsAdminTest-636933970-project Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5f96685045b340b2a978ece9dd591640 Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-MigrationsAdminTest-636933970-project Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 257df6a9-a628-4d96-9e8c-b040c5681437 could not be found. Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '257df6a9-a628-4d96-9e8c-b040c5681437'} Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257df6a9-a628-4d96-9e8c-b040c5681437 could not be found. Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257df6a9-a628-4d96-9e8c-b040c5681437 could not be found. Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:11.496628 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257df6a9-a628-4d96-9e8c-b040c5681437 could not be found. Sep 08 10:22:11.502680 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:11.506572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Returning 404 to user: Instance 257df6a9-a628-4d96-9e8c-b040c5681437 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:11.507676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6488bab7-01a8-4b12-b87c-567a22f3040d tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437" status: 404 len: 111 microversion: 2.1 time: 0.125167 Sep 08 10:22:11.508728 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1181/2208] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:11 2022] GET /compute/v2.1/servers/257df6a9-a628-4d96-9e8c-b040c5681437 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:11.516676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:11.522407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:11.538016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.538955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.539875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.548439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.549240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.549910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.604718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:11.789222 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c235c576-e620-46f8-bcaf-6d0d28c9dbbe tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 204 len: 0 microversion: 2.1 time: 0.276307 Sep 08 10:22:11.790256 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1182/2209] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:11 2022] DELETE /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:11.800139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:11.801534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:11.830922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.832770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.835242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.836585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.842706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.844909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.922318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:11.941805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:11.951920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:11.956667 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01100905-d466-4ed4-b91e-cc9f1cb83171 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.706933 Sep 08 10:22:11.959850 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1028/2210] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:11 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:11.977288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:11.979519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:11.981594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:11.982721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lazy-loading 'fault' on Instance uuid 42850fd4-9c12-4dca-a639-6f4cebdcf399 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:11.983206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cabf1c4d-0c6b-4b3f-a152-0d1706acaada tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350ac2b80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:12.048016 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cabf1c4d-0c6b-4b3f-a152-0d1706acaada tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.086187 Sep 08 10:22:12.048978 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1029/2211] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:11 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:12.068410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:12.073574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:12.102221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:12.107347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:12.108351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:12.112689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:12.114369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:12.116052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:12.116815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:12.119891 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d711dd31-9c58-4413-b4fc-e2995fcb1035 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 200 len: 1313 microversion: 2.1 time: 0.325227 Sep 08 10:22:12.121253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1183/2212] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:11 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:12.410594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:12.411991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:12.427252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:12.430957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:12.433362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:12.434028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:12.436475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:12.437208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:12.438499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:12.870154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:12.885355 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65e38291-19c3-4d57-b2ce-9fa521576347 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1600 microversion: 2.1 time: 0.479828 Sep 08 10:22:12.886064 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1184/2213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:12 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1600 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:12.897226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-85dc3ce0-522d-493d-b2a1-6016f19b4a2d req-d971abef-2cef-4373-841f-7d78141fc720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42850fd4-9c12-4dca-a639-6f4cebdcf399", "name": "network-vif-deleted", "tag": "09b0b766-dfe3-4e32-be88-12f2942d36e3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:12.918473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-85dc3ce0-522d-493d-b2a1-6016f19b4a2d req-d971abef-2cef-4373-841f-7d78141fc720 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:12.918959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-85dc3ce0-522d-493d-b2a1-6016f19b4a2d req-d971abef-2cef-4373-841f-7d78141fc720 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:12.927414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-85dc3ce0-522d-493d-b2a1-6016f19b4a2d req-d971abef-2cef-4373-841f-7d78141fc720 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:13.317022 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-85dc3ce0-522d-493d-b2a1-6016f19b4a2d req-d971abef-2cef-4373-841f-7d78141fc720 service nova] Creating event network-vif-deleted:09b0b766-dfe3-4e32-be88-12f2942d36e3 for instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 on n-h1-833090-19 Sep 08 10:22:13.324259 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-85dc3ce0-522d-493d-b2a1-6016f19b4a2d req-d971abef-2cef-4373-841f-7d78141fc720 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.434831 Sep 08 10:22:13.325488 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1185/2214] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:13.332880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:13.333965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:13.342984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:13.344291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:13.345179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:13.346116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:13.346986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:13.348051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:13.524212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:13.533417 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f352b58a-70b1-4b3a-aa6a-43f069e198f1 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1468 microversion: 2.1 time: 1.483033 Sep 08 10:22:13.556173 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1030/2215] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:12 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1468 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:13.571859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-017ca663-9271-4850-b6cb-3026a4dd0153 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351758ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:13.735299 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-017ca663-9271-4850-b6cb-3026a4dd0153 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.176581 Sep 08 10:22:13.746383 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1031/2216] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:13 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:13.751545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:13.762898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:13.780607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:13.790608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:13.791379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:13.792359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:13.793998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:13.795887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:13.833868 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] HTTP exception thrown: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 HTTP/1.1 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '42850fd4-9c12-4dca-a639-6f4cebdcf399'} Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:13.837174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:13.841640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:13.844470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 404 to user: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:13.846020 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-477bf2dc-63a1-4953-9eb2-f2c95546a74c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 404 len: 111 microversion: 2.1 time: 0.098380 Sep 08 10:22:13.847109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1032/2217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:13 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:13.856803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a6d8bf51-6ac1-4265-8182-fa3890c3c12e req-132a7e6d-886a-4788-bffe-793887c04dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48255b60-3703-431a-9b76-c65d2bc9966a", "name": "network-vif-deleted", "tag": "df6ea807-8c33-4365-8e03-6d7ea7ae7a93"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:13.867750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a6d8bf51-6ac1-4265-8182-fa3890c3c12e req-132a7e6d-886a-4788-bffe-793887c04dde service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:13.868599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a6d8bf51-6ac1-4265-8182-fa3890c3c12e req-132a7e6d-886a-4788-bffe-793887c04dde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:13.869323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a6d8bf51-6ac1-4265-8182-fa3890c3c12e req-132a7e6d-886a-4788-bffe-793887c04dde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:13.898121 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a6d8bf51-6ac1-4265-8182-fa3890c3c12e req-132a7e6d-886a-4788-bffe-793887c04dde service nova] Creating event network-vif-deleted:df6ea807-8c33-4365-8e03-6d7ea7ae7a93 for instance 48255b60-3703-431a-9b76-c65d2bc9966a on n-h2-833090-19 Sep 08 10:22:13.907575 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a6d8bf51-6ac1-4265-8182-fa3890c3c12e req-132a7e6d-886a-4788-bffe-793887c04dde service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056342 Sep 08 10:22:13.913375 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1033/2218] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:13.937283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:13.948285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:13.962508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:13.987234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:13.997689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.000105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.002473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.005236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.005719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.006939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.007398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.008422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.009568 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f90eacca-a4a8-4564-9756-1f3a82f90daf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.682788 Sep 08 10:22:14.023944 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1186/2219] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:13 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:14.033802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.044397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:14.061477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.062198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.062639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.069177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.079553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.092240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.208870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.209377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.209805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.212633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lazy-loading 'fault' on Instance uuid 48255b60-3703-431a-9b76-c65d2bc9966a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:14.275620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc3fa10f-5434-496c-a158-5f759ca9486d tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.360400 Sep 08 10:22:14.279855 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1034/2220] 10.222.0.59 () {58 vars in 1230 bytes} [Thu Sep 8 10:22:13 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:22:14.296417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43b4b8af-3fa9-410e-a333-03f93f5dc4b1 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43b4b8af-3fa9-410e-a333-03f93f5dc4b1 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 10:22:14.303053 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 10:22:14.307884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.311348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43b4b8af-3fa9-410e-a333-03f93f5dc4b1 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:14.312840 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-43b4b8af-3fa9-410e-a333-03f93f5dc4b1 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020761 Sep 08 10:22:14.314110 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1035/2221] 10.222.0.59 () {58 vars in 1182 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:22:14.326736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.337437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.338569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:14.347881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.348764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.349484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.350896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.351660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.352315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.408160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:22:14.434814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.446938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0842c88-6cdd-4400-b35b-cc95d62eb614 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 200 len: 1324 microversion: 2.1 time: 0.421788 Sep 08 10:22:14.448469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:14.451025 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f8290f0a-40f0-447b-912c-8d4bcaa5d125 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.130556 Sep 08 10:22:14.452280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1036/2222] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers => generated 683 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:14.462381 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1187/2223] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 1324 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:14.480790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.492588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.494411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.servers [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Removing options 'limit' from query {{(pid=122456) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:22:14.495945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:14.503633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.505434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.506119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.507110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.507827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.508480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.546101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:22:14.586351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.587713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:14.602793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.603850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.604548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.607643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.608460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.611692 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28d44175-6eea-4e42-9959-f9714948f4d5 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.142419 Sep 08 10:22:14.612129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.616652 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1037/2224] 10.222.0.59 () {58 vars in 1144 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:14.633932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67b933b-520d-440c-919a-2aef25da90c7 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67b933b-520d-440c-919a-2aef25da90c7 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '-1' Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 10:22:14.647055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67b933b-520d-440c-919a-2aef25da90c7 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:14.656221 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f67b933b-520d-440c-919a-2aef25da90c7 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.027820 Sep 08 10:22:14.658905 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1038/2225] 10.222.0.59 () {58 vars in 1142 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:22:14.668966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-381b7a2e-8f13-4969-9a71-f2d744a1bd49 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-381b7a2e-8f13-4969-9a71-f2d744a1bd49 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'testing' Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 10:22:14.686779 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-381b7a2e-8f13-4969-9a71-f2d744a1bd49 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-381b7a2e-8f13-4969-9a71-f2d744a1bd49 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029747 Sep 08 10:22:14.694388 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1039/2226] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:22:14.712135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23bc2aa7-64ec-489f-8bb0-2e9c8ec23357 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.718903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-23bc2aa7-64ec-489f-8bb0-2e9c8ec23357 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.719748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23bc2aa7-64ec-489f-8bb0-2e9c8ec23357 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:14.727707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.servers [None req-23bc2aa7-64ec-489f-8bb0-2e9c8ec23357 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Flavor 'non_existing_flavor' could not be found {{(pid=122456) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 08 10:22:14.728908 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23bc2aa7-64ec-489f-8bb0-2e9c8ec23357 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.031622 Sep 08 10:22:14.729492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1040/2227] 10.222.0.59 () {58 vars in 1178 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:22:14.744046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:14.751347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:14.752060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:14.758879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.760215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.760828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:14.761757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:14.762378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:14.762968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:15.189858 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03b490df-1ce9-4297-afbf-61a38403f30c tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.450971 Sep 08 10:22:15.199647 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1041/2228] 10.222.0.59 () {58 vars in 1174 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:22:15.212804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b471c062-9e20-408e-8162-8fa6b875da8f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350b625e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:15.290040 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b471c062-9e20-408e-8162-8fa6b875da8f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.081270 Sep 08 10:22:15.295898 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1042/2229] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:15 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:15.302320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:15.304699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:15.311758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:15.312758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:15.313386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:15.314297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:15.314932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:15.315649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:15.783701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:15.792990 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0eb31b34-fb36-4806-aabb-139777939dd9 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1426 microversion: 2.1 time: 1.214570 Sep 08 10:22:15.801685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1188/2230] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:14 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1426 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:15.809776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:15.822667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:15.828758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:15.844008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:15.846505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:15.847938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:15.850573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:15.853706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:15.857449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.083181 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ded34b0-c813-4c31-9b92-17334c7fbd02 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.280214 Sep 08 10:22:16.083689 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1189/2231] 10.222.0.59 () {58 vars in 1184 bytes} [Thu Sep 8 10:22:15 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:22:16.114292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:16.128765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:16.138339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:16.138842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 48255b60-3703-431a-9b76-c65d2bc9966a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:16.140300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:16.141656 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de05b4d7-3e71-4de3-aea0-b6aa0268473d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.843837 Sep 08 10:22:16.142715 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1043/2232] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:15 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:16.160429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d0a3b729-3fce-422b-adbc-838ba1621429 req-608a3784-cef9-486c-990a-9b033251cde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b35549a-0f59-4a78-bcf5-fa13562fe95f", "name": "network-vif-plugged", "status": "completed", "tag": "5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:16.181173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:16.183157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.186976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.188342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.189557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.190107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.193260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.194975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d0a3b729-3fce-422b-adbc-838ba1621429 req-608a3784-cef9-486c-990a-9b033251cde8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.195495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d0a3b729-3fce-422b-adbc-838ba1621429 req-608a3784-cef9-486c-990a-9b033251cde8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.195928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d0a3b729-3fce-422b-adbc-838ba1621429 req-608a3784-cef9-486c-990a-9b033251cde8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.221136 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d0a3b729-3fce-422b-adbc-838ba1621429 req-608a3784-cef9-486c-990a-9b033251cde8 service nova] Creating event network-vif-plugged:5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0 for instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f on n-h2-833090-19 Sep 08 10:22:16.229883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d0a3b729-3fce-422b-adbc-838ba1621429 req-608a3784-cef9-486c-990a-9b033251cde8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085752 Sep 08 10:22:16.230984 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1044/2233] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:16.238074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3e888f79-755b-42a3-aff8-45f0b2196788 req-9484b85a-64b4-4b2d-9a1e-04abd5f3df96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5a736f-021a-43fd-ae81-209ae40bc1f5", "name": "network-vif-deleted", "tag": "642a50fe-153c-4e4e-82bf-40d85d4ed091"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:16.246893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] HTTP exception thrown: Instance 48255b60-3703-431a-9b76-c65d2bc9966a could not be found. Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Request method failure captured: Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a HTTP/1.1 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDFv46tDoz9G8sK6qXhrUNLEQcNscYg3-Ui6ckSMfgwf_S-GyOdfida5puevu4eRmdmu0JSVs2jezidjVu4X5Idozso0VxRBolwggMaFoQxKQSbPEbv6aT7hAUpnjotvCbIUY_S0wdwb1qdipwvG3QtTLKkH57_uqIOznBAe6QIiOc Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e0721ab63dc349cb99bdb42d4c5e1732", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-LiveMigrationTest-135334318 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-LiveMigrationTest-135334318-project Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 46a59f79e24b4644a167dc0a4d2c4af9 Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-LiveMigrationTest-135334318-project Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 48255b60-3703-431a-9b76-c65d2bc9966a could not be found. Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '48255b60-3703-431a-9b76-c65d2bc9966a'} Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48255b60-3703-431a-9b76-c65d2bc9966a could not be found. Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48255b60-3703-431a-9b76-c65d2bc9966a could not be found. Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:16.252102 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48255b60-3703-431a-9b76-c65d2bc9966a could not be found. Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:16.260813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Returning 404 to user: Instance 48255b60-3703-431a-9b76-c65d2bc9966a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:16.261536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3e888f79-755b-42a3-aff8-45f0b2196788 req-9484b85a-64b4-4b2d-9a1e-04abd5f3df96 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.261536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3e888f79-755b-42a3-aff8-45f0b2196788 req-9484b85a-64b4-4b2d-9a1e-04abd5f3df96 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.261536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3e888f79-755b-42a3-aff8-45f0b2196788 req-9484b85a-64b4-4b2d-9a1e-04abd5f3df96 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.261825 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6481f226-455e-4d68-bc99-0bce2cd2d56f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a" status: 404 len: 111 microversion: 2.1 time: 0.149596 Sep 08 10:22:16.263395 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1190/2234] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:16 2022] GET /compute/v2.1/servers/48255b60-3703-431a-9b76-c65d2bc9966a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:16.269337 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3e888f79-755b-42a3-aff8-45f0b2196788 req-9484b85a-64b4-4b2d-9a1e-04abd5f3df96 service nova] Creating event network-vif-deleted:642a50fe-153c-4e4e-82bf-40d85d4ed091 for instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 on n-h2-833090-19 Sep 08 10:22:16.276699 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3e888f79-755b-42a3-aff8-45f0b2196788 req-9484b85a-64b4-4b2d-9a1e-04abd5f3df96 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044333 Sep 08 10:22:16.277613 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1045/2235] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:16.281687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:16.291379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-986cb950-09bb-441c-8125-5fc7ce7615a8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '.version_select at 0x7f2350b13670>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:16.297221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:16.311978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:16.337066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.337729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.338255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.339279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.343419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.343911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.380126 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-986cb950-09bb-441c-8125-5fc7ce7615a8 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094581277" status: 202 len: 0 microversion: 2.1 time: 0.096057 Sep 08 10:22:16.383879 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1046/2236] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:22:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094581277 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:16.391656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8abbc7f-6da5-4e44-91df-9fb70284f9af tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23553f9ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:16.481093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:22:16.550504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8abbc7f-6da5-4e44-91df-9fb70284f9af tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.162730 Sep 08 10:22:16.551086 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1047/2237] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:16 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:16.766742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:16.797457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.798474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.798474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.818902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:16.820344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:16.845945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.846756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.849776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.852343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.855659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.858893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.970000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:16.975814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:16.978313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:16.981687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lazy-loading 'fault' on Instance uuid 2f5a736f-021a-43fd-ae81-209ae40bc1f5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:17.253529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96685045b340b2a978ece9dd591640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cafdc851cfa34429b274c120b9d9c8b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:17.277161 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ebb75eb0-3960-4f4c-9d6b-5bf8906e7dc2 tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 200 len: 1302 microversion: 2.1 time: 0.462831 Sep 08 10:22:17.300651 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1048/2238] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:16 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 1302 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:17.329443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:17.342204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:17.364014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:17.368673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:17.369156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:17.369929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:17.370410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:17.370900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:17.570037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:17.595912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b1b1570-a9c7-42fb-94d6-487d1962d8fc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.331095 Sep 08 10:22:17.611488 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1191/2239] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:22:16 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:17.621307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ded24926-c776-4638-bd14-524a07dc49f2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235098eb80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:17.715793 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ded24926-c776-4638-bd14-524a07dc49f2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.117673 Sep 08 10:22:17.725550 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1192/2240] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:17 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:17.746940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e169e24d-e6eb-4af7-a3e2-8a3f8882eafc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:17.752066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e169e24d-e6eb-4af7-a3e2-8a3f8882eafc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:17.753096 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e169e24d-e6eb-4af7-a3e2-8a3f8882eafc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.026504 Sep 08 10:22:17.779603 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1193/2241] 10.222.0.59 () {58 vars in 1178 bytes} [Thu Sep 8 10:22:17 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:22:17.799452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:17.821121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:17.824203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Searching by: {'deleted': False, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:22:17.842467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:17.842961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:17.848171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:17.850788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:17.853761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:17.854397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:17.963467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:17.977814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:17.982160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:17.988635 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2f4582aa-eadf-4d91-ba0b-854754380671 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.678686 Sep 08 10:22:18.001978 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1049/2242] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:17 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:18.024649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:22:18.127321 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e929ed95-92fb-4aee-b58b-ef75b8afcef2 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.345894 Sep 08 10:22:18.127321 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1194/2243] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:22:17 2022] GET /compute/v2.1/servers => generated 683 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:18.141878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:18.142506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:18.149900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.150732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.151663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.152596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.153261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.153889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.245629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:18.313322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:18.313942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] [instance: 2f5a736f-021a-43fd-ae81-209ae40bc1f5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:18.321824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.322310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.332947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.334250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.339796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.347874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.382240 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] HTTP exception thrown: Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 could not be found. Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Request method failure captured: Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 HTTP/1.1 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcC_JTF4YNZ_BHMFcX7DiFarHB0tM-673Hq415jjJKTj1PjE__nOE9VgYm5a3B7_tRj6RCtnVXM2How5wEcIO_Eq74bdVPKFfXDhwlUlZHnTV8t1cndQsvxZ6cpwE3PzDm_l3SP7W4SBMidTWy8zxUuH__TlxYQ7uHb5VwszmXa1fM8 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cafdc851cfa34429b274c120b9d9c8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cafdc851cfa34429b274c120b9d9c8b6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: cafdc851cfa34429b274c120b9d9c8b6 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-MigrationsAdminTest-636933970 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-MigrationsAdminTest-636933970-project Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5f96685045b340b2a978ece9dd591640 Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-MigrationsAdminTest-636933970-project Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 could not be found. Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '2f5a736f-021a-43fd-ae81-209ae40bc1f5'} Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 could not be found. Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 could not be found. Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:18.384056 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 could not be found. Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] Returning 404 to user: Instance 2f5a736f-021a-43fd-ae81-209ae40bc1f5 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b9abb44-a7c8-4def-b4b7-e5421282eb3c tempest-MigrationsAdminTest-636933970 tempest-MigrationsAdminTest-636933970-project] 10.222.0.59 "GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5" status: 404 len: 111 microversion: 2.1 time: 0.076205 Sep 08 10:22:18.390511 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1195/2244] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:18 2022] GET /compute/v2.1/servers/2f5a736f-021a-43fd-ae81-209ae40bc1f5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:18.467358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bda8d1c8-0511-4c26-9f39-468690e9e845 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 204 len: 0 microversion: 2.1 time: 0.329256 Sep 08 10:22:18.469649 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1050/2245] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:18 2022] DELETE /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:18.484484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:18.485852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:18.507362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.513250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.514043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.520768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.521953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.525585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.536549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:18.601419 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] HTTP exception thrown: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 HTTP/1.1 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '42850fd4-9c12-4dca-a639-6f4cebdcf399'} Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:18.603608 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:18.608055 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:18.611008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 404 to user: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:18.613703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-92d8b254-dc7c-4537-aace-01754d77c952 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 404 len: 111 microversion: 2.1 time: 0.140076 Sep 08 10:22:18.617795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1196/2246] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:18 2022] DELETE /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:18.627683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:18.627683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:18.662613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.666723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.671221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.673437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:18.676575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:18.681738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:18.733880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9181e5a5-fc20-48e2-a58b-7c1c289fca6f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350a63b80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:18.765514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:18.880688 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9181e5a5-fc20-48e2-a58b-7c1c289fca6f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.153460 Sep 08 10:22:18.891277 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1197/2247] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:18 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:22:19.015322 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-484a92e6-62f5-41af-859f-8f6dcdb1f7a8 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 204 len: 0 microversion: 2.1 time: 0.394409 Sep 08 10:22:19.020043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:19.021492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:19.026429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1051/2248] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:18 2022] DELETE /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:19.038322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:19.044220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:19.045208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:19.045766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:19.046787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:19.047875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:19.050051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:19.053669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:19.074897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:19.077426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:19.078265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:19.079820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:19.080568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:19.081276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:19.930165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:19.939162 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d37763cc-9a2f-4545-98d7-815134a0bed0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 200 len: 1521 microversion: 2.1 time: 0.908001 Sep 08 10:22:19.944437 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1052/2249] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:19 2022] GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:19.954254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:19.961295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:19.981072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:19.981814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:19.982625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:19.982773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:19.984061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:19.984695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:19.985294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:20.001824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:20.008063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:20.013384 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c97f7c8-83d6-4602-8ffe-f29e5237d19f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1281 microversion: 2.25 time: 0.995226 Sep 08 10:22:20.020437 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1198/2250] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:19 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1281 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:22:20.038340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c9e38b6-08e9-4628-888b-34f43998405e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509cda60>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:20.062918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:20.134600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c9e38b6-08e9-4628-888b-34f43998405e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.106555 Sep 08 10:22:20.135493 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1199/2251] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:20 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:20.245964 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-22fe303f-601c-4d17-80b8-872cfdfaf67f tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 204 len: 0 microversion: 2.1 time: 0.299897 Sep 08 10:22:20.251346 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1053/2252] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:19 2022] DELETE /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:20.261243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:20.262036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:20.293452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:20.302537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:20.309863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:20.316710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:20.323417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:20.344090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:20.786466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:20.795610 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-008b59c9-ecf3-4753-95f9-746945f853e1 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1484 microversion: 2.1 time: 0.539127 Sep 08 10:22:20.797065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1200/2253] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:20 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1484 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:20.974687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:20.976213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:20.988327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:20.992619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:20.995732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:21.001013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:21.002279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:21.002735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:21.042860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:21.055138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:21.076864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:21.080147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:21.080980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:21.084845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:21.086811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:21.088475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:22.003196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:22.018875 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5b3b796-cef1-4c88-b78a-9850e579bacc tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 200 len: 1521 microversion: 2.1 time: 1.046600 Sep 08 10:22:22.019616 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1054/2254] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:20 2022] GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 1521 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:22.027394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08d4a525-7e6c-4fb9-b943-0231d0c164ad tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23554048b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:22.131768 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08d4a525-7e6c-4fb9-b943-0231d0c164ad tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.110710 Sep 08 10:22:22.132675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1055/2255] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:22 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:22.147188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:22.148171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:22.155758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:22.156554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:22.157178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:22.158113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:22.158876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:22.159533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.080602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:23.094667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:23.101723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:23.102970 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2fc5359e-8d7d-46cb-b55e-e47cfef2d4b1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1477 microversion: 2.25 time: 2.064397 Sep 08 10:22:23.107804 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1201/2256] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:21 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1477 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:23.120648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-259d6935-a267-4425-8459-8a839be1f048 req-2153eda1-6da1-48fc-a671-eb45dd8d3d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d54b3ce-40c1-4410-be63-a9ab59f67519", "name": "network-vif-deleted", "tag": "225b9ccd-539b-42ac-b643-c167c9862616"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:23.153839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-259d6935-a267-4425-8459-8a839be1f048 req-2153eda1-6da1-48fc-a671-eb45dd8d3d6f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:23.156501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-259d6935-a267-4425-8459-8a839be1f048 req-2153eda1-6da1-48fc-a671-eb45dd8d3d6f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:23.158741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-259d6935-a267-4425-8459-8a839be1f048 req-2153eda1-6da1-48fc-a671-eb45dd8d3d6f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.193064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-259d6935-a267-4425-8459-8a839be1f048 req-2153eda1-6da1-48fc-a671-eb45dd8d3d6f service nova] Creating event network-vif-deleted:225b9ccd-539b-42ac-b643-c167c9862616 for instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 on n-h1-833090-19 Sep 08 10:22:23.208616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-259d6935-a267-4425-8459-8a839be1f048 req-2153eda1-6da1-48fc-a671-eb45dd8d3d6f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099168 Sep 08 10:22:23.210764 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1202/2257] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:23.231916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:23.232654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:23.267808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:23.268566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:23.273787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.276606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:23.277286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:23.278641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.625652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:23.637718 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7da7d4b5-82bd-442a-9178-8d9ffd9e66d0 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 200 len: 1479 microversion: 2.1 time: 0.425455 Sep 08 10:22:23.639403 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1203/2258] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:23 2022] GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 1479 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:23.652790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:23.653718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:23.667020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:23.668277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:23.671906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:23.672927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.673857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:23.674482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:23.685661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:23.686607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.705737 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d27ed4c-733e-44bb-a6b8-3a4db3230592 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1484 microversion: 2.1 time: 1.563832 Sep 08 10:22:23.729875 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1056/2259] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:22 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1484 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:23.740962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a02064f1-b646-4530-88e5-a4f4abfab530 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235539dd30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:23.844552 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a02064f1-b646-4530-88e5-a4f4abfab530 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.111221 Sep 08 10:22:23.846499 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1057/2260] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:23 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:23.879506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3d093e79-756a-4a81-9cb7-52f436bf8992 req-cfd4a615-84d5-4817-975f-836883a98127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e79c97b-cc74-4562-bd3f-e4d4ee9b6826", "name": "network-vif-deleted", "tag": "ddf5ae5a-4ced-4792-a02a-f3ce00e7bbdd"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:23.927423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3d093e79-756a-4a81-9cb7-52f436bf8992 req-cfd4a615-84d5-4817-975f-836883a98127 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:23.937939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3d093e79-756a-4a81-9cb7-52f436bf8992 req-cfd4a615-84d5-4817-975f-836883a98127 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:23.938745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3d093e79-756a-4a81-9cb7-52f436bf8992 req-cfd4a615-84d5-4817-975f-836883a98127 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:23.983642 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3d093e79-756a-4a81-9cb7-52f436bf8992 req-cfd4a615-84d5-4817-975f-836883a98127 service nova] Creating event network-vif-deleted:ddf5ae5a-4ced-4792-a02a-f3ce00e7bbdd for instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 on n-h2-833090-19 Sep 08 10:22:23.996902 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3d093e79-756a-4a81-9cb7-52f436bf8992 req-cfd4a615-84d5-4817-975f-836883a98127 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122069 Sep 08 10:22:23.997959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1058/2261] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:22:24.426733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 0b35549a-0f59-4a78-bcf5-fa13562fe95f {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:24.489382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de556823-bad4-4ac1-ae52-cb819c65c692 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1972 microversion: 2.25 time: 0.847866 Sep 08 10:22:24.489981 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1204/2262] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:23 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1972 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:24.519513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:24.520307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:24.531377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:24.532736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:24.533940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:24.535578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:24.538231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:24.539144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:24.669052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:24.670327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:24.707594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:24.708149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:24.711610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:24.716459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:24.717283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:24.729390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:24.858131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:24.861424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:24.863765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:24.866795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lazy-loading 'fault' on Instance uuid 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:25.073942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:25.086881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4afdfe9915e34589a5c126b25d228e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea416d64c664fb2864e2d42c8fa8306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:25.095297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9175ab5e-7f5e-48fe-bbf0-6b4d3e255ffa tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 200 len: 1313 microversion: 2.1 time: 0.432567 Sep 08 10:22:25.100744 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1205/2263] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:24 2022] GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:25.114946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 0b35549a-0f59-4a78-bcf5-fa13562fe95f {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:25.128434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:25.139833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:25.157236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:25.157745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:25.158193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:25.158920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:25.159389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:25.159855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:25.177470 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74cbacd7-9878-4d28-8546-ac125877f41a tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1972 microversion: 2.25 time: 0.661855 Sep 08 10:22:25.181087 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1059/2264] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:24 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1972 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:25.195564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-094e430d-49f8-4424-a4d0-d9ad63c51a62 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235113eaf0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:25.373854 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-094e430d-49f8-4424-a4d0-d9ad63c51a62 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.189395 Sep 08 10:22:25.374513 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1060/2265] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:25 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:25.390609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:25.396032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:25.400114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:25.400594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:25.401435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:25.412644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:25.413978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:25.453779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6a842ee-093b-47ed-80d3-97317ba7c87d tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.078107 Sep 08 10:22:25.454835 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1061/2266] 10.222.0.59 () {60 vars in 1217 bytes} [Thu Sep 8 10:22:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:22:25.480215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:25.490314 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07a3501a-ac6d-4cc0-93e8-21e759cfd248 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1442 microversion: 2.1 time: 0.381899 Sep 08 10:22:25.499889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1206/2267] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:25 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1442 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:25.529568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-19", "block_migration": "auto"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:25.541518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:25.583881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:25.584385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:25.592103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:25.592892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:25.593362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:25.593793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:25.749513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'flavor' on Instance uuid 0b35549a-0f59-4a78-bcf5-fa13562fe95f {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:25.800911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Going to try to live migrate instance to n-h1-833090-19 {{(pid=122456) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:22:26.037761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-95533afb-c805-494c-9cd4-8f274cd166e1 req-45f84069-e339-478f-8697-a63050501eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a03a7af3-2569-4592-bab4-88792475ddec", "name": "network-vif-deleted", "tag": "3ea7fc6f-91bc-42c7-89eb-65b824d46318"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:26.071422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-95533afb-c805-494c-9cd4-8f274cd166e1 req-45f84069-e339-478f-8697-a63050501eec service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.071957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-95533afb-c805-494c-9cd4-8f274cd166e1 req-45f84069-e339-478f-8697-a63050501eec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.072397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-95533afb-c805-494c-9cd4-8f274cd166e1 req-45f84069-e339-478f-8697-a63050501eec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.120847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-95533afb-c805-494c-9cd4-8f274cd166e1 req-45f84069-e339-478f-8697-a63050501eec service nova] Creating event network-vif-deleted:3ea7fc6f-91bc-42c7-89eb-65b824d46318 for instance a03a7af3-2569-4592-bab4-88792475ddec on n-h2-833090-19 Sep 08 10:22:26.128655 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-95533afb-c805-494c-9cd4-8f274cd166e1 req-45f84069-e339-478f-8697-a63050501eec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096252 Sep 08 10:22:26.138628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1207/2268] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:26.162462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:26.164446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:26.192987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.196455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.197212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.198495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.200709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.201652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.226554 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] HTTP exception thrown: Instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 could not be found. Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 HTTP/1.1 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 could not be found. Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9e79c97b-cc74-4562-bd3f-e4d4ee9b6826'} Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 could not be found. Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 could not be found. Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.239051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 could not be found. Sep 08 10:22:26.247521 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.261837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 404 to user: Instance 9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:26.263242 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c5592ee-d360-4105-a4b5-3ed65c0e0d5e tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826" status: 404 len: 111 microversion: 2.1 time: 0.122939 Sep 08 10:22:26.265968 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1208/2269] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:26 2022] GET /compute/v2.1/servers/9e79c97b-cc74-4562-bd3f-e4d4ee9b6826 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:26.289723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:26.290416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 42850fd4-9c12-4dca-a639-6f4cebdcf399] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:26.319759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.329658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.330618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.331832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.332570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.333215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.367822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] HTTP exception thrown: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 HTTP/1.1 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '42850fd4-9c12-4dca-a639-6f4cebdcf399'} Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.370445 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. Sep 08 10:22:26.374920 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.377913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 404 to user: Instance 42850fd4-9c12-4dca-a639-6f4cebdcf399 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:26.382228 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04938be8-0af8-40a7-99fd-f3468a4750b4 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399" status: 404 len: 111 microversion: 2.1 time: 0.107072 Sep 08 10:22:26.382228 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1209/2270] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:26 2022] GET /compute/v2.1/servers/42850fd4-9c12-4dca-a639-6f4cebdcf399 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:26.393285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:26.393914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] [instance: 0d54b3ce-40c1-4410-be63-a9ab59f67519] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:26.409965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.412041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.415482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.419834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.422113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.422977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.467608 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] HTTP exception thrown: Instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 could not be found. Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Request method failure captured: Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 HTTP/1.1 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcInYw2-okkX3BNviNk2eCNFzThsecJok-jKMketyl2AFSUYYppaaBBEXOicjj0sNmbaV-DM4cNjYaqYhTMEB6WZCLPTg3vj4bv9cVeAqOWS83MPWI0PA1mQNJBeBXI-q2GAWeD_yqfa84r1NVTko37PYWdEltUcDsHyuPKYvGcMalk Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dea416d64c664fb2864e2d42c8fa8306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dea416d64c664fb2864e2d42c8fa8306", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: dea416d64c664fb2864e2d42c8fa8306 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-249007591 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4afdfe9915e34589a5c126b25d228e95 Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListServersNegativeTestJSON-249007591-project Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 could not be found. Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0d54b3ce-40c1-4410-be63-a9ab59f67519'} Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 could not be found. Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 could not be found. Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.469975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 could not be found. Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] Returning 404 to user: Instance 0d54b3ce-40c1-4410-be63-a9ab59f67519 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:26.474843 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1414e4c7-2440-42dd-b05e-3dd788dbdd88 tempest-ListServersNegativeTestJSON-249007591 tempest-ListServersNegativeTestJSON-249007591-project] 10.222.0.59 "GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519" status: 404 len: 111 microversion: 2.1 time: 0.083800 Sep 08 10:22:26.476581 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1210/2271] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:26 2022] GET /compute/v2.1/servers/0d54b3ce-40c1-4410-be63-a9ab59f67519 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:26.486122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce8e8664-cbb1-490d-b755-10f9f38cebeb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509874c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:26.552142 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce8e8664-cbb1-490d-b755-10f9f38cebeb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.074868 Sep 08 10:22:26.555759 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1211/2272] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:26 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:26.570437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:26.571788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:26.593187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.593930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.610335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.611866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.619790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.620475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.775396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:26.802725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:26.812343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:26.812932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:26.816102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lazy-loading 'fault' on Instance uuid a03a7af3-2569-4592-bab4-88792475ddec {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:27.049026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:27.059418 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9f724cc-a0cb-4fa5-89e7-00480eca4d0a tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 200 len: 1301 microversion: 2.1 time: 0.501941 Sep 08 10:22:27.065554 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1212/2273] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:26 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 1301 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:27.429548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27298e97-2c3a-46ab-8d59-b402de88b187 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '.version_select at 0x7f2350a4ff70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:27.578396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27298e97-2c3a-46ab-8d59-b402de88b187 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0" status: 200 len: 371 microversion: 2.1 time: 0.511224 Sep 08 10:22:27.579063 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1213/2274] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:22:27 2022] GET /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0 => generated 371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:27.603181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f87fa6a1-a1c9-4857-928e-340d45e54437 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351808550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:27.707239 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f87fa6a1-a1c9-4857-928e-340d45e54437 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.115203 Sep 08 10:22:27.723947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1214/2275] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:27 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:27.738282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Action: 'update', calling method: .version_select at 0x7f23509ff040>, body: {"quota_set": {"ram": "5120"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:27.941623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:27.961040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:27.966855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:27.969114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:27.969781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:27.972523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:27.977691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:27.978395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:28.178461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b5e3a52-8d28-42fb-afd2-1614f8f33fdd tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0" status: 200 len: 328 microversion: 2.1 time: 0.448430 Sep 08 10:22:28.189763 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1215/2276] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:22:27 2022] PUT /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0 => generated 328 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:28.207423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:28.208073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: a03a7af3-2569-4592-bab4-88792475ddec] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:28.230220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:28.235093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:28.235713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:28.238510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:28.239617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:28.240069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:28.293867 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] HTTP exception thrown: Instance a03a7af3-2569-4592-bab4-88792475ddec could not be found. Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Request method failure captured: Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec HTTP/1.1 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDFv46tDoz9G8sK6qXhrUNLEQcNscYg3-Ui6ckSMfgwf_S-GyOdfida5puevu4eRmdmu0JSVs2jezidjVu4X5Idozso0VxRBolwggMaFoQxKQSbPEbv6aT7hAUpnjotvCbIUY_S0wdwb1qdipwvG3QtTLKkH57_uqIOznBAe6QIiOc Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e0721ab63dc349cb99bdb42d4c5e1732", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-LiveMigrationTest-135334318 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-LiveMigrationTest-135334318-project Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 46a59f79e24b4644a167dc0a4d2c4af9 Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-LiveMigrationTest-135334318-project Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance a03a7af3-2569-4592-bab4-88792475ddec could not be found. Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'a03a7af3-2569-4592-bab4-88792475ddec'} Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a03a7af3-2569-4592-bab4-88792475ddec could not be found. Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a03a7af3-2569-4592-bab4-88792475ddec could not be found. Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:28.295567 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a03a7af3-2569-4592-bab4-88792475ddec could not be found. Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Returning 404 to user: Instance a03a7af3-2569-4592-bab4-88792475ddec could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:28.300182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f11e116c-cec0-4be2-9771-6e30adab1cc9 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec" status: 404 len: 111 microversion: 2.1 time: 0.108483 Sep 08 10:22:28.307257 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1216/2277] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:28 2022] GET /compute/v2.1/servers/a03a7af3-2569-4592-bab4-88792475ddec => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:28.337906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9f9da61-89bd-43c1-a1c6-748b3c925421 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:28.370854 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9f9da61-89bd-43c1-a1c6-748b3c925421 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0" status: 202 len: 0 microversion: 2.1 time: 0.062169 Sep 08 10:22:28.376545 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1217/2278] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:22:28 2022] DELETE /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:22:28.392978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:28.396836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:28.415007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:28.415546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:28.416039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:28.421664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:28.422461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:28.424742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:28.502252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:22:28.665597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b394a099-3e42-4037-bb69-d1366f523575 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 204 len: 0 microversion: 2.1 time: 0.285605 Sep 08 10:22:28.666270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1218/2279] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:22:28 2022] DELETE /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:28.672168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7bb91edd-9910-4ec1-bda6-d571dac1d4ef tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '.version_select at 0x7f235098e9d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:28.810163 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7bb91edd-9910-4ec1-bda6-d571dac1d4ef tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0" status: 200 len: 371 microversion: 2.1 time: 0.142589 Sep 08 10:22:28.813703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1219/2280] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:22:28 2022] GET /compute/v2.1/os-quota-sets/47ec71bac4da4e24a3a786e16d0459a0 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:28.831128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:28.831944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:28.839965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:28.851219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:28.854036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:28.855034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:28.855318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:28.855782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:30.563394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:30.573519 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d55e5e45-cf6d-4a86-b214-7418c1295f07 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1499 microversion: 2.1 time: 1.758662 Sep 08 10:22:30.579706 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1220/2281] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:28 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1499 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:30.585383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01b23131-2c1c-4335-b998-3ffe320e2c35 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351e9cd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:30.692157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01b23131-2c1c-4335-b998-3ffe320e2c35 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.110810 Sep 08 10:22:30.692759 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1221/2282] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:30 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:30.708607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f76582c-bc9a-4e90-abba-f14668604e61 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '.version_select at 0x7f2350a631f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:31.334056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a19b113e-f6ca-4c4e-adc2-812db84b79b3 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f/action" status: 202 len: 0 microversion: 2.25 time: 5.814071 Sep 08 10:22:31.335447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1062/2283] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:22:25 2022] POST /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f/action => generated 0 bytes in 5816 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:22:31.346109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:31.347248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:31.373706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:31.376246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:31.381095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:31.382253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:31.383790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:31.389313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:31.466744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f76582c-bc9a-4e90-abba-f14668604e61 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36/defaults" status: 200 len: 371 microversion: 2.1 time: 0.772884 Sep 08 10:22:31.467639 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1222/2284] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:22:30 2022] GET /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36/defaults => generated 371 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:31.612700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:31.614125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:31.625179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:31.631572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:31.632256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:31.633566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:31.636196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:31.636860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:32.261356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:32.271246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:32.272137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:32.285198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:32.287080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7180402c-cefd-4b5c-9573-d1c5256dabfa tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1499 microversion: 2.1 time: 0.684059 Sep 08 10:22:32.287951 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1223/2285] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:31 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1499 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:32.291267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c2aed19-4e9f-467b-8263-4cb13ce7b1ed tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.950516 Sep 08 10:22:32.291901 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1063/2286] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:31 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:32.300078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-556c76b0-9449-4ef7-a203-c2fa6f6614d2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351b093a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:32.329559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Action: 'update', calling method: .version_select at 0x7f235113e160>, body: {"quota_set": {"ram": "5120"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:32.426471 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-556c76b0-9449-4ef7-a203-c2fa6f6614d2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.137022 Sep 08 10:22:32.427939 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1224/2287] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:32 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:32.795880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:32.797025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:32.797669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:32.799826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:32.800511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:32.803479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:32.986908 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c496d121-1bd9-4bfe-a514-9258d70151f9 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3" status: 200 len: 328 microversion: 2.1 time: 0.693869 Sep 08 10:22:32.994666 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1064/2288] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:22:32 2022] PUT /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3 => generated 328 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:33.013620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '.version_select at 0x7f2351e9cd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:33.152771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:33.159241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:33.159706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:33.160539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:33.169887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:33.172263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:33.201197 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-120e35b1-f4fe-4b60-9065-ba4277b4198e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3/detail" status: 200 len: 916 microversion: 2.1 time: 0.197968 Sep 08 10:22:33.211926 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1225/2289] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:22:33 2022] GET /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3/detail => generated 916 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:33.364735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:33.366097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:33.382090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:33.384119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:33.384722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:33.389996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:33.396460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:33.398380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:33.409266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-175b4001-7cb6-4b3b-9da9-ba9b04589c4c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Action: 'create', calling method: .version_select at 0x7f235552aaf0>, body: {"keypair": {"name": "tempest-keypair-319582988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHgPZzq9IXMH1probkMPFt/SQ8foxouJkN9x79Vf0zQUsyodcufG+YF7XFgqXOg5CXolYgTFTW53jh5Me6ZvuAejM16LDIEi8EmGY4QAXSVcyatiMuD3GpeM3Bi2pApmQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:33.413120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:33.510212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-175b4001-7cb6-4b3b-9da9-ba9b04589c4c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Getting quotas for project 3573779db74b412a84142504d7eadba9. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:33.537095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-175b4001-7cb6-4b3b-9da9-ba9b04589c4c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Getting quotas for user 8dcd2d7fa8fc48c3a9fe978d34455c32 and project 3573779db74b412a84142504d7eadba9. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:33.687865 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-175b4001-7cb6-4b3b-9da9-ba9b04589c4c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.399759 Sep 08 10:22:33.699062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1065/2290] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:33.713574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:33.714365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:33.727772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:33.732723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:33.733368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:33.734243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:33.734986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:33.738217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:34.118272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:34.137406 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f2978ac-c2ee-45a2-9da4-7b62a11e3648 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1457 microversion: 2.1 time: 0.777773 Sep 08 10:22:34.141501 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1226/2291] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:33 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1457 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:34.153165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c47f2ac-e88a-4aad-a1a3-bf75a26a266b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509d7280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:34.239413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c47f2ac-e88a-4aad-a1a3-bf75a26a266b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1455 microversion: 2.1 time: 0.096491 Sep 08 10:22:34.241336 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1227/2292] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:34 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:34.252122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Action: 'update', calling method: .version_select at 0x7f23512faaf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:34.379550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:34.380588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:34.381200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:34.382344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:34.385029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:34.385683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:34.504644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:34.510083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:34.510538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:34.515088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:34.515619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:34.516176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:34.676121 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93e2fd70-b5ca-42d2-9e3d-e02a32269a15 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3?user_id=12252860e7d8401295cb1b64912f4674" status: 200 len: 328 microversion: 2.1 time: 0.432500 Sep 08 10:22:34.677064 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1228/2293] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:22:34 2022] PUT /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3?user_id=12252860e7d8401295cb1b64912f4674 => generated 328 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:34.682730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-dbfd31e0-0ecf-4cab-a9b8-d094a043653c req-e4fcf9df-1058-4830-8014-5cad7e2e4eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc06ff9-6688-4171-829f-608b36008d7c", "name": "network-vif-deleted", "tag": "ef6e6845-4aee-4922-9016-5f3098f1a1f7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:34.693561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dbfd31e0-0ecf-4cab-a9b8-d094a043653c req-e4fcf9df-1058-4830-8014-5cad7e2e4eef service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:34.699582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dbfd31e0-0ecf-4cab-a9b8-d094a043653c req-e4fcf9df-1058-4830-8014-5cad7e2e4eef service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:34.700253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dbfd31e0-0ecf-4cab-a9b8-d094a043653c req-e4fcf9df-1058-4830-8014-5cad7e2e4eef service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:34.729071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-dbfd31e0-0ecf-4cab-a9b8-d094a043653c req-e4fcf9df-1058-4830-8014-5cad7e2e4eef service nova] Creating event network-vif-deleted:ef6e6845-4aee-4922-9016-5f3098f1a1f7 for instance 7dc06ff9-6688-4171-829f-608b36008d7c on n-h2-833090-19 Sep 08 10:22:34.741814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-dbfd31e0-0ecf-4cab-a9b8-d094a043653c req-e4fcf9df-1058-4830-8014-5cad7e2e4eef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063157 Sep 08 10:22:34.747298 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1229/2294] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:34.754395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-965124d1-e192-469a-85cb-de787e9e5b4e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '.version_select at 0x7f23512fa310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:34.902457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:34.907199 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-965124d1-e192-469a-85cb-de787e9e5b4e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3?user_id=12252860e7d8401295cb1b64912f4674" status: 200 len: 370 microversion: 2.1 time: 0.158268 Sep 08 10:22:34.914126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:34.915074 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1230/2295] 10.222.0.59 () {58 vars in 1323 bytes} [Thu Sep 8 10:22:34 2022] GET /compute/v2.1/os-quota-sets/e000a7d5f0f24c8f93c9a3baaa200ba3?user_id=12252860e7d8401295cb1b64912f4674 => generated 370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:34.926031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:34.927713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-789dc7bb-f7ae-49c6-bf5f-439f4c2ce4c9 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 1.226090 Sep 08 10:22:34.928465 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1066/2296] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:33 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:35.176867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:35.177613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:35.186864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:35.187354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:35.200137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:35.200930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:35.201418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:35.201872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:35.256259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1d9857f-b958-4321-bbcc-f27348aa5461 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235125a820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:35.346768 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1d9857f-b958-4321-bbcc-f27348aa5461 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1464 microversion: 2.1 time: 0.094339 Sep 08 10:22:35.347736 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1067/2297] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:35 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:35.349109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:35.349612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:35.350054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:35.350520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lazy-loading 'fault' on Instance uuid 7dc06ff9-6688-4171-829f-608b36008d7c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:22:35.369406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b08db077-606e-40db-af6b-f8efb6d9363b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23516a0790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:35.454058 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b08db077-606e-40db-af6b-f8efb6d9363b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 200 len: 1464 microversion: 2.1 time: 0.080578 Sep 08 10:22:35.455375 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1068/2298] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:35 2022] GET /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 1464 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:35.469884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:35.470832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:35.483967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:35.484701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:35.485402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:35.487171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:35.489219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:35.491637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:35.607727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a59f79e24b4644a167dc0a4d2c4af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0721ab63dc349cb99bdb42d4c5e1732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:35.616639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ec81043-a8e7-4c21-ab14-73300dbeb433 tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 200 len: 1301 microversion: 2.1 time: 0.446216 Sep 08 10:22:35.640129 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1231/2299] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:35 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 1301 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:35.650822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cbece56-3217-476b-9d39-23caa310d787 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Calling method '.version_select at 0x7f2351788f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:36.207449 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9cbece56-3217-476b-9d39-23caa310d787 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36/defaults" status: 200 len: 371 microversion: 2.1 time: 0.564957 Sep 08 10:22:36.219088 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1232/2300] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:22:35 2022] GET /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36/defaults => generated 371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:36.234975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:36.236877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:36.245090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:36.247359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:36.248111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:36.249708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:36.250920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:36.251629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:37.465320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:37.480771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-664c195e-da48-461c-b90c-d4f4ef445756 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1480 microversion: 2.1 time: 2.014863 Sep 08 10:22:37.483814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1069/2301] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:35 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1480 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:37.484348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:37.503217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:37.504423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Action: 'update', calling method: .version_select at 0x7f235552a280>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:37.504777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:37.505983 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b7f3eb2-3b8c-49e7-a35e-a0dd8628eef2 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 1.285739 Sep 08 10:22:37.506539 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1233/2302] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:36 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:37.524541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:37.526583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] [instance: 7dc06ff9-6688-4171-829f-608b36008d7c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:37.543412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:37.545081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:37.546405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:37.557552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:37.559068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:37.560115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:37.612506 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] HTTP exception thrown: Instance 7dc06ff9-6688-4171-829f-608b36008d7c could not be found. Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Request method failure captured: Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c HTTP/1.1 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcDFv46tDoz9G8sK6qXhrUNLEQcNscYg3-Ui6ckSMfgwf_S-GyOdfida5puevu4eRmdmu0JSVs2jezidjVu4X5Idozso0VxRBolwggMaFoQxKQSbPEbv6aT7hAUpnjotvCbIUY_S0wdwb1qdipwvG3QtTLKkH57_uqIOznBAe6QIiOc Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e0721ab63dc349cb99bdb42d4c5e1732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e0721ab63dc349cb99bdb42d4c5e1732", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-LiveMigrationTest-135334318 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e0721ab63dc349cb99bdb42d4c5e1732 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-LiveMigrationTest-135334318 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-LiveMigrationTest-135334318-project Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 46a59f79e24b4644a167dc0a4d2c4af9 Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-LiveMigrationTest-135334318-project Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7dc06ff9-6688-4171-829f-608b36008d7c could not be found. Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7dc06ff9-6688-4171-829f-608b36008d7c'} Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc06ff9-6688-4171-829f-608b36008d7c could not be found. Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc06ff9-6688-4171-829f-608b36008d7c could not be found. Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:22:37.626089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc06ff9-6688-4171-829f-608b36008d7c could not be found. Sep 08 10:22:37.630711 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:22:37.637050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] Returning 404 to user: Instance 7dc06ff9-6688-4171-829f-608b36008d7c could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:22:37.642368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dde1f8fd-5b86-4cee-ba7b-5c11715a22ea tempest-LiveMigrationTest-135334318 tempest-LiveMigrationTest-135334318-project] 10.222.0.59 "GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c" status: 404 len: 111 microversion: 2.1 time: 0.134756 Sep 08 10:22:37.645936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1234/2303] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:37 2022] GET /compute/v2.1/servers/7dc06ff9-6688-4171-829f-608b36008d7c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:22:37.707761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:37.708592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:37.709885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:37.711273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:37.713341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:37.714315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:37.914109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:38.209892 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2c0dbc9a-ffa5-4d9d-892e-6478a82023e5 tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36" status: 200 len: 329 microversion: 2.1 time: 0.723991 Sep 08 10:22:38.219198 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1070/2304] 10.222.0.59 () {60 vars in 1263 bytes} [Thu Sep 8 10:22:37 2022] PUT /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36 => generated 329 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:38.223728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Action: 'update', calling method: .version_select at 0x7f23516f78b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:38.358354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:38.360039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:38.360601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:38.361563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:38.366271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:38.366945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:38.497457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:38.515857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:38.516505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:38.528096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:38.529309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:38.530526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:38.534563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:38.535373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:38.539314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:38.922096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:38.933541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b527eb5f-f8b2-4f63-83c7-ca17ff84eb22 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1467 microversion: 2.1 time: 0.429050 Sep 08 10:22:38.938431 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1071/2305] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:38 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1467 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:38.958540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:38.964049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:38.981489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:38.982266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:38.982929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:38.984106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:38.984791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:38.985434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:38.993957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b3979d6-4c0d-4890-a6fb-5afa419be26e tempest-QuotasAdminTestJSON-306984525 tempest-QuotasAdminTestJSON-306984525-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36" status: 200 len: 329 microversion: 2.1 time: 0.773287 Sep 08 10:22:38.997318 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1235/2306] 10.222.0.59 () {60 vars in 1263 bytes} [Thu Sep 8 10:22:38 2022] PUT /compute/v2.1/os-quota-sets/ac93cf8165984bfd972e1d9d0f288e36 => generated 329 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:22:39.010494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-633009618"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:39.043495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:39.061562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:39.066444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:39.067067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:39.067990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:39.068561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:39.069379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:39.507938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:39.535080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:39.546603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:39.549820 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b562db6-2598-4ddc-bd80-696ad19c79dc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.602103 Sep 08 10:22:39.556072 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1072/2307] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:38 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:39.563215 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ec4d7eb-4e66-44b5-bbaa-be41c570d032 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "POST /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558/action" status: 202 len: 0 microversion: 2.1 time: 0.563275 Sep 08 10:22:39.563898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1236/2308] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:22:38 2022] POST /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:22:39.580759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f68821dc-b71c-4077-8b91-9a2a5dee67e5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235125aaf0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:39.675822 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f68821dc-b71c-4077-8b91-9a2a5dee67e5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.098870 Sep 08 10:22:39.685036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1073/2309] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:39 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:40.591614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:40.592436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:40.622527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:40.628993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:40.629662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:40.630637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:40.636537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:40.637256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:40.695283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da210dfa-ee06-435d-bd95-c2f66887c5cc tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23517830d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:40.779482 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da210dfa-ee06-435d-bd95-c2f66887c5cc tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.091182 Sep 08 10:22:40.782228 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1074/2310] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:40 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:22:40.952091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a316b28b-54fc-4f72-bc2b-b4d14928fb14 req-138fd955-a337-4f9f-af05-56ef14f574a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d485bf32-a51c-4748-9c53-3c5d643fd273", "name": "network-vif-unplugged", "status": "completed", "tag": "69a878c2-2b18-44bb-a936-0eec42248f2e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:40.979619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a316b28b-54fc-4f72-bc2b-b4d14928fb14 req-138fd955-a337-4f9f-af05-56ef14f574a9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:40.980336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a316b28b-54fc-4f72-bc2b-b4d14928fb14 req-138fd955-a337-4f9f-af05-56ef14f574a9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:40.982126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a316b28b-54fc-4f72-bc2b-b4d14928fb14 req-138fd955-a337-4f9f-af05-56ef14f574a9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:41.013932 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a316b28b-54fc-4f72-bc2b-b4d14928fb14 req-138fd955-a337-4f9f-af05-56ef14f574a9 service nova] Creating event network-vif-unplugged:69a878c2-2b18-44bb-a936-0eec42248f2e for instance d485bf32-a51c-4748-9c53-3c5d643fd273 on n-h2-833090-19 Sep 08 10:22:41.027795 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a316b28b-54fc-4f72-bc2b-b4d14928fb14 req-138fd955-a337-4f9f-af05-56ef14f574a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080537 Sep 08 10:22:41.030814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1075/2311] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:41.368171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:41.388188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:41.389970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:41.391425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca1150d9-347f-4102-8cc5-d74c1bed3bc5 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.805920 Sep 08 10:22:41.408197 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1237/2312] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:40 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:41.800706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6059b7a2-fa25-42cf-acae-ad5ab894d7d3 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235163a4c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:41.894613 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6059b7a2-fa25-42cf-acae-ad5ab894d7d3 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.100244 Sep 08 10:22:41.895206 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1076/2313] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:41 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:42.032870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c47be344-1b23-4509-b48d-ec03c94aef71"}], "security_groups": [{"name": "tempest-securitygroup--1574599894"}], "key_name": "tempest-keypair-319582988", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:42.419662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:42.420465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:42.441185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:42.449412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:42.451639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:42.454733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:42.461129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:42.466302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:42.824473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] validate_networks() for [('c47be344-1b23-4509-b48d-ec03c94aef71', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:22:42.992185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:43.018977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:43.025773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:43.028207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89a26d15-c33d-4f11-9f03-98e2d2d08380 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.613961 Sep 08 10:22:43.035845 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1077/2314] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:42 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:22:43.680823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc193d25-1253-4478-96ca-8ab823bf4b05 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Action: 'create', calling method: .version_select at 0x7f2351204f70>, body: {"keypair": {"name": "tempest-keypair-1973166936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe4PZGryAJ3B9Q/3O4dNOoDWthQYlaM9S9OhlYkrWu1u49fqNpe6RfItF1n857wzkfliH6PgmkMRLrlfbO/SzZXTC/gRedOW2K4Y4NoK2EUozJ5mnYXV80xEtFknGRpOQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:43.735872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-bc193d25-1253-4478-96ca-8ab823bf4b05 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Getting quotas for project 0ad840b082bb4751a2d693d109a6b161. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:43.750253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-bc193d25-1253-4478-96ca-8ab823bf4b05 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Getting quotas for user 0054d68ce9d646b483c86362f6a4ab30 and project 0ad840b082bb4751a2d693d109a6b161. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:43.803941 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc193d25-1253-4478-96ca-8ab823bf4b05 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.766483 Sep 08 10:22:43.812429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1078/2315] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:43.822107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85ca400c-c492-4e9e-ab6f-d0fe6b7a2340 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23554e99d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:43.899188 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85ca400c-c492-4e9e-ab6f-d0fe6b7a2340 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.085318 Sep 08 10:22:43.917361 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1079/2316] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:43 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:44.040687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b48b72b1-a2bb-4c5c-a3fb-c7dd05d8cf64 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Action: 'create', calling method: .version_select at 0x7f23554ce1f0>, body: {"keypair": {"name": "tempest-keypair-1777355017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzTUPaRR7nod9Woo5/PrQkTWkiUmvfdcxgg9/9qE9ZxIW7xbd3zW0KnHliT1SxJTiIWMQ2AO0hKkRZgMU12Y9cEpe64P0IvBBbhWaS6HeXRWilDrSdGLkaMCNsC6k5uGQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:44.113312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b48b72b1-a2bb-4c5c-a3fb-c7dd05d8cf64 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Getting quotas for project f09c48205b9b4ba7888ed04e1029704b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:44.138934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b48b72b1-a2bb-4c5c-a3fb-c7dd05d8cf64 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Getting quotas for user 8cbbcadf7663400daad4ee6ea5db1ddf and project f09c48205b9b4ba7888ed04e1029704b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:44.223885 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b48b72b1-a2bb-4c5c-a3fb-c7dd05d8cf64 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.305042 Sep 08 10:22:44.225543 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1080/2317] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:22:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:44.240554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:44.241659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:44.259399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:44.260770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:44.261298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:44.262147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:44.262904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:44.265181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:44.808918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:22:44.812761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:22:44.813668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:22:44.815491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:22:44.817015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:22:44.876960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:44.879396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:44.885404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:44.889075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:44.891164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:44.893553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:44.950269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Getting quotas for project 3573779db74b412a84142504d7eadba9. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:44.962163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Getting quotas for user 8dcd2d7fa8fc48c3a9fe978d34455c32 and project 3573779db74b412a84142504d7eadba9. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:44.997794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:22:45.002887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:22:45.024696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:45.035790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:45.037354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:45.047220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-72c53a72-b979-4a5b-9d03-d858f4ca503c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.818468 Sep 08 10:22:45.049362 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1081/2318] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:44 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:45.071610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9794f7a8-6420-4572-8e5f-6c5b61b2ee3e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350b625e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:45.122125 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-769be0a1-d4b7-4553-ab2d-5efdc1b5ebce tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.099263 Sep 08 10:22:45.137391 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1238/2319] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:22:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 3118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:22:45.151785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51d4cf10-c041-4a42-a6ca-09fe3575ec12 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:45.153704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51d4cf10-c041-4a42-a6ca-09fe3575ec12 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:45.178690 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9794f7a8-6420-4572-8e5f-6c5b61b2ee3e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.122718 Sep 08 10:22:45.179312 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1082/2320] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:45 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:45.471218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51d4cf10-c041-4a42-a6ca-09fe3575ec12 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:45.482157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51d4cf10-c041-4a42-a6ca-09fe3575ec12 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1225 microversion: 2.1 time: 0.343500 Sep 08 10:22:45.486786 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1239/2321] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:45 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1225 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:46.084983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:46.089634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:46.116980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:46.120783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:46.121243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:46.122004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:46.122474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:46.122916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:46.194704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d20aed00-5928-42fb-8d82-a7fe3e52473d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351cd9af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:46.340856 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d20aed00-5928-42fb-8d82-a7fe3e52473d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.150529 Sep 08 10:22:46.343754 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1240/2322] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:46 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:46.513259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:46.514112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:46.529197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:46.529946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:46.533904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:46.534939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:46.538969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:46.539841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:46.941844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:46.956233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85763aec-c0a3-431d-aef6-2be1878fc177 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1277 microversion: 2.1 time: 0.447700 Sep 08 10:22:46.957147 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1241/2323] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:46 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1277 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:22:47.362254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a661a263-77bf-40eb-8c0c-13d455eed433 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351b091f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:47.447726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a661a263-77bf-40eb-8c0c-13d455eed433 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.087175 Sep 08 10:22:47.449012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1242/2324] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:47 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:47.757531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:47.983126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:47.987267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:48.000754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:48.001622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:48.002285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:48.003215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:48.008708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:48.009488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:48.332990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:48.342594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:48.350473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:48.356956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:48.357309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b6a8014-9575-40a1-8fc2-c85a6db7e871 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1283 microversion: 2.1 time: 0.375670 Sep 08 10:22:48.357972 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1243/2325] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:47 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:48.381103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-06ffb1f2-72ef-404c-9239-530a0335a062 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 2.298312 Sep 08 10:22:48.391160 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1083/2326] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:46 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:48.465597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78bbc78f-65ab-4589-9384-28348d28d2b4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2352196700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:48.585891 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78bbc78f-65ab-4589-9384-28348d28d2b4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.125484 Sep 08 10:22:48.586566 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1244/2327] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:48 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:49.054923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b2c1931b-0e30-4503-ad7f-78113d8d549d req-c59fdc29-4e18-4d91-ada2-8e65f558356d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "name": "network-vif-plugged", "status": "completed", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:49.119560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b2c1931b-0e30-4503-ad7f-78113d8d549d req-c59fdc29-4e18-4d91-ada2-8e65f558356d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:49.123279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b2c1931b-0e30-4503-ad7f-78113d8d549d req-c59fdc29-4e18-4d91-ada2-8e65f558356d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:49.127179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b2c1931b-0e30-4503-ad7f-78113d8d549d req-c59fdc29-4e18-4d91-ada2-8e65f558356d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:49.168759 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b2c1931b-0e30-4503-ad7f-78113d8d549d req-c59fdc29-4e18-4d91-ada2-8e65f558356d service nova] Creating event network-vif-plugged:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:22:49.181316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b2c1931b-0e30-4503-ad7f-78113d8d549d req-c59fdc29-4e18-4d91-ada2-8e65f558356d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131644 Sep 08 10:22:49.184948 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1245/2328] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:49.222330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-10664026", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:49.329472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:22:49.389958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:49.390719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:49.437789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:49.438333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:49.439893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:49.441689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:49.442404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:49.443320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:49.822992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:49.830874 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d499cff-6a1c-49b8-ae22-fb5d040b90dd tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1283 microversion: 2.1 time: 0.447584 Sep 08 10:22:49.831456 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1246/2329] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:49 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1283 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:49.854470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:49.862193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:49.881055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:49.881545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:49.881981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:49.886832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:49.888081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:49.888866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:50.138332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:22:50.138768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:22:50.139251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:22:50.139700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:22:50.140122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:22:50.156621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:50.164872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:50.165343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:50.166234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:50.166641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:50.167200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:50.216017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:50.221779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:50.243561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:22:50.255903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:22:50.317013 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a61ae44-36ee-47ae-8d1e-1f8060f9c369 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472365 Sep 08 10:22:50.325953 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1084/2330] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:22:50.333570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fbe43903-4811-40b8-a40c-71ad3083b488 req-e00fd5b6-890a-4885-9646-c7b794a14e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b35549a-0f59-4a78-bcf5-fa13562fe95f", "name": "network-vif-unplugged", "status": "completed", "tag": "5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:50.358195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fbe43903-4811-40b8-a40c-71ad3083b488 req-e00fd5b6-890a-4885-9646-c7b794a14e16 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:50.358974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fbe43903-4811-40b8-a40c-71ad3083b488 req-e00fd5b6-890a-4885-9646-c7b794a14e16 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:50.359625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fbe43903-4811-40b8-a40c-71ad3083b488 req-e00fd5b6-890a-4885-9646-c7b794a14e16 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:50.379508 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fbe43903-4811-40b8-a40c-71ad3083b488 req-e00fd5b6-890a-4885-9646-c7b794a14e16 service nova] Creating event network-vif-unplugged:5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0 for instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f on n-h2-833090-19 Sep 08 10:22:50.385646 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fbe43903-4811-40b8-a40c-71ad3083b488 req-e00fd5b6-890a-4885-9646-c7b794a14e16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057810 Sep 08 10:22:50.387335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1085/2331] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:50.394738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-77f1c9d0-faec-4a52-b0b7-fa84e5deb72b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23516a4f70>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:50.399941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:50.430206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:50.431782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:50.433138 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-499942f3-894a-46db-b837-8c4b42a44a54 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.582476 Sep 08 10:22:50.433772 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1247/2332] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:49 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:50.484395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c67c218d-05d1-4ca9-87a9-b3e2f46bf12b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:50.492313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c67c218d-05d1-4ca9-87a9-b3e2f46bf12b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:50.520819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-77f1c9d0-faec-4a52-b0b7-fa84e5deb72b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.131803 Sep 08 10:22:50.521631 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1086/2333] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:50 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:50.765630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c67c218d-05d1-4ca9-87a9-b3e2f46bf12b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:50.780380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c67c218d-05d1-4ca9-87a9-b3e2f46bf12b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1215 microversion: 2.1 time: 0.345383 Sep 08 10:22:50.780991 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1248/2334] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:50 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:50.858584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:50.859444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:50.874008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:50.876550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:50.877782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:50.880411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:50.882105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:50.882575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:51.251149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:51.267877 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9656b68e-aaa2-4958-97b4-647000fbb734 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1283 microversion: 2.1 time: 0.414215 Sep 08 10:22:51.280785 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1087/2335] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:50 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1283 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:51.319767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-328368932", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b91d47c3-873a-4975-9ff8-880cb1fe8d5d"}], "security_groups": [{"name": "tempest-securitygroup--168107817"}], "key_name": "tempest-keypair-1973166936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:51.469055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:51.472906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:51.508484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:51.509072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:51.509528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:51.510285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:51.525003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:51.525679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:51.856363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] validate_networks() for [('b91d47c3-873a-4975-9ff8-880cb1fe8d5d', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:22:51.992279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:51.997333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:52.014011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:52.015619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:52.017173 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb3c11be-614e-42f8-8549-6c4a414f98bf tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.557297 Sep 08 10:22:52.040399 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1088/2336] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:51 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:22:52.057960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ccb7069-d4fa-4f36-9c18-a56e0f481d5f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23554e7940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:52.153401 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ccb7069-d4fa-4f36-9c18-a56e0f481d5f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.111550 Sep 08 10:22:52.154006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1089/2337] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:52 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:52.176026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:52.176661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:52.189093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:52.193765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:52.194525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:52.197771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:52.198417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:52.199069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:53.024218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:53.038951 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1915d55-6216-4f63-8f9a-148b0144d5b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1211 microversion: 2.1 time: 0.883850 Sep 08 10:22:53.042815 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1090/2338] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:52 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1211 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:53.056722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:53.058677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:53.082178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:53.086518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:53.087331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:53.088578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:53.091598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:53.093255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:53.605319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:53.618537 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e456c566-c9f4-4173-b821-080006911e10 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1351 microversion: 2.1 time: 0.572350 Sep 08 10:22:53.623158 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1091/2339] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:53 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1351 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:53.637581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-93540e81-68fd-445f-9e80-8715b0efe9a5 req-751f5a1b-42ad-4ada-9b8a-156fb1155b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b35549a-0f59-4a78-bcf5-fa13562fe95f", "tag": "5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:53.666225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-93540e81-68fd-445f-9e80-8715b0efe9a5 req-751f5a1b-42ad-4ada-9b8a-156fb1155b48 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:53.671368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-93540e81-68fd-445f-9e80-8715b0efe9a5 req-751f5a1b-42ad-4ada-9b8a-156fb1155b48 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:53.672302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-93540e81-68fd-445f-9e80-8715b0efe9a5 req-751f5a1b-42ad-4ada-9b8a-156fb1155b48 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:53.706684 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-93540e81-68fd-445f-9e80-8715b0efe9a5 req-751f5a1b-42ad-4ada-9b8a-156fb1155b48 service nova] Creating event network-changed:5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0 for instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f on n-h2-833090-19 Sep 08 10:22:53.717366 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-93540e81-68fd-445f-9e80-8715b0efe9a5 req-751f5a1b-42ad-4ada-9b8a-156fb1155b48 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092704 Sep 08 10:22:53.726430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1092/2340] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:53.734441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:53.736746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:53.753868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:53.756014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:53.759123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:53.760189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:53.760934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:53.761584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:54.936056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=13 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:55.073769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:55.088709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:55.095858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:55.097684 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-72f68dad-b1f1-4dab-9cfd-0c65a347f3cc tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 1.369404 Sep 08 10:22:55.108187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1093/2341] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:53 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:55.126405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c772292b-7dc6-4b03-ae65-e8f3e6932ead tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23553f99d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:56.185413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Getting quotas for project 0ad840b082bb4751a2d693d109a6b161. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:56.211500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=15,nova_api:UPDATE=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:56.221697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Getting quotas for user 0054d68ce9d646b483c86362f6a4ab30 and project 0ad840b082bb4751a2d693d109a6b161. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:56.269851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:22:56.270528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:22:56.271305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:22:56.272702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:22:56.273291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:22:56.302912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:56.307096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:56.307956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:56.314520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:56.315271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:56.315889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:56.370854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Getting quotas for project 0ad840b082bb4751a2d693d109a6b161. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:22:56.383112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Getting quotas for user 0054d68ce9d646b483c86362f6a4ab30 and project 0ad840b082bb4751a2d693d109a6b161. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:22:56.421398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:22:56.428721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:22:56.622992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-120c0784-091f-47f3-8956-93af71297d6a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.306706 Sep 08 10:22:56.626636 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1249/2342] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:22:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 5312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:22:56.633090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:56.634158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:56.657396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:56.658135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:56.658965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:56.660135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:56.663331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:56.664196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:57.424215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:57.439819 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95a7f8b9-452d-4fbc-aa3d-c6e1c9c21364 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1273 microversion: 2.1 time: 0.811142 Sep 08 10:22:57.443351 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1250/2343] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:56 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1273 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:57.469981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:57.471191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:57.501701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:57.503303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:57.506472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:57.510690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:57.513224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:57.514939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:58.465269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:58.481062 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a5c66a1c-7c61-4066-812d-84fca12cad59 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1351 microversion: 2.1 time: 1.033841 Sep 08 10:22:58.482012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1251/2344] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:57 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1351 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:58.517039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:58.517700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:58.573396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:58.574389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:58.574956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:58.592513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:58.603029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:58.605279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:59.451952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:59.478835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:59.483328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:59.487310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b272262-b3c3-405d-9d2a-f5414264f22f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 1.004066 Sep 08 10:22:59.490907 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1252/2345] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:22:58 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:22:59.498867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1c8188bd-ddbd-461b-b1e5-b9f182a4c47d req-7a0492d3-94f2-4546-849f-668124aff842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d31be5-96cc-4468-9c82-33a9b53c2223", "tag": "4571da7a-d97e-4d3d-83d3-023c7006e107"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:22:59.541084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1c8188bd-ddbd-461b-b1e5-b9f182a4c47d req-7a0492d3-94f2-4546-849f-668124aff842 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:59.545714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1c8188bd-ddbd-461b-b1e5-b9f182a4c47d req-7a0492d3-94f2-4546-849f-668124aff842 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:59.547837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1c8188bd-ddbd-461b-b1e5-b9f182a4c47d req-7a0492d3-94f2-4546-849f-668124aff842 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:59.595083 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1c8188bd-ddbd-461b-b1e5-b9f182a4c47d req-7a0492d3-94f2-4546-849f-668124aff842 service nova] Creating event network-changed:4571da7a-d97e-4d3d-83d3-023c7006e107 for instance f0d31be5-96cc-4468-9c82-33a9b53c2223 on n-h1-833090-19 Sep 08 10:22:59.607536 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1c8188bd-ddbd-461b-b1e5-b9f182a4c47d req-7a0492d3-94f2-4546-849f-668124aff842 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114006 Sep 08 10:22:59.617215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1253/2346] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:22:59.648200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:59.649072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:59.673778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:59.674290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:59.674744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:59.685844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:59.686413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:59.687062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:59.691943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:22:59.868772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:22:59.882809 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ec4743e-2bc0-4056-a92b-2f9fe3d76499 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1329 microversion: 2.1 time: 0.255097 Sep 08 10:22:59.903712 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1254/2347] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:59 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1329 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:22:59.909778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:22:59.910669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:22:59.918383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:59.919320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:59.923518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:22:59.924623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:22:59.926695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:22:59.927639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:00.186881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:00.237432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=60 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:00.429979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:00.445832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38537580-fff5-4c34-b3fb-ba202ed1e20c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1315 microversion: 2.1 time: 0.540274 Sep 08 10:23:00.463257 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1255/2348] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:22:59 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:00.499137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:00.499830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:00.531908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:00.532480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:00.532979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:00.533791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:00.544432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:00.545306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:01.096238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:01.128412 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-caa39d23-12be-4cb9-bb59-71cc791f39a8 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1351 microversion: 2.1 time: 0.673699 Sep 08 10:23:01.129824 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1256/2349] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:00 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1351 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:01.147578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:01.153873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:01.173340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:01.175409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:01.178664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:01.179730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:01.182933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:01.183428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:01.541621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:01.551210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:01.565001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:01.566812 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c32cf154-01b1-46e7-9acf-4431a7775c63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.435485 Sep 08 10:23:01.567156 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1257/2350] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:01 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:01.571916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:01.572704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:01.586301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:01.587724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:01.589719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:01.590731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:01.592611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:01.593873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:01.730763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:01.750125 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec3b2995-bebe-435f-94a3-863a35eeed79 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1335 microversion: 2.1 time: 0.175186 Sep 08 10:23:01.751376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1258/2351] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:01 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:01.772717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:01.773631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:01.783757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:01.788830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:01.789431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:01.790209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:01.790687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:01.796130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:02.167672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:02.178514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6226c9b0-dd84-4585-a4c7-e2a0300f240b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1315 microversion: 2.1 time: 0.425669 Sep 08 10:23:02.192434 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1259/2352] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:01 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:02.201536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5c9ed463-0a0f-4535-921c-b577ebebe77a req-e7621bb9-978d-48e9-a9ef-9609f111a1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c4b6e2-f598-4ed6-bc7b-570148c9e012", "tag": "9d091496-0fba-4b75-a05e-0e54633ec4ca"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:02.212572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5c9ed463-0a0f-4535-921c-b577ebebe77a req-e7621bb9-978d-48e9-a9ef-9609f111a1b4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:02.213322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5c9ed463-0a0f-4535-921c-b577ebebe77a req-e7621bb9-978d-48e9-a9ef-9609f111a1b4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:02.213925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5c9ed463-0a0f-4535-921c-b577ebebe77a req-e7621bb9-978d-48e9-a9ef-9609f111a1b4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:02.237827 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5c9ed463-0a0f-4535-921c-b577ebebe77a req-e7621bb9-978d-48e9-a9ef-9609f111a1b4 service nova] Creating event network-changed:9d091496-0fba-4b75-a05e-0e54633ec4ca for instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 on n-h2-833090-19 Sep 08 10:23:02.251512 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5c9ed463-0a0f-4535-921c-b577ebebe77a req-e7621bb9-978d-48e9-a9ef-9609f111a1b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057236 Sep 08 10:23:02.256896 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1260/2353] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:02.263153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:02.273307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:02.296515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:02.298918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:02.300392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:02.302428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:02.304579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:02.305395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:02.889523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:02.902500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f698ed2-db3e-48d3-a05e-a1d03d54526f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1351 microversion: 2.1 time: 0.644026 Sep 08 10:23:02.906848 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1261/2354] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:02 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1351 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:02.918024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:02.919052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:02.927323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:02.928476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:02.929085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:02.930171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:02.930770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:02.931767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.238683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:03.248229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:03.250341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:03.251794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e60541f3-f752-4f37-bd83-1f63296ea9bd tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.341452 Sep 08 10:23:03.253158 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1262/2355] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:02 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:03.257951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:03.258639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:03.269245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.270084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.270739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.271722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.272390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.273179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.353523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:03.364186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-547a3952-e394-4c85-abf0-dc7f6aebd6af tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1335 microversion: 2.1 time: 0.109667 Sep 08 10:23:03.367770 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1263/2356] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:03 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:03.394813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-51775524-7764-4942-bcaa-d6aae74828a7 req-31281ca8-ac6e-441f-be4c-9066add7a2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d31be5-96cc-4468-9c82-33a9b53c2223", "name": "network-vif-plugged", "status": "completed", "tag": "4571da7a-d97e-4d3d-83d3-023c7006e107"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:03.413237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-51775524-7764-4942-bcaa-d6aae74828a7 req-31281ca8-ac6e-441f-be4c-9066add7a2c3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.413237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-51775524-7764-4942-bcaa-d6aae74828a7 req-31281ca8-ac6e-441f-be4c-9066add7a2c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.413237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-51775524-7764-4942-bcaa-d6aae74828a7 req-31281ca8-ac6e-441f-be4c-9066add7a2c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.422943 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-51775524-7764-4942-bcaa-d6aae74828a7 req-31281ca8-ac6e-441f-be4c-9066add7a2c3 service nova] Creating event network-vif-plugged:4571da7a-d97e-4d3d-83d3-023c7006e107 for instance f0d31be5-96cc-4468-9c82-33a9b53c2223 on n-h1-833090-19 Sep 08 10:23:03.429706 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-51775524-7764-4942-bcaa-d6aae74828a7 req-31281ca8-ac6e-441f-be4c-9066add7a2c3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041943 Sep 08 10:23:03.430782 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1264/2357] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:03.436684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:03.437449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:03.458321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.458740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.459189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.460478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.460478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.460931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.695126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:03.712001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe2c4d48-7e68-4cc4-977d-2e207ccd6d8c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1315 microversion: 2.1 time: 0.279955 Sep 08 10:23:03.713192 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1265/2358] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:03 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:03.745795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=16 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:03.931871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:03.932694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:03.961580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.964065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.966198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:03.971804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:03.973087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:03.975145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:04.632241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:04.695823 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b4efa32-7a08-448f-a42d-c925e780fefb tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1351 microversion: 2.1 time: 0.764713 Sep 08 10:23:04.698669 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1266/2359] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:03 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1351 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:23:04.729451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:04.738278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:04.769647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:04.772983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:04.775530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:04.776657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:04.780743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:04.781547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:05.079133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=20 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:05.497513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:05.511438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:05.516029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:05.517646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-052131eb-2c8d-4d6e-8378-b5d42edac3c1 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1487 microversion: 2.25 time: 0.816498 Sep 08 10:23:05.526061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1267/2360] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:04 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1487 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:05.531554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:05.532481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:05.549132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:05.549945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:05.551128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:05.554643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:05.555339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:05.556015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:06.273796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:06.289415 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-31c6d701-233f-4901-a81d-54ea46c0d6f1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1402 microversion: 2.1 time: 0.761775 Sep 08 10:23:06.296467 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1268/2361] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:05 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1402 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:06.314782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:06.321058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:06.345541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:06.351870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:06.358639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:06.360838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:06.362623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:06.365666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:06.368782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:06.434120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=84 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:08.028847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:08.039150 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cad18d0c-c91e-4aa2-a4bf-b0ac419c6729 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1315 microversion: 2.1 time: 1.738574 Sep 08 10:23:08.059496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1269/2362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:06 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1315 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:08.060546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:08.061418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:08.085607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:08.086105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:08.086546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:08.087268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:08.087736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:08.098247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:08.549442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:08.561805 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a9d7bcb-8dfd-4952-b146-e37264e8660f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1542 microversion: 2.1 time: 0.515557 Sep 08 10:23:08.565276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1270/2363] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:08 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1542 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:08.580987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:08.581879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:08.601855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:08.604693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:08.605369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:08.606294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:08.608035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:08.608697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:08.974068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:08.985131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:08.986667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:08.987921 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea000876-5767-4956-902d-d17b27278e61 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1477 microversion: 2.25 time: 0.420855 Sep 08 10:23:08.992405 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1271/2364] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:08 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:09.003755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:09.003755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:09.062131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:09.063693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:09.064465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:09.065699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:09.066378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:09.067045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:09.075147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:09.703379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:09.722408 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9185d755-7cb0-4d39-a2ac-b682391d466e tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1402 microversion: 2.1 time: 0.723176 Sep 08 10:23:09.740807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1272/2365] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:08 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1402 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:09.747753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:09.748415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:09.772150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:09.773934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:09.773934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:09.775202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:09.775951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:09.777558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:10.027218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0643b640-273e-425a-bdc5-6ab316683cea tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.284425 Sep 08 10:23:10.035581 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1273/2366] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:23:09 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223/os-interface => generated 285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:10.035581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25ecf19c-c64a-4830-97e0-08c82e2e7803 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '.version_select at 0x7f23512a4f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:10.047877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ecf19c-c64a-4830-97e0-08c82e2e7803 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:10.053852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ecf19c-c64a-4830-97e0-08c82e2e7803 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:10.054845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ecf19c-c64a-4830-97e0-08c82e2e7803 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:10.088780 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25ecf19c-c64a-4830-97e0-08c82e2e7803 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/os-migrations" status: 200 len: 1713 microversion: 2.25 time: 0.052712 Sep 08 10:23:10.096614 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1274/2367] 10.222.0.59 () {60 vars in 1184 bytes} [Thu Sep 8 10:23:10 2022] GET /compute/v2.1/os-migrations => generated 1713 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:10.107781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:10.108962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:10.133541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:10.134040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:10.134479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:10.135235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:10.141621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:10.143448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:10.836547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:10.848154 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c91360b5-4cb5-44d7-bdce-6df31620d259 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1315 microversion: 2.1 time: 0.750019 Sep 08 10:23:10.850883 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1275/2368] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:10 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:10.860758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-12d4dd83-79a1-4e10-8be0-53d545d75a35 req-7973123c-662b-427c-82b2-0c1ada1227ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c4b6e2-f598-4ed6-bc7b-570148c9e012", "name": "network-vif-plugged", "status": "completed", "tag": "9d091496-0fba-4b75-a05e-0e54633ec4ca"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:10.883630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-12d4dd83-79a1-4e10-8be0-53d545d75a35 req-7973123c-662b-427c-82b2-0c1ada1227ce service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:10.885736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-12d4dd83-79a1-4e10-8be0-53d545d75a35 req-7973123c-662b-427c-82b2-0c1ada1227ce service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:10.886345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-12d4dd83-79a1-4e10-8be0-53d545d75a35 req-7973123c-662b-427c-82b2-0c1ada1227ce service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:10.910202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-12d4dd83-79a1-4e10-8be0-53d545d75a35 req-7973123c-662b-427c-82b2-0c1ada1227ce service nova] Creating event network-vif-plugged:9d091496-0fba-4b75-a05e-0e54633ec4ca for instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 on n-h2-833090-19 Sep 08 10:23:10.923191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-12d4dd83-79a1-4e10-8be0-53d545d75a35 req-7973123c-662b-427c-82b2-0c1ada1227ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070698 Sep 08 10:23:10.930195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1276/2369] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:10.935673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-05ac3a88-fa03-4541-bf09-cc35ae9aa64b req-f51fd88a-bbf6-44c0-abee-0ecafc6b6bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6657a9c-c729-4811-aa0b-b54bde87bc4a", "tag": "1e840973-adce-40af-bf0e-70733119924d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:10.974019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-05ac3a88-fa03-4541-bf09-cc35ae9aa64b req-f51fd88a-bbf6-44c0-abee-0ecafc6b6bb0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:10.974825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-05ac3a88-fa03-4541-bf09-cc35ae9aa64b req-f51fd88a-bbf6-44c0-abee-0ecafc6b6bb0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:10.975536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-05ac3a88-fa03-4541-bf09-cc35ae9aa64b req-f51fd88a-bbf6-44c0-abee-0ecafc6b6bb0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:11.003122 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-05ac3a88-fa03-4541-bf09-cc35ae9aa64b req-f51fd88a-bbf6-44c0-abee-0ecafc6b6bb0 service nova] Creating event network-changed:1e840973-adce-40af-bf0e-70733119924d for instance b6657a9c-c729-4811-aa0b-b54bde87bc4a on n-h1-833090-19 Sep 08 10:23:11.024472 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-05ac3a88-fa03-4541-bf09-cc35ae9aa64b req-f51fd88a-bbf6-44c0-abee-0ecafc6b6bb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089091 Sep 08 10:23:11.025968 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1277/2370] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:11.035690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:11.036398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:11.046005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:11.047574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:11.048255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:11.049859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:11.053110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:11.053986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:12.083472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] Lazy-loading 'services' on Instance uuid 0b35549a-0f59-4a78-bcf5-fa13562fe95f {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:12.142544 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f96d451b-caef-4a4f-a42a-f78e6475d5e7 tempest-LiveAutoBlockMigrationV225Test-1624159645 tempest-LiveAutoBlockMigrationV225Test-1624159645-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1972 microversion: 2.25 time: 1.113420 Sep 08 10:23:12.148721 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1278/2371] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:11 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1972 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:12.159425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:12.167021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:12.180783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:12.181788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:12.182472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:12.183409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:12.184106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:12.188143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:12.792013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:12.801794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5229694d-0e54-4dfa-b7b5-5c6ad4093eb1 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1402 microversion: 2.1 time: 0.650173 Sep 08 10:23:12.809287 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1279/2372] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:12 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1402 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:12.830083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:12.831853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:12.856596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:12.858214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:12.860546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:12.862179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:12.863566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:12.864977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:13.552297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:13.568805 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cab4ef1e-f486-43ac-b629-d17d5266a6ef tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1315 microversion: 2.1 time: 0.754836 Sep 08 10:23:13.569555 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1280/2373] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:12 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:13.599303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:13.599932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:13.619625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:13.620258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:13.622219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:13.628551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:13.629108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:13.629820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:13.712427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:13.923166 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28ebb5ad-84c2-4fb7-84c5-991757cd1c65 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 204 len: 0 microversion: 2.25 time: 0.347317 Sep 08 10:23:13.932399 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1281/2374] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:23:13 2022] DELETE /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:14.719840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1675805348", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "8795d94b-c65c-4304-88f6-36952f0eb6c2"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:15.748374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c772292b-7dc6-4b03-ae65-e8f3e6932ead tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 20.638761 Sep 08 10:23:15.749364 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1094/2375] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:22:55 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 20640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:15.759491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:15.767620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:15.769792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] validate_networks() for [('8795d94b-c65c-4304-88f6-36952f0eb6c2', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:15.784867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:15.792598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:15.793023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:15.794640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:15.794640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:15.794640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:16.313932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:16.330216 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c99bcc53-c00c-4bd9-a24e-9f03535668c2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1402 microversion: 2.1 time: 0.578867 Sep 08 10:23:16.330835 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1095/2376] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:15 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1402 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:16.366283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:16.366927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:16.383716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:16.384862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:16.385699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:16.387163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:16.388275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:16.389023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.380878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:17.401473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:17.404511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:17.414487 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59a4253f-d771-4828-9bd0-c630578c5b63 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1266 microversion: 2.25 time: 1.060696 Sep 08 10:23:17.416597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1096/2377] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:16 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1266 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:17.422839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0138707a-6fa7-49ff-832b-d31a81c9588d req-380ccc8a-b77a-45b9-8eae-d2e60ce9ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d31be5-96cc-4468-9c82-33a9b53c2223", "tag": "4571da7a-d97e-4d3d-83d3-023c7006e107"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:17.433712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0138707a-6fa7-49ff-832b-d31a81c9588d req-380ccc8a-b77a-45b9-8eae-d2e60ce9ede6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:17.434529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0138707a-6fa7-49ff-832b-d31a81c9588d req-380ccc8a-b77a-45b9-8eae-d2e60ce9ede6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:17.435208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0138707a-6fa7-49ff-832b-d31a81c9588d req-380ccc8a-b77a-45b9-8eae-d2e60ce9ede6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.455339 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0138707a-6fa7-49ff-832b-d31a81c9588d req-380ccc8a-b77a-45b9-8eae-d2e60ce9ede6 service nova] Creating event network-changed:4571da7a-d97e-4d3d-83d3-023c7006e107 for instance f0d31be5-96cc-4468-9c82-33a9b53c2223 on n-h1-833090-19 Sep 08 10:23:17.473102 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0138707a-6fa7-49ff-832b-d31a81c9588d req-380ccc8a-b77a-45b9-8eae-d2e60ce9ede6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050268 Sep 08 10:23:17.477440 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1097/2378] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:17.499334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:17.508522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:17.523301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:17.523984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:17.525188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.526035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:17.530288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:17.531856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.579741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:17.581043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:17.581692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:17.582278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:17.583168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:17.594790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:17.595683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:17.596902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.597838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:17.598503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:17.599138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.643721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Getting quotas for project ea5db21064454e6284601ca78e59d689. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:17.659864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Getting quotas for user 0952ab80be6945a3b1a2e522f305a496 and project ea5db21064454e6284601ca78e59d689. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:17.710446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:23:17.722583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:23:17.794958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:17.918092 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d284adc2-b9d1-435c-8fcd-f883c92e67bd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.983662 Sep 08 10:23:17.918775 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1282/2379] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3990 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:23:17.934373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c86f0c10-0bcd-43d6-8a3e-d1fb7b38611a req-bf32d457-757a-45c7-b3df-6632488ee11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b35549a-0f59-4a78-bcf5-fa13562fe95f", "name": "network-vif-deleted", "tag": "5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:17.981897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c86f0c10-0bcd-43d6-8a3e-d1fb7b38611a req-bf32d457-757a-45c7-b3df-6632488ee11b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:17.988284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c86f0c10-0bcd-43d6-8a3e-d1fb7b38611a req-bf32d457-757a-45c7-b3df-6632488ee11b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:17.989103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c86f0c10-0bcd-43d6-8a3e-d1fb7b38611a req-bf32d457-757a-45c7-b3df-6632488ee11b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:17.993049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:18.012204 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6feb858-2179-422c-b0a7-6647b7dbe373 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1464 microversion: 2.1 time: 0.532779 Sep 08 10:23:18.013252 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1098/2380] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:17 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1464 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:18.024448 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c86f0c10-0bcd-43d6-8a3e-d1fb7b38611a req-bf32d457-757a-45c7-b3df-6632488ee11b service nova] Creating event network-vif-deleted:5d98eb4d-c5f3-4c66-8de6-3ea7098cdcd0 for instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f on n-h1-833090-19 Sep 08 10:23:18.028916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f112d7db-8378-4a53-8f3e-bc74c15abaec tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2355404c10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:18.039158 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c86f0c10-0bcd-43d6-8a3e-d1fb7b38611a req-bf32d457-757a-45c7-b3df-6632488ee11b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108449 Sep 08 10:23:18.040225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1283/2381] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:18.209351 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f112d7db-8378-4a53-8f3e-bc74c15abaec tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.193628 Sep 08 10:23:18.210711 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1099/2382] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:23:18 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:18.225555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:18.231350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:18.255678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:18.257651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:18.266589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:18.268048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:18.270126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:18.270735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:18.369383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ef640e6-8baa-4618-8ef3-546c28ce21e0 tempest-NetworksTest-2120799959 tempest-NetworksTest-2120799959-project-admin] Calling method '.version_select at 0x7f2351b095e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:19.215912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.237505 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f1972e2-b797-4edd-8385-a6a90b6fb414 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1402 microversion: 2.1 time: 1.024333 Sep 08 10:23:19.238335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1100/2383] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:18 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1402 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:19.256263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:19.256929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:19.275008 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ef640e6-8baa-4618-8ef3-546c28ce21e0 tempest-NetworksTest-2120799959 tempest-NetworksTest-2120799959-project-admin] 10.222.0.59 "GET /compute/v2.1/os-networks" status: 200 len: 6055 microversion: 2.1 time: 1.232603 Sep 08 10:23:19.277408 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1284/2384] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:23:18 2022] GET /compute/v2.1/os-networks => generated 6055 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:19.288764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:19.290149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:19.291421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:19.293811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:19.294383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:19.294841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:19.588563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:19.589395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:19.617450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:19.620747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:19.621979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:19.624058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.625490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:19.630951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:19.631515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:19.646363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.648510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.649912 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c1cdf24-5806-486e-aa08-ea454aa41a3b tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1266 microversion: 2.26 time: 0.410507 Sep 08 10:23:19.651029 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1101/2385] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:19 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:19.668302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:19.669309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:19.681249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:19.681859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:19.682395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:19.683183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:19.684440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:19.685206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:19.852019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.863387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.872134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:19.874838 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9efe409-f223-49f0-8cab-3ca5f9bb64f6 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1266 microversion: 2.25 time: 0.222461 Sep 08 10:23:19.876602 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1102/2386] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:19 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:19.882357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f9bf6e5-a536-47c8-9c3f-eeb6c8803e1f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23512305e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:19.972975 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f9bf6e5-a536-47c8-9c3f-eeb6c8803e1f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1454 microversion: 2.1 time: 0.095014 Sep 08 10:23:19.974303 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1103/2387] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:23:19 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:19.985981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df047da9-b1b5-44b8-b030-a448e31d0754 tempest-NetworksTest-2120799959 tempest-NetworksTest-2120799959-project-admin] Calling method '.version_select at 0x7f2351734280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:20.195091 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81815995-662d-4ad0-adbb-bf5a1355be45 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1617 microversion: 2.1 time: 0.916413 Sep 08 10:23:20.195740 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1285/2388] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:19 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1617 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:20.218799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c732ba70-d681-4316-b9b1-6d156af87d62 req-d9639e57-02a0-407f-95e8-944bcbb16c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6657a9c-c729-4811-aa0b-b54bde87bc4a", "name": "network-vif-plugged", "status": "completed", "tag": "1e840973-adce-40af-bf0e-70733119924d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:20.244386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c732ba70-d681-4316-b9b1-6d156af87d62 req-d9639e57-02a0-407f-95e8-944bcbb16c1c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:20.249020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c732ba70-d681-4316-b9b1-6d156af87d62 req-d9639e57-02a0-407f-95e8-944bcbb16c1c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:20.249749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c732ba70-d681-4316-b9b1-6d156af87d62 req-d9639e57-02a0-407f-95e8-944bcbb16c1c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:20.280242 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c732ba70-d681-4316-b9b1-6d156af87d62 req-d9639e57-02a0-407f-95e8-944bcbb16c1c service nova] Creating event network-vif-plugged:1e840973-adce-40af-bf0e-70733119924d for instance b6657a9c-c729-4811-aa0b-b54bde87bc4a on n-h1-833090-19 Sep 08 10:23:20.291704 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c732ba70-d681-4316-b9b1-6d156af87d62 req-d9639e57-02a0-407f-95e8-944bcbb16c1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080171 Sep 08 10:23:20.292564 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1286/2389] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:20.306238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cec87c7f-a70a-4c46-b892-9f417c26dd56 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: .version_select at 0x7f23517ec0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1763183278", "policies": ["affinity"]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:20.326329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df047da9-b1b5-44b8-b030-a448e31d0754 tempest-NetworksTest-2120799959 tempest-NetworksTest-2120799959-project-admin] 10.222.0.59 "GET /compute/v2.1/os-networks/b6b6db8b-7040-43e1-aa29-02266fee8e41" status: 200 len: 652 microversion: 2.1 time: 0.350649 Sep 08 10:23:20.327719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1104/2390] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:23:19 2022] GET /compute/v2.1/os-networks/b6b6db8b-7040-43e1-aa29-02266fee8e41 => generated 652 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:20.338337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:20.339243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:20.353092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:20.353831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:20.355017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:20.356090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:20.357278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:20.359686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:20.375213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-cec87c7f-a70a-4c46-b892-9f417c26dd56 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:20.394380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-cec87c7f-a70a-4c46-b892-9f417c26dd56 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:20.573916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-cec87c7f-a70a-4c46-b892-9f417c26dd56 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:20.599580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-cec87c7f-a70a-4c46-b892-9f417c26dd56 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:20.658905 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cec87c7f-a70a-4c46-b892-9f417c26dd56 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.364847 Sep 08 10:23:20.659567 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1287/2391] 10.222.0.59 () {60 vars in 1174 bytes} [Thu Sep 8 10:23:20 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:20.682371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-365809d4-522b-4dc9-ac78-3d8461b1c5c9 tempest-NetworksTest-2120799959 tempest-NetworksTest-2120799959-project-admin] Calling method '.version_select at 0x7f2351b095e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:20.837908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:20.846464 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88614775-21be-4e8e-bba1-82808277a307 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1402 microversion: 2.1 time: 0.517482 Sep 08 10:23:20.861060 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1105/2392] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:20 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1402 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:20.869663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:20.870265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:20.882777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:20.883279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:20.893572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:20.895576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:20.896323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:20.897324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.082367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.091698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.098294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.106604 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-872a8c30-c174-4a1e-9a36-1f32d7a1a3d8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1320 microversion: 2.26 time: 0.244120 Sep 08 10:23:21.106604 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1106/2393] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:20 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:21.133249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:21.134231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:21.144139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.151719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:21.152518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.153495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.154166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:21.154829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.236455 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-365809d4-522b-4dc9-ac78-3d8461b1c5c9 tempest-NetworksTest-2120799959 tempest-NetworksTest-2120799959-project-admin] 10.222.0.59 "GET /compute/v2.1/os-networks" status: 200 len: 6055 microversion: 2.1 time: 0.565034 Sep 08 10:23:21.237048 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1288/2394] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:23:20 2022] GET /compute/v2.1/os-networks => generated 6055 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:21.247139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-118296072", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a54b9ff8-9c36-4c06-b48d-dc8006ff95ee"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:21.300847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.318306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.326758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.328080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89f29202-d878-4ee9-a9e4-308b42f69a97 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1266 microversion: 2.25 time: 0.206578 Sep 08 10:23:21.345506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1107/2395] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:21 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:21.367678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:21.368432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4573276d-3b09-42a2-b4b1-2eed4693ec50 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23516a4c10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:21.447904 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4573276d-3b09-42a2-b4b1-2eed4693ec50 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1463 microversion: 2.1 time: 0.091191 Sep 08 10:23:21.448510 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1108/2396] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:23:21 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:21.465958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-69a24f44-4dfe-49d1-b36c-c04098d98f8c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235539dd30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:21.552818 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-69a24f44-4dfe-49d1-b36c-c04098d98f8c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 200 len: 1463 microversion: 2.1 time: 0.091781 Sep 08 10:23:21.568621 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1109/2397] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:23:21 2022] GET /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 1463 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:23:21.585368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:21.588799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:21.602076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.604237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:21.604894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.605784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.607038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:21.607806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.812383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:21.812711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:21.813237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:21.814310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:21.815123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:21.874642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.875356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:21.876024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.879800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.880496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:21.883387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:21.939338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:21.950948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:21.957126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:21.964452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca37b165-7ddb-4c07-8a14-544fc7a1f778 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1468 microversion: 2.1 time: 0.392837 Sep 08 10:23:21.965770 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1110/2398] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:21 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:21.975569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:21.977042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:21.987134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Going to run 2 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:23:21.989903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:23:21.998693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:21.999548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:22.000742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:22.002082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:22.004151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:22.006600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:22.076193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122457) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 08 10:23:22.127279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:22.140240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:22.195941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:22.201941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:22.221286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=8904ea32-ef8e-4736-bf82-af73eb0f90d4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:23:22.284850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:22.294821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:22.374907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=88 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:22.399668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:22.415435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:22.476754 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b33f7ba-20a9-4ae5-a0bf-59727904f8b7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.233829 Sep 08 10:23:22.477889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1289/2399] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:23:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:23:22.483722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb9dce7b-1b94-4d3a-84cd-7f3bb258036e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351e480d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:22.601198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:22.619853 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26ea4240-0cbd-4f0c-b289-7869e749afc2 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1589 microversion: 2.1 time: 0.652671 Sep 08 10:23:22.623208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1111/2400] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:21 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1589 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:22.636748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:22.639913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:22.657189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:22.657997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:22.658827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:22.660150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:22.664900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:22.665691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:22.686422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb9dce7b-1b94-4d3a-84cd-7f3bb258036e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?changes-since=2022-09-08T10%3A20%3A33Z" status: 200 len: 2374 microversion: 2.1 time: 0.207067 Sep 08 10:23:22.704178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1290/2401] 10.222.0.59 () {58 vars in 1199 bytes} [Thu Sep 8 10:23:22 2022] GET /compute/v2.1/images?changes-since=2022-09-08T10%3A20%3A33Z => generated 2374 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:22.710145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:22.710849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:22.723491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:22.724415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:22.724904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:22.725752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:22.726216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:22.726710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:22.957785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:22.984985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:22.989080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:23.002395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cde53d5-a725-42d2-83c1-d191ce4662d4 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1266 microversion: 2.25 time: 0.296908 Sep 08 10:23:23.003376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1291/2402] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:22 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:23.025242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.039263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:23.039986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Searching by: {'deleted': False, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:23:23.106338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:23.106926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:23.109802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:23.111500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:23.112101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:23.115199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:23.178854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:23:23.283283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38f1dd90-d247-42e9-be33-58b476cb0460 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.267443 Sep 08 10:23:23.284111 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1292/2403] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/servers => generated 1000 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:23.291367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.292467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:23.300729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:23.301440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:23.302026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:23.303279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:23.303925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:23.304521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:23.307351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:23.324880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:23.326580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:23.336101 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc35074e-51db-4fca-8bbb-a270f9ecde57 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.706987 Sep 08 10:23:23.337168 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1112/2404] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:22 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:23.357752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-893af612-c2ad-4795-a6f3-f0f8096cf9c4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235125aaf0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.509839 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-893af612-c2ad-4795-a6f3-f0f8096cf9c4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-486943536" status: 200 len: 484 microversion: 2.1 time: 0.170153 Sep 08 10:23:23.510438 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1113/2405] 10.222.0.59 () {58 vars in 1229 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-486943536 => generated 484 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:23.515013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17b3f3fc-7a78-4d6e-b42c-e800380c5153 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.519788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17b3f3fc-7a78-4d6e-b42c-e800380c5153 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:23.554066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64c07ad4-560d-4a36-944c-9f162cb90374 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.268604 Sep 08 10:23:23.555756 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1293/2406] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a/os-interface => generated 285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:23.568776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-736cd642-10fc-47e7-a90b-f2a586dbb80d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23517f9f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.697022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17b3f3fc-7a78-4d6e-b42c-e800380c5153 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:23.712166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17b3f3fc-7a78-4d6e-b42c-e800380c5153 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1218 microversion: 2.1 time: 0.200655 Sep 08 10:23:23.718958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-736cd642-10fc-47e7-a90b-f2a586dbb80d tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?server=bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 955 microversion: 2.1 time: 0.161789 Sep 08 10:23:23.719812 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1294/2407] 10.222.0.59 () {58 vars in 1209 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/images?server=bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 955 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:23.729068 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1114/2408] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:23.734991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba352636-e39e-42bb-90b9-0c0ae7ee7590 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235140dd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.843992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba352636-e39e-42bb-90b9-0c0ae7ee7590 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 485 microversion: 2.1 time: 0.109843 Sep 08 10:23:23.844679 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1295/2409] 10.222.0.59 () {58 vars in 1317 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273 => generated 485 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:23:23.859730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0cf68b4-0d34-4cab-a717-d805e9b7220c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235550a0d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:23.936615 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0cf68b4-0d34-4cab-a717-d805e9b7220c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 485 microversion: 2.1 time: 0.081188 Sep 08 10:23:23.941271 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1115/2410] 10.222.0.59 () {58 vars in 1303 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273 => generated 485 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:23.964005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46f69f6a-6cc9-4799-ba5e-2c64c519128b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235140daf0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.036991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.038238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:24.070179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:24.071443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:24.073481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:24.074524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:24.076608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:24.079411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:24.292711 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46f69f6a-6cc9-4799-ba5e-2c64c519128b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.330850 Sep 08 10:23:24.296894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1296/2411] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:23:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:24.313292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-63ccf770-17f6-48ff-a30f-759c77575fe2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23512efe50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.386218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:24.404858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:24.415809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:24.419266 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d17134ed-53ef-4319-9f55-e568226ede90 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1266 microversion: 2.25 time: 0.389443 Sep 08 10:23:24.421639 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1116/2412] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:24 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:23:24.440857 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63ccf770-17f6-48ff-a30f-759c77575fe2 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.131870 Sep 08 10:23:24.444286 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1297/2413] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:23:24 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:24.458200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-251d7958-d4e4-4173-9cd5-4175c8385d1b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23515e4700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.461059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.461700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:24.469795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:24.471565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:24.474722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:24.476143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:24.478032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:24.479918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:24.605780 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-251d7958-d4e4-4173-9cd5-4175c8385d1b tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.152008 Sep 08 10:23:24.607100 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1298/2414] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:23:24 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:23:24.621698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d935ab8-6e68-45a9-9ee9-053cd719b303 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235140d820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.809136 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d935ab8-6e68-45a9-9ee9-053cd719b303 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?changes-since=2022-09-08T10%3A20%3A28Z" status: 200 len: 6332 microversion: 2.1 time: 0.192727 Sep 08 10:23:24.809760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1299/2415] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Sep 8 10:23:24 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-08T10%3A20%3A28Z => generated 6332 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:23:24.816598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:24.824850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:24.843736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:24.844592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:24.845279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:24.846296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:24.846875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:24.847942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:25.557548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:25.569429 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-772d4360-7c00-47e5-97a6-925347752e2a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1214 microversion: 2.1 time: 0.757022 Sep 08 10:23:25.583885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1300/2416] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:24 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1214 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:25.612341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd99d3c5-fcb5-40ae-b727-03e564d01a74 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351293dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:25.719521 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd99d3c5-fcb5-40ae-b727-03e564d01a74 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-486943536" status: 200 len: 664 microversion: 2.1 time: 0.133284 Sep 08 10:23:25.721538 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1301/2417] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Sep 8 10:23:25 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-486943536 => generated 664 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:25.734240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9a23f2b3-0bd3-4a91-989c-c95b34025f76 req-2b38ca06-3cd5-4077-8909-bf5823a92686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "name": "network-vif-unplugged", "status": "completed", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:25.768129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a23f2b3-0bd3-4a91-989c-c95b34025f76 req-2b38ca06-3cd5-4077-8909-bf5823a92686 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:25.768403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a23f2b3-0bd3-4a91-989c-c95b34025f76 req-2b38ca06-3cd5-4077-8909-bf5823a92686 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:25.769001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a23f2b3-0bd3-4a91-989c-c95b34025f76 req-2b38ca06-3cd5-4077-8909-bf5823a92686 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:25.782504 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9a23f2b3-0bd3-4a91-989c-c95b34025f76 req-2b38ca06-3cd5-4077-8909-bf5823a92686 service nova] Creating event network-vif-unplugged:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:23:25.796638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9a23f2b3-0bd3-4a91-989c-c95b34025f76 req-2b38ca06-3cd5-4077-8909-bf5823a92686 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073462 Sep 08 10:23:25.799076 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1302/2418] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:25.845091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:25.845685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:25.863855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:25.864357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:25.864805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:25.866078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:25.866537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:25.867350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:25.927511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:26.292555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.313786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.334391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.345477 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79d92a86-a090-4925-aa77-c9af226d0437 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 200 len: 1266 microversion: 2.25 time: 0.538075 Sep 08 10:23:26.351297 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1303/2419] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:25 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 1266 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:26.385595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f5075b3-8f13-461f-a9b0-3775ac1fcbd1 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23512a4700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:26.452187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.483739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.487647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.490718 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e2b6b533-5bd4-4acc-8de5-cc039a53647a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 2.047404 Sep 08 10:23:26.499150 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1117/2420] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:24 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:26.603494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:26.607259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:26.638760 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f5075b3-8f13-461f-a9b0-3775ac1fcbd1 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1467 microversion: 2.1 time: 0.285449 Sep 08 10:23:26.650049 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1304/2421] 10.222.0.59 () {58 vars in 1338 bytes} [Thu Sep 8 10:23:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fv2.1%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:26.662107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:26.662880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:26.663835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:26.665165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:26.665649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:26.670941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:26.671667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97c59634-cc8b-4667-8d37-c0495a813718 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235140d940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:26.911681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:26.923636 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6133709-8071-4066-a2ee-c443290a8faa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1270 microversion: 2.1 time: 0.329533 Sep 08 10:23:26.943983 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1118/2422] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:26 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1270 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:26.952264 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97c59634-cc8b-4667-8d37-c0495a813718 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1467 microversion: 2.1 time: 0.289035 Sep 08 10:23:26.953149 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1305/2423] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Sep 8 10:23:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.59%2Fcompute%2Fservers%2Fd485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1467 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:26.971981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ad1d175-7bfb-4e84-8c4d-8276cbf25fdc tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350b620d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:27.264148 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ad1d175-7bfb-4e84-8c4d-8276cbf25fdc tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.297003 Sep 08 10:23:27.265730 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1119/2424] 10.222.0.59 () {58 vars in 1170 bytes} [Thu Sep 8 10:23:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:27.295447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0634991b-b7d4-4135-a8b0-1999b87f532f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23509d7b80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:27.378843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:27.379601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 0b35549a-0f59-4a78-bcf5-fa13562fe95f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:27.391833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:27.394763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:27.395300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:27.400159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:27.400794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:27.401368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:27.435281 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0634991b-b7d4-4135-a8b0-1999b87f532f tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.149020 Sep 08 10:23:27.436396 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1306/2425] 10.222.0.59 () {58 vars in 1170 bytes} [Thu Sep 8 10:23:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:27.457851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3efc2ba-c996-4760-8004-5477329323c4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23513f79d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:27.477479 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] HTTP exception thrown: Instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f could not be found. Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Request method failure captured: Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f HTTP/1.1 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBvZt7-B03FwdtfDbr9ueTW_DCG5FZYsBVHUxEzNFvzce3wGHf30oIC1uvB7V84U64CuJAwRO5CNnGbt515SPCXgX__cYk2duhnDsFukltFG05uPwMeeJ9NaotDz1yZSv9sIuiqwo-xFrIDLk7xUS60FSrODAMu5GsujUwNOheLb4U Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7fcb031b760e4b5fbdcc1adb626aa462", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 448b7c1cb3eb4b63a427a3d7b7d6eb13 Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f could not be found. Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '0b35549a-0f59-4a78-bcf5-fa13562fe95f'} Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f could not be found. Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f could not be found. Sep 08 10:23:27.485606 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f could not be found. Sep 08 10:23:27.489681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:27.491860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Returning 404 to user: Instance 0b35549a-0f59-4a78-bcf5-fa13562fe95f could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:27.492942 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c312d57-a92c-4457-96e9-bfcb2cf60667 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f" status: 404 len: 111 microversion: 2.25 time: 0.121513 Sep 08 10:23:27.499707 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1120/2426] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:27 2022] GET /compute/v2.1/servers/0b35549a-0f59-4a78-bcf5-fa13562fe95f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:23:27.529118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:27.529745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:27.541174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3efc2ba-c996-4760-8004-5477329323c4 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/fe14f6a4-d144-40d8-8fee-904fb43a30eb" status: 200 len: 784 microversion: 2.1 time: 0.088255 Sep 08 10:23:27.542012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1307/2427] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:23:27 2022] GET /compute/v2.1/images/fe14f6a4-d144-40d8-8fee-904fb43a30eb => generated 784 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:27.558942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08bdf4d5-53a1-45f4-8b81-7d7694fbcedb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351cd9310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:27.559716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:27.560387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:27.561743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:27.563163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:27.568499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:27.570010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:27.827071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08bdf4d5-53a1-45f4-8b81-7d7694fbcedb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.273271 Sep 08 10:23:27.835496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1308/2428] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:23:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:27.853925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-952f2f95-6428-41d3-b397-85de7fcee4e8 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235128dca0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:28.156524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:28.164005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:28.173368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:28.175729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:28.179517 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-15a29b89-f8af-4873-a206-b0934eb52435 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.654133 Sep 08 10:23:28.181651 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1121/2429] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:27 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:23:28.194262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:28.195723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:28.207342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:28.210409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:28.210861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:28.212344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:28.212992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:28.213425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:28.401553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:28.409846 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b9d0f307-0da6-46b1-96eb-6bacdacf2fd9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1276 microversion: 2.1 time: 0.226081 Sep 08 10:23:28.427582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1122/2430] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:28 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:28.884363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45f93ba5-300b-4655-a702-b8716b1480ae tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] Calling method '.version_select at 0x7f2355404820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:28.933936 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45f93ba5-300b-4655-a702-b8716b1480ae tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.514520 Sep 08 10:23:28.944431 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1123/2431] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:23:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:28.974870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-88acf3a3-4ec0-4c30-80dc-829b1d55fd66 req-1240de7d-1074-4df7-aca1-70c7c665fed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a55553-afc6-447d-9c45-fc7e0119e91c", "tag": "3d8c788c-2474-4943-b9be-bd722b2437d8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:29.022569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-88acf3a3-4ec0-4c30-80dc-829b1d55fd66 req-1240de7d-1074-4df7-aca1-70c7c665fed4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.025866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-88acf3a3-4ec0-4c30-80dc-829b1d55fd66 req-1240de7d-1074-4df7-aca1-70c7c665fed4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.027842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-88acf3a3-4ec0-4c30-80dc-829b1d55fd66 req-1240de7d-1074-4df7-aca1-70c7c665fed4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.080472 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-88acf3a3-4ec0-4c30-80dc-829b1d55fd66 req-1240de7d-1074-4df7-aca1-70c7c665fed4 service nova] Creating event network-changed:3d8c788c-2474-4943-b9be-bd722b2437d8 for instance 44a55553-afc6-447d-9c45-fc7e0119e91c on n-h2-833090-19 Sep 08 10:23:29.103199 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-88acf3a3-4ec0-4c30-80dc-829b1d55fd66 req-1240de7d-1074-4df7-aca1-70c7c665fed4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142378 Sep 08 10:23:29.106690 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1124/2432] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:29.124918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:29.128200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:29.155845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.159435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.161854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.167906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.168386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.168849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.305945 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-952f2f95-6428-41d3-b397-85de7fcee4e8 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8" status: 204 len: 0 microversion: 2.1 time: 1.459692 Sep 08 10:23:29.307016 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1309/2433] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:27 2022] DELETE /compute/v2.1/images/7ec6d00a-50ff-4414-877c-a1891763a5b8 => generated 0 bytes in 1461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:23:29.312287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e9780d0-14c0-49cd-b09a-05b9c0c4284b tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] Action: 'update', calling method: .version_select at 0x7f23513f7040>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:29.430456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:29.441786 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a43fa01-09c8-4813-bff4-3342efabfc81 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1589 microversion: 2.1 time: 0.333605 Sep 08 10:23:29.456185 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1125/2434] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:29 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1589 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:29.456185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:29.456185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:29.457540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.463900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.463900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.463900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.463900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.463900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.733310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e9780d0-14c0-49cd-b09a-05b9c0c4284b tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.424981 Sep 08 10:23:29.734107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1310/2435] 10.222.0.59 () {60 vars in 1206 bytes} [Thu Sep 8 10:23:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:29.747818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0d449eb-7bf1-4cd4-bdf5-0607032a7db8 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2351288a60>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:29.791639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:29.802764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:29.804263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:29.805479 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1dd4ba8-2903-4c3c-899d-2e1cd83a57c1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.361538 Sep 08 10:23:29.806054 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1126/2436] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:29 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:29.824566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:29.825587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:29.835074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.835903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.836578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.837515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:29.838186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:29.839052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:29.954226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:29.976250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cbca7839-c3d2-44ca-bcdf-dda0c1c4e626 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1276 microversion: 2.1 time: 0.155446 Sep 08 10:23:29.998567 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1127/2437] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:29 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:30.004149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-920b6850-186f-4f65-885f-a1f3a9ed7df5 tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] Calling method '.version_select at 0x7f23514615e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:30.045046 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-920b6850-186f-4f65-885f-a1f3a9ed7df5 tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.045218 Sep 08 10:23:30.046229 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1128/2438] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:23:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:30.071002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae8bffe5-7512-4b5a-a7e7-2ef5cc073387 tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] Action: 'update', calling method: .version_select at 0x7f2351916e50>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:30.340567 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ae8bffe5-7512-4b5a-a7e7-2ef5cc073387 tempest-QuotaClassesAdminTestJSON-226143134 tempest-QuotaClassesAdminTestJSON-226143134-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.278943 Sep 08 10:23:30.353665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1129/2439] 10.222.0.59 () {60 vars in 1206 bytes} [Thu Sep 8 10:23:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:30.582224 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0d449eb-7bf1-4cd4-bdf5-0607032a7db8 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815" status: 204 len: 0 microversion: 2.1 time: 0.838358 Sep 08 10:23:30.584000 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1311/2440] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:29 2022] DELETE /compute/v2.1/images/2f5e4512-52d3-4167-bba3-db539cf51815 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:30.593084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0451e00c-884c-48d2-9b63-5676ccb6b75a tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f2350b62b80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:30.804279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1276933186", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "285fd52a-58ee-4456-acdc-f4db9154c915"}], "security_groups": [{"name": "tempest-securitygroup--849646347"}], "key_name": "tempest-keypair-1777355017", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f5ff039a-fc62-4e67-8d5c-b37487b348c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:31.048842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] validate_networks() for [('285fd52a-58ee-4456-acdc-f4db9154c915', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:31.606072 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0451e00c-884c-48d2-9b63-5676ccb6b75a tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f" status: 204 len: 0 microversion: 2.1 time: 1.017824 Sep 08 10:23:31.606659 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1130/2441] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:30 2022] DELETE /compute/v2.1/images/7f129281-d7f6-4b74-83db-7d964b02e63f => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:31.615007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:31.615667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:31.629432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:31.629933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:31.630383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:31.631108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:31.631599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:31.632033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.135581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Getting quotas for project f09c48205b9b4ba7888ed04e1029704b. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:32.149237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Getting quotas for user 8cbbcadf7663400daad4ee6ea5db1ddf and project f09c48205b9b4ba7888ed04e1029704b. Resources: dict_keys(['metadata_items']) {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:32.181316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:32.181742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:32.182224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:32.182637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:32.183055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:32.191861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:32.203666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:32.207189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:32.208788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8b1fba5-ec86-4999-b80a-f1b332205cf7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.598380 Sep 08 10:23:32.224781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.224781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.224781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.225160 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1131/2442] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:31 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:32.225471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.225471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.225471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.234302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:32.234930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:32.256061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.256568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.257002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.258768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.259507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.260129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.274757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Getting quotas for project f09c48205b9b4ba7888ed04e1029704b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:32.281515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Getting quotas for user 8cbbcadf7663400daad4ee6ea5db1ddf and project f09c48205b9b4ba7888ed04e1029704b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:32.430814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:23:32.434665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5ff039a-fc62-4e67-8d5c-b37487b348c5',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:23:32.527695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:32.541711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe9d53d1-618d-4cd8-8698-0bb691acb975 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.316347 Sep 08 10:23:32.544154 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1132/2443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:32 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:32.553777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-18971cce-df21-4370-a582-d5c01322a6a4 req-d673286e-71c9-4879-9a15-11c3503b6284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6657a9c-c729-4811-aa0b-b54bde87bc4a", "tag": "1e840973-adce-40af-bf0e-70733119924d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:32.605096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-18971cce-df21-4370-a582-d5c01322a6a4 req-d673286e-71c9-4879-9a15-11c3503b6284 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.608215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-18971cce-df21-4370-a582-d5c01322a6a4 req-d673286e-71c9-4879-9a15-11c3503b6284 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.609184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-18971cce-df21-4370-a582-d5c01322a6a4 req-d673286e-71c9-4879-9a15-11c3503b6284 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.644164 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-18971cce-df21-4370-a582-d5c01322a6a4 req-d673286e-71c9-4879-9a15-11c3503b6284 service nova] Creating event network-changed:1e840973-adce-40af-bf0e-70733119924d for instance b6657a9c-c729-4811-aa0b-b54bde87bc4a on n-h1-833090-19 Sep 08 10:23:32.654707 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-18971cce-df21-4370-a582-d5c01322a6a4 req-d673286e-71c9-4879-9a15-11c3503b6284 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105572 Sep 08 10:23:32.659081 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1133/2444] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:32.670489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:32.671420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:32.687072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.689506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.692380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.693372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.694393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.696431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.712231 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4e98e2c-5f38-4e69-a0cf-5de9d1886f9f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.915066 Sep 08 10:23:32.715280 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1312/2445] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:23:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:23:32.728430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d70665a0-7fec-4a18-8c1a-4c5aa7d27049 req-07a44f51-57a6-4dec-abbf-05f9d251fb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8904ea32-ef8e-4736-bf82-af73eb0f90d4", "tag": "26b7b3d7-944c-4cf4-aace-77d8f31fbdc9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:32.767386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d70665a0-7fec-4a18-8c1a-4c5aa7d27049 req-07a44f51-57a6-4dec-abbf-05f9d251fb46 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:32.774315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:32.775195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d70665a0-7fec-4a18-8c1a-4c5aa7d27049 req-07a44f51-57a6-4dec-abbf-05f9d251fb46 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:32.776751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d70665a0-7fec-4a18-8c1a-4c5aa7d27049 req-07a44f51-57a6-4dec-abbf-05f9d251fb46 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:32.810208 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d70665a0-7fec-4a18-8c1a-4c5aa7d27049 req-07a44f51-57a6-4dec-abbf-05f9d251fb46 service nova] Creating event network-changed:26b7b3d7-944c-4cf4-aace-77d8f31fbdc9 for instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 on n-h1-833090-19 Sep 08 10:23:32.817830 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d70665a0-7fec-4a18-8c1a-4c5aa7d27049 req-07a44f51-57a6-4dec-abbf-05f9d251fb46 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101121 Sep 08 10:23:32.819406 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1313/2446] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:32.833986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-053c969d-40f8-4d3c-8c7c-e01763b08835 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:32.834710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-053c969d-40f8-4d3c-8c7c-e01763b08835 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:32.969080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-411de16a-c007-47be-96ec-0b2d66b6e4ac tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 204 len: 0 microversion: 2.1 time: 0.307884 Sep 08 10:23:32.970052 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1134/2447] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:23:32 2022] DELETE /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:32.985885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:32.994556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:33.014875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:33.016382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:33.016779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:33.017504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:33.017961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:33.018416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:33.019392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-053c969d-40f8-4d3c-8c7c-e01763b08835 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:33.030822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-053c969d-40f8-4d3c-8c7c-e01763b08835 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1122 microversion: 2.1 time: 0.208916 Sep 08 10:23:33.055636 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1314/2448] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:32 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1122 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:33.236285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:33.237747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:33.241850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=12,nova_api:INSERT=10 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:33.256996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:33.260474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:33.263865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:33.264937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:33.265741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:33.266935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:33.776326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:33.789772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:33.794654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:33.798135 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f3500e2-25ba-49c2-9422-0542d74ddadd tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.564311 Sep 08 10:23:33.800261 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1315/2449] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:33 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:33.824892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:33.825875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:33.838885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:33.839536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:33.840100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:33.841088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:33.841774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:33.842415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.184046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:34.203746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:34.208407 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb419b23-e3b6-4030-8bd1-bf3fc8bd770e tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1473 microversion: 2.1 time: 1.218799 Sep 08 10:23:34.211476 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1135/2450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:32 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1473 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:34.219348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:34.220235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:34.226232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a31c919d-9188-4cde-81aa-1a505501bfa3 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.422442 Sep 08 10:23:34.227059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1316/2451] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:33 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:34.239599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.241166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.241820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.242831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.243428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.244055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.328119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:34.344376 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31b4555f-a4ef-47ea-89d7-6572d0f8dea8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1172 microversion: 2.1 time: 0.131149 Sep 08 10:23:34.345455 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1136/2452] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:34 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1172 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:34.646177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:34.647716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:34.662791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.663637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.664793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.665760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.666370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.666951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.709033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:34.822363 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d4c73598-776a-4a86-ba22-aeeee2422978 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 204 len: 0 microversion: 2.25 time: 0.184612 Sep 08 10:23:34.822967 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1317/2453] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:23:34 2022] DELETE /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:23:34.833477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:34.834396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:34.836407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:34.837139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:34.840294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=13 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:34.845318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.845505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.845986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.846108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.846473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.846995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.847226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.847874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.848348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:34.848654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:34.848973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:34.849473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.185923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.199424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.208249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.211968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.217443 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8913ab05-483e-40c6-86e9-8ad1425a203d tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1734 microversion: 2.25 time: 0.385942 Sep 08 10:23:35.219798 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1137/2454] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:34 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1734 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:35.221843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.226446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.231514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bab85d86-b698-497e-9f01-9b64a8c75398 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.400624 Sep 08 10:23:35.232328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d534ab0c-6532-41a8-90a3-676fb97b1a6c req-3286f89a-708f-4f3b-905d-2b7dadf6cbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a6534a-2e40-4622-9b49-fe45eca2fc9f", "tag": "a743004f-d463-44de-9406-6ac374d8d4ff"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:35.233334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1318/2455] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:34 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:23:35.261328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:35.263822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:35.265695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d534ab0c-6532-41a8-90a3-676fb97b1a6c req-3286f89a-708f-4f3b-905d-2b7dadf6cbde service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.267309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d534ab0c-6532-41a8-90a3-676fb97b1a6c req-3286f89a-708f-4f3b-905d-2b7dadf6cbde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.268211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d534ab0c-6532-41a8-90a3-676fb97b1a6c req-3286f89a-708f-4f3b-905d-2b7dadf6cbde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.277782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.278282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.278894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.279791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.280417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.281053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.283732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d534ab0c-6532-41a8-90a3-676fb97b1a6c req-3286f89a-708f-4f3b-905d-2b7dadf6cbde service nova] Creating event network-changed:a743004f-d463-44de-9406-6ac374d8d4ff for instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f on n-h1-833090-19 Sep 08 10:23:35.291454 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d534ab0c-6532-41a8-90a3-676fb97b1a6c req-3286f89a-708f-4f3b-905d-2b7dadf6cbde service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068118 Sep 08 10:23:35.292809 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1138/2456] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:35.300860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:35.301927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:35.310798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.311582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.313007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.313981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.314658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.315514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.904557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:35.915853 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0fa46f73-688e-4213-9478-4fb42470e8c5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1473 microversion: 2.1 time: 0.680037 Sep 08 10:23:35.917123 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1319/2457] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:35 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1473 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:35.922312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:35.923150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:35.938966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.939495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.939918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:35.942352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:35.943203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:35.944264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:36.496731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:36.511598 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-589c8c5c-d98c-4bd4-a018-23e53f62e95b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1228 microversion: 2.1 time: 0.593165 Sep 08 10:23:36.512209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1320/2458] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:35 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1228 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:36.524041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5efd7d45-f7c1-43e3-882a-6b08501d15f0 req-17340454-10a1-4768-8893-cdca0e62b5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a55553-afc6-447d-9c45-fc7e0119e91c", "name": "network-vif-plugged", "status": "completed", "tag": "3d8c788c-2474-4943-b9be-bd722b2437d8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:36.553067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:36.570907 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b6a5c0c-a6cb-4d23-abef-54e3b9920e06 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 1.274600 Sep 08 10:23:36.571612 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1139/2459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:35 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:36.598226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:36.599767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:36.615945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5efd7d45-f7c1-43e3-882a-6b08501d15f0 req-17340454-10a1-4768-8893-cdca0e62b5d1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:36.616540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5efd7d45-f7c1-43e3-882a-6b08501d15f0 req-17340454-10a1-4768-8893-cdca0e62b5d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:36.619635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5efd7d45-f7c1-43e3-882a-6b08501d15f0 req-17340454-10a1-4768-8893-cdca0e62b5d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:36.626497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:36.635225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:36.635862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:36.636824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:36.643384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:36.645040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:36.646179 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5efd7d45-f7c1-43e3-882a-6b08501d15f0 req-17340454-10a1-4768-8893-cdca0e62b5d1 service nova] Creating event network-vif-plugged:3d8c788c-2474-4943-b9be-bd722b2437d8 for instance 44a55553-afc6-447d-9c45-fc7e0119e91c on n-h2-833090-19 Sep 08 10:23:36.652023 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5efd7d45-f7c1-43e3-882a-6b08501d15f0 req-17340454-10a1-4768-8893-cdca0e62b5d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138524 Sep 08 10:23:36.652853 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1321/2460] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:36.660226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:36.661132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:36.667623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:36.668120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:36.668565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:36.669276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:36.669732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:36.670163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.034871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.057939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.060369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.065616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ba3608b4-e320-4fcc-b24c-7b8bc32865b7 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.491621 Sep 08 10:23:37.068864 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1140/2461] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:36 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:37.076476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-62e3ebb2-15a1-4513-9caf-898709a480dd req-1c9a9d41-a6ec-4940-81b5-94397507bb00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d485bf32-a51c-4748-9c53-3c5d643fd273", "name": "network-vif-deleted", "tag": "69a878c2-2b18-44bb-a936-0eec42248f2e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:37.090803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-62e3ebb2-15a1-4513-9caf-898709a480dd req-1c9a9d41-a6ec-4940-81b5-94397507bb00 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.091885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-62e3ebb2-15a1-4513-9caf-898709a480dd req-1c9a9d41-a6ec-4940-81b5-94397507bb00 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.092819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-62e3ebb2-15a1-4513-9caf-898709a480dd req-1c9a9d41-a6ec-4940-81b5-94397507bb00 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.110380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-62e3ebb2-15a1-4513-9caf-898709a480dd req-1c9a9d41-a6ec-4940-81b5-94397507bb00 service nova] Creating event network-vif-deleted:69a878c2-2b18-44bb-a936-0eec42248f2e for instance d485bf32-a51c-4748-9c53-3c5d643fd273 on n-h2-833090-19 Sep 08 10:23:37.117146 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-62e3ebb2-15a1-4513-9caf-898709a480dd req-1c9a9d41-a6ec-4940-81b5-94397507bb00 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046677 Sep 08 10:23:37.118392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1141/2462] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:37.240625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.250192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.257154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.260830 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0584507-7c43-470e-9627-2ebb8465bb82 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1734 microversion: 2.25 time: 0.606652 Sep 08 10:23:37.283699 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1322/2463] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:36 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1734 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:37.289017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:37.290081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:37.309346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.310142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.310736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.311654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.312256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.312855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.385478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.386282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.386877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.387548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lazy-loading 'fault' on Instance uuid d485bf32-a51c-4748-9c53-3c5d643fd273 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:37.436916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eecfa9e0-eab6-480b-9ed9-eb61b2e7d680 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Calling method '.version_select at 0x7f23554c5ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:37.527283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.538966 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-815dfd84-259a-4ed0-92ff-076ef5e71d5c tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 200 len: 1308 microversion: 2.1 time: 0.253650 Sep 08 10:23:37.545557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1323/2464] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:37 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:37.563037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:37.563956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:37.582542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.589582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.590315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.591224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.591866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.592468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.610321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eecfa9e0-eab6-480b-9ed9-eb61b2e7d680 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 371 microversion: 2.1 time: 0.490202 Sep 08 10:23:37.614893 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1142/2465] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:23:37 2022] GET /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:37.656331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:37.659131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:37.666456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.668403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.669996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.670974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.671650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.672278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.733538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:37.742581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f074ad0c-a49c-4803-af81-ef3b72ab2044 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1238 microversion: 2.1 time: 0.195727 Sep 08 10:23:37.743741 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1324/2466] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:37 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1238 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:37.748439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Action: 'update', calling method: .version_select at 0x7f2351713d30>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:37.846700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.847917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.848477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.849297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:37.850142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:37.850657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:37.933608 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6525dee3-af32-4035-8596-a705825c9e2b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 328 microversion: 2.1 time: 0.188465 Sep 08 10:23:37.934379 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1325/2467] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:37 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:38.107783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:38.111420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:38.122995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:38.123621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:38.124075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:38.124867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:38.125519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:38.126018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:38.251247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:38.260251 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dac669fd-1275-4667-93ee-753b1ede1ab1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.643723 Sep 08 10:23:38.260863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1143/2468] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:37 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:38.406129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1996796066", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:38.476462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:38.889059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:38.899236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:38.901042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:38.902520 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b946fa02-608c-4f83-8639-b1c10c1b76a1 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1362 microversion: 2.26 time: 0.811470 Sep 08 10:23:38.915898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1326/2469] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:38 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:23:38.932884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:38.935853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:38.949468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:38.950204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:38.951110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:38.952054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:38.952795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:38.953523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.187683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:39.188555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:39.189246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:39.189855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:39.190429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:39.214159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.214664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.215112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.215887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.216522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.217109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.247417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Getting quotas for project 1074dc867789416584fd4119a4499a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:39.254771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Getting quotas for user 7870fa1d07c941288e13198d5de86c56 and project 1074dc867789416584fd4119a4499a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:39.279250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.utils [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] cores quota exceeded for 1074dc867789416584fd4119a4499a9d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122456) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 10:23:39.280522 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Request method failure captured: Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 145 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcKnvfFQbLgXT1efuSQnMlZgbjl8QhFGoWut1LTaPzsjWX7fn4mIn-cdBxmaKFghPAw1iI-w53wDIfhZrEkUm-pkzI9YKhXZISIy4fIvByQmx9jM8hSfSDMBpeIj45c_muCrHcpggPxxaYtLgz_mlh3Vd9C5nM-YrNDMQrwuhe67RKg Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1074dc867789416584fd4119a4499a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1074dc867789416584fd4119a4499a9d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7870fa1d07c941288e13198d5de86c56 Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1996796066", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1996796066', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452'}}} Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:23:39.324282 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 10:23:39.328790 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.335149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:39.336408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32e2511b-a6e0-454d-803f-65259099e47f tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.074535 Sep 08 10:23:39.341206 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1144/2470] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:23:38 2022] POST /compute/v2.1/servers => generated 111 bytes in 1080 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:39.348066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:39.348947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: d485bf32-a51c-4748-9c53-3c5d643fd273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:39.356348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.357437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.358074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.359381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.360065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.360683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.366099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:39.390744 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] HTTP exception thrown: Instance d485bf32-a51c-4748-9c53-3c5d643fd273 could not be found. Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Request method failure captured: Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 HTTP/1.1 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcHr5st5biyn47TgPUpipqG0JvbX0Hel50XX9RQFLQavA0_JiIBzc4lsOfjOZVdv5E0v9jvGbJMpCSbFsefPVzaRYwRDHSXTRWLtAjqWrFm3uY1glXa-ISba9rUKdRJ3cFY_Myl7LIbPGVUlZ6JuKMnVE7uhEI1rtNaeRCcVVKH3Vlg Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6f9f8699f1cf44af92b4a93458fb7a8f Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ListImageFiltersTestJSON-1802813307 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6f9f8699f1cf44af92b4a93458fb7a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6f9f8699f1cf44af92b4a93458fb7a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6f9f8699f1cf44af92b4a93458fb7a8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6f9f8699f1cf44af92b4a93458fb7a8f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ListImageFiltersTestJSON-1802813307 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6f9f8699f1cf44af92b4a93458fb7a8f Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1802813307 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ListImageFiltersTestJSON-1802813307-project Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 8b792020285b49f4a67a2eb5a74e3824 Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ListImageFiltersTestJSON-1802813307-project Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance d485bf32-a51c-4748-9c53-3c5d643fd273 could not be found. Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'd485bf32-a51c-4748-9c53-3c5d643fd273'} Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d485bf32-a51c-4748-9c53-3c5d643fd273 could not be found. Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d485bf32-a51c-4748-9c53-3c5d643fd273 could not be found. Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:39.392592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d485bf32-a51c-4748-9c53-3c5d643fd273 could not be found. Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Returning 404 to user: Instance d485bf32-a51c-4748-9c53-3c5d643fd273 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45899799-e259-414c-a637-804074f931eb tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273" status: 404 len: 111 microversion: 2.1 time: 0.051510 Sep 08 10:23:39.397464 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1145/2471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:39 2022] GET /compute/v2.1/servers/d485bf32-a51c-4748-9c53-3c5d643fd273 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:39.400642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:39.401116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:39.408156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.408654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.409268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.410712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.411331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.412010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.642907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:39.657225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:39.661156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:39.663811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a9df2d1-11cb-4b82-9c39-1547a54e564f tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1734 microversion: 2.25 time: 0.746039 Sep 08 10:23:39.665065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1327/2472] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:38 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1734 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:39.672075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4b17d799-02cb-45eb-a726-49eb68e0894f req-ae6d0398-daa3-426f-96d2-42315d7e3642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8904ea32-ef8e-4736-bf82-af73eb0f90d4", "name": "network-vif-plugged", "status": "completed", "tag": "26b7b3d7-944c-4cf4-aace-77d8f31fbdc9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:39.689585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b17d799-02cb-45eb-a726-49eb68e0894f req-ae6d0398-daa3-426f-96d2-42315d7e3642 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.693091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b17d799-02cb-45eb-a726-49eb68e0894f req-ae6d0398-daa3-426f-96d2-42315d7e3642 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.693883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b17d799-02cb-45eb-a726-49eb68e0894f req-ae6d0398-daa3-426f-96d2-42315d7e3642 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.717666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4b17d799-02cb-45eb-a726-49eb68e0894f req-ae6d0398-daa3-426f-96d2-42315d7e3642 service nova] Creating event network-vif-plugged:26b7b3d7-944c-4cf4-aace-77d8f31fbdc9 for instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 on n-h1-833090-19 Sep 08 10:23:39.729089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4b17d799-02cb-45eb-a726-49eb68e0894f req-ae6d0398-daa3-426f-96d2-42315d7e3642 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061529 Sep 08 10:23:39.730476 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1328/2473] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:39.742063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:39.744615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:39.758119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.759005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.760192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.761666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:39.762806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:39.763955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:39.916405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:39.926270 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-299d157e-7fa1-4173-97a9-bbad8c47d022 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1305 microversion: 2.1 time: 0.529393 Sep 08 10:23:39.930906 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1146/2474] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:39 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1305 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:39.951901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Action: 'update', calling method: .version_select at 0x7f23554c5430>, body: {"quota_set": {"cores": 20}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:40.047857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.049253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.049977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.052029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.052701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.053310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.128051 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff9d6cda-1501-4b67-a1a5-6ee3498c6932 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 329 microversion: 2.1 time: 0.179762 Sep 08 10:23:40.129519 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1147/2475] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:39 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:40.134636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:40.135192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:40.142287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.142767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.143835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.145046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.145654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.146803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.180578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:40.185921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:40.204582 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a26aa562-8b3e-45f1-83ee-51686e7083fb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.471943 Sep 08 10:23:40.205494 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1329/2476] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:39 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:40.211515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:40.212572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:40.223374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.225885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.226991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.228809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.229819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.231130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.263512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:40.321673 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1bdbfa0a-dc6b-43f1-8f46-67b372700492 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 204 len: 0 microversion: 2.1 time: 0.190138 Sep 08 10:23:40.325568 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1148/2477] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:23:40 2022] DELETE /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:40.334428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07539caf-9729-44ea-868a-a421df9d303a tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Calling method '.version_select at 0x7f2351ad7670>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:40.432353 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07539caf-9729-44ea-868a-a421df9d303a tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 371 microversion: 2.1 time: 0.105037 Sep 08 10:23:40.433177 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1149/2478] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:23:40 2022] GET /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:40.438725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:40.439878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:40.446631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.449035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.449035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:40.449035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:40.449035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:40.449035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.001160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.013529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.021493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.022992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d038c1c2-5c00-4305-9937-96ce21d5175a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1546 microversion: 2.26 time: 0.816349 Sep 08 10:23:41.024860 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1330/2479] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:40 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1546 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:41.052071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Action: 'update', calling method: .version_select at 0x7f23512828b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:41.136616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.149102 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d491a9b1-0ae3-496a-a210-84f3c7c22c55 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1474 microversion: 2.1 time: 0.714789 Sep 08 10:23:41.159489 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1150/2480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:40 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1474 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:41.167159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:41.167159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:41.179813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.180316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.180762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.184039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.184620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.185079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.230763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.231289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.231657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.232405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.232863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.233313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.314631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.330725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.334301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.338633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1fc9467e-24c0-4e55-aac5-eb64e7d66e7c tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 200 len: 1371 microversion: 2.25 time: 0.184998 Sep 08 10:23:41.343090 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1151/2481] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:41 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:41.358877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:41.359924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:41.365509 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-334e8812-d245-4613-b3f7-59631237b131 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 328 microversion: 2.1 time: 0.311474 Sep 08 10:23:41.366438 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1331/2482] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:41 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:41.371349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a3a6a207-f62c-4cd6-92cf-81af6c3f9d7b req-3c2dff75-4975-4b73-b7be-5e8e2714257f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7265635f-ed38-4363-84e1-d4f53815fb77", "name": "network-vif-deleted", "tag": "d0564e9f-ad94-40f2-a233-8c2e9ea93b6a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:41.376974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.380072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.381916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.384474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.385719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.387410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.407583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a3a6a207-f62c-4cd6-92cf-81af6c3f9d7b req-3c2dff75-4975-4b73-b7be-5e8e2714257f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.408319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a3a6a207-f62c-4cd6-92cf-81af6c3f9d7b req-3c2dff75-4975-4b73-b7be-5e8e2714257f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.408935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a3a6a207-f62c-4cd6-92cf-81af6c3f9d7b req-3c2dff75-4975-4b73-b7be-5e8e2714257f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.430166 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a3a6a207-f62c-4cd6-92cf-81af6c3f9d7b req-3c2dff75-4975-4b73-b7be-5e8e2714257f service nova] Creating event network-vif-deleted:d0564e9f-ad94-40f2-a233-8c2e9ea93b6a for instance 7265635f-ed38-4363-84e1-d4f53815fb77 on n-h1-833090-19 Sep 08 10:23:41.446038 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a3a6a207-f62c-4cd6-92cf-81af6c3f9d7b req-3c2dff75-4975-4b73-b7be-5e8e2714257f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078098 Sep 08 10:23:41.450150 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1332/2483] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:41.470124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f235114c3a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:41.496013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.496436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.496868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.497515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:41.504722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.505439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.506026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.506885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.507510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.508129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.547728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.555299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.556015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.588260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.589752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.593788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.659279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:41.681673 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9961eb6e-9f19-42ed-b146-27d008a0530f tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-9802531" status: 201 len: 0 microversion: 2.26 time: 0.229319 Sep 08 10:23:41.687805 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1333/2484] 10.222.0.59 () {62 vars in 1371 bytes} [Thu Sep 8 10:23:41 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-9802531 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 483 bytes (1 switches on core 0) Sep 08 10:23:41.694749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:41.695576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:41.704319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.705254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.706460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.707894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:41.708570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:41.709562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:41.759163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:41.771584 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d5b8647-cc30-45ca-91df-808c7a8a04c4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1305 microversion: 2.1 time: 0.425722 Sep 08 10:23:41.772167 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1152/2485] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:41 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1305 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:41.792943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1464084210", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:41.860908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:42.272214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:42.282987 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e674b3f-8ce4-460b-bc9b-846826e64f83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.593776 Sep 08 10:23:42.283879 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1334/2486] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:41 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:42.291764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d92f059e-8238-4c31-bf97-a4db64961069 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23512a2040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.310294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d92f059e-8238-4c31-bf97-a4db64961069 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.313005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d92f059e-8238-4c31-bf97-a4db64961069 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.313711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d92f059e-8238-4c31-bf97-a4db64961069 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.328667 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d92f059e-8238-4c31-bf97-a4db64961069 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-9802531" status: 204 len: 0 microversion: 2.26 time: 0.043144 Sep 08 10:23:42.334831 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1335/2487] 10.222.0.59 () {60 vars in 1352 bytes} [Thu Sep 8 10:23:42 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-9802531 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:42.336801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2792842a-dc8c-4b26-909e-f5df9124909b req-94a480e6-8a88-4818-9ec4-1669bce97129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a6534a-2e40-4622-9b49-fe45eca2fc9f", "name": "network-vif-plugged", "status": "completed", "tag": "a743004f-d463-44de-9406-6ac374d8d4ff"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:42.347954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2792842a-dc8c-4b26-909e-f5df9124909b req-94a480e6-8a88-4818-9ec4-1669bce97129 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.349310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2792842a-dc8c-4b26-909e-f5df9124909b req-94a480e6-8a88-4818-9ec4-1669bce97129 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.350034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2792842a-dc8c-4b26-909e-f5df9124909b req-94a480e6-8a88-4818-9ec4-1669bce97129 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.362794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2792842a-dc8c-4b26-909e-f5df9124909b req-94a480e6-8a88-4818-9ec4-1669bce97129 service nova] Creating event network-vif-plugged:a743004f-d463-44de-9406-6ac374d8d4ff for instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f on n-h1-833090-19 Sep 08 10:23:42.368345 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2792842a-dc8c-4b26-909e-f5df9124909b req-94a480e6-8a88-4818-9ec4-1669bce97129 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 Sep 08 10:23:42.371453 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1336/2488] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:42.377248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.383790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:42.393611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.394566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.395858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.396785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.397522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.398566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.456177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:42.456619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:42.457095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:42.458253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:42.458687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:42.468311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.468799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.469230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.469963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.470423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.470859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.490178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Getting quotas for project 1074dc867789416584fd4119a4499a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:42.495330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Getting quotas for user 7870fa1d07c941288e13198d5de86c56 and project 1074dc867789416584fd4119a4499a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:42.508567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.utils [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] instances quota exceeded for 1074dc867789416584fd4119a4499a9d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122456) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 10:23:42.509114 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Request method failure captured: Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 145 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcKnvfFQbLgXT1efuSQnMlZgbjl8QhFGoWut1LTaPzsjWX7fn4mIn-cdBxmaKFghPAw1iI-w53wDIfhZrEkUm-pkzI9YKhXZISIy4fIvByQmx9jM8hSfSDMBpeIj45c_muCrHcpggPxxaYtLgz_mlh3Vd9C5nM-YrNDMQrwuhe67RKg Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1074dc867789416584fd4119a4499a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1074dc867789416584fd4119a4499a9d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7870fa1d07c941288e13198d5de86c56 Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1464084210", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1464084210', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452'}}} Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:23:42.511557 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:42.515419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-719dee9e-34b4-463d-8b96-1cb430f241d1 tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.736655 Sep 08 10:23:42.521037 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1153/2489] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:23:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 744 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:42.522566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f2351438790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.533119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.533532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.533970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.534449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:42.540723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.541209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.541638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.542347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.542804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.543236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.566302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.567650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.568238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.588843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:42.609501 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b00ff91-c0d1-4d3c-be5c-fc09a45e1d1a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 204 len: 0 microversion: 2.26 time: 0.091360 Sep 08 10:23:42.610349 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1154/2490] 10.222.0.59 () {60 vars in 1295 bytes} [Thu Sep 8 10:23:42 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:42.615757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.616783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: 7265635f-ed38-4363-84e1-d4f53815fb77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:42.623371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.624101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.624996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.626130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.626770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.627360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.651590 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] HTTP exception thrown: Instance 7265635f-ed38-4363-84e1-d4f53815fb77 could not be found. Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Request method failure captured: Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 HTTP/1.1 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBvZt7-B03FwdtfDbr9ueTW_DCG5FZYsBVHUxEzNFvzce3wGHf30oIC1uvB7V84U64CuJAwRO5CNnGbt515SPCXgX__cYk2duhnDsFukltFG05uPwMeeJ9NaotDz1yZSv9sIuiqwo-xFrIDLk7xUS60FSrODAMu5GsujUwNOheLb4U Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7fcb031b760e4b5fbdcc1adb626aa462", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 448b7c1cb3eb4b63a427a3d7b7d6eb13 Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 7265635f-ed38-4363-84e1-d4f53815fb77 could not be found. Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7265635f-ed38-4363-84e1-d4f53815fb77'} Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7265635f-ed38-4363-84e1-d4f53815fb77 could not be found. Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7265635f-ed38-4363-84e1-d4f53815fb77 could not be found. Sep 08 10:23:42.653511 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7265635f-ed38-4363-84e1-d4f53815fb77 could not be found. Sep 08 10:23:42.657419 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:42.658962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Returning 404 to user: Instance 7265635f-ed38-4363-84e1-d4f53815fb77 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:42.659883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a4bded29-e7c5-466c-b555-1b29c065a9e7 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77" status: 404 len: 111 microversion: 2.25 time: 0.048415 Sep 08 10:23:42.665184 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1155/2491] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:42 2022] GET /compute/v2.1/servers/7265635f-ed38-4363-84e1-d4f53815fb77 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:23:42.669995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Action: 'update', calling method: .version_select at 0x7f23513885e0>, body: {"quota_set": {"instances": 10}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:42.748224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.748733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.749204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.749940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.750402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.751017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.822920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d19c3790-d360-477c-b2b9-1a860170b799 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 329 microversion: 2.1 time: 0.156366 Sep 08 10:23:42.834020 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1156/2492] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:42 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 329 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:42.841110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.842173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:42.849873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:42.852343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.852870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.853340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.854266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.854728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.855155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.883104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:42.892836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:42.898904 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-379a2f7d-f0c7-4a69-9495-eba3cc7b0e65 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1474 microversion: 2.1 time: 0.526248 Sep 08 10:23:42.901678 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1337/2493] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:42 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1474 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:42.917982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4272a82d-7418-4458-a2a6-8bdc0cc9645c tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23518235e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.934480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4272a82d-7418-4458-a2a6-8bdc0cc9645c tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:42.934993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4272a82d-7418-4458-a2a6-8bdc0cc9645c tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:42.935437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4272a82d-7418-4458-a2a6-8bdc0cc9645c tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:42.961021 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4272a82d-7418-4458-a2a6-8bdc0cc9645c tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 200 len: 12 microversion: 2.26 time: 0.056222 Sep 08 10:23:42.961923 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1338/2494] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:23:42 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:42.972610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-70085312-e7f8-43c5-9e9d-7f9227684233 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '.version_select at 0x7f235140d790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:42.998260 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-653b7fd6-4a77-4ee0-9d5d-9277ab23e035 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 204 len: 0 microversion: 2.1 time: 0.172717 Sep 08 10:23:43.005788 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1157/2495] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:23:42 2022] DELETE /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:43.011404 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-70085312-e7f8-43c5-9e9d-7f9227684233 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143528919" status: 204 len: 0 microversion: 2.25 time: 0.047976 Sep 08 10:23:43.013412 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1339/2496] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143528919 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:43.019639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3dbd1920-a10b-4484-900d-4e184a3d2d4f tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Calling method '.version_select at 0x7f2351126280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.022671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.024944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:43.033820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.034489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.035140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.042412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.045277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.045975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.150545 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3dbd1920-a10b-4484-900d-4e184a3d2d4f tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 371 microversion: 2.1 time: 0.135869 Sep 08 10:23:43.152451 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1340/2497] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:23:43 2022] GET /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:43.157910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f2351293dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.170260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.170991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.171879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.172865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:43.184765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.185622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.186325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.187268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.188411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.189083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.221610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.222094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.222542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.234600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.235740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.237130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.295794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:43.314546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6167e343-e4c5-42b7-bfdb-5853767e3607 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1473422497" status: 201 len: 0 microversion: 2.26 time: 0.160728 Sep 08 10:23:43.315445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1341/2498] 10.222.0.59 () {62 vars in 1380 bytes} [Thu Sep 8 10:23:43 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1473422497 => generated 0 bytes in 162 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 10:23:43.322729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.323647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:43.330677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.331370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.331858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.333291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.333910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.334344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.504018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:43.519829 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42136f56-86ce-4035-bff5-e58c89b78acc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1305 microversion: 2.1 time: 0.510093 Sep 08 10:23:43.535997 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1158/2499] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:43 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1305 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:43.542093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Action: 'update', calling method: .version_select at 0x7f235131bca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:43.622827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:43.632271 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6250178f-ab89-436a-a088-e9e2024ac743 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1667 microversion: 2.1 time: 0.314418 Sep 08 10:23:43.633175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1342/2500] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:43 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1667 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:43.638586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.639373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:43.645819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.646791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.647517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.648395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.648991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.649566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.675302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.676725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.677205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.677961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.678559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.679071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.747079 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6d97cb8-fe28-4b0b-b15f-555155046c44 tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 325 microversion: 2.1 time: 0.209349 Sep 08 10:23:43.747770 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1159/2501] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:43 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:43.753726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc65c49e-11e0-4b20-906e-df5384198407 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f235140b1f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.767591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc65c49e-11e0-4b20-906e-df5384198407 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.768084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc65c49e-11e0-4b20-906e-df5384198407 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.768531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc65c49e-11e0-4b20-906e-df5384198407 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.781237 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc65c49e-11e0-4b20-906e-df5384198407 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 200 len: 36 microversion: 2.26 time: 0.032374 Sep 08 10:23:43.782203 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1160/2502] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:23:43 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 36 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:43.795081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f710c12a-5096-4a64-aeac-0585cc31eded req-4dfdb5df-dd4e-41fb-956f-e1c48c1e5d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1c0d3-f5f6-4f97-97cd-360fe2947558", "name": "network-vif-deleted", "tag": "9f19506d-c16c-4273-9023-0c752d5ecdd5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:43.814894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f710c12a-5096-4a64-aeac-0585cc31eded req-4dfdb5df-dd4e-41fb-956f-e1c48c1e5d77 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.815418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f710c12a-5096-4a64-aeac-0585cc31eded req-4dfdb5df-dd4e-41fb-956f-e1c48c1e5d77 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.815880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f710c12a-5096-4a64-aeac-0585cc31eded req-4dfdb5df-dd4e-41fb-956f-e1c48c1e5d77 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.836854 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f710c12a-5096-4a64-aeac-0585cc31eded req-4dfdb5df-dd4e-41fb-956f-e1c48c1e5d77 service nova] Creating event network-vif-deleted:9f19506d-c16c-4273-9023-0c752d5ecdd5 for instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 on n-h2-833090-19 Sep 08 10:23:43.842386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f710c12a-5096-4a64-aeac-0585cc31eded req-4dfdb5df-dd4e-41fb-956f-e1c48c1e5d77 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058901 Sep 08 10:23:43.842998 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1161/2503] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:43.848977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3869aac9-4e13-4e03-aadc-8411e35e94e6 req-4d0af45a-55d9-4788-8f02-b678a66282a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f61f7ec-ddbd-41ab-9fde-8da04751631c", "tag": "89d823cd-f9c3-4c91-82cf-bdbf64d47398"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:43.859946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3869aac9-4e13-4e03-aadc-8411e35e94e6 req-4d0af45a-55d9-4788-8f02-b678a66282a7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.860440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3869aac9-4e13-4e03-aadc-8411e35e94e6 req-4d0af45a-55d9-4788-8f02-b678a66282a7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.860871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3869aac9-4e13-4e03-aadc-8411e35e94e6 req-4d0af45a-55d9-4788-8f02-b678a66282a7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.869174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:43.878471 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3869aac9-4e13-4e03-aadc-8411e35e94e6 req-4d0af45a-55d9-4788-8f02-b678a66282a7 service nova] Creating event network-changed:89d823cd-f9c3-4c91-82cf-bdbf64d47398 for instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c on n-h2-833090-19 Sep 08 10:23:43.878678 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afe5d5f8-230d-4983-a5f0-98228b70063d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.244126 Sep 08 10:23:43.879540 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1343/2504] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:43 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:43.886114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23511a3820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:43.886298 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3869aac9-4e13-4e03-aadc-8411e35e94e6 req-4d0af45a-55d9-4788-8f02-b678a66282a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041688 Sep 08 10:23:43.892043 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1162/2505] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:43.901541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1781664902", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:43.910324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.911711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.912357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.913043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:43.916632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:43.932318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.933054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.933960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.934898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.935885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.936027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.971555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:43.972053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:43.972497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:43.980815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:44.007211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.022924 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51233ef4-59a4-43e1-92cd-380f400b838d tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1473422497" status: 204 len: 0 microversion: 2.26 time: 0.141717 Sep 08 10:23:44.023556 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1344/2506] 10.222.0.59 () {60 vars in 1364 bytes} [Thu Sep 8 10:23:43 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1473422497 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:44.028311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.028923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.034711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.035196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.035707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.036401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.037078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.037271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.070843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.071355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.071824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.072279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lazy-loading 'fault' on Instance uuid bea1c0d3-f5f6-4f97-97cd-360fe2947558 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.122422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.131065 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b11879ce-8211-4052-9f43-b1aadf791d93 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1308 microversion: 2.1 time: 0.106533 Sep 08 10:23:44.131665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1345/2507] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:44.136386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.136882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.142534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.143078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.143601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.144321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.144766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.145755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.172355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:44.187002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:44.212885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:44.213380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:44.213929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:44.214406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:44.214920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:44.224259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.224868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.225383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.226145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.226687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.227183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.246891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Getting quotas for project 1074dc867789416584fd4119a4499a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:44.253399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Getting quotas for user 7870fa1d07c941288e13198d5de86c56 and project 1074dc867789416584fd4119a4499a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:44.266558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.utils [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] ram quota exceeded for 1074dc867789416584fd4119a4499a9d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122456) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 10:23:44.267174 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Request method failure captured: Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 145 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcKnvfFQbLgXT1efuSQnMlZgbjl8QhFGoWut1LTaPzsjWX7fn4mIn-cdBxmaKFghPAw1iI-w53wDIfhZrEkUm-pkzI9YKhXZISIy4fIvByQmx9jM8hSfSDMBpeIj45c_muCrHcpggPxxaYtLgz_mlh3Vd9C5nM-YrNDMQrwuhe67RKg Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1074dc867789416584fd4119a4499a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1074dc867789416584fd4119a4499a9d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7870fa1d07c941288e13198d5de86c56 Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1781664902", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1781664902', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452'}}} Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:23:44.270043 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b4ee263-fa06-4a74-94cf-1e7d4c1b818b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.378318 Sep 08 10:23:44.275894 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1163/2508] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:23:43 2022] POST /compute/v2.1/servers => generated 110 bytes in 380 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:44.279142 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c509ba16-127b-4e60-8732-b4d004cf8689 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 204 len: 0 microversion: 2.25 time: 0.140240 Sep 08 10:23:44.279142 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1346/2509] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:23:44 2022] DELETE /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:44.280038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6760f780-97ff-4841-a286-d58fc750097a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f235117b820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.282442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Action: 'update', calling method: .version_select at 0x7f23512889d0>, body: {"quota_set": {"ram": 51200}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:44.288235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6760f780-97ff-4841-a286-d58fc750097a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.288715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6760f780-97ff-4841-a286-d58fc750097a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.289149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6760f780-97ff-4841-a286-d58fc750097a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.298715 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6760f780-97ff-4841-a286-d58fc750097a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 200 len: 12 microversion: 2.26 time: 0.024889 Sep 08 10:23:44.299302 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1164/2510] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:44.304833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.305562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.311546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.312029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.312465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.313156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.313608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.314026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.346885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.347947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.348375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.349101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.349546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.349962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.376720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:44.413327 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba135d26-12c9-4290-84df-b510de71ca5b tempest-QuotasAdminNegativeTest-703949346 tempest-QuotasAdminNegativeTest-703949346-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 200 len: 329 microversion: 2.1 time: 0.134501 Sep 08 10:23:44.421573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1347/2511] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:44 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:44.421573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23517135e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.430377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.430857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.431290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.431919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.437741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.438221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.438662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.439416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.439901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.440867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.460861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.463080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.463652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.464097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.469063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.470496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.471691 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ced2b5a7-714d-4de4-a595-a14596512e6a tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1549 microversion: 2.25 time: 0.171411 Sep 08 10:23:44.472242 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1165/2512] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:44.476476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.476617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af5460bc-ad7c-4ed1-a6d6-f34f4c8f4f0b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Action: 'update', calling method: .version_select at 0x7f235140b700>, body: {"quota_set": {"ram": 0}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:44.481427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af5460bc-ad7c-4ed1-a6d6-f34f4c8f4f0b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7870fa1d07c941288e13198d5de86c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1074dc867789416584fd4119a4499a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af5460bc-ad7c-4ed1-a6d6-f34f4c8f4f0b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Request method failure captured: Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d HTTP/1.1 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 25 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcKnvfFQbLgXT1efuSQnMlZgbjl8QhFGoWut1LTaPzsjWX7fn4mIn-cdBxmaKFghPAw1iI-w53wDIfhZrEkUm-pkzI9YKhXZISIy4fIvByQmx9jM8hSfSDMBpeIj45c_muCrHcpggPxxaYtLgz_mlh3Vd9C5nM-YrNDMQrwuhe67RKg Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1074dc867789416584fd4119a4499a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1074dc867789416584fd4119a4499a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1074dc867789416584fd4119a4499a9d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1074dc867789416584fd4119a4499a9d Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-453988489 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7870fa1d07c941288e13198d5de86c56 Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-QuotasAdminNegativeTest-453988489-project Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: {"quota_set": {"ram": 0}} Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1074dc867789416584fd4119a4499a9d', 'body': {'quota_set': {'ram': 0}}} Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:23:44.491631 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 10:23:44.496184 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:44.497027 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35eb0bd8-911e-416e-ac3b-0b4a7f38cab3 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 204 len: 0 microversion: 2.26 time: 0.076799 Sep 08 10:23:44.497120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af5460bc-ad7c-4ed1-a6d6-f34f4c8f4f0b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:44.497208 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1348/2513] 10.222.0.59 () {60 vars in 1295 bytes} [Thu Sep 8 10:23:44 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:44.497311 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af5460bc-ad7c-4ed1-a6d6-f34f4c8f4f0b tempest-QuotasAdminNegativeTest-453988489 tempest-QuotasAdminNegativeTest-453988489-project] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d" status: 403 len: 116 microversion: 2.1 time: 0.020024 Sep 08 10:23:44.497311 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1166/2514] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:23:44 2022] PUT /compute/v2.1/os-quota-sets/1074dc867789416584fd4119a4499a9d => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:44.503747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f235114c3a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.514602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.515101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.515575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.516057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.522760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.523285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.523783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.524467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.524912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.525332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.543091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.543845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.551768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.552477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.552808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.560770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.561258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.561696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.569083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.569659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.570058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.570709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.571180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.571660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.574787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:44.604277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.625380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3dd2a1f2-05f7-45c8-8232-dbad327d22c9 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1224021320" status: 201 len: 0 microversion: 2.26 time: 0.124786 Sep 08 10:23:44.627569 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1349/2515] 10.222.0.59 () {62 vars in 1380 bytes} [Thu Sep 8 10:23:44 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1224021320 => generated 0 bytes in 127 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 08 10:23:44.638327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23511a38b0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.649191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.649669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.650100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.650571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.656374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.656845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.657594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.658273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.658725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.659144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.688876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.689498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.689942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.700153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.700631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.701064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.722073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.729377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.730800 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-374a473f-ee31-4e09-afa9-2967c0378808 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.191549 Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1167/2516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.749670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.750776 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb30c3e3-a512-424b-8886-e9654affa7e2 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1676545240" status: 201 len: 0 microversion: 2.26 time: 0.117610 Sep 08 10:23:44.751634 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1350/2517] 10.222.0.59 () {62 vars in 1380 bytes} [Thu Sep 8 10:23:44 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1676545240 => generated 0 bytes in 120 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 08 10:23:44.762193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f235140d430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.770126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.770611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.771086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.771579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.777242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.778207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.778647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.779339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.779824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.780258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.803447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.803961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.804397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.820209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.839956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7088d0f-9a84-42ce-9d95-cdb19591b922 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 204 len: 0 microversion: 2.26 time: 0.082726 Sep 08 10:23:44.841047 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1351/2518] 10.222.0.59 () {60 vars in 1295 bytes} [Thu Sep 8 10:23:44 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:23:44.850811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78776a93-ea04-4ac6-b9e3-3c8cf0e5abfc tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23511a9040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.859677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78776a93-ea04-4ac6-b9e3-3c8cf0e5abfc tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.860396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78776a93-ea04-4ac6-b9e3-3c8cf0e5abfc tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.861244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78776a93-ea04-4ac6-b9e3-3c8cf0e5abfc tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.871604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78776a93-ea04-4ac6-b9e3-3c8cf0e5abfc tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 200 len: 12 microversion: 2.26 time: 0.026016 Sep 08 10:23:44.872230 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1352/2519] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:44.884767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f2351282550>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.892786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.893503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.894162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.894947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.902527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.903224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.903865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.905021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.905994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.907069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.911662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:44.931241 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d15a77c7-0d8b-43f0-b0a9-1cc4ce1a371a tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1667 microversion: 2.1 time: 0.188228 Sep 08 10:23:44.941271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.942880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.943965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.949500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1168/2520] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1667 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:44.959302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:44.959551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:44.962109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:44.971787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.972366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.973226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:44.974294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:44.974809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:44.975922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.001046 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bae315f8-70e7-4611-aa65-30c9a179d757 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 204 len: 0 microversion: 2.26 time: 0.120246 Sep 08 10:23:45.002616 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1353/2521] 10.222.0.59 () {60 vars in 1295 bytes} [Thu Sep 8 10:23:44 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:23:45.013158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f23518231f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.025062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.026026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.026746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.027512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.034432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.035039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.035854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.036589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.037209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.037647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.069305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.072323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.072323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.083983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.084635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.085172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.110280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:45.128506 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-70699d78-be64-440a-8af7-c0244a6f4e41 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-595262579" status: 201 len: 0 microversion: 2.26 time: 0.119798 Sep 08 10:23:45.131692 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1354/2522] 10.222.0.59 () {62 vars in 1377 bytes} [Thu Sep 8 10:23:45 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-595262579 => generated 0 bytes in 124 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 08 10:23:45.143887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f235110bca0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.155202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.155737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.156184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.156656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.163579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.164077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.164515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.165218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.165974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.166098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.194662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.195160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.195646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.205744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.206226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.206667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.210244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=4,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:45.237952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:45.256472 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b7d494e-a0fd-4361-9ab4-3474ff9292f8 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1092338753" status: 201 len: 0 microversion: 2.26 time: 0.117370 Sep 08 10:23:45.257488 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1355/2523] 10.222.0.59 () {62 vars in 1380 bytes} [Thu Sep 8 10:23:45 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags/tempest-tag-1092338753 => generated 0 bytes in 119 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 10:23:45.269528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.274186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.281110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.281926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.282420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.283833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.284533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.285044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.328561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.329051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.329492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.329947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lazy-loading 'fault' on Instance uuid bea1c0d3-f5f6-4f97-97cd-360fe2947558 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:45.354401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:45.364317 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b6ce0e9-7bd0-4fb6-a166-1b0ebedecada tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1318 microversion: 2.1 time: 0.413044 Sep 08 10:23:45.365576 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1169/2524] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:44 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:45.370754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Action: 'update_all', calling method: .version_select at 0x7f2351390160>, body: {"tags": ["tempest-tag-778121992", "tempest-tag-1517339306"]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:45.382245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.382779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.383220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.383759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.393800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.394617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.395251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.396511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.397215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.397874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.416165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b792020285b49f4a67a2eb5a74e3824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f8699f1cf44af92b4a93458fb7a8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:45.431712 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e56fd96-887f-46d8-8aee-47364a2b8061 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 200 len: 1308 microversion: 2.1 time: 0.165117 Sep 08 10:23:45.432356 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1356/2525] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:45 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:45.441668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.442583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.443262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.465937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:45.484576 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10c71dcb-bfdb-46c6-a401-62b4ef582ef4 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 200 len: 61 microversion: 2.26 time: 0.117862 Sep 08 10:23:45.485549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1170/2526] 10.222.0.59 () {62 vars in 1312 bytes} [Thu Sep 8 10:23:45 2022] PUT /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 61 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:45.500980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-92d2d8b2-8100-456c-89fc-c86d983fc31a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f2351290d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.501443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.502307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.511229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.512298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.513675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.515199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.516117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.518041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.520773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d2d8b2-8100-456c-89fc-c86d983fc31a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.523680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d2d8b2-8100-456c-89fc-c86d983fc31a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.527408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92d2d8b2-8100-456c-89fc-c86d983fc31a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.541778 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-92d2d8b2-8100-456c-89fc-c86d983fc31a tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 200 len: 61 microversion: 2.26 time: 0.049145 Sep 08 10:23:45.543091 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1357/2527] 10.222.0.59 () {60 vars in 1292 bytes} [Thu Sep 8 10:23:45 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 61 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:45.553485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '.version_select at 0x7f2351086280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.562830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.563402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.563985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.564778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.573230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.573872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.574386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.575169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.575748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.576252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.599713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.600341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.601035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.615780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lazy-loading 'flavor' on Instance uuid 44a55553-afc6-447d-9c45-fc7e0119e91c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:45.632907 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93c87ab9-6d20-41dc-ba31-7d9a39734157 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags" status: 204 len: 0 microversion: 2.26 time: 0.084044 Sep 08 10:23:45.633769 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1358/2528] 10.222.0.59 () {60 vars in 1295 bytes} [Thu Sep 8 10:23:45 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c/tags => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 10:23:45.642824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.643329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.650230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.650680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.651499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.651900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.652359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.652791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.681664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:45.775091 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d89869bf-7397-4ef1-9683-86fc2d70b347 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 204 len: 0 microversion: 2.26 time: 0.135873 Sep 08 10:23:45.778171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1359/2529] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:23:45 2022] DELETE /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:45.784903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:45.786412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:45.793814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.794565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.795198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:45.796113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:45.796848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:45.797452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.296366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.306719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.308088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.309474 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af1f3986-9400-4766-86a4-5431dfe8a972 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 200 len: 1549 microversion: 2.25 time: 0.814877 Sep 08 10:23:46.310041 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1171/2530] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:45 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 1549 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:46.314629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:46.315425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:46.322847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.323334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.323804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.324507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.324952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.325371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.367979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.378309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4798a238-772c-4e63-a65b-9d400ebf35a4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.598330 Sep 08 10:23:46.387535 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1360/2531] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:45 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:46.547537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-72be72e5-308d-4baa-a687-d75446ed5e0e req-8475ce00-293b-4520-b174-d590aa79c358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea32bd39-e3a8-4d12-bcb9-755de5068631", "name": "network-vif-deleted", "tag": "55482318-61d3-45e3-b82f-fe0ec7626732"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:46.558614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-72be72e5-308d-4baa-a687-d75446ed5e0e req-8475ce00-293b-4520-b174-d590aa79c358 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.559322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-72be72e5-308d-4baa-a687-d75446ed5e0e req-8475ce00-293b-4520-b174-d590aa79c358 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.559891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-72be72e5-308d-4baa-a687-d75446ed5e0e req-8475ce00-293b-4520-b174-d590aa79c358 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.573596 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-72be72e5-308d-4baa-a687-d75446ed5e0e req-8475ce00-293b-4520-b174-d590aa79c358 service nova] Creating event network-vif-deleted:55482318-61d3-45e3-b82f-fe0ec7626732 for instance ea32bd39-e3a8-4d12-bcb9-755de5068631 on n-h1-833090-19 Sep 08 10:23:46.579269 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-72be72e5-308d-4baa-a687-d75446ed5e0e req-8475ce00-293b-4520-b174-d590aa79c358 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198054 Sep 08 10:23:46.579449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.580218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1361/2532] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:46.586738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:46.587927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:46.592504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.595298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.595838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.596849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.597356 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da40fdd8-eaef-4523-974d-04032ae922d6 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1552 microversion: 2.26 time: 0.286054 Sep 08 10:23:46.597702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.603529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.603529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.603529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.605039 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1172/2533] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:46 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1552 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:46.624448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:46.633643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:46.646718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.647480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.650014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.651569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.652848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.654833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.718762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcd2d7fa8fc48c3a9fe978d34455c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3573779db74b412a84142504d7eadba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:46.727742 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16d3b05b-78eb-4378-aa26-5b66bece5447 tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 200 len: 1599 microversion: 2.1 time: 0.146162 Sep 08 10:23:46.744762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1362/2534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:46 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:46.746571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:46.746571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] [instance: bea1c0d3-f5f6-4f97-97cd-360fe2947558] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:46.752739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.753498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.754101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.755325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:46.755972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:46.756611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:46.772707 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] HTTP exception thrown: Instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 could not be found. Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Request method failure captured: Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 HTTP/1.1 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcHr5st5biyn47TgPUpipqG0JvbX0Hel50XX9RQFLQavA0_JiIBzc4lsOfjOZVdv5E0v9jvGbJMpCSbFsefPVzaRYwRDHSXTRWLtAjqWrFm3uY1glXa-ISba9rUKdRJ3cFY_Myl7LIbPGVUlZ6JuKMnVE7uhEI1rtNaeRCcVVKH3Vlg Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 6f9f8699f1cf44af92b4a93458fb7a8f Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListImageFiltersTestJSON-1802813307 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6f9f8699f1cf44af92b4a93458fb7a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6f9f8699f1cf44af92b4a93458fb7a8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6f9f8699f1cf44af92b4a93458fb7a8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6f9f8699f1cf44af92b4a93458fb7a8f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListImageFiltersTestJSON-1802813307 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 6f9f8699f1cf44af92b4a93458fb7a8f Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1802813307 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListImageFiltersTestJSON-1802813307-project Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 8b792020285b49f4a67a2eb5a74e3824 Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListImageFiltersTestJSON-1802813307-project Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 could not be found. Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bea1c0d3-f5f6-4f97-97cd-360fe2947558'} Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 could not be found. Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 could not be found. Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:46.774905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 could not be found. Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Returning 404 to user: Instance bea1c0d3-f5f6-4f97-97cd-360fe2947558 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b504362a-7bb3-4027-bcea-aa309246acd5 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558" status: 404 len: 111 microversion: 2.1 time: 0.035272 Sep 08 10:23:46.781685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1363/2535] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:46 2022] GET /compute/v2.1/servers/bea1c0d3-f5f6-4f97-97cd-360fe2947558 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:46.789265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df494ad7-4068-45ad-8f9e-51b823dfaf84 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235110ad30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:47.025924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:47.041695 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4598e04a-d588-4f65-8c20-3a07478a8cb9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1468 microversion: 2.1 time: 0.435190 Sep 08 10:23:47.043721 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1173/2536] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:46 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:47.078390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:47.081046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:47.091441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.092258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.092716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.093803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.094263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.094682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.458035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:47.478341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cf6cb405-5dcf-486e-b1b1-c35eebbb79de tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 200 len: 1468 microversion: 2.1 time: 0.410170 Sep 08 10:23:47.482607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1174/2537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:47 2022] GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 1468 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:47.496659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:47.499037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: ea32bd39-e3a8-4d12-bcb9-755de5068631] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:47.516295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.516424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.517185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.518820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.519516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.520185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.557430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] HTTP exception thrown: Instance ea32bd39-e3a8-4d12-bcb9-755de5068631 could not be found. Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Request method failure captured: Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 HTTP/1.1 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBvZt7-B03FwdtfDbr9ueTW_DCG5FZYsBVHUxEzNFvzce3wGHf30oIC1uvB7V84U64CuJAwRO5CNnGbt515SPCXgX__cYk2duhnDsFukltFG05uPwMeeJ9NaotDz1yZSv9sIuiqwo-xFrIDLk7xUS60FSrODAMu5GsujUwNOheLb4U Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7fcb031b760e4b5fbdcc1adb626aa462", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 448b7c1cb3eb4b63a427a3d7b7d6eb13 Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance ea32bd39-e3a8-4d12-bcb9-755de5068631 could not be found. Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ea32bd39-e3a8-4d12-bcb9-755de5068631'} Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea32bd39-e3a8-4d12-bcb9-755de5068631 could not be found. Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea32bd39-e3a8-4d12-bcb9-755de5068631 could not be found. Sep 08 10:23:47.559009 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea32bd39-e3a8-4d12-bcb9-755de5068631 could not be found. Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Returning 404 to user: Instance ea32bd39-e3a8-4d12-bcb9-755de5068631 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:47.562358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-44d88c7f-42cc-422e-9d85-0957fa5057a8 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631" status: 404 len: 111 microversion: 2.25 time: 0.076761 Sep 08 10:23:47.564823 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1175/2538] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:47 2022] GET /compute/v2.1/servers/ea32bd39-e3a8-4d12-bcb9-755de5068631 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:23:47.585326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:47.586636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:47.602731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.603227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.603693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.604399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.605775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.606352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.615658 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df494ad7-4068-45ad-8f9e-51b823dfaf84 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/images/f7f10891-fa47-4cc2-9bf8-dde482dde96e" status: 204 len: 0 microversion: 2.1 time: 0.834323 Sep 08 10:23:47.619389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1364/2539] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:46 2022] DELETE /compute/v2.1/images/f7f10891-fa47-4cc2-9bf8-dde482dde96e => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:47.624231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-77519c4d-49e8-4ad5-8923-be3d31aba800 req-9101ebcb-a042-4421-a0c7-c13a19ecb039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d31be5-96cc-4468-9c82-33a9b53c2223", "name": "network-vif-deleted", "tag": "4571da7a-d97e-4d3d-83d3-023c7006e107"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:47.654863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-77519c4d-49e8-4ad5-8923-be3d31aba800 req-9101ebcb-a042-4421-a0c7-c13a19ecb039 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.659740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-77519c4d-49e8-4ad5-8923-be3d31aba800 req-9101ebcb-a042-4421-a0c7-c13a19ecb039 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.660685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-77519c4d-49e8-4ad5-8923-be3d31aba800 req-9101ebcb-a042-4421-a0c7-c13a19ecb039 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.679629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-77519c4d-49e8-4ad5-8923-be3d31aba800 req-9101ebcb-a042-4421-a0c7-c13a19ecb039 service nova] Creating event network-vif-deleted:4571da7a-d97e-4d3d-83d3-023c7006e107 for instance f0d31be5-96cc-4468-9c82-33a9b53c2223 on n-h1-833090-19 Sep 08 10:23:47.685910 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-77519c4d-49e8-4ad5-8923-be3d31aba800 req-9101ebcb-a042-4421-a0c7-c13a19ecb039 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065108 Sep 08 10:23:47.686926 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1365/2540] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:47.694027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:47.699912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:47.701336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Searching by: {'reservation_id': 'r-zycuq3r5', 'deleted': False, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:23:47.707833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.718395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.722959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.724538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.725285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.725967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.785798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:47.788162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=15 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:47.807826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5f67ac8-0149-47ff-9604-441ca3417904 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.238652 Sep 08 10:23:47.808473 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1176/2541] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:47 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:47.820626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:47.821915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:47.835688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.836631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.837284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.838184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.843849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.844094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:23:47.844539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:47.917371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:23:47.928441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:47.935358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:47.935876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:47.936319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:48.058862 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23dd32af-3173-4c89-ba71-d348167c83c3 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "DELETE /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 204 len: 0 microversion: 2.25 time: 0.245198 Sep 08 10:23:48.061883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1177/2542] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:23:47 2022] DELETE /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:23:48.076383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8592d98a-7313-4e3b-a807-a2591879d9f1 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f23511e25e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:48.224488 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8edb5d80-987e-42ca-b6c0-7f7fb31e403c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?reservation_id=r-zycuq3r5" status: 200 len: 2929 microversion: 2.1 time: 0.535933 Sep 08 10:23:48.225338 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1366/2543] 10.222.0.59 () {58 vars in 1197 bytes} [Thu Sep 8 10:23:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-zycuq3r5 => generated 2929 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:48.230353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:48.231364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:48.244437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:48.248375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:48.251995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:48.253007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:48.253711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:48.254364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:48.487549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:48.499519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:48.501858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0952ab80be6945a3b1a2e522f305a496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5db21064454e6284601ca78e59d689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:48.506588 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7480de66-bc86-4a9e-bd9a-fb79d7817c35 tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 200 len: 1552 microversion: 2.26 time: 0.277803 Sep 08 10:23:48.524118 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1367/2544] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:48 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 1552 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:48.537724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:48.538712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] [instance: f0d31be5-96cc-4468-9c82-33a9b53c2223] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:48.559270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:48.559794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:48.560252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:48.560957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:48.561411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:48.583235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:48.602421 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] HTTP exception thrown: Instance f0d31be5-96cc-4468-9c82-33a9b53c2223 could not be found. Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Request method failure captured: Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 HTTP/1.1 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcJptgvFI3f7PiKDFUEUQTQ2mPgetXaUQfTvlttidAjHG4ua2581_mshuR6soOomOfHJr6EQrVQW_eGRA_KTVyJbcC_i3czY22_hJpE0wx_CFeVSQHoYw5DkVcbdV3TRM73pfMj2NJq2LjJIPwy1ngodIxTXPf99Qq8eiYqgNOk3rmM Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3573779db74b412a84142504d7eadba9 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestFqdnHostnames-787674136 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3573779db74b412a84142504d7eadba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3573779db74b412a84142504d7eadba9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3573779db74b412a84142504d7eadba9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3573779db74b412a84142504d7eadba9", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestFqdnHostnames-787674136 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3573779db74b412a84142504d7eadba9 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-787674136 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestFqdnHostnames-787674136-project Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 8dcd2d7fa8fc48c3a9fe978d34455c32 Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestFqdnHostnames-787674136-project Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f0d31be5-96cc-4468-9c82-33a9b53c2223 could not be found. Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f0d31be5-96cc-4468-9c82-33a9b53c2223'} Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d31be5-96cc-4468-9c82-33a9b53c2223 could not be found. Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d31be5-96cc-4468-9c82-33a9b53c2223 could not be found. Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:48.618933 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d31be5-96cc-4468-9c82-33a9b53c2223 could not be found. Sep 08 10:23:48.624035 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:23:48.635139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Returning 404 to user: Instance f0d31be5-96cc-4468-9c82-33a9b53c2223 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:48.636304 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f5f49c3-f02c-4769-a138-c72080f3573c tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223" status: 404 len: 111 microversion: 2.1 time: 0.116389 Sep 08 10:23:48.638005 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1368/2545] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:48 2022] GET /compute/v2.1/servers/f0d31be5-96cc-4468-9c82-33a9b53c2223 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:23:48.675940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:48.676804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:48.695967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:48.696415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:48.696844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:48.704155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:48.704688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:48.705135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.031259 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8592d98a-7313-4e3b-a807-a2591879d9f1 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/images/91a72a2b-38ad-4908-a049-722d21d30b22" status: 204 len: 0 microversion: 2.1 time: 0.966990 Sep 08 10:23:49.032505 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1178/2546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:48 2022] DELETE /compute/v2.1/images/91a72a2b-38ad-4908-a049-722d21d30b22 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:49.053361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb08596f-a19f-45ee-94d5-32eea5fe6d9e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.109485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.server_groups [None req-bb08596f-a19f-45ee-94d5-32eea5fe6d9e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Querying cell 52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) for 2 instances {{(pid=122456) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:23:49.119579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb08596f-a19f-45ee-94d5-32eea5fe6d9e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.121154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb08596f-a19f-45ee-94d5-32eea5fe6d9e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.125959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb08596f-a19f-45ee-94d5-32eea5fe6d9e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.133175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:49.146856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:49.154872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:49.158300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5324f8c4-8503-4ce7-a95b-956545e43135 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1564 microversion: 2.25 time: 0.512283 Sep 08 10:23:49.160604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1369/2547] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:48 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1564 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:49.169505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-684c9dae-1965-4d5d-bcb2-1cedb755d53f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] Calling method '.version_select at 0x7f23510d4940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.193509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb08596f-a19f-45ee-94d5-32eea5fe6d9e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/a54b9ff8-9c36-4c06-b48d-dc8006ff95ee" status: 200 len: 266 microversion: 2.1 time: 0.159182 Sep 08 10:23:49.194109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1179/2548] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:23:49 2022] GET /compute/v2.1/os-server-groups/a54b9ff8-9c36-4c06-b48d-dc8006ff95ee => generated 266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:49.211048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:49.221990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.225900 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-684c9dae-1965-4d5d-bcb2-1cedb755d53f tempest-ServersTestFqdnHostnames-787674136 tempest-ServersTestFqdnHostnames-787674136-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319582988" status: 202 len: 0 microversion: 2.1 time: 0.063858 Sep 08 10:23:49.226072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:49.228603 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1370/2549] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319582988 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:23:49.244770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16db37fb-4a71-44f5-b403-464602c79980 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] Calling method '.version_select at 0x7f235110a670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.245001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.245305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.245760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.246506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.246970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.247402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.499844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:49.509364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2cb8ea0d-dea8-47ee-a74f-0e8d1c78450f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.297953 Sep 08 10:23:49.509894 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1180/2550] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:49 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:49.522319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.523152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:49.529883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.530992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.531577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.532455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.533161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.533702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.755949 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16db37fb-4a71-44f5-b403-464602c79980 tempest-ListImageFiltersTestJSON-1802813307 tempest-ListImageFiltersTestJSON-1802813307-project] 10.222.0.59 "DELETE /compute/v2.1/images/9013a880-2048-4f70-98dc-4ff6ab2a3331" status: 204 len: 0 microversion: 2.1 time: 0.515479 Sep 08 10:23:49.757055 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1371/2551] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:49 2022] DELETE /compute/v2.1/images/9013a880-2048-4f70-98dc-4ff6ab2a3331 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:23:49.820779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd2ce4d3-dbe8-402c-8a29-b8ad45fa1287 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 200 len: 1621 microversion: 2.1 time: 0.304515 Sep 08 10:23:49.821406 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1181/2552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:49 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 1621 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:49.826459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.827395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] [instance: 44a55553-afc6-447d-9c45-fc7e0119e91c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:49.841360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.842114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.842765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.853875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.854562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.855177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.875791 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] HTTP exception thrown: Instance 44a55553-afc6-447d-9c45-fc7e0119e91c could not be found. Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Request method failure captured: Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c HTTP/1.1 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcKP9bJcOgzxDQCyVO23xi_hMtFXAfWlId-jniRLua3UcE9LsD8QfGBzrgcQYLTBp7WQSURLBj7WfRIxweIjs4T59qfKxsosL1pkMupoIkb5TMIGCx5ZG1W5-gywl9AkCr5YhEKmcR1sTPgVotIZBifNevS4XS_eLqwl1XqNp5Un-5Y Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.26 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: ea5db21064454e6284601ca78e59d689 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerTagsTestJSON-672299760 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ea5db21064454e6284601ca78e59d689"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ea5db21064454e6284601ca78e59d689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ea5db21064454e6284601ca78e59d689"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ea5db21064454e6284601ca78e59d689", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerTagsTestJSON-672299760 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: ea5db21064454e6284601ca78e59d689 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerTagsTestJSON-672299760 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerTagsTestJSON-672299760-project Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0952ab80be6945a3b1a2e522f305a496 Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerTagsTestJSON-672299760-project Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 44a55553-afc6-447d-9c45-fc7e0119e91c could not be found. Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '44a55553-afc6-447d-9c45-fc7e0119e91c'} Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a55553-afc6-447d-9c45-fc7e0119e91c could not be found. Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a55553-afc6-447d-9c45-fc7e0119e91c could not be found. Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:49.883672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a55553-afc6-447d-9c45-fc7e0119e91c could not be found. Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:49.888130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] Returning 404 to user: Instance 44a55553-afc6-447d-9c45-fc7e0119e91c could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:49.889051 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09bd6b0c-4fae-4376-bb61-4226e15d9eff tempest-ServerTagsTestJSON-672299760 tempest-ServerTagsTestJSON-672299760-project] 10.222.0.59 "GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c" status: 404 len: 111 microversion: 2.26 time: 0.066027 Sep 08 10:23:49.892368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1182/2553] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:49 2022] GET /compute/v2.1/servers/44a55553-afc6-447d-9c45-fc7e0119e91c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:23:49.901272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b924bb22-2ebc-47a3-9afa-eb954e982120 req-134bc312-0407-4af1-b833-86cfa131e204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a55553-afc6-447d-9c45-fc7e0119e91c", "name": "network-vif-deleted", "tag": "3d8c788c-2474-4943-b9be-bd722b2437d8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:49.927987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b924bb22-2ebc-47a3-9afa-eb954e982120 req-134bc312-0407-4af1-b833-86cfa131e204 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.928473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b924bb22-2ebc-47a3-9afa-eb954e982120 req-134bc312-0407-4af1-b833-86cfa131e204 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.928907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b924bb22-2ebc-47a3-9afa-eb954e982120 req-134bc312-0407-4af1-b833-86cfa131e204 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.944233 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b924bb22-2ebc-47a3-9afa-eb954e982120 req-134bc312-0407-4af1-b833-86cfa131e204 service nova] Creating event network-vif-deleted:3d8c788c-2474-4943-b9be-bd722b2437d8 for instance 44a55553-afc6-447d-9c45-fc7e0119e91c on n-h2-833090-19 Sep 08 10:23:49.949628 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b924bb22-2ebc-47a3-9afa-eb954e982120 req-134bc312-0407-4af1-b833-86cfa131e204 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055899 Sep 08 10:23:49.950244 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1183/2554] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:49.955592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:49.956294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:49.963450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.964210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.964807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.965706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:49.966308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:49.966946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:49.989478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:50.038910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7d5c58c5-2e79-4aee-952e-4bf33c99ac90 tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] Action: 'create', calling method: .version_select at 0x7f23554abca0>, body: {"security_group": {"name": "tempest-securitygroup-663281282", "description": "tempest-description-54069846"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:50.247272 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b2bebba-93eb-42e9-a09c-2e854c7dc2ef tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 200 len: 1621 microversion: 2.1 time: 0.295712 Sep 08 10:23:50.248637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1184/2555] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:49 2022] GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 1621 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:50.254598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:50.257194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:50.266519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:50.267356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:50.268053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:50.269241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:50.270361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:50.270864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:50.414465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:50.424312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:50.426305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:50.428472 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-43e58b40-7cfb-47b2-a9f5-0b2113b21bac tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1346 microversion: 2.25 time: 0.178148 Sep 08 10:23:50.429658 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1185/2556] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:50 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1346 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:50.435978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0317df5c-59fb-40b6-ba23-6edf42ad032c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: .version_select at 0x7f235117be50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-839386824", "policies": ["anti-affinity"]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:50.462471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=55 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:50.472487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0317df5c-59fb-40b6-ba23-6edf42ad032c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:50.483079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0317df5c-59fb-40b6-ba23-6edf42ad032c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:50.512064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:50.596286 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7d5c58c5-2e79-4aee-952e-4bf33c99ac90 tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.837540 Sep 08 10:23:50.597278 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1372/2557] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:23:49 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:50.607130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:50.615598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:50.617250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0317df5c-59fb-40b6-ba23-6edf42ad032c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:50.626440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0317df5c-59fb-40b6-ba23-6edf42ad032c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:50.627728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:50.628592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:50.629455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:50.631345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:50.632095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:50.632859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:50.647263 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0317df5c-59fb-40b6-ba23-6edf42ad032c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.215896 Sep 08 10:23:50.648558 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1186/2558] 10.222.0.59 () {60 vars in 1174 bytes} [Thu Sep 8 10:23:50 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:50.655224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f240b333-6ac5-49fc-bdf7-571a512f158e tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] Action: 'create', calling method: .version_select at 0x7f23511e2790>, body: {"security_group": {"name": "tempest-securitygroup-574009479", "description": "tempest-description-301049760"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:50.920642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:50.953531 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6219ec0e-4fe2-465a-9e1a-ce031b5e4580 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.352849 Sep 08 10:23:50.956507 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f240b333-6ac5-49fc-bdf7-571a512f158e tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.306680 Sep 08 10:23:50.957578 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1187/2559] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:23:50 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:50.970548 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1373/2560] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:50 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:50.971639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1061297585", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d1510f53-ddb4-4761-b9e5-3179c80f85cc"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:51.054683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:51.388325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:23:51.388897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:23:51.389609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:23:51.390221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:23:51.390856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:23:51.407740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:51.408053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-403bd417-c1d1-495b-8849-0428dd300f80 tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Action: 'create', calling method: .version_select at 0x7f23554ab550>, body: {"security_group": {"name": "tempest-securitygroup-2143058637", "description": "tempest-description-446838634"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:51.408746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:51.409328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:51.410207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:51.410815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:51.411401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:51.446938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:51.457459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:51.478878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Going to run 2 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:23:51.482832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:23:51.604036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122456) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 08 10:23:51.688273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:51.712957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:51.760661 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-403bd417-c1d1-495b-8849-0428dd300f80 tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.788522 Sep 08 10:23:51.762015 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1374/2561] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:23:50 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:51.767390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:51.768447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:51.785695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:51.787077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:51.787234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:51.787949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:51.798856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:51.799403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:51.842367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:51.849697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:51.868261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:23:51.870037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:51.870535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:51.870998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:51.871425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lazy-loading 'fault' on Instance uuid abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:23:51.924614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:51.930717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:51.954742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:51.957000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '448b7c1cb3eb4b63a427a3d7b7d6eb13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcb031b760e4b5fbdcc1adb626aa462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:51.959768 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e87de8a2-ad79-42cd-b420-5688e899bc46 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 200 len: 1351 microversion: 2.25 time: 0.195391 Sep 08 10:23:51.961146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1375/2562] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:51 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 1351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:23:51.982797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-398fb854-b65e-4556-bbc5-bbf19d3b5974 tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Action: 'create', calling method: .version_select at 0x7f235110b940>, body: {"security_group": {"name": "tempest-securitygroup-1401614896", "description": "tempest-description-958851449"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:51.986976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:51.994324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:52.049021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:52.060068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:52.109975 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a95acab-3d25-4664-8521-4436b60a5990 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.150941 Sep 08 10:23:52.110849 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1188/2563] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:23:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 1152 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:23:52.115993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-45a911f4-914e-41e0-893d-ac01d9eb16e7 req-b9e986ed-aa18-4436-9999-ec186e04d89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a", "name": "network-vif-deleted", "tag": "001f665d-26c6-43c2-8aa9-ae7333f08bcb"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:52.126152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-45a911f4-914e-41e0-893d-ac01d9eb16e7 req-b9e986ed-aa18-4436-9999-ec186e04d89c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.126636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-45a911f4-914e-41e0-893d-ac01d9eb16e7 req-b9e986ed-aa18-4436-9999-ec186e04d89c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.127061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-45a911f4-914e-41e0-893d-ac01d9eb16e7 req-b9e986ed-aa18-4436-9999-ec186e04d89c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.139840 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-45a911f4-914e-41e0-893d-ac01d9eb16e7 req-b9e986ed-aa18-4436-9999-ec186e04d89c service nova] Creating event network-vif-deleted:001f665d-26c6-43c2-8aa9-ae7333f08bcb for instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a on n-h2-833090-19 Sep 08 10:23:52.144910 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-45a911f4-914e-41e0-893d-ac01d9eb16e7 req-b9e986ed-aa18-4436-9999-ec186e04d89c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Sep 08 10:23:52.145841 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1189/2564] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:52.151054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:52.151808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:52.158380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.158870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.159422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.160395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.160934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.161363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.207037 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-398fb854-b65e-4556-bbc5-bbf19d3b5974 tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.244062 Sep 08 10:23:52.207754 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1376/2565] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:23:51 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:52.347582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:52.358225 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-796f102c-ba93-4d3b-a106-f6530ee9f794 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.211157 Sep 08 10:23:52.371731 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1190/2566] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:52 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:52.371731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:52.376139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:52.376139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Searching by: {'deleted': False, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:23:52.387728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Calling method '.version_select at 0x7f23554ab0d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:52.399792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.400585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.401217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.402172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.402806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.403623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.406102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.406580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.407027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.407799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:52.408254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:52.408700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:52.428702 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db0ed1a8-223f-49a8-a1d1-c4083d0cb605 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] 10.222.0.59 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.211638 Sep 08 10:23:52.429916 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1377/2567] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Sep 8 10:23:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:52.436122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Calling method '.version_select at 0x7f235110a5e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:52.455435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:23:52.529081 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bafd6a77-be25-474b-8959-b2d814ec59c8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.169159 Sep 08 10:23:52.530300 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1191/2568] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:23:52 2022] GET /compute/v2.1/servers => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:52.545265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-751810937", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:52.678770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:23:53.220511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Getting quotas for project 9d727df846d94565927b6732ac3334be. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:23:53.228430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:23:53.235609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Getting quotas for user 8e1750ca154d4d60aa9049dbea97cb44 and project 9d727df846d94565927b6732ac3334be. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:23:53.252086 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Request method failure captured: Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 1751 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcK3Cth9ByE7q22oduIjkdStxx5ZqvoBfwgvLs32sMMr9JFZxwJX6FDLBvXkU0eWb4XCSfAfeoIhnjzWRazcKAh7ente7_OnocvxgfL0eHFfIfEUjXbVOfwz9CGPzrhye-HsrvRY-eyzLfOmiB6x_KijFH1Y4M7Izdq8zrk3GIvGbpA Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9d727df846d94565927b6732ac3334be Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-676522146 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d727df846d94565927b6732ac3334be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d727df846d94565927b6732ac3334be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9d727df846d94565927b6732ac3334be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9d727df846d94565927b6732ac3334be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-676522146 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9d727df846d94565927b6732ac3334be Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-676522146 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-676522146-project Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 8e1750ca154d4d60aa9049dbea97cb44 Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-676522146-project Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-751810937", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:53.254839 n-d-833090-19 devstack@n-api.service[122456]: exception: Maximum number of metadata items exceeds 128 Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-751810937', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:53.257678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:53.260723 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c77745ce-e853-4fe9-a1e3-bc7f8f2d48d9 tempest-AbsoluteLimitsNegativeTestJSON-676522146 tempest-AbsoluteLimitsNegativeTestJSON-676522146-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.726648 Sep 08 10:23:53.265250 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1192/2569] 10.222.0.59 () {60 vars in 1148 bytes} [Thu Sep 8 10:23:52 2022] POST /compute/v2.1/servers => generated 87 bytes in 729 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:23:53.271069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-abf16854-ee25-48db-9e06-02e5f0b08222 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:53.272882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-abf16854-ee25-48db-9e06-02e5f0b08222 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:53.374705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-abf16854-ee25-48db-9e06-02e5f0b08222 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:53.383863 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-abf16854-ee25-48db-9e06-02e5f0b08222 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1219 microversion: 2.1 time: 0.117378 Sep 08 10:23:53.384856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1193/2570] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:53 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:53.402735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:53.406065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] [instance: abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:53.432607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:53.436621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:53.437227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:53.438233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:53.438922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:53.440719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:53.483334 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] HTTP exception thrown: Instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a could not be found. Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Request method failure captured: Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a HTTP/1.1 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcBvZt7-B03FwdtfDbr9ueTW_DCG5FZYsBVHUxEzNFvzce3wGHf30oIC1uvB7V84U64CuJAwRO5CNnGbt515SPCXgX__cYk2duhnDsFukltFG05uPwMeeJ9NaotDz1yZSv9sIuiqwo-xFrIDLk7xUS60FSrODAMu5GsujUwNOheLb4U Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7fcb031b760e4b5fbdcc1adb626aa462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7fcb031b760e4b5fbdcc1adb626aa462", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 7fcb031b760e4b5fbdcc1adb626aa462 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-885377743 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 448b7c1cb3eb4b63a427a3d7b7d6eb13 Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-885377743-project Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a could not be found. Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a'} Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a could not be found. Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a could not be found. Sep 08 10:23:53.487995 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a could not be found. Sep 08 10:23:53.491447 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:23:53.495237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] Returning 404 to user: Instance abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:23:53.497934 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af7497be-b96e-4d74-b1df-f1351f9cf768 tempest-LiveAutoBlockMigrationV225Test-885377743 tempest-LiveAutoBlockMigrationV225Test-885377743-project] 10.222.0.59 "GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a" status: 404 len: 111 microversion: 2.25 time: 0.111850 Sep 08 10:23:53.500480 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1194/2571] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:23:53 2022] GET /compute/v2.1/servers/abd9cd4b-dcac-4a8b-8e8a-91ca2955ca6a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:23:53.527402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:53.528084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:53.556852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:53.557619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:53.558159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:53.558996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:53.561494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:53.561934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:53.886419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:53.898436 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03efe7bb-005b-4aa9-ba67-1c91e309f188 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.390021 Sep 08 10:23:53.902150 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1195/2572] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:53 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:53.949726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cac95c4c-38b6-451a-8640-3aed307286c0 req-84cc0fac-4880-43e3-94c1-9562558666d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f61f7ec-ddbd-41ab-9fde-8da04751631c", "name": "network-vif-plugged", "status": "completed", "tag": "89d823cd-f9c3-4c91-82cf-bdbf64d47398"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:23:53.967603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cac95c4c-38b6-451a-8640-3aed307286c0 req-84cc0fac-4880-43e3-94c1-9562558666d7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:53.968146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cac95c4c-38b6-451a-8640-3aed307286c0 req-84cc0fac-4880-43e3-94c1-9562558666d7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:53.968584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cac95c4c-38b6-451a-8640-3aed307286c0 req-84cc0fac-4880-43e3-94c1-9562558666d7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:53.994177 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cac95c4c-38b6-451a-8640-3aed307286c0 req-84cc0fac-4880-43e3-94c1-9562558666d7 service nova] Creating event network-vif-plugged:89d823cd-f9c3-4c91-82cf-bdbf64d47398 for instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c on n-h2-833090-19 Sep 08 10:23:54.011000 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cac95c4c-38b6-451a-8640-3aed307286c0 req-84cc0fac-4880-43e3-94c1-9562558666d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065443 Sep 08 10:23:54.015673 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1196/2573] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:23:54.414669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:54.415688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:54.437911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:54.445945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:54.447780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:54.449917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:54.452147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:54.452833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:55.397537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:55.412949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1006a4b-1284-481c-ae55-e7d0a2186b20 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1271 microversion: 2.1 time: 1.001353 Sep 08 10:23:55.414871 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1197/2574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:54 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1271 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:55.425266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:55.426391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:55.441877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:55.444830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:55.445519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:55.446463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:55.447203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:55.447866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:56.194952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:56.209288 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14309942-de31-4565-9f6d-b9ca63e20d04 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.792831 Sep 08 10:23:56.210696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1198/2575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:55 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:56.441626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:56.442691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:56.453663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:56.457835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:56.457835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:56.457835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:56.457835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:56.457835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:56.618391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:56.629137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7d34f541-0e42-4d9a-8d20-3fed47d393f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1277 microversion: 2.1 time: 0.192198 Sep 08 10:23:56.630764 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1199/2576] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:56 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:57.240152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:57.240794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:57.262712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:57.263936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:57.266230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:57.268352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:57.270435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:57.271117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:57.957961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:57.976712 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1afa3c1-3dce-4fcd-a9c8-bca257cde5bd tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1293 microversion: 2.1 time: 0.746752 Sep 08 10:23:57.978533 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1200/2577] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:57 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1293 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:57.985782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:57.987062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:57.995340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:57.996769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:57.998144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:57.999321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:58.000968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:58.002256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:58.242254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:58.250711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0400d1d2-131e-4a9a-b08e-bdcec2982cc1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1277 microversion: 2.1 time: 0.270216 Sep 08 10:23:58.268010 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1201/2578] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:57 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:23:59.005575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:59.006772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:59.015074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:59.015837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:59.016424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:59.017481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:59.017950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:59.018378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:59.605359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0ec4e9c-b5bf-4ce1-baa7-96eda1c1c3b9 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:23:59.606063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Neutron security group f0ec4e9c-b5bf-4ce1-baa7-96eda1c1c3b9 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:23:59.606598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.security_groups [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Security Group ID f0ec4e9c-b5bf-4ce1-baa7-96eda1c1c3b9 does not exist {{(pid=122457) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 08 10:23:59.764341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0ec4e9c-b5bf-4ce1-baa7-96eda1c1c3b9 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:23:59.765231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Neutron security group f0ec4e9c-b5bf-4ce1-baa7-96eda1c1c3b9 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:23:59.765888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.security_groups [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Security Group ID f0ec4e9c-b5bf-4ce1-baa7-96eda1c1c3b9 does not exist {{(pid=122457) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 08 10:23:59.768736 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-613d2d80-fd72-4794-9a09-704e7dd0dcae tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] 10.222.0.59 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10468 microversion: 2.1 time: 7.335901 Sep 08 10:23:59.773162 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1378/2579] 10.222.0.59 () {58 vars in 1191 bytes} [Thu Sep 8 10:23:52 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10468 bytes in 7342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:23:59.791846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:59.792442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:23:59.792758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:23:59.802215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:59.803529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:59.804362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:59.805737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:23:59.806774 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b44d5f2b-d159-4ebf-adb8-261deab7481c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1484 microversion: 2.1 time: 0.806386 Sep 08 10:23:59.806939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:23:59.807746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:23:59.809549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1202/2580] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:58 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1484 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:23:59.827230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4fc0763b-e6f3-483f-982a-2933ce5f1c79 tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] Calling method '.version_select at 0x7f23511e2a60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:23:59.997523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:00.015677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80f21a20-d529-4ef5-b702-3beceb6e22d6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1277 microversion: 2.1 time: 0.238940 Sep 08 10:24:00.017359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1379/2581] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:23:59 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:00.024301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:00.025093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:00.041657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:00.042773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:00.043445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:00.044800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:00.045467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:00.046118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:00.458893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0215f80-91d4-40d9-a568-4cbc677be006 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.440141 Sep 08 10:24:00.460974 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1380/2582] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:24:00 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c/os-interface => generated 285 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:01.007259 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4fc0763b-e6f3-483f-982a-2933ce5f1c79 tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1108 microversion: 2.1 time: 1.194444 Sep 08 10:24:01.008885 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1203/2583] 10.222.0.59 () {58 vars in 1191 bytes} [Thu Sep 8 10:23:59 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1108 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:01.023109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fdd54f2b-31f7-4aac-aaa0-ce979846e2d1 tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Calling method '.version_select at 0x7f23510de940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:01.044993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:01.045878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:01.057126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:01.057919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:01.058587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:01.059603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:01.060234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:01.060881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:01.930125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:01.949404 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f343be53-6adc-4e07-bf04-f2681bcfca5a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.908261 Sep 08 10:24:01.951068 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1204/2584] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:01 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:02.400035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:02.416488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:02.975182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fdd54f2b-31f7-4aac-aaa0-ce979846e2d1 tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/3d12fd23-5057-4bac-a336-f14536431f91" status: 202 len: 0 microversion: 2.1 time: 1.956223 Sep 08 10:24:02.982390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:02.983011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:02.983562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1381/2585] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:24:01 2022] DELETE /compute/v2.1/os-security-groups/3d12fd23-5057-4bac-a336-f14536431f91 => generated 0 bytes in 1965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:24:02.993495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a51eccfc-ee96-41be-b057-422026e5e75c tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] Calling method '.version_select at 0x7f23510de160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:02.994086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=16 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:03.018105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:03.019128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:03.019788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:03.021850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:03.022523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:03.025375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:03.383760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=35 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:03.890986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:03.907368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1d3705d-f890-431e-9a1c-140b33521016 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.929732 Sep 08 10:24:03.908735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1205/2586] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:02 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:03.917434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:03.926919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:03.930989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Searching by: {'deleted': False, 'project_id': '0ad840b082bb4751a2d693d109a6b161'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:24:03.941104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:03.942583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:03.943290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:03.956596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:03.957825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:03.958511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.030855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:24:04.103452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-117df55f-c022-4886-90f8-2eb24686fa99 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.193242 Sep 08 10:24:04.115757 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1206/2587] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:24:03 2022] GET /compute/v2.1/servers => generated 339 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:04.396060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a0d9b15a-367c-4862-9d99-427324cc61ff req-bc8a4bd9-a03f-418b-af9f-4e8f1ca9518a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e", "tag": "c24d10b0-7de5-48c3-90aa-54106e29d5d4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:04.409768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a0d9b15a-367c-4862-9d99-427324cc61ff req-bc8a4bd9-a03f-418b-af9f-4e8f1ca9518a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:04.410513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a0d9b15a-367c-4862-9d99-427324cc61ff req-bc8a4bd9-a03f-418b-af9f-4e8f1ca9518a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:04.411319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a0d9b15a-367c-4862-9d99-427324cc61ff req-bc8a4bd9-a03f-418b-af9f-4e8f1ca9518a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.425876 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a0d9b15a-367c-4862-9d99-427324cc61ff req-bc8a4bd9-a03f-418b-af9f-4e8f1ca9518a service nova] Creating event network-changed:c24d10b0-7de5-48c3-90aa-54106e29d5d4 for instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e on n-h2-833090-19 Sep 08 10:24:04.435125 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a0d9b15a-367c-4862-9d99-427324cc61ff req-bc8a4bd9-a03f-418b-af9f-4e8f1ca9518a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317721 Sep 08 10:24:04.436371 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1207/2588] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:04.549823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-678591095", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:04.562230 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a51eccfc-ee96-41be-b057-422026e5e75c tempest-SecurityGroupsTestAdminJSON-534605342 tempest-SecurityGroupsTestAdminJSON-534605342-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5df8118c-8181-47f5-95c2-38058ce73c9f" status: 202 len: 0 microversion: 2.1 time: 1.577340 Sep 08 10:24:04.563037 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1382/2589] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:24:02 2022] DELETE /compute/v2.1/os-security-groups/5df8118c-8181-47f5-95c2-38058ce73c9f => generated 0 bytes in 1579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:24:04.568589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:04.589065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:04.590177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Searching by: {'deleted': False, 'project_id': '0ad840b082bb4751a2d693d109a6b161'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:24:04.608733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:04.613600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:04.620968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.625139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:04.626249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:04.628048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.700621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:24:04.701273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:24:04.703115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:24:04.705693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:24:04.706373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:24:04.706578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:24:04.739313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:04.739953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:04.742560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.743652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:04.744310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:04.745428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.791686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:04.792269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Getting quotas for project 332b4844846d473e9560fecbeb6f6292. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:24:04.809374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Getting quotas for user 952788fcfa2e4799b5f17aac65dea5e1 and project 332b4844846d473e9560fecbeb6f6292. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:24:04.811605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:04.815855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:04.826396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:04.838699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:24:04.841629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:24:04.986841 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b3022a3d-a7ea-45cf-a38d-591298a3a8b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.546479 Sep 08 10:24:04.991305 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1208/2590] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:24:05.009974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:05.011376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:05.032882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:05.033430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:05.033805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:05.034525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:05.034983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:05.035410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:05.067040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:05.415181 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fedf8065-6bd3-487e-b095-40bcfb562b12 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.850824 Sep 08 10:24:05.416210 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1383/2591] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:24:04 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:05.430260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ed7758f2-3358-495d-bf81-9e0dfa6b5f95 req-ddd71a45-51a8-41e0-aa6b-e3ee28188ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f61f7ec-ddbd-41ab-9fde-8da04751631c", "tag": "89d823cd-f9c3-4c91-82cf-bdbf64d47398"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:05.452441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ed7758f2-3358-495d-bf81-9e0dfa6b5f95 req-ddd71a45-51a8-41e0-aa6b-e3ee28188ab4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:05.466709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ed7758f2-3358-495d-bf81-9e0dfa6b5f95 req-ddd71a45-51a8-41e0-aa6b-e3ee28188ab4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:05.469175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ed7758f2-3358-495d-bf81-9e0dfa6b5f95 req-ddd71a45-51a8-41e0-aa6b-e3ee28188ab4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:05.500387 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ed7758f2-3358-495d-bf81-9e0dfa6b5f95 req-ddd71a45-51a8-41e0-aa6b-e3ee28188ab4 service nova] Creating event network-changed:89d823cd-f9c3-4c91-82cf-bdbf64d47398 for instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c on n-h2-833090-19 Sep 08 10:24:05.528143 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ed7758f2-3358-495d-bf81-9e0dfa6b5f95 req-ddd71a45-51a8-41e0-aa6b-e3ee28188ab4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109162 Sep 08 10:24:05.532686 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1384/2592] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:05.551156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45a33d9e-527a-419d-a704-253d4f1ac4fd tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] Calling method '.version_select at 0x7f2355417790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:06.153968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:06.162105 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e7a5528-f134-4ad4-971f-df1e25253abc tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1484 microversion: 2.1 time: 1.167766 Sep 08 10:24:06.172294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1209/2593] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:04 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1484 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:06.199133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:06.200614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:06.213380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:06.213893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:06.214339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:06.215065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:06.220586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:06.221203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:06.594383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:06.607921 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0af8222e-ed0b-4835-91c7-3303fe50b449 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.419132 Sep 08 10:24:06.609114 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1210/2594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:06 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:06.633295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:06.634589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:06.678024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:06.678536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:06.678972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:06.680380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:06.680833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:06.691844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:06.774926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45a33d9e-527a-419d-a704-253d4f1ac4fd tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5b154581-75e1-4b60-8a7a-650997350704" status: 202 len: 0 microversion: 2.1 time: 1.240444 Sep 08 10:24:06.778784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1385/2595] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:24:05 2022] DELETE /compute/v2.1/os-security-groups/5b154581-75e1-4b60-8a7a-650997350704 => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:24:06.783632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c42cd48a-c8cb-459c-8c68-4f899208a937 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:06.799229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c42cd48a-c8cb-459c-8c68-4f899208a937 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021815 Sep 08 10:24:06.804953 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1386/2596] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:24:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:06.817711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c013df1b-9572-48a3-9e6d-56ce4a2ed827 req-b8fcdb22-6d0a-4554-a0f3-d00779108037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94", "tag": "5850860d-7a3d-46a5-8081-db2dee619bc9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:06.844350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:06.859763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:06.860503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c013df1b-9572-48a3-9e6d-56ce4a2ed827 req-b8fcdb22-6d0a-4554-a0f3-d00779108037 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:06.862188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c013df1b-9572-48a3-9e6d-56ce4a2ed827 req-b8fcdb22-6d0a-4554-a0f3-d00779108037 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:06.862641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c013df1b-9572-48a3-9e6d-56ce4a2ed827 req-b8fcdb22-6d0a-4554-a0f3-d00779108037 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:06.868313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:06.874448 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5186f7fc-b51b-43aa-b8ce-a41b394d5047 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1281 microversion: 2.54 time: 0.264066 Sep 08 10:24:06.876458 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1211/2597] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:06 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:06.896026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5bcb8ad5-5365-4ad9-b49a-0c36bd670817 tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] Calling method '.version_select at 0x7f23512c6d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:06.909534 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c013df1b-9572-48a3-9e6d-56ce4a2ed827 req-b8fcdb22-6d0a-4554-a0f3-d00779108037 service nova] Creating event network-changed:5850860d-7a3d-46a5-8081-db2dee619bc9 for instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 on n-h1-833090-19 Sep 08 10:24:06.916829 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c013df1b-9572-48a3-9e6d-56ce4a2ed827 req-b8fcdb22-6d0a-4554-a0f3-d00779108037 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110564 Sep 08 10:24:06.917994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1387/2598] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:07.139452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:07.140078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:07.155749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.162455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.162973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.163761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.166797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.167481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.226962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:24:07.252189 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5bcb8ad5-5365-4ad9-b49a-0c36bd670817 tempest-SecurityGroupsTestAdminJSON-549253992 tempest-SecurityGroupsTestAdminJSON-549253992-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/c937ae19-a10a-4563-a33a-2e3d726dd752" status: 202 len: 0 microversion: 2.1 time: 0.370336 Sep 08 10:24:07.253373 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1212/2599] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:24:06 2022] DELETE /compute/v2.1/os-security-groups/c937ae19-a10a-4563-a33a-2e3d726dd752 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:24:07.385991 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5fe51249-d2e2-4116-87e2-c226982da4ce tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 204 len: 0 microversion: 2.1 time: 0.252214 Sep 08 10:24:07.386598 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1388/2600] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:24:07 2022] DELETE /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:24:07.395960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:07.396589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:07.410312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.410821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.411267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.412018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.412480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.412910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.632298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:07.633328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:07.654402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.654843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.655641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.656556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.657216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.657827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.727059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:07.738305 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f439c72e-b703-48d2-b204-4f1d37e8e019 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1714 microversion: 2.1 time: 0.347184 Sep 08 10:24:07.745830 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1213/2601] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:07 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1714 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:07.915337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:07.915993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:07.933789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.935399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.939723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:07.947615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:07.949278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:07.952821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:08.508905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:08.518360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:08.519922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:08.533937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c91a805-4337-498b-a082-1b5541f51100 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1281 microversion: 2.54 time: 0.617480 Sep 08 10:24:08.534880 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1214/2602] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:07 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1281 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:24:08.687093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:08.699569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3eaeb005-ba8c-4fe5-908b-996ccf904822 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 1.068431 Sep 08 10:24:08.700715 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1389/2603] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:07 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:08.770586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:08.773985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:08.793522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:08.795873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:08.796513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:08.800264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:08.800966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:08.804142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:09.572261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:09.573819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:09.601408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:09.604178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:09.604662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:09.612523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:09.614254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:09.614792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:09.925091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:09.935310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:09.945430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:09.946908 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ced927e6-cd37-4684-a94e-cb1833311840 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1335 microversion: 2.54 time: 0.381694 Sep 08 10:24:09.947961 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1390/2604] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:09 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1335 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:24:09.952724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:09.953343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:09.979169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:09.979705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:09.980155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:09.980886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:09.981356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:09.981788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:10.166062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:10.180603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa85c307-cbf1-4b27-a3a9-ce44ff18680a tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1714 microversion: 2.1 time: 1.412138 Sep 08 10:24:10.181537 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1215/2605] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:08 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1714 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:10.677703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:10.691898 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4712ba3b-aeff-4b58-a73e-639cec26191a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.739861 Sep 08 10:24:10.692795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1391/2606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:09 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:10.978641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:10.979279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:10.989983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:10.990499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:10.990952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:10.991726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:10.992229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:10.993465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:11.176246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:11.185192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:11.186746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:11.187981 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2a1d1bb-c776-4440-b43a-d7c584d37567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1335 microversion: 2.54 time: 0.214113 Sep 08 10:24:11.206008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:11.207805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:11.213924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1216/2607] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:10 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1335 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:11.217248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:11.218228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:11.219005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:11.220294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:11.221042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:11.221692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:11.632437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:11.647851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce8cbb6b-5eb6-4fc7-abeb-09f648b04b18 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1714 microversion: 2.1 time: 0.445723 Sep 08 10:24:11.648677 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1392/2608] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:11 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1714 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:11.716065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:11.716696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:11.735216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:11.735748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:11.736202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:11.736951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:11.737414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:11.737878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:12.012569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:12.025660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0fd984f-d55c-4698-bfd7-2fbcb7d680ba tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.313815 Sep 08 10:24:12.046159 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1217/2609] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:11 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:12.223400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:12.224736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:12.237178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:12.239692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:12.240241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:12.241258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:12.243934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:12.244716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:12.359697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:12.370206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:12.371914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:12.373149 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97feb3d1-5ddd-4b2b-8ed7-71cf57cebdbb tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1335 microversion: 2.54 time: 0.155699 Sep 08 10:24:12.374137 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1393/2610] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:12 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1335 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:12.672998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:12.674279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:12.689219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:12.691733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:12.692495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:12.693888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:12.696453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:12.697554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:12.925002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:12.967390 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7554291b-ebdd-4f53-bf78-143d70c83d14 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1647 microversion: 2.1 time: 0.294245 Sep 08 10:24:12.970448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1218/2611] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:12 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1647 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:13.052711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:13.053652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:13.084975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:13.087919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:13.088494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:13.089523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:13.092728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:13.093484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:13.401690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:13.402527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:13.411988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:13.417649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:13.419944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:13.422921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:13.423798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:13.424356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:13.626770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:13.642555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:13.644602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:13.646064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5f33db6-73b8-4683-be01-37aa8fd93bab tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1335 microversion: 2.54 time: 0.249028 Sep 08 10:24:13.660891 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1219/2612] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:13 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1335 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:13.662041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:13.680922 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f9de9c7c-cfa1-43c6-86e6-4ef568d76345 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.630826 Sep 08 10:24:13.731546 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1394/2613] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:13 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:13.878914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4dedf435-d30a-47c5-a214-80ad0be80fee req-47e0e60d-6a3b-46da-a6e1-f3cc90926a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94", "name": "network-vif-plugged", "status": "completed", "tag": "5850860d-7a3d-46a5-8081-db2dee619bc9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:13.889115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4dedf435-d30a-47c5-a214-80ad0be80fee req-47e0e60d-6a3b-46da-a6e1-f3cc90926a4a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:13.894070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4dedf435-d30a-47c5-a214-80ad0be80fee req-47e0e60d-6a3b-46da-a6e1-f3cc90926a4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:13.894766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4dedf435-d30a-47c5-a214-80ad0be80fee req-47e0e60d-6a3b-46da-a6e1-f3cc90926a4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:13.911609 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4dedf435-d30a-47c5-a214-80ad0be80fee req-47e0e60d-6a3b-46da-a6e1-f3cc90926a4a service nova] Creating event network-vif-plugged:5850860d-7a3d-46a5-8081-db2dee619bc9 for instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 on n-h1-833090-19 Sep 08 10:24:13.918096 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4dedf435-d30a-47c5-a214-80ad0be80fee req-47e0e60d-6a3b-46da-a6e1-f3cc90926a4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255600 Sep 08 10:24:13.918861 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1220/2614] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:13.996561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:13.997517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:14.008720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.009468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.010068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:14.010953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.016435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.017161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:14.162455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:14.172637 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-631ab94e-54fb-4aa6-bc48-2fb77edbea17 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1647 microversion: 2.1 time: 0.180037 Sep 08 10:24:14.173942 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1395/2615] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:13 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1647 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:14.509463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-eea5f72b-6025-478a-99be-912317643da6 req-e88eb5f5-5959-4abb-ad46-f1126c9e95e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6657a9c-c729-4811-aa0b-b54bde87bc4a", "name": "network-vif-deleted", "tag": "1e840973-adce-40af-bf0e-70733119924d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:14.555546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eea5f72b-6025-478a-99be-912317643da6 req-e88eb5f5-5959-4abb-ad46-f1126c9e95e7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.561892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eea5f72b-6025-478a-99be-912317643da6 req-e88eb5f5-5959-4abb-ad46-f1126c9e95e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.564322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eea5f72b-6025-478a-99be-912317643da6 req-e88eb5f5-5959-4abb-ad46-f1126c9e95e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:14.616116 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-eea5f72b-6025-478a-99be-912317643da6 req-e88eb5f5-5959-4abb-ad46-f1126c9e95e7 service nova] Creating event network-vif-deleted:1e840973-adce-40af-bf0e-70733119924d for instance b6657a9c-c729-4811-aa0b-b54bde87bc4a on n-h1-833090-19 Sep 08 10:24:14.639733 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-eea5f72b-6025-478a-99be-912317643da6 req-e88eb5f5-5959-4abb-ad46-f1126c9e95e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143161 Sep 08 10:24:14.640622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1396/2616] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:24:14.672762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:14.677934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:14.695050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:14.706233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.711038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.716264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:14.717066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.717513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.718325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:14.766972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:14.804585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:14.831604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:14.865891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:14.883135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:14.888001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:14.896650 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1fa7c93-ca05-440b-a94d-e18a6e847c73 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1356 microversion: 2.54 time: 0.223041 Sep 08 10:24:14.898644 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1397/2617] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:14 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1356 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:14.909600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:14.912760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:14.924391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.925838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.926618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:14.929716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:14.932095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:14.933802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:15.136351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1953030924", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:15.263636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:15.277013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17ff02b2-d11c-4d6c-abc0-bd06457451d9 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1319 microversion: 2.1 time: 0.376891 Sep 08 10:24:15.306116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:24:15.310187 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1398/2618] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:14 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:15.315175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e62013ef-5b17-42e2-80b9-99a403d661b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Action: 'create', calling method: .version_select at 0x7f2355475430>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1888558964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt4+drzhZDBzBvxd1v3zER5LmOrR2WDK79JJjI4n5HI1a8uhu2UtWCM+jbnYomDpmmlVwrjre/nwTOHwMcIFdohgzjnvPrCT6SLRc/c/QJvHefDhoO4bFotpzBLaVjF4w=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:15.352790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e62013ef-5b17-42e2-80b9-99a403d661b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Getting quotas for project 332b4844846d473e9560fecbeb6f6292. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:24:15.365968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e62013ef-5b17-42e2-80b9-99a403d661b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Getting quotas for user 952788fcfa2e4799b5f17aac65dea5e1 and project 332b4844846d473e9560fecbeb6f6292. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:24:15.409914 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e62013ef-5b17-42e2-80b9-99a403d661b2 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.098423 Sep 08 10:24:15.411653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1399/2619] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:24:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:24:15.417940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:15.419452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:15.458641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:15.460473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:15.462875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:15.469684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:15.471966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:15.473865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:15.548643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:15.590942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:15.595547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:15.597239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:15.602842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lazy-loading 'fault' on Instance uuid b6657a9c-c729-4811-aa0b-b54bde87bc4a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:24:15.773089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0054d68ce9d646b483c86362f6a4ab30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad840b082bb4751a2d693d109a6b161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:15.788853 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8a857bb-878c-4cb4-89f1-f81427363187 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 200 len: 1367 microversion: 2.1 time: 0.375702 Sep 08 10:24:15.789512 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1400/2620] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:15 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:15.800675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1888558964", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:15.809487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:15.826017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:15.829233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:15.829534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:15.830247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:15.833533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:15.834190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:15.997854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:24:15.998269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:24:15.998749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:24:15.999380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:24:15.999935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:24:16.028089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.029512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.030265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.038530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.042095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.044830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.099423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Getting quotas for project 1d86ba5344c14acd9af5b1bb370df16f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:24:16.099684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:24:16.099984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:24:16.100463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:24:16.104139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:24:16.104693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:24:16.120425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Getting quotas for user 200a226e0a8946d5b5efafa7a9db269b and project 1d86ba5344c14acd9af5b1bb370df16f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:24:16.171002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:24:16.179170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:24:16.313950 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea94596d-b0ba-4131-86da-3be4497fca36 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.876957 Sep 08 10:24:16.315780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:16.321606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1221/2621] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:24:16.344417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.346990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.350853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.361083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.362675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.363850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.425687 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-779bb681-93af-4d3e-8ace-3000ee4ea2d5 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "POST /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8/action" status: 202 len: 1139 microversion: 2.54 time: 0.634240 Sep 08 10:24:16.428661 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1401/2622] 10.222.0.59 () {62 vars in 1320 bytes} [Thu Sep 8 10:24:15 2022] POST /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8/action => generated 1139 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:24:16.452377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-459284f5-d950-4ed6-b26f-343b427c3dbd req-49c40039-9d0a-4578-a956-5bdec55b0504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e", "name": "network-vif-plugged", "status": "completed", "tag": "c24d10b0-7de5-48c3-90aa-54106e29d5d4"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:16.515401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-459284f5-d950-4ed6-b26f-343b427c3dbd req-49c40039-9d0a-4578-a956-5bdec55b0504 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.517375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-459284f5-d950-4ed6-b26f-343b427c3dbd req-49c40039-9d0a-4578-a956-5bdec55b0504 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.517891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-459284f5-d950-4ed6-b26f-343b427c3dbd req-49c40039-9d0a-4578-a956-5bdec55b0504 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.552174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-459284f5-d950-4ed6-b26f-343b427c3dbd req-49c40039-9d0a-4578-a956-5bdec55b0504 service nova] Creating event network-vif-plugged:c24d10b0-7de5-48c3-90aa-54106e29d5d4 for instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e on n-h2-833090-19 Sep 08 10:24:16.561651 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-459284f5-d950-4ed6-b26f-343b427c3dbd req-49c40039-9d0a-4578-a956-5bdec55b0504 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130039 Sep 08 10:24:16.561942 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1402/2623] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:16.569067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:16.569535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:16.579817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.580317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.580912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.581950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:16.582464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:16.582838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:16.744366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-591081426", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "8e5daf05-081a-4e84-8aec-3d4ab955f0a1"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:16.886700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] validate_networks() for [('8e5daf05-081a-4e84-8aec-3d4ab955f0a1', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:24:17.964828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:17.973975 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d2a6ad4-0b9c-46f2-8715-5615cf8d857c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1469 microversion: 2.1 time: 1.410964 Sep 08 10:24:17.988459 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1403/2624] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:16 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1469 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:18.000045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:18.000998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:18.015398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.017274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.017971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.019363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.020171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.020885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.191770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:18.210178 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b114165e-6b90-46a0-9ba4-0a49a1db5a29 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1275 microversion: 2.1 time: 0.220322 Sep 08 10:24:18.221859 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1404/2625] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:17 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:18.231933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:18.232551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:18.241697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.242483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.243195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.244205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.244893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.245474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.370321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:18.381746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:18.392159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:18.394770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67a4b6e5-24da-49a1-8788-f69d833efa4b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.171670 Sep 08 10:24:18.396626 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1405/2626] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:18 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:18.427493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:18.435009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] [instance: b6657a9c-c729-4811-aa0b-b54bde87bc4a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:18.442878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.443805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.444458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.445413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.446082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.447502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.464093 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] HTTP exception thrown: Instance b6657a9c-c729-4811-aa0b-b54bde87bc4a could not be found. Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Request method failure captured: Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a HTTP/1.1 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcJy1Z9uv7l1dADJmQDFETzIj4o_LovReX6NRCivGCJwnox7PMgfXDgNqhcAodTRu7DqhuAzZUvLqW2klucJntWAVRLvPlCUl4fCHkyvU9KQdAfI5SDnKxxGfiUYL0NHD5dlkBwqyrURyIrnOu3obSjKMAOdlPQrIL0y4aWOs3t0YUA Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0ad840b082bb4751a2d693d109a6b161 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestManualDisk-1819571484 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad840b082bb4751a2d693d109a6b161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ad840b082bb4751a2d693d109a6b161"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ad840b082bb4751a2d693d109a6b161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ad840b082bb4751a2d693d109a6b161", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestManualDisk-1819571484 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0ad840b082bb4751a2d693d109a6b161 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestManualDisk-1819571484 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestManualDisk-1819571484-project Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0054d68ce9d646b483c86362f6a4ab30 Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestManualDisk-1819571484-project Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b6657a9c-c729-4811-aa0b-b54bde87bc4a could not be found. Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b6657a9c-c729-4811-aa0b-b54bde87bc4a'} Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6657a9c-c729-4811-aa0b-b54bde87bc4a could not be found. Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6657a9c-c729-4811-aa0b-b54bde87bc4a could not be found. Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:18.466200 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6657a9c-c729-4811-aa0b-b54bde87bc4a could not be found. Sep 08 10:24:18.469847 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:18.472071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Returning 404 to user: Instance b6657a9c-c729-4811-aa0b-b54bde87bc4a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:24:18.473259 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e94916dd-c02c-4166-82eb-ef31a8e51536 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a" status: 404 len: 111 microversion: 2.1 time: 0.055059 Sep 08 10:24:18.478034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1406/2627] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:18 2022] GET /compute/v2.1/servers/b6657a9c-c729-4811-aa0b-b54bde87bc4a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:24:18.485479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:18.486735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:18.495567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.496434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.497756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.498862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.499697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.500349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.735427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:18.746971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:24:18.747607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:24:18.748581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:24:18.749166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:24:18.751087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:24:18.777073 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba46d405-667b-40f9-9523-ac22b59e407d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 200 len: 1319 microversion: 2.1 time: 0.297459 Sep 08 10:24:18.781988 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1407/2628] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:18 2022] GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:18.790698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f63d9df-ab93-40b1-a370-7193a012f729 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] Calling method '.version_select at 0x7f2352b089d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:18.803275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.805240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.806860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.810657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:18.812457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:18.814784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:18.873111 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f63d9df-ab93-40b1-a370-7193a012f729 tempest-ServersTestManualDisk-1819571484 tempest-ServersTestManualDisk-1819571484-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973166936" status: 202 len: 0 microversion: 2.1 time: 0.087949 Sep 08 10:24:18.874746 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1408/2629] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973166936 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:24:18.893512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Getting quotas for project 8b458f47fb0242268a00e3cf1fbf64ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:24:18.899497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Getting quotas for user 87d0fe33ea984af88d341d9720636a34 and project 8b458f47fb0242268a00e3cf1fbf64ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:24:18.913401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:18.914736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:24:18.923139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:24:18.984914 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.660407 Sep 08 10:24:18.992955 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1222/2630] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:24:18.998800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb75ab24-76fa-4ebe-8257-a0af3fa9cf97 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:19.000117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb75ab24-76fa-4ebe-8257-a0af3fa9cf97 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:19.138748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb75ab24-76fa-4ebe-8257-a0af3fa9cf97 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:19.152278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb75ab24-76fa-4ebe-8257-a0af3fa9cf97 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1216 microversion: 2.1 time: 0.157093 Sep 08 10:24:19.174621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1409/2631] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:18 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:19.238629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:19.239655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:19.258254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:19.259978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:19.260779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:19.263707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:19.264371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:19.265772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:19.426471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:19.427254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:19.431105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:19.443357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:19.444795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:19.446818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:19.449325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:19.450715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:19.451379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:19.520429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:19.536064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb1e1262-3025-4e72-a2d9-7bf703cd9488 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1281 microversion: 2.1 time: 0.302764 Sep 08 10:24:19.536683 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1223/2632] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:19 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1281 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:19.676387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:19.690079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:19.692625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:19.694390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb3e8a75-7612-4280-8d91-9c66a24d2083 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.275385 Sep 08 10:24:19.695835 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1410/2633] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:19 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:24:19.813566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:19.816662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:19.834426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:19.835632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:19.836335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:19.839027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:19.844096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:19.845800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.183611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:20.184989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:20.194885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.199378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.200244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.201976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.202667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.203745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.331432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:20.355420 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91461b03-2b2d-417a-9e72-8f812fe509f1 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 200 len: 1468 microversion: 2.1 time: 0.552773 Sep 08 10:24:20.362738 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1224/2634] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:19 2022] GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 1468 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:20.371844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:20.385770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5b3403d-827c-413d-831f-5578688a2d4f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1212 microversion: 2.1 time: 0.208017 Sep 08 10:24:20.386444 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1411/2635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:20 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1212 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:20.402099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:20.417418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:20.418711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Searching by: {'reservation_id': 'r-u88m1g2e', 'deleted': False, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:24:20.436867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.437465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.439501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.441810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.442522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.444182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.568902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:20.570230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:20.589315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.591324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.592192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.593322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.593998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.596564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.755532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:24:20.836416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:20.853286 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da01fe80-97e1-4d6d-9430-6c290f763d89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1281 microversion: 2.1 time: 0.293719 Sep 08 10:24:20.856729 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1412/2636] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:20 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1281 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:20.873665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:20.874566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:20.910469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.911003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.911504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.912245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.912699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.918176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:20.939848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:20.952898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:20.956976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:20.959000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:21.255800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:21.293788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:21.295608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:21.297337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-682a4cef-5b7f-4fac-8c38-dd705628a396 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.430274 Sep 08 10:24:21.298418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1413/2637] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:20 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:21.410463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:21.411085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:21.430179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:21.431718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:21.432196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:21.432973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:21.433444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:21.433881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:21.818039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:21.848104 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15f2e5ee-6fdc-4480-9055-b1cbfdf66fd5 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1286 microversion: 2.1 time: 0.441418 Sep 08 10:24:21.848958 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1414/2638] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:21 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1286 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:21.889077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:21.889922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:21.903115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:21.903899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:21.904531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:21.905416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:21.905880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:21.906837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.106209 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c4cf123-7f46-4c08-aee1-b88aaec7209e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?reservation_id=r-u88m1g2e" status: 200 len: 2930 microversion: 2.1 time: 1.718950 Sep 08 10:24:22.106819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1225/2639] 10.222.0.59 () {58 vars in 1197 bytes} [Thu Sep 8 10:24:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-u88m1g2e => generated 2930 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:22.140763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6fe1974e-5a0f-4bac-b5bb-8fe7ad1c1e83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:22.242767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.server_groups [None req-6fe1974e-5a0f-4bac-b5bb-8fe7ad1c1e83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Querying cell 52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) for 2 instances {{(pid=122456) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:24:22.243604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fe1974e-5a0f-4bac-b5bb-8fe7ad1c1e83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.244098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fe1974e-5a0f-4bac-b5bb-8fe7ad1c1e83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.262379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fe1974e-5a0f-4bac-b5bb-8fe7ad1c1e83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.326204 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6fe1974e-5a0f-4bac-b5bb-8fe7ad1c1e83 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/d1510f53-ddb4-4761-b9e5-3179c80f85cc" status: 200 len: 270 microversion: 2.1 time: 0.186515 Sep 08 10:24:22.332665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1226/2640] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:24:22 2022] GET /compute/v2.1/os-server-groups/d1510f53-ddb4-4761-b9e5-3179c80f85cc => generated 270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:22.339731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:22.343685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:22.360114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.363376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.364254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.365572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.366259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.374380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.625355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:22.658722 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-332ec159-aac1-4c30-aaac-49982dd6e6a8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1281 microversion: 2.1 time: 0.774287 Sep 08 10:24:22.664148 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1415/2641] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:21 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1281 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:22.693599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:22.694312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:22.728539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.729468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.735991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:22.736991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.738654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.739095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.739884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.748711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:22.757684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:22.777864 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f459820-1db9-4f5e-9fff-8b9caaebf8af tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.449142 Sep 08 10:24:22.799785 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1227/2642] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:22 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:22.895870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:22.914285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:22.942759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.943276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.943750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:22.944696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:22.944935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:22.945368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:23.280972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:23.288555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:23.330271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-112a365a-0aba-4853-b508-7e3b62af8db2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1274 microversion: 2.1 time: 0.458603 Sep 08 10:24:23.330893 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1228/2643] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:22 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1274 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:23.692601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:23.693541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:23.703022 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3f2e8fd-2023-42cb-8f83-3808f4e19138 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 200 len: 1622 microversion: 2.1 time: 1.027266 Sep 08 10:24:23.726569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:23.728102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:23.728836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:23.729785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:23.732660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:23.733405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:23.734706 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1416/2644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:22 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 1622 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:23.745400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:23.747029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:23.756464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:23.760796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:23.761543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:23.764490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:23.765462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:23.766300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:23.817698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:24.676956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4fefdaa-cd33-438a-a221-f7fde99f0628 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 200 len: 1621 microversion: 2.1 time: 0.934560 Sep 08 10:24:24.691901 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1417/2645] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:23 2022] GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 1621 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:24.702354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:24.704239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:24.739339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:24.740166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:24.741551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:24.743071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:24.743595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:24.748580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:24.777677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:24.788389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62c477fd-4fef-45f2-8687-1d5b64c762a6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 1.103032 Sep 08 10:24:24.789059 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1229/2646] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:23 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:24.814815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:24.815450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:24.828251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:24.830968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:24.832797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:24.835648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:24.836379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:24.836993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:25.146335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:25.157127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:25.158706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:25.160059 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-24aa9d06-dca6-4019-8b7f-836fbcd70b3e tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.465957 Sep 08 10:24:25.160939 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1418/2647] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:24 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:25.162456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:25.176686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-183112370", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a8c4b6e2-f598-4ed6-bc7b-570148c9e012"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:25.186323 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-762b48c0-b6c9-4527-b076-13fc50c2f7b9 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1274 microversion: 2.1 time: 0.396121 Sep 08 10:24:25.192618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1230/2648] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:24 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1274 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:25.305901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:24:25.815011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:25.815678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:25.833842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:25.834469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:25.834934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:25.835734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:25.836204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:25.836627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:26.573855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:26.583330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cd91f9a2-a194-4f54-bc14-71b5de4f2ac8 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 0.772533 Sep 08 10:24:26.586348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1231/2649] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:25 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:26.600409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:26.605486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:26.624937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:26.625439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:26.625893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:26.626618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:26.627176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:26.632386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:26.935116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:26.957858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:26.968326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:26.969609 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-43641735-bb86-42b8-a58c-dcd781a776be tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.381956 Sep 08 10:24:26.970210 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1232/2650] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:26 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:26.988535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:26.989349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:27.002229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.002939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.003613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:27.006385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.007050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.007818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:27.193019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:24:27.195203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:24:27.196366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:24:27.197035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:24:27.198250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:24:27.257401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.258303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.259071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:27.261342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.262496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.263686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:27.317128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:24:27.329686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:24:27.362738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:24:27.371034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:24:27.522103 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d9497158-7b98-4f2e-bdea-4b32c7c16dfb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.349502 Sep 08 10:24:27.530542 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1419/2651] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:24:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:24:27.539048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8b452bce-2d3c-4812-a6d1-bcf922574c4c req-65a32f79-a4a5-43e5-9542-d31001570b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c776b28d-f039-48b0-a665-ec517d69cbd3", "tag": "aac80c0e-215f-4ba7-8d98-3a3c8d33498c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:27.594376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b452bce-2d3c-4812-a6d1-bcf922574c4c req-65a32f79-a4a5-43e5-9542-d31001570b2f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.600292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b452bce-2d3c-4812-a6d1-bcf922574c4c req-65a32f79-a4a5-43e5-9542-d31001570b2f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.604383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b452bce-2d3c-4812-a6d1-bcf922574c4c req-65a32f79-a4a5-43e5-9542-d31001570b2f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:27.640840 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8b452bce-2d3c-4812-a6d1-bcf922574c4c req-65a32f79-a4a5-43e5-9542-d31001570b2f service nova] Creating event network-changed:aac80c0e-215f-4ba7-8d98-3a3c8d33498c for instance c776b28d-f039-48b0-a665-ec517d69cbd3 on n-h1-833090-19 Sep 08 10:24:27.653271 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8b452bce-2d3c-4812-a6d1-bcf922574c4c req-65a32f79-a4a5-43e5-9542-d31001570b2f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121200 Sep 08 10:24:27.654492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1420/2652] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:27.667415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7e0edddf-ac28-41db-b3ef-4b13605f6bab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:27.669290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e0edddf-ac28-41db-b3ef-4b13605f6bab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:27.816659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e0edddf-ac28-41db-b3ef-4b13605f6bab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:27.833869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:27.847449 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7e0edddf-ac28-41db-b3ef-4b13605f6bab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1216 microversion: 2.1 time: 0.190506 Sep 08 10:24:27.848039 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1421/2653] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:27 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:27.850295 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7803902e-a453-4a12-b8a1-60f113b327a6 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.877341 Sep 08 10:24:27.867400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:27.872951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:27.878515 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1233/2654] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:26 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:27.893147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.893669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.894119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:27.894858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:27.895324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:27.895786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:28.001956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:28.003234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:28.011872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:28.012442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:28.012891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:28.014324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:28.016066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:28.016713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:28.188316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:28.203354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:28.208369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:28.211372 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c2ffe1b-5bbf-4f24-bd5a-2260d212cd11 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.219642 Sep 08 10:24:28.213454 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1234/2655] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:27 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:28.659393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:28.670941 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da84e741-cd00-4509-b126-9c15ff6bbe08 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 0.812412 Sep 08 10:24:28.672260 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1422/2656] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:27 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:28.872790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:28.873670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:28.879893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:28.881186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:28.887578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:28.889838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:28.890323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:28.891019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:28.891500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:28.891930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:28.900527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:28.902453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:28.903877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:28.906804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:28.907432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:28.908834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:29.134826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:29.158979 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cfb7a708-c813-497a-83ee-6c6238ea35fc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1220 microversion: 2.1 time: 0.288853 Sep 08 10:24:29.162422 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1235/2657] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:28 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1220 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:29.252361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:29.253995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:29.262153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:29.262971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:29.263637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:29.264533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:29.265165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:29.265821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:29.641628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:29.661608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:29.667570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:29.670854 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f947e643-a457-40b3-9e76-e499282acc10 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.422863 Sep 08 10:24:29.682049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1236/2658] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:29 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:24:29.697357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:29.698760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:29.711041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:29.713334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:29.715661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:29.717183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:29.722733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:29.723781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:29.899890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:29.917567 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18c0d1fa-2cc2-40b2-afb8-f66fb1e3333a tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 1.042472 Sep 08 10:24:29.921622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1423/2659] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:28 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:30.189088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:30.190012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:30.220502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:30.221665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:30.224510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:30.225818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:30.227053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:30.228726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:30.560457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:30.931589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:30.933480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:30.982991 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1af64b9d-c39a-4e3b-9da8-b12028a8a7c0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1276 microversion: 2.1 time: 0.800715 Sep 08 10:24:30.988290 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1424/2660] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:30 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1276 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:31.015173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:31.018971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:31.024717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:31.036038 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da633628-1440-4af5-af70-39a7eb5943c6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 1.343810 Sep 08 10:24:31.039491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:31.043387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:31.044009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:31.044756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:31.045212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:31.045642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:31.054615 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1237/2661] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:29 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:31.067997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:31.069128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:31.077361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:31.078262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:31.078994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:31.080291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:31.081658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:31.084929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:31.229063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:31.242151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:31.248245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:31.254991 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ceb6247-e010-4ebc-9ca5-d32c29cb12a1 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.263301 Sep 08 10:24:31.257138 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1425/2662] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:30 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:31.408151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-df732e86-9306-4428-bb1a-cdf36528de16 req-6896066a-8bc8-4da0-9cda-b5880e92e73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493146a5-66be-4589-b34a-5732a4ef22aa", "tag": "87e96b22-14c3-4bc6-ba66-4f9d95390706"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:31.445523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df732e86-9306-4428-bb1a-cdf36528de16 req-6896066a-8bc8-4da0-9cda-b5880e92e73d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:31.446019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df732e86-9306-4428-bb1a-cdf36528de16 req-6896066a-8bc8-4da0-9cda-b5880e92e73d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:31.446463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df732e86-9306-4428-bb1a-cdf36528de16 req-6896066a-8bc8-4da0-9cda-b5880e92e73d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:31.461865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-df732e86-9306-4428-bb1a-cdf36528de16 req-6896066a-8bc8-4da0-9cda-b5880e92e73d service nova] Creating event network-changed:87e96b22-14c3-4bc6-ba66-4f9d95390706 for instance 493146a5-66be-4589-b34a-5732a4ef22aa on n-h2-833090-19 Sep 08 10:24:31.480113 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-df732e86-9306-4428-bb1a-cdf36528de16 req-6896066a-8bc8-4da0-9cda-b5880e92e73d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100952 Sep 08 10:24:31.481025 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1426/2663] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:24:32.011398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:32.012141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:32.019207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:32.019770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:32.020211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:32.020933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:32.021581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:32.024172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:32.195031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:32.205341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c07eda78-7fcb-4b02-b14e-6a2a75aa75e2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 1.148791 Sep 08 10:24:32.217049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1238/2664] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:31 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:32.232621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:32.233250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:32.241425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:32.242582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:32.243286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:32.244538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:32.244996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:32.245665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:32.459489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:32.470493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d45f82d6-087b-453f-984b-8dc22a463f70 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1274 microversion: 2.1 time: 0.463463 Sep 08 10:24:32.487367 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1427/2665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:32 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:32.493274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:32.494145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:32.501860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:32.503135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:32.503884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:32.504774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:32.505378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:32.506089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:32.765882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:32.783425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:32.786487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:32.794277 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da7c7dd4-c33f-4a54-9be1-7109080e299c tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.305394 Sep 08 10:24:32.795182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1428/2666] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:32 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:33.233313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:33.235390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:33.247923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:33.253718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:33.254602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:33.255908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:33.262984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:33.263827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:33.507617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:33.524238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f0f871e-4b21-4867-97a2-085a22462424 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 1.303565 Sep 08 10:24:33.529512 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1239/2667] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:32 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:33.538684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:33.543700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:33.581595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:33.585493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:33.586292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:33.587275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:33.589802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:33.590513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:34.095035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:34.108310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-263a76dd-deff-4448-910d-616443070e6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.879273 Sep 08 10:24:34.110644 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1429/2668] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:33 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:34.122365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:34.125766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:34.139084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:34.147836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:34.148491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:34.149332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:34.149977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:34.150558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:34.257819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:34.270528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6d60371-9e45-48d8-bb30-d62d1109efca tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 0.739529 Sep 08 10:24:34.271062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1240/2669] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:33 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:34.337751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:34.352663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:34.364911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:34.368381 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ce59998-5b6f-417e-b69c-05554e3df21f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.256347 Sep 08 10:24:34.370660 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1430/2670] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:34 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:34.550175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:34.550792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:34.561804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:34.562569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:34.563202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:34.564164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:34.565680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:34.572379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:35.135045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:35.140275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:35.154251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:35.162955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:35.164232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:35.164997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:35.165475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:35.165905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:35.632448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:35.642448 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-520955ad-20c7-4507-956e-ab08ef43f015 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 1.095978 Sep 08 10:24:35.645859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1241/2671] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:34 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:35.650961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:35.652019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:35.659697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:35.665589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:35.668803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:35.671330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:35.673562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:35.675544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:35.971289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:35.986520 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db27b8c9-65b3-45ef-96cf-eb3f58e2385e tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.857793 Sep 08 10:24:36.011950 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1431/2672] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:35 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:36.022194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:36.024732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:36.046696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:36.047649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:36.048329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:36.049343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:36.055915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:36.056857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:36.159683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:36.176372 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b14119de-412c-476d-9532-b3703448711e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 0.529115 Sep 08 10:24:36.191452 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1242/2673] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:35 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:36.317215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:36.335364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:36.341404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:36.347581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a8bc924-7b03-43c1-8f6c-46c326f0abb9 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.331872 Sep 08 10:24:36.350084 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1432/2674] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:36 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:36.667848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:36.668474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:36.677284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d96fac42-9b44-4f94-852d-67cb58e09f0d req-3a184f8d-d13e-472f-819e-86ec378baa57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc7a421-cb20-467e-8f14-d506b824caa3", "tag": "b98634a0-562d-4392-8e8a-f9be80778899"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:36.679859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:36.680365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:36.680812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:36.689446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:36.689978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:36.690427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:36.696181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d96fac42-9b44-4f94-852d-67cb58e09f0d req-3a184f8d-d13e-472f-819e-86ec378baa57 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:36.696757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d96fac42-9b44-4f94-852d-67cb58e09f0d req-3a184f8d-d13e-472f-819e-86ec378baa57 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:36.697261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d96fac42-9b44-4f94-852d-67cb58e09f0d req-3a184f8d-d13e-472f-819e-86ec378baa57 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:36.721869 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d96fac42-9b44-4f94-852d-67cb58e09f0d req-3a184f8d-d13e-472f-819e-86ec378baa57 service nova] Creating event network-changed:b98634a0-562d-4392-8e8a-f9be80778899 for instance 8dc7a421-cb20-467e-8f14-d506b824caa3 on n-h1-833090-19 Sep 08 10:24:36.728089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d96fac42-9b44-4f94-852d-67cb58e09f0d req-3a184f8d-d13e-472f-819e-86ec378baa57 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054047 Sep 08 10:24:36.729943 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1433/2675] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:37.028750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:37.030495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:37.042394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.043120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.043802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:37.045501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.046212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.046852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:37.280220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:37.743042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:37.756291 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49c79179-9605-43cf-889f-e1932da140ec tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 1.093824 Sep 08 10:24:37.776342 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1243/2676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:36 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:37.782155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d318ce88-7635-45c3-90a1-8c60059116a8 req-85622272-820d-4fef-a139-9ecf5463c1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c776b28d-f039-48b0-a665-ec517d69cbd3", "name": "network-vif-plugged", "status": "completed", "tag": "aac80c0e-215f-4ba7-8d98-3a3c8d33498c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:37.794494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d318ce88-7635-45c3-90a1-8c60059116a8 req-85622272-820d-4fef-a139-9ecf5463c1ff service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.803534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d318ce88-7635-45c3-90a1-8c60059116a8 req-85622272-820d-4fef-a139-9ecf5463c1ff service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.806925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d318ce88-7635-45c3-90a1-8c60059116a8 req-85622272-820d-4fef-a139-9ecf5463c1ff service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:37.833103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d318ce88-7635-45c3-90a1-8c60059116a8 req-85622272-820d-4fef-a139-9ecf5463c1ff service nova] Creating event network-vif-plugged:aac80c0e-215f-4ba7-8d98-3a3c8d33498c for instance c776b28d-f039-48b0-a665-ec517d69cbd3 on n-h1-833090-19 Sep 08 10:24:37.838890 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d318ce88-7635-45c3-90a1-8c60059116a8 req-85622272-820d-4fef-a139-9ecf5463c1ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060741 Sep 08 10:24:37.839887 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1244/2677] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:37.845882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:37.846647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:37.859963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:37.875673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.876911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.877528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:37.879480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.884401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.885151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:37.927830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:37.948682 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4d4e4c65-9f40-45c9-936d-aeabba668f27 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.921751 Sep 08 10:24:37.952427 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1434/2678] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:37 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:37.963777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:37.965352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:37.972694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.973408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.974035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:37.975066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:37.975710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:37.976897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:38.227361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:38.240009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:38.243443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:38.244683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7cecc288-fb61-4a89-a966-29270333aa03 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.291238 Sep 08 10:24:38.245800 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1435/2679] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:37 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:38.534145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:38.550877 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb13ec44-f937-4101-b549-04b77edc8935 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 0.704352 Sep 08 10:24:38.552322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1245/2680] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:37 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:38.786136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:38.787034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:38.806796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:38.807308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:38.807773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:38.808695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:38.809367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:38.809949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:38.973405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:38.974110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:38.992938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:38.995449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:38.996068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:38.996855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:38.997356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:38.997854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:39.083384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:39.462891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:39.477994 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ecf4b9e-f1ef-4d4a-8239-a42e00faa28d tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1323 microversion: 2.1 time: 0.695572 Sep 08 10:24:39.478850 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1436/2681] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:38 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1323 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:39.487293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:39.510516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:39.525746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:39.532662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:39.533792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:39.538067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:39.543125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:39.543858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:39.564959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:39.577003 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f901eca6-b8bf-44cb-992e-a083175e07e0 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.604867 Sep 08 10:24:39.579686 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1246/2682] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:38 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:39.591547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:39.592384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:39.602441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:39.603152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:39.603777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:39.605124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:39.605741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:39.606320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:39.748331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:39.764712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:39.778956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:39.780740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:39.782046 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7586b0cb-ec98-49ec-ad57-0a693a1c3956 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.301988 Sep 08 10:24:39.783034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1437/2683] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:39 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:40.029719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:40.046450 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a920e97e-ff26-450a-bd93-9ff51736129c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 0.465328 Sep 08 10:24:40.056042 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1247/2684] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:39 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:40.502237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:40.502845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:40.513633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:40.515698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:40.516582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:40.517853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:40.518803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:40.519975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:40.608448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:40.609519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:40.621419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:40.622863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:40.623814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:40.630179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:40.633150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:40.634525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.178794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:41.211960 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fb1d09a-af0d-4d09-ba6c-edc898e82dc0 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1473 microversion: 2.1 time: 0.712169 Sep 08 10:24:41.213931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1438/2685] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:40 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1473 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:41.222203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:41.223685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:41.237249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:41.249330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6eb80fff-dcac-4b87-a5ef-6b3c2535c5fe tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.647696 Sep 08 10:24:41.254442 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1248/2686] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:40 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:41.268470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:41.269597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:41.274424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.275611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.277041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.278731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.279680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.280341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.289378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.289885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.290327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.297141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.297920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.298905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.518796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:41.541031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:41.550712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:41.552961 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9ec9d65-07b6-4479-994e-d62a6d521a36 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.337942 Sep 08 10:24:41.554602 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1439/2687] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:41 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:41.562116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:41.563156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:41.577331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.578097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.582026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.583308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.583969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.584572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.652675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Request method failure captured: Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3/diagnostics HTTP/1.1 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcLMoN8hFhx-pBnFiC1o7-GCC72sif7KU68yp4UOOySqiaUkzRSszgkm91loGtMTZ_nRMQQUY6RiIveAeg2W5IiRKRaRlh-zohHsvKA8D_Xbdaw1r2eUR_nvBio8kpbf1gM6HOb_w8cnBt4A3wypg01YjyTm3K0kOhK3u_gSTlg2Yvw Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1d86ba5344c14acd9af5b1bb370df16f Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-941652224 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1d86ba5344c14acd9af5b1bb370df16f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1d86ba5344c14acd9af5b1bb370df16f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1d86ba5344c14acd9af5b1bb370df16f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1d86ba5344c14acd9af5b1bb370df16f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-941652224 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1d86ba5344c14acd9af5b1bb370df16f Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-941652224 Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerDiagnosticsNegativeTest-941652224-project Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 200a226e0a8946d5b5efafa7a9db269b Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-941652224-project Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': 'c776b28d-f039-48b0-a665-ec517d69cbd3'} Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:41.657600 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:41.661183 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:41.661183 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:41.661183 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:24:41.661183 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:24:41.661183 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 10:24:41.661183 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:41.664773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:24:41.666058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a446ad89-0afc-479e-ba01-f82f076554d6 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.110202 Sep 08 10:24:41.671020 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1440/2688] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:24:41 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3/diagnostics => generated 117 bytes in 116 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:24:41.686923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:41.687888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:41.707784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.708283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.708721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.709436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.709890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.710343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.828186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:24:41.939150 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8544fed8-8043-4ab9-88fd-5476b8630c62 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 204 len: 0 microversion: 2.1 time: 0.257158 Sep 08 10:24:41.940904 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1441/2689] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:24:41 2022] DELETE /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:24:41.952838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:41.954211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:41.977029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.977884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.978673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:41.979677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:41.980920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:41.981592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:43.244329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:43.253745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2a2d3e71-11cf-4a21-8352-23ae88383be0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 1.992198 Sep 08 10:24:43.256057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1249/2690] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:41 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:43.270602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:43.271730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:43.285521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:43.287246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:43.292161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:43.295251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:43.296292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:43.296895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:43.890776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200a226e0a8946d5b5efafa7a9db269b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d86ba5344c14acd9af5b1bb370df16f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:43.913276 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4df694da-c91a-4a3f-b9dc-47c858b50f79 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 200 len: 1479 microversion: 2.1 time: 1.965974 Sep 08 10:24:43.916468 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1442/2691] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:41 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 1479 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:43.927716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:43.928761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:43.966546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:43.968048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:43.968507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:43.969238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:43.972872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:43.975218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.056298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.068083 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f140fa6a-b391-4d43-968a-26b6f7f8fd60 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.809719 Sep 08 10:24:44.087038 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1250/2692] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:43 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:44.097037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-14c7c456-a8a3-479e-bf80-c6bdaf9e81bd req-b46d6bff-f123-4b70-bf09-3bb3a7ebb0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493146a5-66be-4589-b34a-5732a4ef22aa", "name": "network-vif-plugged", "status": "completed", "tag": "87e96b22-14c3-4bc6-ba66-4f9d95390706"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:44.114242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-14c7c456-a8a3-479e-bf80-c6bdaf9e81bd req-b46d6bff-f123-4b70-bf09-3bb3a7ebb0e3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.114988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-14c7c456-a8a3-479e-bf80-c6bdaf9e81bd req-b46d6bff-f123-4b70-bf09-3bb3a7ebb0e3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.115616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-14c7c456-a8a3-479e-bf80-c6bdaf9e81bd req-b46d6bff-f123-4b70-bf09-3bb3a7ebb0e3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.141785 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-14c7c456-a8a3-479e-bf80-c6bdaf9e81bd req-b46d6bff-f123-4b70-bf09-3bb3a7ebb0e3 service nova] Creating event network-vif-plugged:87e96b22-14c3-4bc6-ba66-4f9d95390706 for instance 493146a5-66be-4589-b34a-5732a4ef22aa on n-h2-833090-19 Sep 08 10:24:44.151010 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-14c7c456-a8a3-479e-bf80-c6bdaf9e81bd req-b46d6bff-f123-4b70-bf09-3bb3a7ebb0e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062371 Sep 08 10:24:44.153257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1251/2693] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:44.167741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:44.183228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.185697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Searching by: {'deleted': False, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:24:44.203998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.204481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.204926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.209747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.210395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.210870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.265785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:24:44.315013 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6baccfe8-c3a9-4d85-8622-eb505ca09569 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.160278 Sep 08 10:24:44.322930 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1252/2694] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:24:44 2022] GET /compute/v2.1/servers => generated 344 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:44.334468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:44.336549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:44.353994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.354583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.355035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.355850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.356313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.356763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.444021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.459077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.472472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.474776 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49b46cce-060e-460a-8374-051e9ca36279 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.555263 Sep 08 10:24:44.478112 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1443/2695] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:43 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:44.485274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:44.505448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.521938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Searching by: {'deleted': False, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:24:44.548586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.550403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.551762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.554109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.554816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.555405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:44.647616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:24:44.747491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:44.775898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:44.778707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:44.781063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.361881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:45.369873 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3fb93b30-d68a-42da-ac6d-45d138ee73f8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 1.045467 Sep 08 10:24:45.370644 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1253/2696] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:44 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:45.381696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a81538d7-9b49-4393-8437-2c8a8e7311d3 req-5a9fe8f6-08eb-4d53-b460-ab7587766670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c776b28d-f039-48b0-a665-ec517d69cbd3", "name": "network-vif-deleted", "tag": "aac80c0e-215f-4ba7-8d98-3a3c8d33498c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:45.392116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a81538d7-9b49-4393-8437-2c8a8e7311d3 req-5a9fe8f6-08eb-4d53-b460-ab7587766670 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.392596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a81538d7-9b49-4393-8437-2c8a8e7311d3 req-5a9fe8f6-08eb-4d53-b460-ab7587766670 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.393097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a81538d7-9b49-4393-8437-2c8a8e7311d3 req-5a9fe8f6-08eb-4d53-b460-ab7587766670 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.428043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a81538d7-9b49-4393-8437-2c8a8e7311d3 req-5a9fe8f6-08eb-4d53-b460-ab7587766670 service nova] Creating event network-vif-deleted:aac80c0e-215f-4ba7-8d98-3a3c8d33498c for instance c776b28d-f039-48b0-a665-ec517d69cbd3 on n-h1-833090-19 Sep 08 10:24:45.443226 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a81538d7-9b49-4393-8437-2c8a8e7311d3 req-5a9fe8f6-08eb-4d53-b460-ab7587766670 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067855 Sep 08 10:24:45.447187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1254/2697] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:45.456926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:45.459714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d612fed5-c695-450a-85f3-86834f64f30c tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.979507 Sep 08 10:24:45.463528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] [instance: c776b28d-f039-48b0-a665-ec517d69cbd3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:45.476574 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1444/2698] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:24:44 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:45.483694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.487795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.488384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.489780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:45.490581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:45.491565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.493511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.494036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.499969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.500681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.501603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.502492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.503108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.504010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.534344 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] HTTP exception thrown: Instance c776b28d-f039-48b0-a665-ec517d69cbd3 could not be found. Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Request method failure captured: Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 HTTP/1.1 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcLMoN8hFhx-pBnFiC1o7-GCC72sif7KU68yp4UOOySqiaUkzRSszgkm91loGtMTZ_nRMQQUY6RiIveAeg2W5IiRKRaRlh-zohHsvKA8D_Xbdaw1r2eUR_nvBio8kpbf1gM6HOb_w8cnBt4A3wypg01YjyTm3K0kOhK3u_gSTlg2Yvw Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1d86ba5344c14acd9af5b1bb370df16f Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-941652224 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1d86ba5344c14acd9af5b1bb370df16f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1d86ba5344c14acd9af5b1bb370df16f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1d86ba5344c14acd9af5b1bb370df16f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1d86ba5344c14acd9af5b1bb370df16f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-941652224 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1d86ba5344c14acd9af5b1bb370df16f Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-941652224 Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerDiagnosticsNegativeTest-941652224-project Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 200a226e0a8946d5b5efafa7a9db269b Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-941652224-project Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance c776b28d-f039-48b0-a665-ec517d69cbd3 could not be found. Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'c776b28d-f039-48b0-a665-ec517d69cbd3'} Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c776b28d-f039-48b0-a665-ec517d69cbd3 could not be found. Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c776b28d-f039-48b0-a665-ec517d69cbd3 could not be found. Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:24:45.542617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c776b28d-f039-48b0-a665-ec517d69cbd3 could not be found. Sep 08 10:24:45.547799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:24:45.550441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] Returning 404 to user: Instance c776b28d-f039-48b0-a665-ec517d69cbd3 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:24:45.552197 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc52bcd7-5f41-4b5c-b115-9b3183ac4e89 tempest-ServerDiagnosticsNegativeTest-941652224 tempest-ServerDiagnosticsNegativeTest-941652224-project] 10.222.0.59 "GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3" status: 404 len: 111 microversion: 2.1 time: 0.103531 Sep 08 10:24:45.553028 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1255/2699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:45 2022] GET /compute/v2.1/servers/c776b28d-f039-48b0-a665-ec517d69cbd3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:24:45.580778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9c6a252-eb18-4c44-8937-f860cd43048a tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:45.601458 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9c6a252-eb18-4c44-8937-f860cd43048a tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043570 Sep 08 10:24:45.602047 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1256/2700] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:24:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:45.628644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:45.631163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:45.654023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.654805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.655440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.656510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:45.657032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:45.657466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:45.862384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:45.882821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:45.889130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:45.893238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-262a682a-1bab-45e8-8018-2d3e6f6b461a tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.273851 Sep 08 10:24:45.896669 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1257/2701] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:45 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:45.970362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:45.981576 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1c75670-953d-4476-812d-e3e0c9d4b712 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1316 microversion: 2.1 time: 0.503780 Sep 08 10:24:45.986005 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1445/2702] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:45 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:46.221008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f6ef39b0-eec4-4a98-a81d-3084b591db60 req-4a691f96-6dee-49b5-a7a9-d25244ab9579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc7a421-cb20-467e-8f14-d506b824caa3", "name": "network-vif-plugged", "status": "completed", "tag": "b98634a0-562d-4392-8e8a-f9be80778899"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:46.245282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f6ef39b0-eec4-4a98-a81d-3084b591db60 req-4a691f96-6dee-49b5-a7a9-d25244ab9579 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:46.247815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f6ef39b0-eec4-4a98-a81d-3084b591db60 req-4a691f96-6dee-49b5-a7a9-d25244ab9579 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:46.249157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f6ef39b0-eec4-4a98-a81d-3084b591db60 req-4a691f96-6dee-49b5-a7a9-d25244ab9579 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:46.295183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f6ef39b0-eec4-4a98-a81d-3084b591db60 req-4a691f96-6dee-49b5-a7a9-d25244ab9579 service nova] Creating event network-vif-plugged:b98634a0-562d-4392-8e8a-f9be80778899 for instance 8dc7a421-cb20-467e-8f14-d506b824caa3 on n-h1-833090-19 Sep 08 10:24:46.323788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f6ef39b0-eec4-4a98-a81d-3084b591db60 req-4a691f96-6dee-49b5-a7a9-d25244ab9579 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096735 Sep 08 10:24:46.325093 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1258/2703] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:46.394447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:46.395423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:46.413375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:46.413857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:46.414301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:46.415015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:46.415591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:46.416022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:46.734349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:46.734999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:46.746921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:46.748252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:46.748714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:46.750743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:46.751278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:46.752885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:46.818948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:24:46.974385 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14fff1d0-a385-4215-a641-9e60b289bee5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 204 len: 0 microversion: 2.1 time: 0.245151 Sep 08 10:24:46.978257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1259/2704] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:24:46 2022] DELETE /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:24:46.997035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:46.998737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:47.014762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:47.015488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:47.018582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:47.020403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:47.021008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:47.021543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:47.893762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:47.913969 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb0f3d71-5f18-4e99-ad20-26ab35378992 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1316 microversion: 2.1 time: 1.523590 Sep 08 10:24:47.917784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1446/2705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:46 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1316 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:47.938210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:47.942398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:47.966479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:47.970320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:47.973372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:47.974201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:47.976091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:47.982699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:47.983966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:47.997126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:47.998602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:47.999848 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bda43ca3-16c1-4c71-b77c-354452bde86f tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 1.021393 Sep 08 10:24:48.004759 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1260/2706] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:46 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:48.009613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:48.010233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:48.037392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.037899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.038348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.039078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.039564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.039998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.524847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:48.541596 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b805acf8-49ef-492b-b6e9-f54a19f186c2 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1506 microversion: 2.1 time: 0.535619 Sep 08 10:24:48.549516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:48.557892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1261/2707] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:48 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:48.571341 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48eae2a8-a4a7-49b7-bd35-a3a317482f8e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1609 microversion: 2.1 time: 0.651176 Sep 08 10:24:48.580229 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1447/2708] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:47 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1609 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:48.585527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:48.587774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:48.603699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.604933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.608968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.624052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.625568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.626445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.727658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:48.728999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-752c437a-1952-4c51-af3f-5db8089f4a23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa/os-instance-actions/req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087" status: 200 len: 313 microversion: 2.1 time: 0.159828 Sep 08 10:24:48.734785 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1262/2709] 10.222.0.59 () {58 vars in 1419 bytes} [Thu Sep 8 10:24:48 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa/os-instance-actions/req-ffbac193-1fb4-41d3-b506-0b8bb9bcc087 => generated 313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:24:48.748381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:48.752007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:48.755901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:48.782088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.782843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.783515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.784396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.785001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.785968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.942696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:48.943324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:48.957489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.958044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.958429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:48.959159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:48.959649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:48.960081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.019164 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a5d4268-4e90-4c6c-a343-13b7c21f6b4c tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "POST /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa/action" status: 202 len: 0 microversion: 2.1 time: 0.275375 Sep 08 10:24:49.021340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1448/2710] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:24:48 2022] POST /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:24:49.071193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:49.072352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:49.080441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:49.082478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:49.085681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.087085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:49.087879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:49.089643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.461001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:49.470114 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8004710a-c496-418b-b807-15435d63b972 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1466 microversion: 2.1 time: 0.531678 Sep 08 10:24:49.492670 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1263/2711] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:48 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1466 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:49.506125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:49.506744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:49.519356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:49.551852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:49.556501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:49.557204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.560867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:49.561611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:49.562438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.574729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:49.583087 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-478dbd14-1e8b-4630-970a-2663e9390575 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1508 microversion: 2.1 time: 0.545577 Sep 08 10:24:49.583707 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1449/2712] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:49 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1508 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:49.615065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:49.619272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:49.631084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:49.632911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:49.634117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.636519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:49.637941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:49.638590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:49.685841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:49.910599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:49.971579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:49.976582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:49.978772 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6e5f879-1d5c-42bf-980f-dd9b2e52743b tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1408 microversion: 2.54 time: 0.484727 Sep 08 10:24:49.984542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1264/2713] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:49 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:49.993446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:49.998303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:50.018438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:50.021051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:50.022467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:50.028398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:50.030773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:50.032971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:50.149319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-830d20ee-105d-4abd-a4be-da94d7435ec9 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1619 microversion: 2.1 time: 0.561559 Sep 08 10:24:50.167120 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1450/2714] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:49 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1619 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:50.481556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:50.494437 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4d37d2c9-cca5-4027-b6b2-57367775a94b tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1609 microversion: 2.1 time: 0.508436 Sep 08 10:24:50.495032 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1265/2715] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:49 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1609 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:50.532280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-217442661", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a8c4b6e2-f598-4ed6-bc7b-570148c9e012"]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:50.612181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:50.613094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:50.629888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:50.637465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:50.638401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:50.640200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:50.645934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:50.647952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:50.733313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:24:51.813999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:24:51.814594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:24:51.814907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:24:51.815323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:24:51.815764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:24:51.862369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:51.872274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:51.872274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:51.872274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:51.872274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:51.872274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:51.872996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:51.911752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc9e130d-46ed-483e-9159-d80ad234c8bd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1508 microversion: 2.1 time: 1.292354 Sep 08 10:24:51.920592 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1266/2716] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:50 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1508 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:24:51.933391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:24:51.938102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:51.938844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:51.955022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:51.955699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:51.956133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:24:51.957988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:51.958962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:51.965666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:51.967036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:51.994324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:24:52.000075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:24:52.202628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:52.220801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:52.222669 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a4d573d1-88e7-460d-ae14-ca027b61fc97 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695974 Sep 08 10:24:52.222837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:52.224364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a6bba85-4400-4c7b-8610-5f5e57961b9d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1414 microversion: 2.54 time: 0.302467 Sep 08 10:24:52.226642 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1451/2717] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:24:52.227429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1267/2718] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:51 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1414 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:52.237071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e045abef-65ce-474d-a318-ae041b089e99 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:52.238311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e045abef-65ce-474d-a318-ae041b089e99 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:52.254926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:52.255483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:52.268744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:52.269550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:52.270212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:52.271328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:52.271951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:52.272669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:52.281156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:52.588189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e045abef-65ce-474d-a318-ae041b089e99 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:52.596615 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e045abef-65ce-474d-a318-ae041b089e99 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1216 microversion: 2.1 time: 0.363432 Sep 08 10:24:52.599789 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1268/2719] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:52 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1216 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:52.969067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3425f8e0-dba4-47e6-afb0-f77dd5f640df tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:52.984390 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3425f8e0-dba4-47e6-afb0-f77dd5f640df tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.383394 Sep 08 10:24:53.007433 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1269/2720] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:24:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:53.019723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:53.034748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:53.048384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:53.052733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:53.053489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:53.054533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:53.055239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:53.056000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:53.060745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:53.077528 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af527961-d06c-4f73-9bb3-03dd82e128ad tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1609 microversion: 2.1 time: 0.849730 Sep 08 10:24:53.097741 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1452/2721] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:52 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1609 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:53.263977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:53.264838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:53.284081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:53.284893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:53.286020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:53.287367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:53.288004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:53.288577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:53.613882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:53.632958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:53.639829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:53.647171 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0842831-15fa-4c13-958d-872125d93b74 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1414 microversion: 2.54 time: 0.389285 Sep 08 10:24:53.655171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1453/2722] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:53 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1414 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:53.676738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:53.680901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:53.713345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:53.714891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:53.717510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:53.718459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:53.721696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:53.722344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:53.804957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:53.822972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c502c23f-7966-4e19-8eea-8ec1c1fdedea tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1508 microversion: 2.1 time: 0.811199 Sep 08 10:24:53.829450 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1270/2723] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:53 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1508 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:53.892808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:53.909827 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-deb1c1c6-2c62-4ed7-a7e0-3ddef251c05f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1268 microversion: 2.1 time: 0.252648 Sep 08 10:24:53.911993 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1454/2724] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:53 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1268 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:54.105408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:54.106720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:54.125673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:54.126172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:54.126609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:54.127320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:54.134012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:54.134935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:54.226911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:24:54.446182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f4ce8a6-9de5-4f4e-98b1-3f2ab528b3f9 tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1425006870", "imageRef": "bccba887-e025-4be8-a57b-e23a6f741810", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:54.559378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-3f4ce8a6-9de5-4f4e-98b1-3f2ab528b3f9 tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:24:55.190333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:55.202964 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec039e1e-2571-4900-84a8-885f7e1f5654 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1609 microversion: 2.1 time: 1.102337 Sep 08 10:24:55.206254 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1271/2725] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:54 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1609 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:55.216250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:55.220388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:55.229706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:55.230205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:55.230841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:55.234097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:55.234481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:55.234921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:55.956179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:55.970580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:55.972283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:55.973850 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94987c24-5184-4a17-a76d-2d0d0ee704ea tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1414 microversion: 2.54 time: 0.766287 Sep 08 10:24:55.975013 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1272/2726] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:55 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1414 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:55.980677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:55.982027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:55.990745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:55.991638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:55.992246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:55.993128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:55.993736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:55.994501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:56.514769 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3f4ce8a6-9de5-4f4e-98b1-3f2ab528b3f9 tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f4ce8a6-9de5-4f4e-98b1-3f2ab528b3f9 tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] Request method failure captured: Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 143 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcL0CMrczMn_d94phPIETojS2MBAADfmOwBGgjs9g7sJqYuuAjHiXd4qRPbwyxnTL2WJCuCkL3uJl8tqPt3mqZAXccObl6BBtfQn1_ke0-zvKx0UPCgmrCHG6V911INCH9PKpP60-HxhQQfuNMomapx5T7YtJaCbmjFcJjnovSOTm04 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 942f094ba7d9431887a93dcd45dd3165 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FlavorsV2NegativeTest-1606077381 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/942f094ba7d9431887a93dcd45dd3165"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/942f094ba7d9431887a93dcd45dd3165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/942f094ba7d9431887a93dcd45dd3165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_942f094ba7d9431887a93dcd45dd3165", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FlavorsV2NegativeTest-1606077381 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 942f094ba7d9431887a93dcd45dd3165 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1606077381 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FlavorsV2NegativeTest-1606077381-project Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 39c2e2b2459a4ec5b4694a6b7352fca4 Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FlavorsV2NegativeTest-1606077381-project Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1425006870", "imageRef": "bccba887-e025-4be8-a57b-e23a6f741810", "flavorRef": "452"}} Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor's memory is too small for requested image. Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1425006870', 'imageRef': 'bccba887-e025-4be8-a57b-e23a6f741810', 'flavorRef': '452'}}} Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:24:56.516842 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f4ce8a6-9de5-4f4e-98b1-3f2ab528b3f9 tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f4ce8a6-9de5-4f4e-98b1-3f2ab528b3f9 tempest-FlavorsV2NegativeTest-1606077381 tempest-FlavorsV2NegativeTest-1606077381-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.076263 Sep 08 10:24:56.523885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1455/2727] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:24:54 2022] POST /compute/v2.1/servers => generated 93 bytes in 2078 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:24:56.540609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:56.541241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:56.562225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:56.564028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:56.566554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:56.567878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:56.568816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:56.569063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:57.188852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:57.200102 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62e4a109-a0ae-44f0-b727-ae0a6a405c23 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1508 microversion: 2.1 time: 1.223691 Sep 08 10:24:57.208205 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1273/2728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:55 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1508 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:57.323215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-399456116", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "7bea54b2-3154-47c8-835b-cf27d6e1658d"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:57.424128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] validate_networks() for [('7bea54b2-3154-47c8-835b-cf27d6e1658d', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:24:57.871689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:57.885520 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-694c741a-642d-4201-aa93-fa998f970d4a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 1.362795 Sep 08 10:24:57.886729 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1456/2729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:56 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:57.900072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:57.900896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:57.917962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:57.918469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:57.918913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:57.922634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:57.925276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:57.925684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:58.175971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:58.190212 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a84da91-7f4d-495b-a101-62a49a0cbfb5 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1542 microversion: 2.1 time: 0.294501 Sep 08 10:24:58.191057 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1457/2730] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:57 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1542 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:58.201793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:58.203843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:58.217870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:58.218600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:58.219229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:58.220232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:58.220877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:58.223291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:58.544115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:58.558497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:58.564475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:58.568350 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-045ab5a8-47f5-4b3a-bf56-881f31cd3197 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1399 microversion: 2.54 time: 0.373835 Sep 08 10:24:58.575250 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1458/2731] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:24:58 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1399 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:24:58.600895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-60823197-7f41-4c25-867a-2394a9395ba1 req-803fe9b9-43b5-4291-9e12-bcc6fe6ec41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f61f7ec-ddbd-41ab-9fde-8da04751631c", "name": "network-vif-unplugged", "status": "completed", "tag": "89d823cd-f9c3-4c91-82cf-bdbf64d47398"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:58.634548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-60823197-7f41-4c25-867a-2394a9395ba1 req-803fe9b9-43b5-4291-9e12-bcc6fe6ec41e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:58.635386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-60823197-7f41-4c25-867a-2394a9395ba1 req-803fe9b9-43b5-4291-9e12-bcc6fe6ec41e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:58.636071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-60823197-7f41-4c25-867a-2394a9395ba1 req-803fe9b9-43b5-4291-9e12-bcc6fe6ec41e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:58.670449 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-60823197-7f41-4c25-867a-2394a9395ba1 req-803fe9b9-43b5-4291-9e12-bcc6fe6ec41e service nova] Creating event network-vif-unplugged:89d823cd-f9c3-4c91-82cf-bdbf64d47398 for instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c on n-h2-833090-19 Sep 08 10:24:58.681917 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-60823197-7f41-4c25-867a-2394a9395ba1 req-803fe9b9-43b5-4291-9e12-bcc6fe6ec41e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098609 Sep 08 10:24:58.692491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1459/2732] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:58.698119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-62e02d81-d0de-4d9c-a4ae-c43520e24132 req-21b787b6-a031-477b-850a-3833d4c3485a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e", "tag": "e26d38c1-e1b9-4b18-b8e7-ee09edffdb74"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:24:58.720765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62e02d81-d0de-4d9c-a4ae-c43520e24132 req-21b787b6-a031-477b-850a-3833d4c3485a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:58.724936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62e02d81-d0de-4d9c-a4ae-c43520e24132 req-21b787b6-a031-477b-850a-3833d4c3485a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:58.725522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62e02d81-d0de-4d9c-a4ae-c43520e24132 req-21b787b6-a031-477b-850a-3833d4c3485a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:58.759600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-62e02d81-d0de-4d9c-a4ae-c43520e24132 req-21b787b6-a031-477b-850a-3833d4c3485a service nova] Creating event network-changed:e26d38c1-e1b9-4b18-b8e7-ee09edffdb74 for instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e on n-h1-833090-19 Sep 08 10:24:58.766583 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-62e02d81-d0de-4d9c-a4ae-c43520e24132 req-21b787b6-a031-477b-850a-3833d4c3485a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072273 Sep 08 10:24:58.768332 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1460/2733] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:24:58.774802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:58.775857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:58.782860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:58.783732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:58.784420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:58.785582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:58.786355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:58.786997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:59.368227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:24:59.381207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-929e78ec-7016-4d16-ae64-90eb1ae9c9cd tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1506 microversion: 2.1 time: 0.611396 Sep 08 10:24:59.382361 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1461/2734] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:58 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:24:59.387410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ea78c2c-fc58-4059-b933-5fae9ffe0b57 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '.version_select at 0x7f23506858b0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:59.454843 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ea78c2c-fc58-4059-b933-5fae9ffe0b57 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1888558964" status: 204 len: 0 microversion: 2.54 time: 0.070997 Sep 08 10:24:59.459615 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1462/2735] 10.222.0.59 () {60 vars in 1319 bytes} [Thu Sep 8 10:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1888558964 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:24:59.476206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:24:59.478717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:24:59.491816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:59.494815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:59.496612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:24:59.498814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:24:59.501594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:24:59.503601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:00.862954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:00.870907 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f025d6cd-b29f-43d6-b7a0-12739f385f79 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 1.407234 Sep 08 10:25:00.878371 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1463/2736] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:24:59 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:00.886842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:00.896463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:00.919166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:00.920267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:00.920722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:00.921452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:00.921914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:00.922348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.120094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:01.132362 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6be7a9bd-751d-4d55-8a37-22d1397aceb4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1253 microversion: 2.1 time: 0.252600 Sep 08 10:25:01.133195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1464/2737] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:00 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1253 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:01.144796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '.version_select at 0x7f2350685790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:01.152084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:01.166373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.167122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.167874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.172468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.173185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.173788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.246208 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd894d7b-573c-4f91-b9c7-9ecd5c7a13be tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.111771 Sep 08 10:25:01.250585 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1465/2738] 10.222.0.59 () {58 vars in 1296 bytes} [Thu Sep 8 10:25:01 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa/os-instance-actions => generated 611 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:01.251730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:01.252174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:01.252732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:01.254073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:01.254780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:01.264855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:01.273281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:01.292004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.292971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.293765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.294710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.295318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.295934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.299201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.303197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.303741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.307177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.307704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.308154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.377467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Getting quotas for project 0fac3ab51d9049bea3393313680eb6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:01.395272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:25:01.399766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Getting quotas for user 0218f274eff54ce8bf63b54e39df1820 and project 0fac3ab51d9049bea3393313680eb6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:01.450584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:01.463341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:01.680470 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4487a361-bc43-41f9-8677-9f704387535d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "DELETE /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 204 len: 0 microversion: 2.54 time: 0.427190 Sep 08 10:25:01.688639 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1466/2739] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:25:01 2022] DELETE /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:25:01.695450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b0804a12-9b70-449c-822d-4f26589c7ff0 req-89d5cd57-5a68-4f5a-8632-5cc3bf7eede5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f61f7ec-ddbd-41ab-9fde-8da04751631c", "name": "network-vif-deleted", "tag": "89d823cd-f9c3-4c91-82cf-bdbf64d47398"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:01.703995 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54cf302b-113d-4370-b2f8-8bc76e102067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.490860 Sep 08 10:25:01.708386 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1274/2740] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:24:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:25:01.734232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:01.736168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:01.738296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0804a12-9b70-449c-822d-4f26589c7ff0 req-89d5cd57-5a68-4f5a-8632-5cc3bf7eede5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.748027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0804a12-9b70-449c-822d-4f26589c7ff0 req-89d5cd57-5a68-4f5a-8632-5cc3bf7eede5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.748498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0804a12-9b70-449c-822d-4f26589c7ff0 req-89d5cd57-5a68-4f5a-8632-5cc3bf7eede5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.753956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.754680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.755262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.757799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.759337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.760307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.782280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b0804a12-9b70-449c-822d-4f26589c7ff0 req-89d5cd57-5a68-4f5a-8632-5cc3bf7eede5 service nova] Creating event network-vif-deleted:89d823cd-f9c3-4c91-82cf-bdbf64d47398 for instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c on n-h2-833090-19 Sep 08 10:25:01.806751 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b0804a12-9b70-449c-822d-4f26589c7ff0 req-89d5cd57-5a68-4f5a-8632-5cc3bf7eede5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116172 Sep 08 10:25:01.807642 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1467/2741] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:01.816800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:01.828924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:01.832378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:25:01.867163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.867737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.868144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.868869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:01.869331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:01.869758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:01.968000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:01.982430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:02.000938 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a823da6b-038e-4be0-bfb2-8f40ec69d6e7 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "DELETE /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 204 len: 0 microversion: 2.1 time: 0.286765 Sep 08 10:25:02.005092 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1275/2742] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:25:01 2022] DELETE /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:25:02.013905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93580dc5-e9ba-400a-aa9f-e4e56761cdfa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:02.014920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93580dc5-e9ba-400a-aa9f-e4e56761cdfa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:02.341962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93580dc5-e9ba-400a-aa9f-e4e56761cdfa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:02.353139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:02.357295 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93580dc5-e9ba-400a-aa9f-e4e56761cdfa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1217 microversion: 2.1 time: 0.350149 Sep 08 10:25:02.366745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:02.369097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:02.375252 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1276/2743] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:02 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:02.381421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:02.382033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:02.385786 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8edc979-3649-4333-9810-e6c2b554f567 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1405 microversion: 2.54 time: 0.571484 Sep 08 10:25:02.400738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:02.401145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:02.401586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:02.402290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:02.402718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:02.403137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:02.417784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1468/2744] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:01 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1405 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:02.438870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:02.441280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:02.463309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:02.466048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:02.467152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:02.482005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:02.483385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:02.486458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.241003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.250309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a5d9d36-86b0-4439-a3fc-31bc546391f4 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1512 microversion: 2.1 time: 0.830487 Sep 08 10:25:03.260807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.265601 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1469/2745] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:02 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1512 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:03.273665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:03.274474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:03.283495 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f3fe240-4f34-4158-b7f6-45b2106ade87 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 0.906879 Sep 08 10:25:03.284091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1277/2746] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:02 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:03.301304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:03.302010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:03.302607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.303518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:03.304119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:03.304695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.382594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:03.383139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:03.395232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:03.396053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:03.396649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.399654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:03.400757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:03.401404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.551958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.580708 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49107bb2-66aa-48fd-9a41-d49bfdf014a8 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1253 microversion: 2.1 time: 0.311104 Sep 08 10:25:03.599526 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1470/2747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:03 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1253 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:03.612166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:03.613064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:03.628745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:03.629526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:03.630170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.631079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:03.631723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:03.638627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:03.642344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:03.750447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.794374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-115f9d34-5ef1-4d9e-b1f6-d8a5cdd7e067 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1269 microversion: 2.1 time: 0.402842 Sep 08 10:25:03.795805 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1278/2748] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:03 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1269 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:03.886144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.902745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.905171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:03.906726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d51ca03-20b2-49f0-b06f-6b90128af977 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1405 microversion: 2.54 time: 0.305774 Sep 08 10:25:03.912137 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1471/2749] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:03 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:04.290102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:04.291073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:04.306354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:04.307192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:04.307872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:04.308801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:04.310255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:04.315075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:04.318231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:04.318860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:04.333468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:04.333979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:04.334430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:04.335152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:04.335647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:04.336079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.002972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.019694 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c9ae424-5ebc-4c09-8340-65e81a195b15 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1512 microversion: 2.1 time: 0.733189 Sep 08 10:25:05.040249 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1279/2750] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:04 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:05.045545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:05.051220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:05.070079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:05.070864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:05.071330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.072105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:05.072547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:05.072975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.181942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.190972 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35c65c01-1554-4f6c-ab38-6160906ba94b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 0.878458 Sep 08 10:25:05.225905 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1472/2751] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:04 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:05.239762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:05.241771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:05.262107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:05.262997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:05.267025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.272345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:05.274305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:05.276842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.402483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.423056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb7459eb-066c-4025-8e85-79d07284cb3e tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1253 microversion: 2.1 time: 0.381232 Sep 08 10:25:05.423936 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1280/2752] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:05 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1253 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:05.431390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:05.432312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:05.444129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:05.445152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:05.445747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.447260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:05.447912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:05.448492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:05.518272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.531842 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6cff4d9-d23e-4319-9a26-4afb75d1f1ab tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1275 microversion: 2.1 time: 0.304586 Sep 08 10:25:05.534224 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1473/2753] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:05 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:05.589611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.605582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.608688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '952788fcfa2e4799b5f17aac65dea5e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b4844846d473e9560fecbeb6f6292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:05.610113 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd47f25b-2180-4830-b38d-3e982656da79 tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 200 len: 1405 microversion: 2.54 time: 0.184776 Sep 08 10:25:05.612862 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1281/2754] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:05 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:06.058457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:06.070055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:06.089810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:06.091717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:06.095078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:06.100639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:06.101179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:06.104509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:06.231724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:06.233037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:06.241412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:06.247023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:06.247849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:06.249020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:06.249661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:06.250253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:06.993595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:07.010985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16e29954-820f-4bad-b519-20b811bea046 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1512 microversion: 2.1 time: 0.970937 Sep 08 10:25:07.013855 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1474/2755] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:06 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1512 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:07.029114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:07.030857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:07.048514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.049271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.049875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.053551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.054244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.060734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.336387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:07.361238 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-405655bf-709c-4b02-8adb-7e4e4957a6da tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1253 microversion: 2.1 time: 0.336316 Sep 08 10:25:07.385922 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1475/2756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:07 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1253 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:07.402605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:07.403283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:07.417454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.417962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.418407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.419133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.425222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:07.427834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.428365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.452441 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-304d3e7b-9238-4a8e-b983-7536158aea7e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 1.224691 Sep 08 10:25:07.453781 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1282/2757] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:06 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:07.471875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:07.473271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] [instance: 64a110e1-dea5-4154-90a9-689795bd62e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:07.496548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.497210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.503005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.505704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.506437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.506990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.518168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:07.546289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] HTTP exception thrown: Instance 64a110e1-dea5-4154-90a9-689795bd62e8 could not be found. Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Request method failure captured: Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 HTTP/1.1 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcLD-_A8H64ZsEsu2tO4We2rLZnGLbi5H-9qViuejpKfttIa76rTIbrSahnLFyKKL56geexfdhU7Kk7eE6XmAdgwN60F-ShBUA2n6jMJ5ubrYwVt58r7zqpRfDLPU2kjDhnfT2_bPm3_6uVxvE2vWaGe5uQ_PYZonArsV1XRtL08OOs Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.54 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 332b4844846d473e9560fecbeb6f6292 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerShowV254Test-777153147 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/332b4844846d473e9560fecbeb6f6292"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/332b4844846d473e9560fecbeb6f6292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/332b4844846d473e9560fecbeb6f6292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_332b4844846d473e9560fecbeb6f6292", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerShowV254Test-777153147 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 332b4844846d473e9560fecbeb6f6292 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerShowV254Test-777153147 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerShowV254Test-777153147-project Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 952788fcfa2e4799b5f17aac65dea5e1 Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerShowV254Test-777153147-project Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 64a110e1-dea5-4154-90a9-689795bd62e8 could not be found. Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '64a110e1-dea5-4154-90a9-689795bd62e8'} Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a110e1-dea5-4154-90a9-689795bd62e8 could not be found. Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a110e1-dea5-4154-90a9-689795bd62e8 could not be found. Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:07.549815 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a110e1-dea5-4154-90a9-689795bd62e8 could not be found. Sep 08 10:25:07.554977 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:07.558558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] Returning 404 to user: Instance 64a110e1-dea5-4154-90a9-689795bd62e8 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:25:07.559724 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc7bce70-9899-4e63-bcc3-4606a3305e0d tempest-ServerShowV254Test-777153147 tempest-ServerShowV254Test-777153147-project] 10.222.0.59 "GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8" status: 404 len: 111 microversion: 2.54 time: 0.104723 Sep 08 10:25:07.560851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1283/2758] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:07 2022] GET /compute/v2.1/servers/64a110e1-dea5-4154-90a9-689795bd62e8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:25:07.603360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:07.615003 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65f52a92-7ad7-46fd-ab1d-d4c551fc0ee7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1275 microversion: 2.1 time: 0.226563 Sep 08 10:25:07.620944 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1476/2759] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:07 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:07.854691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-06fbe6b5-a0a7-434e-b711-e70e07d3f7fc req-4109c46b-9a47-4a93-b05b-49344bb885ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493146a5-66be-4589-b34a-5732a4ef22aa", "name": "network-vif-deleted", "tag": "87e96b22-14c3-4bc6-ba66-4f9d95390706"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:07.883798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-06fbe6b5-a0a7-434e-b711-e70e07d3f7fc req-4109c46b-9a47-4a93-b05b-49344bb885ff service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:07.896832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-06fbe6b5-a0a7-434e-b711-e70e07d3f7fc req-4109c46b-9a47-4a93-b05b-49344bb885ff service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:07.900235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-06fbe6b5-a0a7-434e-b711-e70e07d3f7fc req-4109c46b-9a47-4a93-b05b-49344bb885ff service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:07.954138 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-06fbe6b5-a0a7-434e-b711-e70e07d3f7fc req-4109c46b-9a47-4a93-b05b-49344bb885ff service nova] Creating event network-vif-deleted:87e96b22-14c3-4bc6-ba66-4f9d95390706 for instance 493146a5-66be-4589-b34a-5732a4ef22aa on n-h2-833090-19 Sep 08 10:25:07.988867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-06fbe6b5-a0a7-434e-b711-e70e07d3f7fc req-4109c46b-9a47-4a93-b05b-49344bb885ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138498 Sep 08 10:25:07.998494 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1284/2760] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:08.040857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:08.072467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:08.099970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.100933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.101579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.102481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.103229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.103838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.271113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f08479b9-e2e4-4821-ab70-1d5d19a0dd08 req-6d59b4db-7904-4b62-9e82-ffb9f65f1efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e", "name": "network-vif-plugged", "status": "completed", "tag": "e26d38c1-e1b9-4b18-b8e7-ee09edffdb74"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:08.282544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.283068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.293052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.294242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lazy-loading 'fault' on Instance uuid 493146a5-66be-4589-b34a-5732a4ef22aa {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:25:08.309678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f08479b9-e2e4-4821-ab70-1d5d19a0dd08 req-6d59b4db-7904-4b62-9e82-ffb9f65f1efc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.310590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f08479b9-e2e4-4821-ab70-1d5d19a0dd08 req-6d59b4db-7904-4b62-9e82-ffb9f65f1efc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.311791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f08479b9-e2e4-4821-ab70-1d5d19a0dd08 req-6d59b4db-7904-4b62-9e82-ffb9f65f1efc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.386459 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f08479b9-e2e4-4821-ab70-1d5d19a0dd08 req-6d59b4db-7904-4b62-9e82-ffb9f65f1efc service nova] Creating event network-vif-plugged:e26d38c1-e1b9-4b18-b8e7-ee09edffdb74 for instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e on n-h1-833090-19 Sep 08 10:25:08.398940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d0fe33ea984af88d341d9720636a34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b458f47fb0242268a00e3cf1fbf64ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:08.406772 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f08479b9-e2e4-4821-ab70-1d5d19a0dd08 req-6d59b4db-7904-4b62-9e82-ffb9f65f1efc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140009 Sep 08 10:25:08.407868 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1285/2761] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:08.416140 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-be4fe9ec-d0f8-4589-a989-f70d60101f6f tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 200 len: 1306 microversion: 2.1 time: 0.373081 Sep 08 10:25:08.431486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1477/2762] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:08 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 1306 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:08.461584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:08.462471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:08.477605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:08.478234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:08.480133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.481158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.481838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.482870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.484121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.484489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.484982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.485221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.485416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.497055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.497811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.498457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.840865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:08.856830 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f5ce710-b67c-4841-a71a-bc3892b81245 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1253 microversion: 2.1 time: 0.440079 Sep 08 10:25:08.872583 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1286/2763] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:08 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1253 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:08.887658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:08.893836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:08.908482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.909346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.909971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:08.911652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:08.921618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:08.922227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:09.581742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:09.595616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69e80d28-ed22-4d50-8d93-a8c160a90cbf tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 1.118620 Sep 08 10:25:09.596361 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1478/2764] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:08 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:09.601409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:09.609746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:09.618271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5514ae99-1183-4166-a768-a95ed30afa79 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 0.744219 Sep 08 10:25:09.619018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] [instance: 493146a5-66be-4589-b34a-5732a4ef22aa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:09.621493 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1287/2765] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:08 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:09.632939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:09.634249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:09.635694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:09.639838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:09.640646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:09.641276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:09.677660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] HTTP exception thrown: Instance 493146a5-66be-4589-b34a-5732a4ef22aa could not be found. Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Request method failure captured: Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa HTTP/1.1 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcLPMStlpYgvmtUrcbsao5CitkM_0NBnZvQ3LOI5gCYa5-NmiJG7hSxTWo688j0xwLINHlau_JTZKzSDrygDEyH8uG5GdpgR6N-8jvXS0WEf9CRkCdcZk6i8ZaJjNg7vhUlDPTpMceiMf6ld6UDF9ZD4nqrltOvhQxTCAjki9sjjqrU Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 8b458f47fb0242268a00e3cf1fbf64ba Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceActionsTestJSON-159902328 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8b458f47fb0242268a00e3cf1fbf64ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8b458f47fb0242268a00e3cf1fbf64ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8b458f47fb0242268a00e3cf1fbf64ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8b458f47fb0242268a00e3cf1fbf64ba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceActionsTestJSON-159902328 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 8b458f47fb0242268a00e3cf1fbf64ba Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceActionsTestJSON-159902328 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceActionsTestJSON-159902328-project Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 87d0fe33ea984af88d341d9720636a34 Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceActionsTestJSON-159902328-project Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 493146a5-66be-4589-b34a-5732a4ef22aa could not be found. Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '493146a5-66be-4589-b34a-5732a4ef22aa'} Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493146a5-66be-4589-b34a-5732a4ef22aa could not be found. Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493146a5-66be-4589-b34a-5732a4ef22aa could not be found. Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:09.679909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493146a5-66be-4589-b34a-5732a4ef22aa could not be found. Sep 08 10:25:09.683439 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:09.685757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] Returning 404 to user: Instance 493146a5-66be-4589-b34a-5732a4ef22aa could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:25:09.687690 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9749eb3b-adca-4081-a16e-94ca7d991e92 tempest-InstanceActionsTestJSON-159902328 tempest-InstanceActionsTestJSON-159902328-project] 10.222.0.59 "GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa" status: 404 len: 111 microversion: 2.1 time: 0.090140 Sep 08 10:25:09.692259 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1479/2766] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:09 2022] GET /compute/v2.1/servers/493146a5-66be-4589-b34a-5732a4ef22aa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:25:09.880302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:09.881085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:09.890656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:09.891640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:09.901246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:09.902251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:09.902954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:09.903654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:10.056591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:10.069469 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df82f1c0-5913-4184-8fd9-a8887518d0be tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1253 microversion: 2.1 time: 0.193604 Sep 08 10:25:10.084637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1288/2767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:09 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1253 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:10.618269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:10.619701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:10.632892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:10.634067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:10.636363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:10.638861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:10.640277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:10.642368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:10.650426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:10.654427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:10.702365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:10.714014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:10.722378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:10.726708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:10.734507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:10.738483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:11.347825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:11.863601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:11.876717 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8c18766-b84c-4798-9763-08b3fd64f10e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 1.231468 Sep 08 10:25:11.894031 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1289/2768] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:10 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:11.902534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:11.903657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:11.913937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:11.915496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:11.916463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:11.917755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:11.918820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:11.919298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:12.007891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:12.019714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e106720-215f-4847-bf7b-768eb97940ab tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1316 microversion: 2.1 time: 1.405177 Sep 08 10:25:12.020313 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1480/2769] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:10 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1316 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:12.026992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:12.029460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:12.030118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:12.032778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lazy-loading 'fault' on Instance uuid 2f61f7ec-ddbd-41ab-9fde-8da04751631c {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:25:12.040004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f262ac70-248c-46dd-b7f8-91714d970165 req-9b768417-9097-49b6-af14-60ec4d79e4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb87b182-a7ea-4da4-9c78-b82f740179f8", "tag": "bb5cb180-c808-43df-8564-b4c81007ef41"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:12.071540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f262ac70-248c-46dd-b7f8-91714d970165 req-9b768417-9097-49b6-af14-60ec4d79e4d1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:12.076120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f262ac70-248c-46dd-b7f8-91714d970165 req-9b768417-9097-49b6-af14-60ec4d79e4d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:12.076720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f262ac70-248c-46dd-b7f8-91714d970165 req-9b768417-9097-49b6-af14-60ec4d79e4d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:12.109226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f262ac70-248c-46dd-b7f8-91714d970165 req-9b768417-9097-49b6-af14-60ec4d79e4d1 service nova] Creating event network-changed:bb5cb180-c808-43df-8564-b4c81007ef41 for instance fb87b182-a7ea-4da4-9c78-b82f740179f8 on n-h1-833090-19 Sep 08 10:25:12.122057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f262ac70-248c-46dd-b7f8-91714d970165 req-9b768417-9097-49b6-af14-60ec4d79e4d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100511 Sep 08 10:25:12.122668 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1481/2770] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:12.219246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbbcadf7663400daad4ee6ea5db1ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f09c48205b9b4ba7888ed04e1029704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:12.252346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-efbaf94c-b754-4c1e-8b13-ee2136abaaee tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 200 len: 1258 microversion: 2.1 time: 0.357300 Sep 08 10:25:12.256977 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1290/2771] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:11 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 1258 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:12.911026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:12.913897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:12.931240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:12.933739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:12.937456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:12.938475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:12.939798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:12.941891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.053836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:13.053836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:13.055311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:13.084105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:13.084651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:13.088646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.089667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:13.092030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:13.092906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.530436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:13.553177 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-209b7820-06d0-46e1-a219-22b188046616 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 0.649402 Sep 08 10:25:13.560714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:13.568232 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1482/2772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:12 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:13.578948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e08995fe-2528-4a81-853f-49e1bfda4ade tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1466 microversion: 2.1 time: 0.531605 Sep 08 10:25:13.589957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:13.590952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] [instance: 2f61f7ec-ddbd-41ab-9fde-8da04751631c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:13.595851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1291/2773] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:13 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:13.600009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:13.605149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:13.605401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.606266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:13.606852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:13.607419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.610246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:13.610893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:13.619235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:13.619988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:13.620585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.623494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:13.624738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:13.625424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:13.645090 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] HTTP exception thrown: Instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c could not be found. Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Request method failure captured: Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c HTTP/1.1 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcJzXDiYVc2QxJPGYE7K2b6fnap9-uSFz6KwyZGlgDjHxbYc663uXuuP9J1s9OnsYcIaYejt_SshwV8k1ZpPwODK6D3U6MI6WsZr4rIkVzx6W_AzSHEagKQ2AggPi1ivnyo6x7MqqZQEaY13rammVAj2h4LMnlE9n-R52uRQtpM6cRM Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f09c48205b9b4ba7888ed04e1029704b Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestBootFromVolume-171011054 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f09c48205b9b4ba7888ed04e1029704b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f09c48205b9b4ba7888ed04e1029704b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f09c48205b9b4ba7888ed04e1029704b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f09c48205b9b4ba7888ed04e1029704b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestBootFromVolume-171011054 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f09c48205b9b4ba7888ed04e1029704b Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestBootFromVolume-171011054 Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestBootFromVolume-171011054-project Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 8cbbcadf7663400daad4ee6ea5db1ddf Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestBootFromVolume-171011054-project Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c could not be found. Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '2f61f7ec-ddbd-41ab-9fde-8da04751631c'} Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c could not be found. Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c could not be found. Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:13.651753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c could not be found. Sep 08 10:25:13.656599 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:25:13.659389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Returning 404 to user: Instance 2f61f7ec-ddbd-41ab-9fde-8da04751631c could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:25:13.665740 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4ec2b7b-57e0-4d77-95ee-e00a0c8a1d1f tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c" status: 404 len: 111 microversion: 2.1 time: 0.091110 Sep 08 10:25:13.671675 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1483/2774] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:13 2022] GET /compute/v2.1/servers/2f61f7ec-ddbd-41ab-9fde-8da04751631c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:25:13.680016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c2c60d9-a500-45f7-83f8-9a79146a2ef4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] Calling method '.version_select at 0x7f235092d700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:13.723738 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c2c60d9-a500-45f7-83f8-9a79146a2ef4 tempest-ServersTestBootFromVolume-171011054 tempest-ServersTestBootFromVolume-171011054-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777355017" status: 202 len: 0 microversion: 2.1 time: 0.050333 Sep 08 10:25:13.724746 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1484/2775] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777355017 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:25:14.135804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8696a8df-dd34-4911-a41e-f9b0d912fb72 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1619 microversion: 2.1 time: 0.529896 Sep 08 10:25:14.138408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1292/2776] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:13 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1619 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:14.473835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-203731118", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a8c4b6e2-f598-4ed6-bc7b-570148c9e012"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:14.512846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:14.594400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:14.595021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:14.620366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:25:14.625263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:14.625752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:14.626190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:14.628960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:14.629442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:14.630089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:15.382414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:15.400015 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7bf72b3d-5ccb-4e0a-b03c-d6909295c1e1 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 0.819603 Sep 08 10:25:15.401188 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1293/2777] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:14 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:15.558143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:15.558143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:15.558522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:15.558929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:15.559513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:15.582552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:15.586143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:15.586833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:15.587835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:15.589654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:15.591368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:15.624186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:15.651322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Getting quotas for user dee4290e94384a0bb1e802e65d312184 and project e6b99dcb58f641f0b4ec82fdb0103990. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:15.720226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:15.730437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:15.860526 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e13f136-2fe1-4f49-b7b1-53247c6a6c1d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400293 Sep 08 10:25:15.861794 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1485/2778] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:25:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:25:15.873030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf5e86da-5c71-448c-a3cc-fd7848cb8b61 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:15.873688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf5e86da-5c71-448c-a3cc-fd7848cb8b61 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:16.212531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf5e86da-5c71-448c-a3cc-fd7848cb8b61 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:16.221052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf5e86da-5c71-448c-a3cc-fd7848cb8b61 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1216 microversion: 2.1 time: 0.352338 Sep 08 10:25:16.221635 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1294/2779] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:15 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1216 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:16.430101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:16.431758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:16.439830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:16.440735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:16.441452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:16.442405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:16.443096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:16.443822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:16.956997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:16.984726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52beb78f-361d-4fd0-8c6c-6383d9f0a00d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 0.563735 Sep 08 10:25:16.985330 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1486/2780] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:16 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:17.245634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:17.246914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:17.255940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:17.256878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:17.257566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:17.258497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:17.259182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:17.259868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:17.532803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:17.570336 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dadbb0b9-a5ab-4233-ac51-0b608f94854a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1268 microversion: 2.1 time: 0.328439 Sep 08 10:25:17.571965 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1295/2781] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:17 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1268 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:18.013614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:18.014449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:18.030846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:18.033299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:18.033939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:18.037661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:18.039272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:18.041303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:18.598942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:18.600371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:18.615169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:18.616046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:18.616711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:18.617658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:18.620393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:18.621288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:18.731155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:18.739763 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a6efee34-656b-40a3-8906-622b1c3f7519 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 0.731085 Sep 08 10:25:18.752862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1487/2782] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:18 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:18.781518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:18.792291 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c36f39f8-f178-4145-96fa-6ac1bec635c6 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1274 microversion: 2.1 time: 0.197845 Sep 08 10:25:18.794334 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1296/2783] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:18 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:19.784202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:19.784749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:19.801022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:19.801778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:19.808666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:19.809449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:19.809927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:19.810359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:19.818126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:19.818755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:19.821532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:19.859716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:19.862271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:19.864540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:19.868749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:19.870302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:19.874404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:20.090562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:20.108342 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ef4a33d-a4fe-4e4a-b081-ae81dff2517d tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1274 microversion: 2.1 time: 0.294199 Sep 08 10:25:20.127561 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1297/2784] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:19 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:20.397079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-376525821", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "433794c6-b984-4153-9bd0-c583493e6206"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:20.488176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] validate_networks() for [('433794c6-b984-4153-9bd0-c583493e6206', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:25:21.098439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:21.115272 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1e6392a-2d1d-48aa-8dce-4c9da34b9839 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 1.336808 Sep 08 10:25:21.139159 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1488/2785] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:19 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:21.151912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:21.152549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:21.184543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:21.186296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:21.186767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:21.194199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:21.194703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:21.195148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:22.246923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:22.262319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-abef65db-8daf-451d-abf1-26f301af05bc tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 1.121916 Sep 08 10:25:22.263159 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1489/2786] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:21 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:22.281978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:22.283923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:22.297811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:22.303805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:22.305303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:22.308336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:22.309290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:22.310038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:22.333497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:22.334997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:22.335953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:22.337285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:22.337924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:22.383836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:22.388066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:22.388840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:22.389766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:22.397147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:22.397819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:22.476582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Getting quotas for project f916001554eb4ed09be371252a2f28e5. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:22.497744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Getting quotas for user 0c8f475c0c9446a9939544c1a0f83b1e and project f916001554eb4ed09be371252a2f28e5. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:22.536159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:22.545760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:22.658387 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8cdb449a-230e-4cff-8c33-967f97ddb742 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527652 Sep 08 10:25:22.659261 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1298/2787] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:25:22.670808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-565bac34-1fed-4047-ad8b-4a32e2ba029a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:22.681463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-565bac34-1fed-4047-ad8b-4a32e2ba029a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:22.941416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-565bac34-1fed-4047-ad8b-4a32e2ba029a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:22.964117 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-565bac34-1fed-4047-ad8b-4a32e2ba029a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1231 microversion: 2.1 time: 0.297027 Sep 08 10:25:22.974652 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1299/2788] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:22 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1231 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:23.292279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:23.302839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:23.368357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:23.378103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:23.382609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:23.383184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:23.391486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:23.392107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:23.398161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:23.406938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-09e2de65-e238-4c7d-9377-6ca0a7b301f4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 1.142166 Sep 08 10:25:23.420098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1490/2789] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:22 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:23.906910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:23.926374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-958a8e6e-e71d-4401-9a03-0e7884bf73d7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 0.644015 Sep 08 10:25:23.927312 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1300/2790] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:23 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:24.000001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:24.000923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:24.014691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:24.018685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:24.020065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:24.021053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:24.024596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:24.025583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:24.035635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:24.181906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:24.190427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1524b8f6-707c-4d6e-beac-b06e7a4ff031 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1235 microversion: 2.1 time: 0.201307 Sep 08 10:25:24.203651 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1491/2791] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:23 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1235 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:24.435909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:24.437239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:24.447826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:24.448601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:24.449202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:24.450102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:24.450718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:24.451300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:24.976552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:24.984104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:25.014439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:25.015091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:25.016198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:25.017013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:25.017504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:25.017932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:25.080700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:25.103113 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a85b1fde-cfbb-4f15-9c41-112d221a7ba3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 0.670547 Sep 08 10:25:25.104840 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1301/2792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:24 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:25.227988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:25.229181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:25.239871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:25.243926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:25.245155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:25.246143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:25.247327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:25.248057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:25.604064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:25.666381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:26.271106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:26.296758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6079c2db-2aaa-4baf-9397-ed3dce327d84 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1291 microversion: 2.1 time: 1.078077 Sep 08 10:25:26.304914 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1302/2793] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:25 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1291 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:26.313750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fe13ef95-44e0-4109-a523-28f0c53da6ab req-af5d66e3-4130-43be-a312-363793ed2162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d069283-ae16-4332-a888-5a12230e9a77", "tag": "c5085ce5-72c1-4a0c-9198-8348ed6619ce"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:26.327591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fe13ef95-44e0-4109-a523-28f0c53da6ab req-af5d66e3-4130-43be-a312-363793ed2162 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:26.328119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fe13ef95-44e0-4109-a523-28f0c53da6ab req-af5d66e3-4130-43be-a312-363793ed2162 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:26.328907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fe13ef95-44e0-4109-a523-28f0c53da6ab req-af5d66e3-4130-43be-a312-363793ed2162 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:26.365366 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fe13ef95-44e0-4109-a523-28f0c53da6ab req-af5d66e3-4130-43be-a312-363793ed2162 service nova] Creating event network-changed:c5085ce5-72c1-4a0c-9198-8348ed6619ce for instance 2d069283-ae16-4332-a888-5a12230e9a77 on n-h2-833090-19 Sep 08 10:25:26.373965 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fe13ef95-44e0-4109-a523-28f0c53da6ab req-af5d66e3-4130-43be-a312-363793ed2162 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064469 Sep 08 10:25:26.376102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1303/2794] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:26.391338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:26.392364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:26.399411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:26.400015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:26.401212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:26.402398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:26.402865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:26.405087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:27.311801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:27.323313 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58c61739-6021-470b-97ad-8dc58356a6bd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 2.366593 Sep 08 10:25:27.332179 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1492/2795] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:24 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:27.336995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2dff58ea-290a-4442-954d-57d9a3cac3e9 req-75377faf-701e-450e-b22e-30ed33f01ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb87b182-a7ea-4da4-9c78-b82f740179f8", "name": "network-vif-plugged", "status": "completed", "tag": "bb5cb180-c808-43df-8564-b4c81007ef41"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:27.356978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2dff58ea-290a-4442-954d-57d9a3cac3e9 req-75377faf-701e-450e-b22e-30ed33f01ad6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:27.357715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2dff58ea-290a-4442-954d-57d9a3cac3e9 req-75377faf-701e-450e-b22e-30ed33f01ad6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:27.358339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2dff58ea-290a-4442-954d-57d9a3cac3e9 req-75377faf-701e-450e-b22e-30ed33f01ad6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:27.391579 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2dff58ea-290a-4442-954d-57d9a3cac3e9 req-75377faf-701e-450e-b22e-30ed33f01ad6 service nova] Creating event network-vif-plugged:bb5cb180-c808-43df-8564-b4c81007ef41 for instance fb87b182-a7ea-4da4-9c78-b82f740179f8 on n-h1-833090-19 Sep 08 10:25:27.398568 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2dff58ea-290a-4442-954d-57d9a3cac3e9 req-75377faf-701e-450e-b22e-30ed33f01ad6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065001 Sep 08 10:25:27.399493 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1493/2796] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:27.410166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:27.412719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:27.430015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:27.431063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:27.435546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:27.436646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:27.437684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:27.439039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:27.831325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:27.839729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1c4191f-d767-496c-866c-2d9891ec3b3d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1289 microversion: 2.1 time: 0.438481 Sep 08 10:25:27.840328 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1494/2797] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:27 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1289 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:28.347434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:28.348728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:28.362955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:28.369651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:28.376966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:28.380954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:28.381621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:28.383366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:28.491802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:28.500839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:28.508786 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-76a8af59-7066-4d00-94ac-3d91cfd7408f tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1317 microversion: 2.1 time: 2.129399 Sep 08 10:25:28.512025 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1304/2798] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:26 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1317 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:28.868830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:28.869738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:28.886451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:28.896400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:28.901334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:28.902726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:28.903360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:28.904012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:30.673670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:30.688261 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57f9859e-fcd3-4c8c-8f38-0459722a62e0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 2.344494 Sep 08 10:25:30.710376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1495/2799] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:28 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 2365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:30.729253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:30.729887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:30.759850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:30.762458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:30.763548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:30.769765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:30.771365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:30.774626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:30.828288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:30.846939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-13f9b235-3944-428c-b5dd-9a7678e683ee tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 1.978566 Sep 08 10:25:30.847980 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1305/2800] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:28 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:25:30.854937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ed74053-c448-4c18-aa7c-171789a5747e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Action: 'create', calling method: .version_select at 0x7f2350801940>, body: {"keypair": {"name": "tempest-keypair-1298455185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg8iTllnDApY6SfbepKsbUQNHPG8c6WO3G+keRi8ZX34GmrDcyC7TMvnsUJmr56Bu8D0DM44zNGZVSRymnEHueXz67SlQWfuFoz1bjvJZoMqCB9xb9Shs8uyBdSJVFv5A=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:30.938446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2ed74053-c448-4c18-aa7c-171789a5747e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Getting quotas for project 5302ed717cdd423aabd3d0a282fb1ced. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:30.964446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2ed74053-c448-4c18-aa7c-171789a5747e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Getting quotas for user 19623b43fee044eeb1adf3aad9c87dac and project 5302ed717cdd423aabd3d0a282fb1ced. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:31.036579 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2ed74053-c448-4c18-aa7c-171789a5747e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.187191 Sep 08 10:25:31.037721 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1306/2801] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:25:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:25:31.695836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:31.713227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8af85160-e12f-4b27-bde9-f4d98fbbf0ff tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1508 microversion: 2.1 time: 1.001625 Sep 08 10:25:31.714631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1496/2802] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:30 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1508 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:31.722671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:31.723684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:31.748401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:31.748954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:31.749403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:31.752530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:31.753038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:31.753157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:31.753840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:31.754512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:31.759553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:31.760337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:31.761005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:31.761952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:31.762600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:31.763243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:32.425287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:32.630078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:32.645940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:32.668603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d98daa48-d3ab-4cc0-9583-3d0191909b59 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 0.952247 Sep 08 10:25:32.673674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d49980ec-fb38-4f12-9d2c-fc41959fd79e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1508 microversion: 2.1 time: 0.935720 Sep 08 10:25:32.695709 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1307/2803] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:31 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:32.696777 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1497/2804] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:31 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1508 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:32.707753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:32.709744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:32.710419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:32.711880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:32.721872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:32.722735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:32.723425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:32.724459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:32.725156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:32.725807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:32.738336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:32.738931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:32.739384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:32.740169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:32.740629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:32.741056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:32.871405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:32.872416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:32.873462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:32.874508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:32.875583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:32.998199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:33.019142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:33.021282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:33.021994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:33.024139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:33.025039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:33.027744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:33.100724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e9f8cac-79df-404f-ac77-13eb793c6d52 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "POST /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8/action" status: 202 len: 1110 microversion: 2.1 time: 0.396680 Sep 08 10:25:33.123289 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1498/2805] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:25:32 2022] POST /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8/action => generated 1110 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 08 10:25:33.131855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:33.135278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:33.154547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:33.158018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:33.158726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:33.161799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:33.162593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:33.163279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:33.803489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:33.821468 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7d0a852-07cb-49ec-92a0-ba3014f01d34 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 1.121212 Sep 08 10:25:33.825114 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1308/2806] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:32 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:33.832979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:33.838147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:33.852363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:33.856217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:33.856861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:33.861266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:33.861773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:33.862211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:34.252802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:34.268080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72676579-8bf9-4706-b3b7-0deb0eb1c4fe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 1.140654 Sep 08 10:25:34.269396 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1499/2807] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:33 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:34.522951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:34.545042 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b70ff85-9338-4eea-bc4e-67ace678e49c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 0.711941 Sep 08 10:25:34.546099 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1309/2808] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:33 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:34.762190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1895170383", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:34.852908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:34.855638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:34.864064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:34.866095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:34.868312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:34.869828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:34.873240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:34.881127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:34.884343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:34.887964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:34.892179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:34.894698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:34.896296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:34.906747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:34.910586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:34.912126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:34.913201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:34.914065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:34.915043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:34.943685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Getting quotas for project 8d0bb5d9664e4ab28279d38f902b93f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:34.953280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Getting quotas for user 1fcdc9247d8b45949910d202553e5e05 and project 8d0bb5d9664e4ab28279d38f902b93f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:34.973730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:34.978074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:35.053231 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac4eb9ac-e824-4952-9e4b-2243fbdde13b tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.600459 Sep 08 10:25:35.055211 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1500/2809] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:25:35.067911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-645f0010-096e-48ca-816f-d10b18bb6173 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:35.076464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-645f0010-096e-48ca-816f-d10b18bb6173 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:35.329863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-645f0010-096e-48ca-816f-d10b18bb6173 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:35.341185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-645f0010-096e-48ca-816f-d10b18bb6173 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:35.347608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-645f0010-096e-48ca-816f-d10b18bb6173 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:35.349898 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-645f0010-096e-48ca-816f-d10b18bb6173 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 200 len: 1281 microversion: 2.47 time: 0.285344 Sep 08 10:25:35.366370 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1501/2810] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:35 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:35.367074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:35.367233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:35.386777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:35.387286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:35.392210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:35.393188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:35.393669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:35.394447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:35.777342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:35.798752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-434e1a64-0761-4f97-a17e-bee75084fc7c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.955151 Sep 08 10:25:35.799926 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1310/2811] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:34 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:35.805533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:35.806404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:35.817701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:35.819521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:35.820198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:35.821281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:35.822078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:35.822895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:36.112215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:36.138912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ca88b6c-ed12-4614-bdaf-8f84129403af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.786988 Sep 08 10:25:36.140229 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1502/2812] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:35 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:36.382171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:36.382877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:36.397666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:36.398509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:36.399154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:36.400141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:36.400821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:36.401707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:36.520441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:36.533578 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-15c4ff27-1c3e-4f8e-bbdf-629922f0237a tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 0.732192 Sep 08 10:25:36.551900 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1311/2813] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:35 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:36.615973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:36.645281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:36.647742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:36.653035 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d26e157-10bc-4794-a7ac-3f5d1fe77502 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 200 len: 1333 microversion: 2.47 time: 0.273134 Sep 08 10:25:36.656133 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1503/2814] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:36 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 1333 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:25:36.790672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a283cc2b-a72a-4874-8329-37c82705575a req-57362aec-0819-4eab-90b2-2abe7fdc2289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23af30e-41b7-4cc6-9eb4-4a2007246818", "tag": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:36.817827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a283cc2b-a72a-4874-8329-37c82705575a req-57362aec-0819-4eab-90b2-2abe7fdc2289 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:36.827694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:36.828818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:36.834520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a283cc2b-a72a-4874-8329-37c82705575a req-57362aec-0819-4eab-90b2-2abe7fdc2289 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:36.837260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a283cc2b-a72a-4874-8329-37c82705575a req-57362aec-0819-4eab-90b2-2abe7fdc2289 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:36.845945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:36.852826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:36.854272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:36.868280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:36.869776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:36.877176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:36.902807 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a283cc2b-a72a-4874-8329-37c82705575a req-57362aec-0819-4eab-90b2-2abe7fdc2289 service nova] Creating event network-changed:b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 for instance b23af30e-41b7-4cc6-9eb4-4a2007246818 on n-h2-833090-19 Sep 08 10:25:36.928162 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a283cc2b-a72a-4874-8329-37c82705575a req-57362aec-0819-4eab-90b2-2abe7fdc2289 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139242 Sep 08 10:25:36.929139 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1312/2815] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:37.175637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:37.176831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:37.194221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:37.194968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:37.195750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:37.198093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:37.198772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:37.199406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:37.587515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:37.603272 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db64638c-aa45-44ed-bef4-26a94425d670 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.780356 Sep 08 10:25:37.605160 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1504/2816] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:36 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:37.618952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-518498606", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a3a7749b-bbab-40cf-bd1a-c6618e31d93e"}, {"port": "17fde0e0-1318-48b1-8837-bc941c736cff", "tag": "port-1"}, {"port": "476853c2-0179-4c3b-bd7b-48ae101e3282", "tag": "port-2"}, {"uuid": "0405b675-cf2e-4b2a-b411-b7e23b3311da", "tag": "net-1"}, {"uuid": "0405b675-cf2e-4b2a-b411-b7e23b3311da"}, {"uuid": "edaadf4a-26d2-400e-a8a4-a570573d5fbf", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "edaadf4a-26d2-400e-a8a4-a570573d5fbf", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d5985118-4677-42d8-b3c4-c7e55f8ca017", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a07c40ca-8391-486f-8558-9a92e6c7155d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "dd1b529d-2cec-4e39-976c-27bfa49e4ad5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1853144011"}], "key_name": "tempest-keypair-1298455185", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:37.687074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:37.710224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3fdf4cae-e217-4ba5-94e5-539e558f2a46 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.541385 Sep 08 10:25:37.713979 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1313/2817] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:37 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:37.725188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:37.736028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:37.758521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:37.759018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:37.759569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:37.767044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:37.768720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:37.769147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:37.874774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] validate_networks() for [('a3a7749b-bbab-40cf-bd1a-c6618e31d93e', None, None, None, None, None), (None, None, '17fde0e0-1318-48b1-8837-bc941c736cff', None, None, None), (None, None, '476853c2-0179-4c3b-bd7b-48ae101e3282', None, None, None), ('0405b675-cf2e-4b2a-b411-b7e23b3311da', None, None, None, None, None), ('0405b675-cf2e-4b2a-b411-b7e23b3311da', None, None, None, None, None), ('edaadf4a-26d2-400e-a8a4-a570573d5fbf', '10.2.2.100', None, None, None, None), ('edaadf4a-26d2-400e-a8a4-a570573d5fbf', '10.2.2.200', None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:25:38.227873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:38.236681 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-840eb68c-3399-4f92-8d4d-47e9298006fd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 0.520896 Sep 08 10:25:38.236888 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1314/2818] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:37 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:38.256871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:38.260751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:38.279515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:38.285882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:38.286335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:38.287079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:38.287556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:38.288140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:38.552892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:38.564267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:38.565988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:38.567762 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-734dddca-bc9c-4f3b-a66a-2833ab74c009 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 200 len: 1339 microversion: 2.47 time: 0.322934 Sep 08 10:25:38.569462 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1315/2819] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:38 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 1339 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:38.780428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Action: 'update', calling method: .version_select at 0x7f2350bb6d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:38.893839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:38.895195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:38.895851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:38.896763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:38.897383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:38.898099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:38.980329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d49ca3c-e37a-42ff-94a5-aa860de23d49 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82" status: 200 len: 240 microversion: 2.36 time: 0.409586 Sep 08 10:25:38.986281 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1316/2820] 10.222.0.59 () {62 vars in 1303 bytes} [Thu Sep 8 10:25:38 2022] PUT /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82 => generated 240 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:25:38.995049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-96fa3328-00d6-4072-b7c8-61ad924fcbb7 req-864d1477-819b-418b-a79f-04c3fc0a0bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d069283-ae16-4332-a888-5a12230e9a77", "name": "network-vif-plugged", "status": "completed", "tag": "c5085ce5-72c1-4a0c-9198-8348ed6619ce"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:39.009088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-96fa3328-00d6-4072-b7c8-61ad924fcbb7 req-864d1477-819b-418b-a79f-04c3fc0a0bde service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:39.009778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-96fa3328-00d6-4072-b7c8-61ad924fcbb7 req-864d1477-819b-418b-a79f-04c3fc0a0bde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:39.010400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-96fa3328-00d6-4072-b7c8-61ad924fcbb7 req-864d1477-819b-418b-a79f-04c3fc0a0bde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:39.030221 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-96fa3328-00d6-4072-b7c8-61ad924fcbb7 req-864d1477-819b-418b-a79f-04c3fc0a0bde service nova] Creating event network-vif-plugged:c5085ce5-72c1-4a0c-9198-8348ed6619ce for instance 2d069283-ae16-4332-a888-5a12230e9a77 on n-h2-833090-19 Sep 08 10:25:39.037011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-96fa3328-00d6-4072-b7c8-61ad924fcbb7 req-864d1477-819b-418b-a79f-04c3fc0a0bde service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048537 Sep 08 10:25:39.038119 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1317/2821] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:39.044260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:39.045315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:39.054044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:39.054725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:39.055427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:39.056515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:39.057128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:39.059855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:39.744189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:39.754898 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7227525-221a-412f-8ea3-cde6bed1c625 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.714959 Sep 08 10:25:39.756141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1318/2822] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:39 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:39.760790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:39.761902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:39.768876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:39.769708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:39.770362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:39.771540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:39.772184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:39.773143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:40.001782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:40.019048 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cb92649-240e-40d3-bd7b-0842d6930fc2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.261170 Sep 08 10:25:40.019784 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1319/2823] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:39 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:40.032475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Calling method '.version_select at 0x7f2351e123a0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:40.203637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:40.204079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:40.204518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:40.205283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:40.207385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:40.208043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:40.262798 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6152b28-2e3c-4f80-8823-f2fe3f889003 tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82/detail" status: 200 len: 672 microversion: 2.36 time: 0.239266 Sep 08 10:25:40.265517 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1320/2824] 10.222.0.59 () {60 vars in 1304 bytes} [Thu Sep 8 10:25:40 2022] GET /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82/detail => generated 672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:25:40.280955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:40.281727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:40.300158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:40.300831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:40.301520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:40.304217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:40.305034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:40.305735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:40.899211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:40.913963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f53af76-7268-4077-b0f4-0db99d7b77cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1316 microversion: 2.1 time: 0.645193 Sep 08 10:25:40.914840 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1321/2825] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:40 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:40.932522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:40.933656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:40.948915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:40.949706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:40.950325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:40.951287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:40.951943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:40.953507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.061563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:41.080640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:41.087061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:41.090921 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2f6422d-6df2-43e6-83d3-cfa06feb80f6 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 200 len: 1360 microversion: 2.47 time: 0.174896 Sep 08 10:25:41.094378 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1322/2826] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:40 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:41.125432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Action: 'update', calling method: .version_select at 0x7f23553c5f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:41.235083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:41.236246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:41.237137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.238092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:41.238757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:41.239403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.275475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:41.298491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:41.299334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:41.299894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.300799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:41.301352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:41.303307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.399071 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e02680d3-624c-49c1-8ac1-47c084b5d84a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82?user_id=1efc85f96f59475ca02a25caafb99188" status: 200 len: 240 microversion: 2.36 time: 0.279217 Sep 08 10:25:41.400120 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1323/2827] 10.222.0.59 () {62 vars in 1384 bytes} [Thu Sep 8 10:25:41 2022] PUT /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82?user_id=1efc85f96f59475ca02a25caafb99188 => generated 240 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:25:41.415121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:41.418157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:41.461014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:41.462024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:41.462746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.463814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:41.465429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:41.467352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:41.936508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:41.979363 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e0e17a3-342e-4d18-85ab-966ab0f14ff1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.577246 Sep 08 10:25:42.000949 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1324/2828] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:41 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:42.010259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:42.010895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:42.034222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:42.034652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:42.035104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:42.035862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:42.036322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:42.036781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:42.048625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:42.702133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:42.715914 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f06f654-cd11-4a71-812d-92b5bf1417af tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.713221 Sep 08 10:25:42.717809 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1325/2829] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:42 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:42.729203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-176154541"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:42.748780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:42.774908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:42.775641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:42.776215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:42.776865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:42.777525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:42.777958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:43.203165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74add0f6-d6c1-4ea6-aac6-3ce8bffe6797 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "POST /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48/action" status: 202 len: 52 microversion: 2.47 time: 0.482456 Sep 08 10:25:43.203976 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1326/2830] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:25:42 2022] POST /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48/action => generated 52 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:25:43.217821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16dd3e34-08d6-4e85-8c50-30b6c1762c7a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] Calling method '.version_select at 0x7f23513905e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:43.338410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=37 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:43.393497 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16dd3e34-08d6-4e85-8c50-30b6c1762c7a tempest-QuotasAdminTestV236-1692426451 tempest-QuotasAdminTestV236-1692426451-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82?user_id=1efc85f96f59475ca02a25caafb99188" status: 200 len: 282 microversion: 2.36 time: 0.173434 Sep 08 10:25:43.403522 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1327/2831] 10.222.0.59 () {60 vars in 1364 bytes} [Thu Sep 8 10:25:43 2022] GET /compute/v2.1/os-quota-sets/2ee08c23adff42ef94117a7a6fdfbd82?user_id=1efc85f96f59475ca02a25caafb99188 => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:25:43.412594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:43.415544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:43.424219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:43.425842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:43.426610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:43.428556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:43.429440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:43.430092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:43.477350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:43.478536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:43.479556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:43.481246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:43.482168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:43.507067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:43.507919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:43.508612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:43.509569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:43.510224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:43.512036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:43.569390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Getting quotas for project 5302ed717cdd423aabd3d0a282fb1ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:43.588683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Getting quotas for user 19623b43fee044eeb1adf3aad9c87dac and project 5302ed717cdd423aabd3d0a282fb1ced. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:43.837993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:43.849467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2807bf04-dd68-49d6-99cd-23f961fe8164 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1466 microversion: 2.1 time: 0.443244 Sep 08 10:25:43.850392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1328/2832] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:43 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:43.855389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:43.855888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:43.856103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:43.859059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d5985118-4677-42d8-b3c4-c7e55f8ca017',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a07c40ca-8391-486f-8558-9a92e6c7155d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd1b529d-2cec-4e39-976c-27bfa49e4ad5',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:43.867940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:43.869036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:43.869484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:43.870196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:43.870720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:43.871069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:44.198794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:44.217772 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70097c3b-3a09-43e8-8feb-f363564f2473 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.365833 Sep 08 10:25:44.227545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1329/2833] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:43 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:44.238211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:44.240382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:44.253510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:44.256867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:44.257381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:44.258135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:44.258609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:44.262942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:44.334906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:25:44.577312 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85fca756-8159-4ebf-9ed1-37705ebec601 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.956765 Sep 08 10:25:44.584547 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-190c806d-d9b1-4a37-94c9-810c4df342d2 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "DELETE /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 204 len: 0 microversion: 2.47 time: 0.347338 Sep 08 10:25:44.584547 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1330/2834] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:25:44 2022] DELETE /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:25:44.584857 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1505/2835] 10.222.0.59 () {62 vars in 1189 bytes} [Thu Sep 8 10:25:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 6977 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:25:44.591622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:44.592888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:44.593920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:44.594804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:44.613344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:44.614010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:44.617672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:44.618194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:44.619061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:44.619471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:44.619914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:44.625213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:44.632236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:44.632793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:44.633997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:44.634576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:44.639232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.169421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.180301 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93d3f729-4f53-4cbc-b052-0bfe426e5ca5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.597247 Sep 08 10:25:45.186621 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1331/2836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:44 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:45.192323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:45.192323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:45.201594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.202369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.203075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.205517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c3f0edf-c2fc-450c-af6c-c7e9a6a4d026 tempest-ServersOnMultiNodesTest-566590472 tempest-ServersOnMultiNodesTest-566590472-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1619 microversion: 2.1 time: 0.613072 Sep 08 10:25:45.206601 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1506/2837] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:44 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1619 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:45.212509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.213181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.213975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.225788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d72e0c1-d49c-4508-a1a9-40ae24ed2e80 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:45.226412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d72e0c1-d49c-4508-a1a9-40ae24ed2e80 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:45.324553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3d72e0c1-d49c-4508-a1a9-40ae24ed2e80 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.333526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3d72e0c1-d49c-4508-a1a9-40ae24ed2e80 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.341388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3d72e0c1-d49c-4508-a1a9-40ae24ed2e80 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.342841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d72e0c1-d49c-4508-a1a9-40ae24ed2e80 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1285 microversion: 2.42 time: 0.134909 Sep 08 10:25:45.349572 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1507/2838] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:45 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:45.354742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:45.355529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:45.364470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.365300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.365977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.366920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.377064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.378119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.409186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.418073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.423363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.427002 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de832318-416a-4a74-a9a8-bb6ef412e429 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 200 len: 1366 microversion: 2.47 time: 0.239119 Sep 08 10:25:45.440751 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1332/2839] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:45 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:45.455187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:45.456388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:45.462938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:25:45.467074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.467894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.468797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.469235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.470133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.471055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.540805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:45.633144 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-09bd6aa2-2b05-42cb-a5da-fa6c5c908500 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 204 len: 0 microversion: 2.1 time: 0.281842 Sep 08 10:25:45.635773 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1508/2840] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:25:45 2022] DELETE /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:25:45.650589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:45.651509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:45.662849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.665541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.666212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.668123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:45.669396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:45.670354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:45.686735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.705438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c723f5e2-cc2a-43bb-8366-c92a33870155 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.262729 Sep 08 10:25:45.713460 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1333/2841] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:45 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:45.896832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:45.905901 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1855f811-5c29-4e1e-95f1-61e68230b0aa tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1472 microversion: 2.1 time: 0.264450 Sep 08 10:25:45.906504 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1509/2842] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:45 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:46.221598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:46.229892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:46.254669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:46.255424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:46.257489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:46.259602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:46.263644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:46.265662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:46.372635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-489ddc28-b52c-4b27-b8da-ddea0a3c44ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:46.373264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-489ddc28-b52c-4b27-b8da-ddea0a3c44ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:46.585760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-489ddc28-b52c-4b27-b8da-ddea0a3c44ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.594662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-489ddc28-b52c-4b27-b8da-ddea0a3c44ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.599511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-489ddc28-b52c-4b27-b8da-ddea0a3c44ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.604065 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-489ddc28-b52c-4b27-b8da-ddea0a3c44ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1285 microversion: 2.42 time: 0.235590 Sep 08 10:25:46.604864 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1510/2843] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:46 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:25:46.615344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:46.616729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:46.646605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:46.647262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:46.651128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:46.652262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:46.653303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:46.653969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:46.733243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.745576 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a69cf172-57d7-425d-b000-fdfa5f567b13 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.534128 Sep 08 10:25:46.746908 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1334/2844] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:46 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:46.850933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.867667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.869490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fcdc9247d8b45949910d202553e5e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0bb5d9664e4ab28279d38f902b93f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:46.876462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba11bd36-21bc-4fc3-aeae-46cb1b6b091a tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 200 len: 1366 microversion: 2.47 time: 0.264382 Sep 08 10:25:46.880009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-125645808", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "ba07f7f5-b3cc-4d48-88b6-07b4a3f4345d"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:46.899351 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1511/2845] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:46 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:46.906203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:46.907099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:46.914846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:46.916063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:46.916880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:46.930615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:46.934316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:46.934926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:47.036911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] validate_networks() for [('ba07f7f5-b3cc-4d48-88b6-07b4a3f4345d', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:25:47.457528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:47.469091 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8c0045c3-7603-46ed-98ea-dc16a26ccbec tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 0.566462 Sep 08 10:25:47.469091 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1512/2846] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:46 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:47.492278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:47.493146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:47.500320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:47.501072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:47.502357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:47.503254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:47.510424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:47.511139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:48.602240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:48.609938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef4676f5-544b-4172-8425-9248541fb5e4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 200 len: 1472 microversion: 2.1 time: 1.121755 Sep 08 10:25:48.610521 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1513/2847] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:47 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 1472 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:48.615086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:48.619203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:48.630350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:48.631028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:48.631653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:48.639856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:48.641308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:48.643148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:48.852364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:48.869859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:48.874697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:48.879808 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b2ec9088-c64f-47a5-bb57-c9ba5d3853b0 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1593 microversion: 2.42 time: 0.264983 Sep 08 10:25:48.881953 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1514/2848] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:48 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1593 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:49.285099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:49.287088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:49.288378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:49.288979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:49.289582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:49.311163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:49.313251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:49.314401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:49.318942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:49.319697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:49.321659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:49.376305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Getting quotas for project 99554ceb36574084adb78b3767fb2768. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:49.398058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Getting quotas for user cb0a9cfff55a4af9af3c7e7001e7e48a and project 99554ceb36574084adb78b3767fb2768. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:49.437268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:49.439881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-209804578", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "ef569bc2-14ed-4146-8419-6a217e27f203"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:49.440647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:49.533746 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be77b16d-ae79-4d76-82c7-b925178757f3 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.781158 Sep 08 10:25:49.534429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1335/2849] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:25:49.560029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:49.560875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:49.597698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:49.599208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] validate_networks() for [('ef569bc2-14ed-4146-8419-6a217e27f203', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:25:49.603873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:49.604566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:49.608796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:49.609498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:49.610108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:50.516612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:50.528324 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c402859-c066-4a6d-bfc6-79d5110c4de9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.992432 Sep 08 10:25:50.529823 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1336/2850] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:49 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:50.535950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0df935fd-daf2-461a-96bc-e7e3c46c5336 req-af8e331f-dab3-4af3-a8c7-9ffa23238c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23af30e-41b7-4cc6-9eb4-4a2007246818", "name": "network-vif-plugged", "status": "completed", "tag": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:50.561166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0df935fd-daf2-461a-96bc-e7e3c46c5336 req-af8e331f-dab3-4af3-a8c7-9ffa23238c60 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:50.561874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0df935fd-daf2-461a-96bc-e7e3c46c5336 req-af8e331f-dab3-4af3-a8c7-9ffa23238c60 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:50.562487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0df935fd-daf2-461a-96bc-e7e3c46c5336 req-af8e331f-dab3-4af3-a8c7-9ffa23238c60 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:50.584266 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0df935fd-daf2-461a-96bc-e7e3c46c5336 req-af8e331f-dab3-4af3-a8c7-9ffa23238c60 service nova] Creating event network-vif-plugged:b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 for instance b23af30e-41b7-4cc6-9eb4-4a2007246818 on n-h2-833090-19 Sep 08 10:25:50.602571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0df935fd-daf2-461a-96bc-e7e3c46c5336 req-af8e331f-dab3-4af3-a8c7-9ffa23238c60 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071231 Sep 08 10:25:50.603705 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1337/2851] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:50.613640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:50.615885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] [instance: 555b7b80-a80f-468c-aa67-4d97ff381d48] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:50.628860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:50.636138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:50.636855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:50.637907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:50.638619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:50.639340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:50.684618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] HTTP exception thrown: Instance 555b7b80-a80f-468c-aa67-4d97ff381d48 could not be found. Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Request method failure captured: Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 HTTP/1.1 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMefsTtQCVtSvKxC1p2_39YttYcs7I3PAE9FY4iIR6Wt8MQzdWfcg6HytzdR9ojYu7iqC6XQ1SpNM3Iwr95ZJ02Oxm_Gmhtfbku1V7McdBoXdVTdO25OUqQrEj-vFsQ9UpKdCiVQvv5gcAlcYsx7ZUcZO4T_02PhX6Bho4TGz3nCfg Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 8d0bb5d9664e4ab28279d38f902b93f4 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAaction247Test-2146908055 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8d0bb5d9664e4ab28279d38f902b93f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8d0bb5d9664e4ab28279d38f902b93f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8d0bb5d9664e4ab28279d38f902b93f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8d0bb5d9664e4ab28279d38f902b93f4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAaction247Test-2146908055 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 8d0bb5d9664e4ab28279d38f902b93f4 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAaction247Test-2146908055 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAaction247Test-2146908055-project Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 1fcdc9247d8b45949910d202553e5e05 Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAaction247Test-2146908055-project Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 555b7b80-a80f-468c-aa67-4d97ff381d48 could not be found. Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '555b7b80-a80f-468c-aa67-4d97ff381d48'} Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 555b7b80-a80f-468c-aa67-4d97ff381d48 could not be found. Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 555b7b80-a80f-468c-aa67-4d97ff381d48 could not be found. Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:50.686307 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 555b7b80-a80f-468c-aa67-4d97ff381d48 could not be found. Sep 08 10:25:50.690786 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:50.694317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] Returning 404 to user: Instance 555b7b80-a80f-468c-aa67-4d97ff381d48 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:25:50.699409 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a4aab5e-da40-480e-913b-004e9a7736b3 tempest-ServersAaction247Test-2146908055 tempest-ServersAaction247Test-2146908055-project] 10.222.0.59 "GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48" status: 404 len: 111 microversion: 2.47 time: 0.094330 Sep 08 10:25:50.705664 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1338/2852] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:50 2022] GET /compute/v2.1/servers/555b7b80-a80f-468c-aa67-4d97ff381d48 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:25:50.714433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:50.716383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:50.747252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:50.760436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:50.761807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:50.764070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:50.766523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:50.769250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:51.899552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:51.900154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:51.900599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:51.901041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:51.901514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:51.936461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:51.940219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:51.940730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:51.941573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:51.944447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:51.944954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.003572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Getting quotas for project 373352e1609148bf9315be6c3e335807. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:52.017969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Getting quotas for user 5fe839a7f6fe47e4bd827dc976ba58ca and project 373352e1609148bf9315be6c3e335807. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:52.058970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:52.070173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:52.135595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:52.140290 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d4606bc9-a8ac-4d74-83a8-f028e17087fd tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.256784 Sep 08 10:25:52.145067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1515/2853] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:25:52.147819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96375b98-62a8-4f86-9edc-870a7ae249ca tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1331 microversion: 2.1 time: 1.440672 Sep 08 10:25:52.156029 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1339/2854] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:50 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1331 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:52.168894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:52.172358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 2d069283-ae16-4332-a888-5a12230e9a77] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:52.172513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:52.173145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:52.189374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.189719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.190225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.190674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.191958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.192732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.193189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.193801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.208167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.212433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.212938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.213381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.269842 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance 2d069283-ae16-4332-a888-5a12230e9a77 could not be found. Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 HTTP/1.1 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 2d069283-ae16-4332-a888-5a12230e9a77 could not be found. Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '2d069283-ae16-4332-a888-5a12230e9a77'} Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d069283-ae16-4332-a888-5a12230e9a77 could not be found. Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d069283-ae16-4332-a888-5a12230e9a77 could not be found. Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:25:52.271522 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d069283-ae16-4332-a888-5a12230e9a77 could not be found. Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:25:52.276383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance 2d069283-ae16-4332-a888-5a12230e9a77 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:25:52.279919 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af8c6c8e-20f8-47d5-b07b-a7079ea32c68 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77" status: 404 len: 111 microversion: 2.1 time: 0.122340 Sep 08 10:25:52.280545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1340/2855] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:52 2022] GET /compute/v2.1/servers/2d069283-ae16-4332-a888-5a12230e9a77 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:25:52.293839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:52.294467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:52.366988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.367538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.367990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.380036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.385263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.386419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:52.590409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:52.612723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:52.620841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:52.622454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7562f841-1dc5-41be-aadd-64a3952a1645 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1316 microversion: 2.21 time: 0.473382 Sep 08 10:25:52.623927 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1516/2856] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:52 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:52.637293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-85106865-f029-4f22-b635-ff4b84da93db req-4108ae37-92b3-450c-b7ec-9ea7e39f443f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d069283-ae16-4332-a888-5a12230e9a77", "name": "network-vif-deleted", "tag": "c5085ce5-72c1-4a0c-9198-8348ed6619ce"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:52.691936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-85106865-f029-4f22-b635-ff4b84da93db req-4108ae37-92b3-450c-b7ec-9ea7e39f443f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:52.699235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-85106865-f029-4f22-b635-ff4b84da93db req-4108ae37-92b3-450c-b7ec-9ea7e39f443f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:52.699755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-85106865-f029-4f22-b635-ff4b84da93db req-4108ae37-92b3-450c-b7ec-9ea7e39f443f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:53.202770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:53.212832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:53.226386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:53.235935 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cab00f2-5f5c-4631-aa0a-a610c48af563 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1661 microversion: 2.42 time: 0.946121 Sep 08 10:25:53.236702 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1341/2857] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:52 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1661 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:53.268109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:53.268748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:53.308866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:53.315177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:53.316054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:53.320610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:53.334267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:53.334819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:53.420203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:53.527425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-85106865-f029-4f22-b635-ff4b84da93db req-4108ae37-92b3-450c-b7ec-9ea7e39f443f service nova] Creating event network-vif-deleted:c5085ce5-72c1-4a0c-9198-8348ed6619ce for instance 2d069283-ae16-4332-a888-5a12230e9a77 on n-h2-833090-19 Sep 08 10:25:53.561335 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-85106865-f029-4f22-b635-ff4b84da93db req-4108ae37-92b3-450c-b7ec-9ea7e39f443f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.931613 Sep 08 10:25:53.565837 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1517/2858] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:54.250102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-654085240", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:54.310595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:54.328245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-683ddb2d-37e5-460b-9873-3b7366afcef3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 1.087527 Sep 08 10:25:54.328862 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1342/2859] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:53 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:54.343588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:54.344220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:54.367150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:54.372067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:54.372603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:54.373372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:54.373851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:54.374290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:54.403602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:25:54.679248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:54.701907 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac9111f5-f897-4d31-aa81-5de580834536 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1279 microversion: 2.1 time: 0.362751 Sep 08 10:25:54.702883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1343/2860] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:54 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1279 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:54.709856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:54.731203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:54.739296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:54.745481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:54.753929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:54.755160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:54.758399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:54.759089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:54.841891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:25:55.147742 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-72587a4e-dfb9-4667-aea3-b6dfd48833c2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 204 len: 0 microversion: 2.1 time: 0.439117 Sep 08 10:25:55.149694 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1344/2861] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:25:54 2022] DELETE /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:25:55.166176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:55.169859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:55.186500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:55.187372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:55.190571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:55.192580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:55.194299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:55.197277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:55.925463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:25:55.927781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:25:55.928874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:25:55.929728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:25:55.930462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:25:55.945296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=25 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:55.948833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:55.949710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:55.950325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:55.951230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:55.953501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:55.954162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:55.972699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=7 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:55.991353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Getting quotas for project a77ca45fee15423ea87437641284786a. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:25:55.998485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Getting quotas for user af5cdc71c4cb43f48243af53f70800c6 and project a77ca45fee15423ea87437641284786a. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:25:56.017013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:25:56.022096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:25:56.100977 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76b17da7-780b-4b48-8544-e4de04d48491 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.533744 Sep 08 10:25:56.102087 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1518/2862] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:25:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:25:56.102712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:56.110682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04fc8060-29b3-426e-935f-9ce80575692f tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1535 microversion: 2.1 time: 0.958454 Sep 08 10:25:56.111675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1345/2863] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:55 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1535 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:56.117534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:56.118150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:56.131802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:56.132426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:56.141194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:56.142107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:56.143433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:56.144464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:56.145294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:56.146022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:56.147329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:56.147863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:56.148307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:56.149033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:56.149489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:56.149917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.203783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.217195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.218937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.220191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99ce4c43-cadc-4fbe-92cb-58a87b2083bc tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1358 microversion: 2.21 time: 1.106633 Sep 08 10:25:57.220755 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1519/2864] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:56 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1358 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:57.230353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:57.231404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:57.239331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:57.239998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:57.240689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.241498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:57.242065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:57.242754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.257714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.269997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.272018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.274917 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07f02398-0460-40df-a1cb-8b20b3a1c9fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1708 microversion: 2.42 time: 1.162297 Sep 08 10:25:57.276916 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1346/2865] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:56 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1708 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:57.300719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:57.304317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:57.313975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:57.314186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:57.315160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.316057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:57.316328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:57.316825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.914466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.928541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbf46ddf-2145-4d81-86dc-ca5b358e2dd8 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1472 microversion: 2.1 time: 0.703625 Sep 08 10:25:57.929566 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1520/2866] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:57 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1472 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:57.944557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:57.945405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:57.952669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:57.957582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:57.958324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:57.958981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.959944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:57.960642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:57.961278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:57.966741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df866d7c-3b7f-4346-a61a-c1bd7ccf8ca0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.688341 Sep 08 10:25:57.968268 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1347/2867] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:57 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:57.981622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-dcdae885-5cd7-43d9-ae8e-a8552427ff42 req-800b03c3-2a17-4b4f-a2d1-46f55a64c288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3ab849-3273-458d-94cf-8ddc832dd8de", "tag": "df70bc76-0ecb-4329-af06-886a6e160a06"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:58.013057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dcdae885-5cd7-43d9-ae8e-a8552427ff42 req-800b03c3-2a17-4b4f-a2d1-46f55a64c288 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:58.013922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dcdae885-5cd7-43d9-ae8e-a8552427ff42 req-800b03c3-2a17-4b4f-a2d1-46f55a64c288 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:58.014571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dcdae885-5cd7-43d9-ae8e-a8552427ff42 req-800b03c3-2a17-4b4f-a2d1-46f55a64c288 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:58.038392 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-dcdae885-5cd7-43d9-ae8e-a8552427ff42 req-800b03c3-2a17-4b4f-a2d1-46f55a64c288 service nova] Creating event network-changed:df70bc76-0ecb-4329-af06-886a6e160a06 for instance 7b3ab849-3273-458d-94cf-8ddc832dd8de on n-h1-833090-19 Sep 08 10:25:58.051661 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-dcdae885-5cd7-43d9-ae8e-a8552427ff42 req-800b03c3-2a17-4b4f-a2d1-46f55a64c288 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081044 Sep 08 10:25:58.052078 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1348/2868] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:25:58.068808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:58.070014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:58.077458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:58.078190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:58.078802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:58.079750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:58.080920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:58.081544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:58.234557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:58.244748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:58.250470 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8e67800-025d-42a7-9e9b-0dd0a15f8e42 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1285 microversion: 2.1 time: 0.318352 Sep 08 10:25:58.251095 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1521/2869] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:57 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:58.273121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4dc90c2-6bf7-4dce-9feb-8dad8ab1aa96 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'create', calling method: .version_select at 0x7f23506369d0>, body: {"pool": "b6b6db8b-7040-43e1-aa29-02266fee8e41"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:25:58.277163 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5822cf4a-d596-421c-a0aa-a0fcd1b58537 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1273 microversion: 2.1 time: 0.218366 Sep 08 10:25:58.278151 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1349/2870] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:58 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:25:58.291561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:58.296987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:58.312301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:58.312508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:58.313045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:58.313517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:58.314455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:58.315893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:58.316406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:59.353257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=11 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:59.419009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=9 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:25:59.460508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:59.480416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:59.487711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:59.489237 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b49fedd-a919-4783-9851-21eb71535aa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1358 microversion: 2.21 time: 1.209687 Sep 08 10:25:59.509278 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1350/2871] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:58 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1358 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:59.515611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:59.521783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:59.530354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:59.530601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:59.531220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:59.532153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:59.532791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:59.533379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:59.834067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:59.856090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:59.859772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:25:59.863194 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb2c3c57-46ef-4f64-8bd3-f84e019767dc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1755 microversion: 2.42 time: 0.350915 Sep 08 10:25:59.866283 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1351/2872] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:25:59 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1755 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:25:59.885901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:25:59.886553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:25:59.901792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:59.912140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:59.914151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:25:59.914704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:25:59.915646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:25:59.915646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:00.002863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:00.004773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:00.006102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:00.009045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lazy-loading 'fault' on Instance uuid bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:26:00.335782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:00.360719 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8749399a-119a-446c-9731-17a6c78b66d0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 200 len: 1306 microversion: 2.1 time: 0.492769 Sep 08 10:26:00.365051 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1352/2873] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:25:59 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 1306 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:00.385820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:00.387802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:00.422102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:00.424922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:00.432425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:00.435861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:00.444393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:00.445657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:02.267000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:02.285442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bcb03c38-52c8-4938-8fa9-f3fdef14aefe tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 1.918869 Sep 08 10:26:02.286084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1353/2874] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:00 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:02.293266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:02.293906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:02.312151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:02.312968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:02.313581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:02.314477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:02.318948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:02.319694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:02.962646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:02.979168 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dd389b8-f25e-4771-9bb8-aa0da1252c07 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.691827 Sep 08 10:26:02.991577 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1354/2875] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:02 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:02.991577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:02.991577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:03.008160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:03.008919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:03.009542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:03.010440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:03.011058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:03.011687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:03.492617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:03.504152 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e5b0c3a-cff6-4192-809d-1407b11f0522 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1321 microversion: 2.1 time: 0.522934 Sep 08 10:26:03.504747 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1355/2876] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:02 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:03.512050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-637bbda4-4bd8-4cd7-a730-e5facef10eeb req-56d994bd-6025-42be-99a7-c6b5c9fa6f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e", "name": "network-vif-deleted", "tag": "e26d38c1-e1b9-4b18-b8e7-ee09edffdb74"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:03.538404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-637bbda4-4bd8-4cd7-a730-e5facef10eeb req-56d994bd-6025-42be-99a7-c6b5c9fa6f1d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:03.540475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-637bbda4-4bd8-4cd7-a730-e5facef10eeb req-56d994bd-6025-42be-99a7-c6b5c9fa6f1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:03.542089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-637bbda4-4bd8-4cd7-a730-e5facef10eeb req-56d994bd-6025-42be-99a7-c6b5c9fa6f1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:03.571997 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-637bbda4-4bd8-4cd7-a730-e5facef10eeb req-56d994bd-6025-42be-99a7-c6b5c9fa6f1d service nova] Creating event network-vif-deleted:e26d38c1-e1b9-4b18-b8e7-ee09edffdb74 for instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e on n-h1-833090-19 Sep 08 10:26:03.585410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-637bbda4-4bd8-4cd7-a730-e5facef10eeb req-56d994bd-6025-42be-99a7-c6b5c9fa6f1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079238 Sep 08 10:26:03.586013 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1356/2877] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:03.591500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:03.592217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:03.607940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:03.608456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:03.608898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:03.609617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:03.610074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:03.610505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.180118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:04.196965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:04.198392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:04.199527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45ba30c6-22cc-4544-88c2-0c272a6a497b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1358 microversion: 2.21 time: 0.612411 Sep 08 10:26:04.200091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1357/2878] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:03 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:04.215455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:04.216500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:04.231593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.232458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.233072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.234559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.235176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.235783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.290180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:04.775265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:04.791871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:04.800587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:04.801939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2a9629b-3539-4daa-8cb4-6122389a3bba tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1802 microversion: 2.42 time: 0.600581 Sep 08 10:26:04.829819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1358/2879] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:04 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1802 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:04.845346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:04.852686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:04.863404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.864725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.865399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.866301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.866957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.867588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.892693 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e could not be found. Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e HTTP/1.1 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e could not be found. Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e'} Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e could not be found. Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e could not be found. Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:04.897833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e could not be found. Sep 08 10:26:04.902091 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:04.905797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:04.907271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ddd82a1b-4871-42bd-8703-ecf4ac7f15cd tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e" status: 404 len: 111 microversion: 2.1 time: 0.075540 Sep 08 10:26:04.908511 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1359/2880] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:04 2022] GET /compute/v2.1/servers/bc82d4fc-81ef-4cb8-ad45-78a3b47cee8e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:04.945101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:04.945982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:04.953646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4dc90c2-6bf7-4dce-9feb-8dad8ab1aa96 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.700811 Sep 08 10:26:04.955012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1522/2881] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:25:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:04.959159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.960195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.960817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.961371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-137bb0c5-b072-44de-8080-923e2e3542e4 req-b4c27d2d-2500-4609-b793-a9ba007df844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ab849-3273-458d-94cf-8ddc832dd8de", "name": "network-vif-plugged", "status": "completed", "tag": "df70bc76-0ecb-4329-af06-886a6e160a06"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:04.962807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.963713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.965338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:04.991624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-137bb0c5-b072-44de-8080-923e2e3542e4 req-b4c27d2d-2500-4609-b793-a9ba007df844 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:04.992166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-137bb0c5-b072-44de-8080-923e2e3542e4 req-b4c27d2d-2500-4609-b793-a9ba007df844 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:04.993577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-137bb0c5-b072-44de-8080-923e2e3542e4 req-b4c27d2d-2500-4609-b793-a9ba007df844 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.022129 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-137bb0c5-b072-44de-8080-923e2e3542e4 req-b4c27d2d-2500-4609-b793-a9ba007df844 service nova] Creating event network-vif-plugged:df70bc76-0ecb-4329-af06-886a6e160a06 for instance 7b3ab849-3273-458d-94cf-8ddc832dd8de on n-h1-833090-19 Sep 08 10:26:05.028319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-137bb0c5-b072-44de-8080-923e2e3542e4 req-b4c27d2d-2500-4609-b793-a9ba007df844 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071265 Sep 08 10:26:05.029065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1523/2882] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:05.035130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-15dc4f0a-0a01-4241-ba6a-da34318b694e req-87fa9ee7-955b-4f04-b3b1-342a03832168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8", "tag": "ce1eb31b-3be4-4bc5-b845-e5c0288b5f89"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:05.093840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-15dc4f0a-0a01-4241-ba6a-da34318b694e req-87fa9ee7-955b-4f04-b3b1-342a03832168 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.094328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-15dc4f0a-0a01-4241-ba6a-da34318b694e req-87fa9ee7-955b-4f04-b3b1-342a03832168 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.094766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-15dc4f0a-0a01-4241-ba6a-da34318b694e req-87fa9ee7-955b-4f04-b3b1-342a03832168 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.137548 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-15dc4f0a-0a01-4241-ba6a-da34318b694e req-87fa9ee7-955b-4f04-b3b1-342a03832168 service nova] Creating event network-changed:ce1eb31b-3be4-4bc5-b845-e5c0288b5f89 for instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 on n-h1-833090-19 Sep 08 10:26:05.145197 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-15dc4f0a-0a01-4241-ba6a-da34318b694e req-87fa9ee7-955b-4f04-b3b1-342a03832168 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114619 Sep 08 10:26:05.147791 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1524/2883] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:05.161118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:05.161841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:05.168613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.169103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.169542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.173429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.173981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.174424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.345284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:05.358989 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e7fce93c-67c4-4612-8dcc-b7a460c99efa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1515 microversion: 2.1 time: 0.431696 Sep 08 10:26:05.364814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1360/2884] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:04 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1515 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:05.376545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:05.379329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:05.410124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.410621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.411054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.411812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.412265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.412732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.606281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:05.615786 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02c7dae6-aefd-4e0e-9fce-386921060671 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.466543 Sep 08 10:26:05.619529 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1525/2885] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:05 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:05.629977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:05.630478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:05.648185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.648683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.649120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.649839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.650288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.650710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.693611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:05.703743 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-105ee85c-5e63-4951-9242-0b139d20c9b1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1321 microversion: 2.1 time: 0.337243 Sep 08 10:26:05.712224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1361/2886] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:05 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:05.716456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:05.727416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'action', calling method: .version_select at 0x7f23537da550>, body: {"addFloatingIp": {"address": "172.25.4.114"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:05.730395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:05.748809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.749327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.749759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.750462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.750908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.751323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.879375 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-975d888c-af43-40a6-94df-7be8ee43fb07 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 204 len: 0 microversion: 2.1 time: 0.258352 Sep 08 10:26:05.880187 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1526/2887] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:05 2022] DELETE /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:05.887553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:05.892391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:26:05.893821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:05.897313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquired lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:26:05.900766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.907931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.908570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.910000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:05.910597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:05.911177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:05.978463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:06.009670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=5 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:06.269847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:06.316617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:06.318088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:06.320568 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-786860cc-8f05-40aa-af6d-5b4a4bbc90c5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1358 microversion: 2.21 time: 0.439369 Sep 08 10:26:06.321526 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1527/2888] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:05 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:06.336726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-58c6f1df-6099-46bc-8a06-00b5b0f4ce52 req-d26c5206-a734-4680-ac33-4345e54b9611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d7a858-d599-4332-b3f4-008f213a2721", "tag": "4e3467bd-e282-4c69-883c-04c6703aff4d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:06.349060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-58c6f1df-6099-46bc-8a06-00b5b0f4ce52 req-d26c5206-a734-4680-ac33-4345e54b9611 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:06.356737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-58c6f1df-6099-46bc-8a06-00b5b0f4ce52 req-d26c5206-a734-4680-ac33-4345e54b9611 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:06.357298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-58c6f1df-6099-46bc-8a06-00b5b0f4ce52 req-d26c5206-a734-4680-ac33-4345e54b9611 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:06.372339 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-58c6f1df-6099-46bc-8a06-00b5b0f4ce52 req-d26c5206-a734-4680-ac33-4345e54b9611 service nova] Creating event network-changed:4e3467bd-e282-4c69-883c-04c6703aff4d for instance 89d7a858-d599-4332-b3f4-008f213a2721 on n-h2-833090-19 Sep 08 10:26:06.387254 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-58c6f1df-6099-46bc-8a06-00b5b0f4ce52 req-d26c5206-a734-4680-ac33-4345e54b9611 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062672 Sep 08 10:26:06.388496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1528/2889] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:06.406243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:06.411591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:06.421232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:06.422305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:06.423072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:06.425469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:06.426132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:06.426726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:06.433348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:06.775705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:06.807786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:06.818384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:06.823706 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e2215bd8-bdb0-4af9-bfd8-95127a2f1d47 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1849 microversion: 2.42 time: 0.432151 Sep 08 10:26:06.833716 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1529/2890] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:06 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1849 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:06.841245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:06.842180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:06.859178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:06.873666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:06.874382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:06.875134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:06.875779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:06.876404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:07.777885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:07.787435 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7132b2f5-0e01-4f56-9feb-9f2ad1376156 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1472 microversion: 2.1 time: 0.952349 Sep 08 10:26:07.788506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1530/2891] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:06 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1472 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:07.794792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:07.795781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:07.802332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:07.802840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:07.803289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:07.804040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:07.807867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:07.808844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:08.279435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:08.291928 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d020cfa0-1145-429d-aaa7-68c3e12e0678 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1521 microversion: 2.1 time: 0.502408 Sep 08 10:26:08.304363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1531/2892] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:07 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:08.315827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:08.316778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:08.324703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:08.325625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:08.326247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:08.327263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:08.328166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:08.328787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:08.738583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:08.746493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3d5e374-2493-4af0-9cf0-b7a5c019f9fa tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.440643 Sep 08 10:26:08.747661 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1532/2893] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:08 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:08.752311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:08.753184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:08.759437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:08.760208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:08.760810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:08.761668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:08.762274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:08.762854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:09.694388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Building network info cache for instance {{(pid=122456) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:26:09.709407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:09.720078 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61abcae7-4878-4694-97c4-ca5de9249641 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1321 microversion: 2.1 time: 0.971189 Sep 08 10:26:09.723592 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1533/2894] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:08 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1321 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:09.887138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0784a2b-bf3b-41f5-873b-707d5893da7f tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Action: 'create', calling method: .version_select at 0x7f23506a4670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:09.922339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:09.941414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c0784a2b-bf3b-41f5-873b-707d5893da7f tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Getting quotas for project 8ec898ab676f4ee38f4601c494381e14. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:26:09.970408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c0784a2b-bf3b-41f5-873b-707d5893da7f tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Getting quotas for user ea65a52df00c47b3b9de491d8518de0f and project 8ec898ab676f4ee38f4601c494381e14. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:26:10.058213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c0784a2b-bf3b-41f5-873b-707d5893da7f tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Getting quotas for project 8ec898ab676f4ee38f4601c494381e14. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:26:10.064929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c0784a2b-bf3b-41f5-873b-707d5893da7f tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Getting quotas for user ea65a52df00c47b3b9de491d8518de0f and project 8ec898ab676f4ee38f4601c494381e14. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:26:10.082184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0784a2b-bf3b-41f5-873b-707d5893da7f tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.356577 Sep 08 10:26:10.083436 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1534/2895] 10.222.0.59 () {62 vars in 1214 bytes} [Thu Sep 8 10:26:09 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:26:10.092221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:10.093401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:10.103409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:10.104307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:10.104741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:10.105995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:10.106477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:10.107072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:10.641669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:10.658724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:10.669839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:10.671225 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1cb848d2-8280-4872-b67e-b2141b3cd5cf tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1552 microversion: 2.21 time: 0.586562 Sep 08 10:26:10.672438 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1535/2896] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:10 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1552 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:10.678615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:10.684730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:10.702474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:10.703115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:10.703687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:10.704493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:10.705632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:10.709781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.283581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:11.293615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:11.305537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:11.307011 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87d95f6d-20e1-4601-b078-dbe23af5ad83 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1849 microversion: 2.42 time: 0.632893 Sep 08 10:26:11.307908 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1536/2897] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:10 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1849 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:11.314969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:11.320088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:11.334034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.334806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.335497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.336468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.338761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.339170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.526106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Updating instance_info_cache with network_info: [{"id": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8", "address": "fa:16:3e:13:c4:b4", "network": {"id": "433794c6-b984-4153-9bd0-c583493e6206", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-115905869-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f916001554eb4ed09be371252a2f28e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb3c0b3f7-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122456) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:26:11.546918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Releasing lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:26:11.549781 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d942189-c3df-4ae2-96af-dba7d44eeaaf tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action" status: 202 len: 0 microversion: 2.1 time: 5.830168 Sep 08 10:26:11.550525 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1362/2898] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:05 2022] POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action => generated 0 bytes in 5833 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:26:11.562451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:11.568515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:11.585720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.586460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.588395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.590562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.592008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.593905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.658284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:11.674144 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f079fd9d-d98b-4f92-9d08-029133b50beb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 200 len: 1472 microversion: 2.1 time: 0.364913 Sep 08 10:26:11.694123 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1537/2899] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:11 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:11.709534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1803c381-073c-4733-bc59-a348930fb401 req-5c99056f-c382-4496-96fd-65a4293883ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23af30e-41b7-4cc6-9eb4-4a2007246818", "tag": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:11.731414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1803c381-073c-4733-bc59-a348930fb401 req-5c99056f-c382-4496-96fd-65a4293883ca service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.736067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1803c381-073c-4733-bc59-a348930fb401 req-5c99056f-c382-4496-96fd-65a4293883ca service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.736525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1803c381-073c-4733-bc59-a348930fb401 req-5c99056f-c382-4496-96fd-65a4293883ca service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.755729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1803c381-073c-4733-bc59-a348930fb401 req-5c99056f-c382-4496-96fd-65a4293883ca service nova] Creating event network-changed:b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 for instance b23af30e-41b7-4cc6-9eb4-4a2007246818 on n-h2-833090-19 Sep 08 10:26:11.761925 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1803c381-073c-4733-bc59-a348930fb401 req-5c99056f-c382-4496-96fd-65a4293883ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066443 Sep 08 10:26:11.764342 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1538/2900] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:11.770980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:11.772821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:11.779873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.781236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.781984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.783165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:11.783943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:11.784953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:11.993047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:12.005208 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb9826ee-b43c-4318-bf35-b3dfb463e454 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1521 microversion: 2.1 time: 0.452758 Sep 08 10:26:12.005821 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1363/2901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:11 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:12.015630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dc14066-3b5a-4a3d-a145-08af58d274e5 tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:12.076651 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7dc14066-3b5a-4a3d-a145-08af58d274e5 tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.069729 Sep 08 10:26:12.079964 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1364/2902] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Sep 8 10:26:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:26:12.089930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:12.091034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:12.113775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.116982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.119095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:12.122450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.124304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.125522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:12.202989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:12.356132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:12.369108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82710279-71d3-4e0c-a27d-6ceb9b220f82 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.603206 Sep 08 10:26:12.369961 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1539/2903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:11 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:12.377049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:12.385049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:12.399170 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dda8c083-578a-453e-9346-0214bde38ded tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 204 len: 0 microversion: 2.21 time: 0.317434 Sep 08 10:26:12.400813 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1365/2904] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:26:12 2022] DELETE /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:26:12.400954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.401436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.401884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:12.402608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.403060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.406931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:12.409055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1dbe21a-3804-4b9a-aa53-329707727f11 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'create', calling method: .version_select at 0x7f23507d90d0>, body: {"pool": "b6b6db8b-7040-43e1-aa29-02266fee8e41"} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:12.852716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:12.872814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e8d8880-de80-460c-b173-513f6ca2c7b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1321 microversion: 2.1 time: 0.500473 Sep 08 10:26:12.892468 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1540/2905] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:12 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:12.898816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-95e13f9a-a770-43f2-8924-1369be351116 req-4c945cfd-2860-4c7c-a6cd-9afe25a6c11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc7a421-cb20-467e-8f14-d506b824caa3", "name": "network-vif-deleted", "tag": "b98634a0-562d-4392-8e8a-f9be80778899"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:12.909673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-95e13f9a-a770-43f2-8924-1369be351116 req-4c945cfd-2860-4c7c-a6cd-9afe25a6c11e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.910552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-95e13f9a-a770-43f2-8924-1369be351116 req-4c945cfd-2860-4c7c-a6cd-9afe25a6c11e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.911237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-95e13f9a-a770-43f2-8924-1369be351116 req-4c945cfd-2860-4c7c-a6cd-9afe25a6c11e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:12.929798 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-95e13f9a-a770-43f2-8924-1369be351116 req-4c945cfd-2860-4c7c-a6cd-9afe25a6c11e service nova] Creating event network-vif-deleted:b98634a0-562d-4392-8e8a-f9be80778899 for instance 8dc7a421-cb20-467e-8f14-d506b824caa3 on n-h1-833090-19 Sep 08 10:26:12.935952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-95e13f9a-a770-43f2-8924-1369be351116 req-4c945cfd-2860-4c7c-a6cd-9afe25a6c11e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041736 Sep 08 10:26:12.942116 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1541/2906] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:12.948052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69f17b89-d5bc-47ca-b9a0-0b6198d9aae8 tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:12.958039 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69f17b89-d5bc-47ca-b9a0-0b6198d9aae8 tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934" status: 200 len: 235 microversion: 2.64 time: 0.014156 Sep 08 10:26:12.959326 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1542/2907] 10.222.0.59 () {60 vars in 1304 bytes} [Thu Sep 8 10:26:12 2022] GET /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934 => generated 235 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:26:12.964500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:12.965634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:12.972689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.973572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.974234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:12.975994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:12.976838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:12.977515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:13.651439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:13.674540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:13.691334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:13.692785 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6686c79a-ef31-4b44-99a2-86350b4273f7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1870 microversion: 2.42 time: 0.732213 Sep 08 10:26:13.693703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1543/2908] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:12 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1870 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:13.698575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:13.704514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:13.732024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:13.732924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:13.733556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:13.734476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:13.735164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:13.735829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.066974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:14.080643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:14.082325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb0a9cfff55a4af9af3c7e7001e7e48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99554ceb36574084adb78b3767fb2768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:14.095666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f86ff0ae-9cba-4686-a509-faf4d7ab0fa5 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 200 len: 1558 microversion: 2.21 time: 0.388712 Sep 08 10:26:14.096375 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1544/2909] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:13 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 1558 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:14.101847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:14.102435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8dc7a421-cb20-467e-8f14-d506b824caa3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:14.117895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.118396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.118836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.119581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.120040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.120470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.146413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance 8dc7a421-cb20-467e-8f14-d506b824caa3 could not be found. Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 HTTP/1.1 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8dc7a421-cb20-467e-8f14-d506b824caa3 could not be found. Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8dc7a421-cb20-467e-8f14-d506b824caa3'} Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc7a421-cb20-467e-8f14-d506b824caa3 could not be found. Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc7a421-cb20-467e-8f14-d506b824caa3 could not be found. Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:14.165370 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc7a421-cb20-467e-8f14-d506b824caa3 could not be found. Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance 8dc7a421-cb20-467e-8f14-d506b824caa3 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:14.170301 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d69db443-a190-49d1-98cd-071b32e37e33 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3" status: 404 len: 111 microversion: 2.1 time: 0.069014 Sep 08 10:26:14.170877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1545/2910] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:14 2022] GET /compute/v2.1/servers/8dc7a421-cb20-467e-8f14-d506b824caa3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:14.181975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39ce600e-0718-460a-9c0e-6e69efd35fb5 tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:14.231568 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39ce600e-0718-460a-9c0e-6e69efd35fb5 tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934" status: 204 len: 0 microversion: 2.64 time: 0.060061 Sep 08 10:26:14.232558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1546/2911] 10.222.0.59 () {60 vars in 1307 bytes} [Thu Sep 8 10:26:14 2022] DELETE /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:26:14.240673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:14.251239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:14.258648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.259382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.260000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.260901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.261671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.262248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.654862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:14.665647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d3b755e-3aa8-49d1-a168-2e33c1796ff2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1521 microversion: 2.1 time: 0.431795 Sep 08 10:26:14.680439 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1547/2912] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:14 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:14.688199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1876d7ac-1d65-4676-be54-3175759c260f req-a083dbbc-829a-4723-9848-ed7458772716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb87b182-a7ea-4da4-9c78-b82f740179f8", "name": "network-vif-plugged", "status": "completed", "tag": "bb5cb180-c808-43df-8564-b4c81007ef41"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:14.699242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1876d7ac-1d65-4676-be54-3175759c260f req-a083dbbc-829a-4723-9848-ed7458772716 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.700184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1876d7ac-1d65-4676-be54-3175759c260f req-a083dbbc-829a-4723-9848-ed7458772716 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.700846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1876d7ac-1d65-4676-be54-3175759c260f req-a083dbbc-829a-4723-9848-ed7458772716 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.713487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1876d7ac-1d65-4676-be54-3175759c260f req-a083dbbc-829a-4723-9848-ed7458772716 service nova] Creating event network-vif-plugged:bb5cb180-c808-43df-8564-b4c81007ef41 for instance fb87b182-a7ea-4da4-9c78-b82f740179f8 on n-h1-833090-19 Sep 08 10:26:14.720688 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1876d7ac-1d65-4676-be54-3175759c260f req-a083dbbc-829a-4723-9848-ed7458772716 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038555 Sep 08 10:26:14.725585 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1548/2913] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:14.731061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:14.731972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:14.739777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.740499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.741153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:14.742108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:14.742723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:14.743312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:15.106750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:15.117352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2071ae1f-9f61-4565-a760-e65ba9981a9c tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.390444 Sep 08 10:26:15.118157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1549/2914] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:14 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:15.125965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "ed356a2e-ef5c-4059-a100-4db728c7c7b5"}, {"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "17fde0e0-1318-48b1-8837-bc941c736cff"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:15.140290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:15.140766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:15.141194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:15.158217 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] Creating event network-changed:ed356a2e-ef5c-4059-a100-4db728c7c7b5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:15.158725 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] Creating event network-changed:17fde0e0-1318-48b1-8837-bc941c736cff for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:15.164589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b9d39c72-052b-497d-96b4-8c00ec151dea req-ee212266-3b88-44dd-9414-b387b46283ee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042551 Sep 08 10:26:15.165897 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1550/2915] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:15.170313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:15.171010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:15.178326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:15.178811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:15.179729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:15.180398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:15.180849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:15.181277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:15.917180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:15.925298 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f92f748-1b83-4db4-a603-8cbecaf8ca6b tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1321 microversion: 2.1 time: 0.758871 Sep 08 10:26:15.925882 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1551/2916] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:15 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:15.931246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:15.931819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:15.937874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:15.938358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:15.938792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:15.939513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:15.939965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:15.940525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:15.944740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:15.966834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:16.048813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2471381e-7b27-425e-85b1-5f1735a40503 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 204 len: 0 microversion: 2.1 time: 0.118946 Sep 08 10:26:16.048813 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1552/2917] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:15 2022] DELETE /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:16.053559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48f558e4-3efb-4ea2-94fb-601562db6c1e tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.060707 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-48f558e4-3efb-4ea2-94fb-601562db6c1e tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] HTTP exception thrown: Instance group f0e8a52e-1bad-4a27-8652-32280315d934 could not be found. Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48f558e4-3efb-4ea2-94fb-601562db6c1e tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Request method failure captured: Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934 HTTP/1.1 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcM-qQq1LIJxqPwFkegVxoAvIf3UcKpIMBl62xjDhtHeoy_04TOAA6j1rishDbxW44LW6mHx1H-e-m7XvzBATeHEW9eb64LvaEE-opSlyOPLhADGpKZ4i4R-ITqAuyMDNISFtchR3lXjG7manI5FY5Bi1vKJR2rFQ-vMjMAvLBQZPY4 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.64 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 8ec898ab676f4ee38f4601c494381e14 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroup264TestJSON-958313463 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ec898ab676f4ee38f4601c494381e14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ec898ab676f4ee38f4601c494381e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8ec898ab676f4ee38f4601c494381e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8ec898ab676f4ee38f4601c494381e14", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroup264TestJSON-958313463 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 8ec898ab676f4ee38f4601c494381e14 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroup264TestJSON-958313463 Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroup264TestJSON-958313463-project Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea65a52df00c47b3b9de491d8518de0f Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroup264TestJSON-958313463-project Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance group f0e8a52e-1bad-4a27-8652-32280315d934 could not be found. Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f0e8a52e-1bad-4a27-8652-32280315d934'} Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f0e8a52e-1bad-4a27-8652-32280315d934 could not be found. Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f0e8a52e-1bad-4a27-8652-32280315d934 could not be found. Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.072151 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f0e8a52e-1bad-4a27-8652-32280315d934 could not be found. Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48f558e4-3efb-4ea2-94fb-601562db6c1e tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] Returning 404 to user: Instance group f0e8a52e-1bad-4a27-8652-32280315d934 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:16.077196 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48f558e4-3efb-4ea2-94fb-601562db6c1e tempest-ServerGroup264TestJSON-958313463 tempest-ServerGroup264TestJSON-958313463-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934" status: 404 len: 117 microversion: 2.64 time: 0.027899 Sep 08 10:26:16.078539 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1553/2918] 10.222.0.59 () {60 vars in 1307 bytes} [Thu Sep 8 10:26:16 2022] DELETE /compute/v2.1/os-server-groups/f0e8a52e-1bad-4a27-8652-32280315d934 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:16.084005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.085105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.092482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.093050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.093672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.094388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.095149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.095811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.511267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:16.522036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:16.523711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:16.525404 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-711b1ffe-12bb-466a-b9e8-edb017df6df7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.445525 Sep 08 10:26:16.526014 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1554/2919] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:16 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:16.531023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1380c1ad-e299-48c7-8888-aa3ceadf97b4 req-9d06516f-c26c-4263-ae85-4b566580958f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ab849-3273-458d-94cf-8ddc832dd8de", "name": "network-vif-deleted", "tag": "df70bc76-0ecb-4329-af06-886a6e160a06"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:16.541767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1380c1ad-e299-48c7-8888-aa3ceadf97b4 req-9d06516f-c26c-4263-ae85-4b566580958f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.542479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1380c1ad-e299-48c7-8888-aa3ceadf97b4 req-9d06516f-c26c-4263-ae85-4b566580958f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.543075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1380c1ad-e299-48c7-8888-aa3ceadf97b4 req-9d06516f-c26c-4263-ae85-4b566580958f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.562134 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1380c1ad-e299-48c7-8888-aa3ceadf97b4 req-9d06516f-c26c-4263-ae85-4b566580958f service nova] Creating event network-vif-deleted:df70bc76-0ecb-4329-af06-886a6e160a06 for instance 7b3ab849-3273-458d-94cf-8ddc832dd8de on n-h1-833090-19 Sep 08 10:26:16.567912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1380c1ad-e299-48c7-8888-aa3ceadf97b4 req-9d06516f-c26c-4263-ae85-4b566580958f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040506 Sep 08 10:26:16.569037 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1555/2920] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:16.575728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.576615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.584598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.585087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.585524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.586226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.586849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.587739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.602272 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] HTTP exception thrown: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Request method failure captured: Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de HTTP/1.1 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMqpLQ6m_5TPP_RYia9RUUV3gf0wQCQ-5qI_UpsLYHMltGPMDshWs-K8Mf1zkpDyOr1VF-0pLtlwhWfd-PsHi9tn8o-Qyk3bkr9nW6I3mQ9UB1mAApZIAcHMMJ4TKEfA_wIPmb4djzXW2C_Y6VOVgF4WpOoCLM0KbbzZ6oA8PYxl0Y Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 99554ceb36574084adb78b3767fb2768 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/99554ceb36574084adb78b3767fb2768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/99554ceb36574084adb78b3767fb2768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/99554ceb36574084adb78b3767fb2768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_99554ceb36574084adb78b3767fb2768", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 99554ceb36574084adb78b3767fb2768 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceActionsV221TestJSON-207025920-project Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: cb0a9cfff55a4af9af3c7e7001e7e48a Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceActionsV221TestJSON-207025920-project Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7b3ab849-3273-458d-94cf-8ddc832dd8de'} Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.603978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Returning 404 to user: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb0412cd-0d64-47d3-be87-5ae224b4c099 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 404 len: 111 microversion: 2.21 time: 0.034910 Sep 08 10:26:16.607862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1556/2921] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:16 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:16.612523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.613186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.618979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.619451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.619920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.620624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.621084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.621512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.633036 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1dbe21a-3804-4b9a-aa53-329707727f11 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.230265 Sep 08 10:26:16.642339 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1366/2922] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:26:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:16.648894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.649508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.655801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.656288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.656717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.657409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.657961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.658384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.686234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:16.761630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:16.772487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5cf66a2-823f-41ec-ae83-49b127928faa tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1506 microversion: 2.1 time: 0.163789 Sep 08 10:26:16.775890 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb4b068b-909a-4976-9d70-1e504a3d0573 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 204 len: 0 microversion: 2.1 time: 0.131717 Sep 08 10:26:16.779355 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1367/2923] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:16 2022] DELETE /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:16.784235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.784861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.789775 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1557/2924] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:16 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:16.790842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.791412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.792003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.792514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.792970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.793382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.799398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '.version_select at 0x7f2355417700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:16.800011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.806561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.807070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.807555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.808525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.808906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.809326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.884577 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4424edbd-e0c9-4b49-9cfe-2ebf8714c97c tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.093619 Sep 08 10:26:16.885166 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1558/2925] 10.222.0.59 () {60 vars in 1337 bytes} [Thu Sep 8 10:26:16 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de/os-instance-actions => generated 611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:26:16.897313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'action', calling method: .version_select at 0x7f2352e0d310>, body: {"addFloatingIp": {"address": "172.25.4.248"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:16.900056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:16.906639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.907129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.907811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.908533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.908987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.909412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.944554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:16.952895 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ace40ba5-fdf1-4ea4-a88d-f01a1c06620d tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.174655 Sep 08 10:26:16.953835 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1368/2926] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:16 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:16.958918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d7a858-d599-4332-b3f4-008f213a2721", "name": "network-vif-plugged", "status": "completed", "tag": "4e3467bd-e282-4c69-883c-04c6703aff4d"}, {"server_uuid": "6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8", "name": "network-vif-plugged", "status": "completed", "tag": "ce1eb31b-3be4-4bc5-b845-e5c0288b5f89"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:16.971048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:16.971558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:16.971988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:16.985843 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] Creating event network-vif-plugged:4e3467bd-e282-4c69-883c-04c6703aff4d for instance 89d7a858-d599-4332-b3f4-008f213a2721 on n-h2-833090-19 Sep 08 10:26:16.986261 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] Creating event network-vif-plugged:ce1eb31b-3be4-4bc5-b845-e5c0288b5f89 for instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 on n-h1-833090-19 Sep 08 10:26:16.986435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:26:16.986785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquired lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:26:16.995428 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f74325ae-860b-4676-a86d-2ced55e11925 req-dd2df025-22b9-479a-be45-fb88c0a77006 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039920 Sep 08 10:26:16.996272 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1369/2927] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:17.001609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:17.002483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:17.009980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.010467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.010905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.011644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.012098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.012519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.337730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:17.350497 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-60938df1-1d37-4c5f-8190-15c933637eb2 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 200 len: 1474 microversion: 2.1 time: 0.352738 Sep 08 10:26:17.352390 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1370/2928] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:16 2022] GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 1474 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:17.363984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:17.366154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:17.377681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.378318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.379744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.382187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.382870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.383399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.858156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41.", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:26:17.864948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Releasing lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:26:17.867203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:17.867781 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.867781 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Request method failure captured: Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action HTTP/1.1 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 46 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMPLmSq_nTPTAVDTEt5XOlBA8qVWyvOmOS75E3TNdzpan0lurjDY0HhnKtUwAU2N4FVdXnSL_f9dU260q8dHDPwMKSySnwhzYbrdpUTqNYKx31Lw7GfmWqZB4HjSuQKopw5emZEwfVyDt5R2iiYEq4vJSImmjdZQQGbfaQFkw8EJQM Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f916001554eb4ed09be371252a2f28e5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0c8f475c0c9446a9939544c1a0f83b1e Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: {"addFloatingIp": {"address": "172.25.4.248"}} Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b23af30e-41b7-4cc6-9eb4-4a2007246818', 'body': {'addFloatingIp': {'address': '172.25.4.248'}}} Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:26:17.875727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] Sep 08 10:26:17.879547 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:17.886821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Returning 400 to user: Cannot associate floating IP 172.25.4.248 (cfeab108-96c5-43f4-85fe-363b3dee506b) with port b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network b6b6db8b-7040-43e1-aa29-02266fee8e41. Sep 08 10:26:17.886821 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-46483587-6f08-46eb-8bba-e585e85ecc82'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:17.888936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d603fca5-0b67-4598-b227-ee922eeced6c tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action" status: 400 len: 382 microversion: 2.1 time: 1.002836 Sep 08 10:26:17.892577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1559/2929] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:16 2022] POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action => generated 382 bytes in 1006 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:17.904153 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-212b78c9-641a-4532-b55c-d8518aea1f95 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 200 len: 1506 microversion: 2.1 time: 0.547991 Sep 08 10:26:17.905926 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1371/2930] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:17 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:17.909340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:17.912769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:17.916823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:17.917730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:17.930124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.930567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.931281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.933985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.934990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.937700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.938415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.939350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:17.939843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.940288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.943756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:17.944207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:17.992084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] HTTP exception thrown: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Request method failure captured: Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de HTTP/1.1 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMqpLQ6m_5TPP_RYia9RUUV3gf0wQCQ-5qI_UpsLYHMltGPMDshWs-K8Mf1zkpDyOr1VF-0pLtlwhWfd-PsHi9tn8o-Qyk3bkr9nW6I3mQ9UB1mAApZIAcHMMJ4TKEfA_wIPmb4djzXW2C_Y6VOVgF4WpOoCLM0KbbzZ6oA8PYxl0Y Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 99554ceb36574084adb78b3767fb2768 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/99554ceb36574084adb78b3767fb2768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/99554ceb36574084adb78b3767fb2768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/99554ceb36574084adb78b3767fb2768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_99554ceb36574084adb78b3767fb2768", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 99554ceb36574084adb78b3767fb2768 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceActionsV221TestJSON-207025920-project Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: cb0a9cfff55a4af9af3c7e7001e7e48a Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceActionsV221TestJSON-207025920-project Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7b3ab849-3273-458d-94cf-8ddc832dd8de'} Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:18.012054 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Returning 404 to user: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-abb9b745-851a-43e7-89e7-290161a64b8b tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 404 len: 111 microversion: 2.21 time: 0.117011 Sep 08 10:26:18.016051 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1560/2931] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:26:17 2022] DELETE /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:18.027404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-29fd7b0c-1799-4eb9-aa07-446843c07e44 req-a49b7a75-81b3-4f74-ada6-7bb26ed5c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "476853c2-0179-4c3b-bd7b-48ae101e3282"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:18.047166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-29fd7b0c-1799-4eb9-aa07-446843c07e44 req-a49b7a75-81b3-4f74-ada6-7bb26ed5c8d3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.047695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-29fd7b0c-1799-4eb9-aa07-446843c07e44 req-a49b7a75-81b3-4f74-ada6-7bb26ed5c8d3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.048124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-29fd7b0c-1799-4eb9-aa07-446843c07e44 req-a49b7a75-81b3-4f74-ada6-7bb26ed5c8d3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:18.060552 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-29fd7b0c-1799-4eb9-aa07-446843c07e44 req-a49b7a75-81b3-4f74-ada6-7bb26ed5c8d3 service nova] Creating event network-changed:476853c2-0179-4c3b-bd7b-48ae101e3282 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:18.066136 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-29fd7b0c-1799-4eb9-aa07-446843c07e44 req-a49b7a75-81b3-4f74-ada6-7bb26ed5c8d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050607 Sep 08 10:26:18.067520 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1561/2932] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:18.074128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:18.075035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:18.082267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.082753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.083395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:18.084282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.084894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.085485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:18.561491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:18.570459 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9179d1dd-d7e1-4f39-a89f-349c81ccf79a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1321 microversion: 2.1 time: 0.663140 Sep 08 10:26:18.571529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1372/2933] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:17 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:18.576968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7b660ba-abd7-4840-a3fb-95444597d209 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '.version_select at 0x7f23506bf040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:18.606259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:18.616588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:18.618375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:18.619901 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca8f7cbf-7410-44d4-b7e6-68cab5bdc2e7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.551061 Sep 08 10:26:18.620588 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1562/2934] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:18 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:18.634262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:18.635339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:18.643560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.645122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.645748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:18.646613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.647330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.647839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:18.682069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:18.785706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:18.790507 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00167524-3f40-4ac7-a17a-ecc1c8497320 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 204 len: 0 microversion: 2.1 time: 0.168278 Sep 08 10:26:18.794948 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1563/2935] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:18 2022] DELETE /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:18.797645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:18.798548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:18.811049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.813115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.813646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:18.814450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:18.815143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:18.815687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:19.293106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:19.317363 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de23de87-dcca-492e-9049-31e4dee05614 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1327 microversion: 2.1 time: 0.524281 Sep 08 10:26:19.332432 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1564/2936] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:18 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1327 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:19.332432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:19.332432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] [instance: 7b3ab849-3273-458d-94cf-8ddc832dd8de] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:19.349466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:19.349981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:19.350431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:19.351155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:19.351648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:19.352087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:19.375399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] HTTP exception thrown: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Request method failure captured: Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de HTTP/1.1 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMqpLQ6m_5TPP_RYia9RUUV3gf0wQCQ-5qI_UpsLYHMltGPMDshWs-K8Mf1zkpDyOr1VF-0pLtlwhWfd-PsHi9tn8o-Qyk3bkr9nW6I3mQ9UB1mAApZIAcHMMJ4TKEfA_wIPmb4djzXW2C_Y6VOVgF4WpOoCLM0KbbzZ6oA8PYxl0Y Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 99554ceb36574084adb78b3767fb2768 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/99554ceb36574084adb78b3767fb2768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/99554ceb36574084adb78b3767fb2768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/99554ceb36574084adb78b3767fb2768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_99554ceb36574084adb78b3767fb2768", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 99554ceb36574084adb78b3767fb2768 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-207025920 Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceActionsV221TestJSON-207025920-project Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: cb0a9cfff55a4af9af3c7e7001e7e48a Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceActionsV221TestJSON-207025920-project Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7b3ab849-3273-458d-94cf-8ddc832dd8de'} Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:19.378633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:19.383908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] Returning 404 to user: Instance 7b3ab849-3273-458d-94cf-8ddc832dd8de could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:19.386676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8336b72e-08b4-4799-a775-ee52b9249bf0 tempest-InstanceActionsV221TestJSON-207025920 tempest-InstanceActionsV221TestJSON-207025920-project] 10.222.0.59 "GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de" status: 404 len: 111 microversion: 2.21 time: 0.058838 Sep 08 10:26:19.387926 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1565/2937] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:19 2022] GET /compute/v2.1/servers/7b3ab849-3273-458d-94cf-8ddc832dd8de => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:19.396132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:19.399111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:19.409208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:19.409981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:19.410447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:19.411175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:19.411667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:19.412342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:19.953579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:19.965669 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2089949a-eeca-4c98-b025-4b4f03f63cd0 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 200 len: 1474 microversion: 2.1 time: 0.577194 Sep 08 10:26:19.994080 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1566/2938] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:19 2022] GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 1474 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:20.000154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1780489329", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "7bea54b2-3154-47c8-835b-cf27d6e1658d"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:20.073883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:20.098766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] validate_networks() for [('7bea54b2-3154-47c8-835b-cf27d6e1658d', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:26:22.327237 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7b660ba-abd7-4840-a3fb-95444597d209 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/cfeab108-96c5-43f4-85fe-363b3dee506b" status: 202 len: 0 microversion: 2.1 time: 3.754219 Sep 08 10:26:22.328401 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1373/2939] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:26:18 2022] DELETE /compute/v2.1/os-floating-ips/cfeab108-96c5-43f4-85fe-363b3dee506b => generated 0 bytes in 3756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:26:22.333094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:22.333956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:22.340304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.340959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.341656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.342548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.342941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.343625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.615534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:26:22.615534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:26:22.615534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:26:22.616454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:26:22.617090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:26:22.627592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.628087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.628560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.629909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.630731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.631502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.657368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Getting quotas for project 0fac3ab51d9049bea3393313680eb6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:26:22.663544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Getting quotas for user 0218f274eff54ce8bf63b54e39df1820 and project 0fac3ab51d9049bea3393313680eb6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:26:22.680094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:26:22.682525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:26:22.712900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:22.723578 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-325c3093-8c18-4f6c-bf67-d2a5619b77b0 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1471 microversion: 2.1 time: 0.393365 Sep 08 10:26:22.724526 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1374/2940] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:22 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:22.729669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:22.730521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:22.739810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-886300e4-5b87-4ba7-9e14-2e58c77baed5 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.744122 Sep 08 10:26:22.741222 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1567/2941] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:26:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:26:22.750750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.752313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.752666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-63c8bc7f-3787-4ddb-82e6-9f2eb548f0a3 req-e2a17b3f-af48-432f-aaae-29d2e0474a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94", "name": "network-vif-unplugged", "status": "completed", "tag": "5850860d-7a3d-46a5-8081-db2dee619bc9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:22.752927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.756145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.756825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.757322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.774051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-63c8bc7f-3787-4ddb-82e6-9f2eb548f0a3 req-e2a17b3f-af48-432f-aaae-29d2e0474a38 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.775125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-63c8bc7f-3787-4ddb-82e6-9f2eb548f0a3 req-e2a17b3f-af48-432f-aaae-29d2e0474a38 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.775863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-63c8bc7f-3787-4ddb-82e6-9f2eb548f0a3 req-e2a17b3f-af48-432f-aaae-29d2e0474a38 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.791190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:22.816649 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-63c8bc7f-3787-4ddb-82e6-9f2eb548f0a3 req-e2a17b3f-af48-432f-aaae-29d2e0474a38 service nova] Creating event network-vif-unplugged:5850860d-7a3d-46a5-8081-db2dee619bc9 for instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 on n-h1-833090-19 Sep 08 10:26:22.821812 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-63c8bc7f-3787-4ddb-82e6-9f2eb548f0a3 req-e2a17b3f-af48-432f-aaae-29d2e0474a38 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078900 Sep 08 10:26:22.825699 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1568/2942] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:22.831367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7cc7e973-d48d-42a0-ac82-7899f8aad9c8 req-5ee80e1e-bbfd-441e-ade7-cad30d14eb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94", "name": "network-vif-deleted", "tag": "5850860d-7a3d-46a5-8081-db2dee619bc9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:22.846289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7cc7e973-d48d-42a0-ac82-7899f8aad9c8 req-5ee80e1e-bbfd-441e-ade7-cad30d14eb09 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.846784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7cc7e973-d48d-42a0-ac82-7899f8aad9c8 req-5ee80e1e-bbfd-441e-ade7-cad30d14eb09 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.847249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7cc7e973-d48d-42a0-ac82-7899f8aad9c8 req-5ee80e1e-bbfd-441e-ade7-cad30d14eb09 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.884172 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7cc7e973-d48d-42a0-ac82-7899f8aad9c8 req-5ee80e1e-bbfd-441e-ade7-cad30d14eb09 service nova] Creating event network-vif-deleted:5850860d-7a3d-46a5-8081-db2dee619bc9 for instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 on n-h1-833090-19 Sep 08 10:26:22.899529 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7cc7e973-d48d-42a0-ac82-7899f8aad9c8 req-5ee80e1e-bbfd-441e-ade7-cad30d14eb09 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069854 Sep 08 10:26:22.900575 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1569/2943] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:22.910940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:22.912505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:22.920997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.921485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.921922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:22.923228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:22.923553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:22.923984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:23.282742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:23.300104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:23.302911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:23.304425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35a87e40-0c13-407c-a142-19a06391d1ed tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.578719 Sep 08 10:26:23.305740 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1375/2944] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:22 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:23.312606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:23.315832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:23.328209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:23.328775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:23.329165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:23.329885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:23.330340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:23.331214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:23.346496 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e could not be found. Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e HTTP/1.1 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e could not be found. Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e'} Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e could not be found. Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e could not be found. Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:23.349482 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e could not be found. Sep 08 10:26:23.354619 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.356057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:23.356635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:23.357443 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38c91e2d-5f07-4e2e-b324-ae31ca6ed093 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e" status: 404 len: 111 microversion: 2.1 time: 0.050135 Sep 08 10:26:23.358553 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1376/2945] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:23 2022] GET /compute/v2.1/servers/ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:23.365461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5b0c5e8-c591-476f-8c02-0a5ba27e4f94 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1527 microversion: 2.1 time: 0.463444 Sep 08 10:26:23.366604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-e00b3eb4-8110-4270-a20e-886461442966 req-556fe169-3cb4-410f-a4cf-4571289074d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "084f648d-df8a-4900-8878-d6f4ecfd7b59"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:23.377412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e00b3eb4-8110-4270-a20e-886461442966 req-556fe169-3cb4-410f-a4cf-4571289074d1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:23.378115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e00b3eb4-8110-4270-a20e-886461442966 req-556fe169-3cb4-410f-a4cf-4571289074d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:23.378741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e00b3eb4-8110-4270-a20e-886461442966 req-556fe169-3cb4-410f-a4cf-4571289074d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:23.379847 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1570/2946] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:22 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1527 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:23.388628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'action', calling method: .version_select at 0x7f2352e0d280>, body: {"removeFloatingIp": {"address": "172.25.4.114"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:23.392263 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-e00b3eb4-8110-4270-a20e-886461442966 req-556fe169-3cb4-410f-a4cf-4571289074d1 service nova] Creating event network-changed:084f648d-df8a-4900-8878-d6f4ecfd7b59 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:23.398274 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-e00b3eb4-8110-4270-a20e-886461442966 req-556fe169-3cb4-410f-a4cf-4571289074d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038167 Sep 08 10:26:23.400391 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1377/2947] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:23.765474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9960e8d8-b9e3-44e5-aaaa-8ff77ea24c08 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:23.767285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9960e8d8-b9e3-44e5-aaaa-8ff77ea24c08 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] [instance: 9ca346ec-a934-4116-88d9-4d5a4488c049] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:23.780068 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9960e8d8-b9e3-44e5-aaaa-8ff77ea24c08 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] HTTP exception thrown: Instance 9ca346ec-a934-4116-88d9-4d5a4488c049 could not be found. Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9960e8d8-b9e3-44e5-aaaa-8ff77ea24c08 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Request method failure captured: Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/9ca346ec-a934-4116-88d9-4d5a4488c049/action HTTP/1.1 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMvwyELZYwoUcLpp7h_qvkRg15sWkvQ_NIES1cvIAnSFvA0f4vsKWUIhn0pM747TX85Wj-mC1GAOimfvOVE37CkrieizUBoRzQOK7zpoHiZHX3MuDHPMfZpdm2fNCkqMARKXgI56sE2pr3WYdJiwVSqGHV-LaNkGok7mt9ThnBM0sA Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db198c173f3e448fbfe8f68dd242a48d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9835d3d36d984860b326dbc05f604360 Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: {"migrate": {}} Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9ca346ec-a934-4116-88d9-4d5a4488c049 could not be found. Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9ca346ec-a934-4116-88d9-4d5a4488c049', 'body': {'migrate': {}}} Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ca346ec-a934-4116-88d9-4d5a4488c049 could not be found. Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ca346ec-a934-4116-88d9-4d5a4488c049 could not be found. Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.783626 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ca346ec-a934-4116-88d9-4d5a4488c049 could not be found. Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9960e8d8-b9e3-44e5-aaaa-8ff77ea24c08 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Returning 404 to user: Instance 9ca346ec-a934-4116-88d9-4d5a4488c049 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:23.788499 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9960e8d8-b9e3-44e5-aaaa-8ff77ea24c08 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/9ca346ec-a934-4116-88d9-4d5a4488c049/action" status: 404 len: 111 microversion: 2.1 time: 0.383578 Sep 08 10:26:23.791913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1378/2948] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:23 2022] POST /compute/v2.1/servers/9ca346ec-a934-4116-88d9-4d5a4488c049/action => generated 111 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:23.797365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:23.798290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:23.809398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:23.809968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:23.810573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:23.811364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:23.812350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:23.812878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:24.211248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:24.218146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:24.219019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:24.219592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:24.220421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:24.220923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:24.221419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:24.266274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:24.288346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1bbc48d4-03db-483c-a243-c7893ed4add3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1270 microversion: 2.1 time: 0.495032 Sep 08 10:26:24.288945 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1379/2949] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:23 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1270 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:24.296312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:24.297303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:24.321944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:24.322439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:24.322874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:24.323833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:24.324444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:24.325331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:24.351281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 could not be found. Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 HTTP/1.1 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 could not be found. Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94'} Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 could not be found. Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 could not be found. Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:24.356991 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 could not be found. Sep 08 10:26:24.371055 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:24.379529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance 6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:24.380577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bdccdd5a-1f74-4997-9404-843efc2a5f4c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94" status: 404 len: 111 microversion: 2.1 time: 0.088857 Sep 08 10:26:24.384264 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1380/2950] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:24 2022] GET /compute/v2.1/servers/6da9c7b7-0d09-4eb9-bdfe-20425b0e7b94 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:24.396323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:24.398021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:24.408395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:24.409742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:24.410800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:24.412382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:24.413484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:24.414587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:25.007332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:26:25.008748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquired lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:26:25.039166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:25.055144 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff71d3e4-e50d-4ba9-9a9d-06af5c0f8c44 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1527 microversion: 2.1 time: 0.667942 Sep 08 10:26:25.056353 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1381/2951] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:24 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1527 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:25.062394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-223022853", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:25.142651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:26:26.437174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:26:26.438996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:26:26.440212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:26:26.442010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:26:26.442685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:26:26.456053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:26.456829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:26.457820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:26.458748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:26.459184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:26.460296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:26.486267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Getting quotas for project a77ca45fee15423ea87437641284786a. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:26:26.493318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Getting quotas for user af5cdc71c4cb43f48243af53f70800c6 and project a77ca45fee15423ea87437641284786a. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:26:26.509113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:26:26.511521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:26:26.560595 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f314790-cec7-4c6f-b326-f579d801f78d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502292 Sep 08 10:26:26.561868 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1382/2952] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:26:26.567898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:26.569049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:26.580114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:26.580587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:26.581052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:26.581923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:26.582953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:26.583396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:27.141740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:27.200053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:27.201704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:27.205901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b9ed3a56-a113-4378-b26a-12fbd1c37740 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.642776 Sep 08 10:26:27.226705 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1383/2953] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:26 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:27.239690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67220cb3-88e4-4834-baf4-c343a10b063f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:27.311220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67220cb3-88e4-4834-baf4-c343a10b063f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/d1510f53-ddb4-4761-b9e5-3179c80f85cc" status: 204 len: 0 microversion: 2.1 time: 0.080608 Sep 08 10:26:27.312445 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1384/2954] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:26:27 2022] DELETE /compute/v2.1/os-server-groups/d1510f53-ddb4-4761-b9e5-3179c80f85cc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:27.322321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e", "name": "network-vif-deleted", "tag": "c24d10b0-7de5-48c3-90aa-54106e29d5d4"}, {"server_uuid": "fb87b182-a7ea-4da4-9c78-b82f740179f8", "name": "network-vif-deleted", "tag": "bb5cb180-c808-43df-8564-b4c81007ef41"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:27.351972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:27.356659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:27.359093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:27.361223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:27.396803 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] Creating event network-vif-deleted:c24d10b0-7de5-48c3-90aa-54106e29d5d4 for instance ab86c75e-0b6f-4ef0-8f0f-c72eeb9df41e on n-h2-833090-19 Sep 08 10:26:27.396803 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] Creating event network-vif-deleted:bb5cb180-c808-43df-8564-b4c81007ef41 for instance fb87b182-a7ea-4da4-9c78-b82f740179f8 on n-h1-833090-19 Sep 08 10:26:27.419713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b4ec2a7a-8663-4658-819f-d7e120772bd4 req-61233ccf-326f-4476-9125-0a747ab54729 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105103 Sep 08 10:26:27.432162 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1385/2955] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:27.652604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:26:27.712443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:27.713677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:27.732989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:27.733869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:27.734658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:27.736485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:27.740254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:27.741021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:27.774125 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] HTTP exception thrown: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Request method failure captured: Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 HTTP/1.1 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMrFvuK-iqUfYVcxJNPt20X8B189FserVvVljTu_0eQYyST_WL7y9EIHINV7F88k80OskZVmeiDDCbky87o-Mzpo60mw6yA90DxgwkR6iHB5B3ZxKi0pKJBwDQv3ptlKjOtsS3P4Gqxqtul_Vve1NNSaAvCO8d-mzaLH_GAU7qu66Y Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f48285cf5e4f48a598692829fb62f31f Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-675200640 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48285cf5e4f48a598692829fb62f31f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48285cf5e4f48a598692829fb62f31f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f48285cf5e4f48a598692829fb62f31f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f48285cf5e4f48a598692829fb62f31f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-675200640 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f48285cf5e4f48a598692829fb62f31f Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-675200640 Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestMultiTenantJSON-675200640-project Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 8012afaabdf14751afd80cda200631ff Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-675200640-project Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '89d7a858-d599-4332-b3f4-008f213a2721'} Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:27.776008 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Returning 404 to user: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:27.782093 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d3f12f7-df32-4061-b723-53792a14e5b7 tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] 10.222.0.59 "DELETE /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 404 len: 111 microversion: 2.1 time: 0.344592 Sep 08 10:26:27.786036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1386/2956] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:27 2022] DELETE /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 111 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:27.797471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:27.798467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:27.822900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:27.824864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:27.827685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:27.829445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:27.833285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:27.834028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:28.327068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:28.343019 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e56e233-bdf4-4e1e-acbf-aad6cbac41cd tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1318 microversion: 2.1 time: 0.555571 Sep 08 10:26:28.344212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1387/2957] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:27 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:28.349065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f34c0086-2cb5-4692-9a65-36bd05285b63 req-4412056a-0206-45ab-aa70-a723acf07887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "6c5df8e6-4c14-418d-a246-db3fd7c9961a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:28.359805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f34c0086-2cb5-4692-9a65-36bd05285b63 req-4412056a-0206-45ab-aa70-a723acf07887 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:28.360553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f34c0086-2cb5-4692-9a65-36bd05285b63 req-4412056a-0206-45ab-aa70-a723acf07887 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:28.361188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f34c0086-2cb5-4692-9a65-36bd05285b63 req-4412056a-0206-45ab-aa70-a723acf07887 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:28.375530 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f34c0086-2cb5-4692-9a65-36bd05285b63 req-4412056a-0206-45ab-aa70-a723acf07887 service nova] Creating event network-changed:6c5df8e6-4c14-418d-a246-db3fd7c9961a for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:28.381256 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f34c0086-2cb5-4692-9a65-36bd05285b63 req-4412056a-0206-45ab-aa70-a723acf07887 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035608 Sep 08 10:26:28.383077 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1388/2958] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:28.388448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:28.389387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:28.395999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:28.397645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:28.399395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:28.400348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:28.400979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:28.401578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:29.408883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:29.438511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b9d2c9f-0167-43e5-8534-2551ef2b648f tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1217 microversion: 2.1 time: 1.053021 Sep 08 10:26:29.439982 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1389/2959] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:28 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1217 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:29.455301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:29.456109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:29.472491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:29.473831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:29.474453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:29.475755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:29.480324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:29.481760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:29.543923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:29.702842 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a7a2a0ec-e2cc-4bf7-a432-c3aed6032b2c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 204 len: 0 microversion: 2.1 time: 0.257279 Sep 08 10:26:29.709708 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1390/2960] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:29 2022] DELETE /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:29.727056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:29.729680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:29.736382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:29.736843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:29.737280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:29.738012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:29.738461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:29.738882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:30.359366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:30.369907 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0c2f31f9-1c03-43fd-a1c3-de09dac1c082 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1527 microversion: 2.1 time: 0.655647 Sep 08 10:26:30.388833 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1391/2961] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:29 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1527 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:30.394861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:30.398378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:30.406753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:30.407667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:30.408468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:30.409436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:30.410020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:30.410518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:30.761624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Updating instance_info_cache with network_info: [{"id": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8", "address": "fa:16:3e:13:c4:b4", "network": {"id": "433794c6-b984-4153-9bd0-c583493e6206", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-115905869-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f916001554eb4ed09be371252a2f28e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb3c0b3f7-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:26:30.764835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:30.795506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Releasing lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:26:30.796839 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c8c2139-6c29-4eb1-83ef-ef91669e51f1 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action" status: 202 len: 0 microversion: 2.1 time: 7.415776 Sep 08 10:26:30.797682 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1571/2962] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:23 2022] POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action => generated 0 bytes in 7417 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:26:30.803306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:30.803958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:30.816239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:30.816778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:30.817254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:30.817919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:30.818375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:30.818800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.006228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:31.026575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:31.030372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:31.033737 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b582214-6e75-41d5-9608-2044eca44856 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.643277 Sep 08 10:26:31.034618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1392/2963] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:30 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:31.041020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2a8e6f2d-f43d-4e1e-b5ad-d9eb5b55c4a6 req-3054d8ca-d969-458a-8295-f762b2617f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07", "tag": "b9f14c32-a2d5-463a-91c3-00d9280d4de3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:31.089062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a8e6f2d-f43d-4e1e-b5ad-d9eb5b55c4a6 req-3054d8ca-d969-458a-8295-f762b2617f44 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.089895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a8e6f2d-f43d-4e1e-b5ad-d9eb5b55c4a6 req-3054d8ca-d969-458a-8295-f762b2617f44 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.090588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a8e6f2d-f43d-4e1e-b5ad-d9eb5b55c4a6 req-3054d8ca-d969-458a-8295-f762b2617f44 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.108857 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2a8e6f2d-f43d-4e1e-b5ad-d9eb5b55c4a6 req-3054d8ca-d969-458a-8295-f762b2617f44 service nova] Creating event network-changed:b9f14c32-a2d5-463a-91c3-00d9280d4de3 for instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 on n-h1-833090-19 Sep 08 10:26:31.115759 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2a8e6f2d-f43d-4e1e-b5ad-d9eb5b55c4a6 req-3054d8ca-d969-458a-8295-f762b2617f44 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079020 Sep 08 10:26:31.117201 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1393/2964] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:31.125482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:31.126866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:31.135896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.137066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.138063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.139182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.139862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.141223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.213281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:31.367012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c7d7ffd-5245-4411-8535-b5520741bdb4 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 204 len: 0 microversion: 2.1 time: 0.221987 Sep 08 10:26:31.372384 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1394/2965] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:31 2022] DELETE /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:31.383832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Action: 'update', calling method: >, body: {"server": {"name": "89d7a858-d599-4332-b3f4-008f213a2721_new"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:31.393623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:31.406874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.407711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.407848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:31.411962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.413619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.418338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.418936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.425614 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-37d4d889-1dea-4606-aba5-618d92ad5f55 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1318 microversion: 2.1 time: 0.626635 Sep 08 10:26:31.427017 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1572/2966] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:30 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:31.437462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "7ff24e51-954c-4345-b488-9f054da2ef8d"}, {"name": "network-changed", "server_uuid": "b23af30e-41b7-4cc6-9eb4-4a2007246818", "tag": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:31.455893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.456730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.457413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.463165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] HTTP exception thrown: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Request method failure captured: Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 HTTP/1.1 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 64 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMrFvuK-iqUfYVcxJNPt20X8B189FserVvVljTu_0eQYyST_WL7y9EIHINV7F88k80OskZVmeiDDCbky87o-Mzpo60mw6yA90DxgwkR6iHB5B3ZxKi0pKJBwDQv3ptlKjOtsS3P4Gqxqtul_Vve1NNSaAvCO8d-mzaLH_GAU7qu66Y Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f48285cf5e4f48a598692829fb62f31f Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-675200640 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48285cf5e4f48a598692829fb62f31f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48285cf5e4f48a598692829fb62f31f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f48285cf5e4f48a598692829fb62f31f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f48285cf5e4f48a598692829fb62f31f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-675200640 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f48285cf5e4f48a598692829fb62f31f Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-675200640 Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestMultiTenantJSON-675200640-project Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 8012afaabdf14751afd80cda200631ff Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-675200640-project Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "89d7a858-d599-4332-b3f4-008f213a2721_new"}} Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '89d7a858-d599-4332-b3f4-008f213a2721', 'body': {'server': {'name': '89d7a858-d599-4332-b3f4-008f213a2721_new'}}} Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:31.464979 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:31.469725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:31.472273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] Returning 404 to user: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:31.474643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2ed1db57-32a9-4430-a2a1-3e46fa40151a tempest-ServersNegativeTestMultiTenantJSON-675200640 tempest-ServersNegativeTestMultiTenantJSON-675200640-project] 10.222.0.59 "PUT /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 404 len: 111 microversion: 2.1 time: 0.100634 Sep 08 10:26:31.475976 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1395/2967] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:26:31 2022] PUT /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:31.481215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:31.487728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:31.502008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.502548 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] Creating event network-changed:7ff24e51-954c-4345-b488-9f054da2ef8d for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:31.503003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.503271 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] Creating event network-changed:b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 for instance b23af30e-41b7-4cc6-9eb4-4a2007246818 on n-h2-833090-19 Sep 08 10:26:31.504236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.505304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.505939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.506592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.513613 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e2fe0294-d22c-4c61-8568-4788077469bb req-7489ae42-bb7d-404a-8d4d-bd78f6081a1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083021 Sep 08 10:26:31.514727 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1573/2968] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:31.520756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff2a20ae-6d40-44a9-9a6d-52ac2daf8ccd tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '.version_select at 0x7f23510d4af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:31.709733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:31.729118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:31.742675 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4e1691c8-7735-48c7-8ed3-2de0e18258d5 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1279 microversion: 2.1 time: 0.265299 Sep 08 10:26:31.746220 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1396/2969] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:31 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:31.766682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:31.767684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:31.777706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.779194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.780043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:31.780991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:31.782770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:31.783703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:32.121841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:32.133825 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4d148bf6-0bb4-4c6c-82d2-0edf930fac1f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 200 len: 1474 microversion: 2.1 time: 0.385937 Sep 08 10:26:32.143394 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1397/2970] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:31 2022] GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:32.143394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:32.143394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:32.152061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:32.153361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:32.154007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:32.155096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:32.155785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:32.156422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:32.185858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:32.353980 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b003efa0-67ca-4bcd-86b4-a023bc8f1068 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 204 len: 0 microversion: 2.1 time: 0.216862 Sep 08 10:26:32.356092 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1398/2971] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:32 2022] DELETE /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:32.373689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:32.374786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:32.384417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:32.385713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:32.386425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:32.387664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:32.388500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:32.389279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:32.646766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:32.672147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:33.013088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:33.022786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:33.024269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:33.028192 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb74b819-c952-440c-ba58-96beace4f979 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.670535 Sep 08 10:26:33.030598 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1399/2972] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:32 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:33.178262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-988273049", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:33.265649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] validate_networks() for [('4f0de39b-d817-4530-ae18-dfb9d8c66246', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:26:34.069001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff2a20ae-6d40-44a9-9a6d-52ac2daf8ccd tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/201b1c83-33c3-448f-a5f6-7ebb50b6a050" status: 202 len: 0 microversion: 2.1 time: 2.552026 Sep 08 10:26:34.076802 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1574/2973] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:26:31 2022] DELETE /compute/v2.1/os-floating-ips/201b1c83-33c3-448f-a5f6-7ebb50b6a050 => generated 0 bytes in 2561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:26:34.085784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:34.087355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:34.096764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:34.097535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:34.099211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:34.104969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:34.108990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:34.109660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:34.699966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:26:34.700937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:26:34.702270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:26:34.702856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:26:34.703524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:26:34.721230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:34.724468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:34.725137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:34.726100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:34.733772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:34.734649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:34.782963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Getting quotas for project fc7ce418fdf848f78fdd52ab736dbf94. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:26:34.789577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Getting quotas for user 07b57454fca148df87413c061b96f431 and project fc7ce418fdf848f78fdd52ab736dbf94. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:26:34.824409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:26:34.826756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:26:34.899745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:34.918395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec2119cb-bb44-485e-b30b-4b93a22f034a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1533 microversion: 2.1 time: 0.837702 Sep 08 10:26:34.920120 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1575/2974] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:34 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1533 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:34.956669 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-461f7c1f-6674-41cf-9a4d-74749ea1b901 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.922933 Sep 08 10:26:34.964636 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1400/2975] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:26:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:26:34.971508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:34.975099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:34.978309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:34.982880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:35.008258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:35.009066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:35.010189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:35.012332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:35.012549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:35.013070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:35.013300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:35.015594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:35.015594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:35.015594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:35.015594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:35.018235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.115392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:36.132959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d4fed74-2f25-42e9-9751-929299ce77e6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1321 microversion: 2.1 time: 1.166603 Sep 08 10:26:36.133922 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1401/2976] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:34 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1321 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:36.151999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:36.153082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:36.167313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.168149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.168755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.169682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.170335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.170955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.430680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:36.459378 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-77924211-dd3c-4610-b87a-01d0fa66435c tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 200 len: 1303 microversion: 2.1 time: 0.314559 Sep 08 10:26:36.460711 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1402/2977] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:36 2022] GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 1303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:36.467008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2acf5287-d565-4f0d-8ded-1e90f52489fa req-54979d32-6403-40a9-9622-3b0dbd42bdae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "be64d2f2-5a29-40cc-bdb5-522ee1650ba5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:36.492051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2acf5287-d565-4f0d-8ded-1e90f52489fa req-54979d32-6403-40a9-9622-3b0dbd42bdae service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.500271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2acf5287-d565-4f0d-8ded-1e90f52489fa req-54979d32-6403-40a9-9622-3b0dbd42bdae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.501022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2acf5287-d565-4f0d-8ded-1e90f52489fa req-54979d32-6403-40a9-9622-3b0dbd42bdae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.502495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:36.518088 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-629084be-86e4-4aaa-8629-7186c87c5773 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1318 microversion: 2.1 time: 1.568842 Sep 08 10:26:36.523575 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1576/2978] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:34 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1318 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:36.537156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:36.537780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:36.566135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.566649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.567175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.567966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.568427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.568862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.924910 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2acf5287-d565-4f0d-8ded-1e90f52489fa req-54979d32-6403-40a9-9622-3b0dbd42bdae service nova] Creating event network-changed:be64d2f2-5a29-40cc-bdb5-522ee1650ba5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:26:36.937301 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2acf5287-d565-4f0d-8ded-1e90f52489fa req-54979d32-6403-40a9-9622-3b0dbd42bdae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.475102 Sep 08 10:26:36.938310 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1403/2979] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:36.952285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ec25e5-76b7-482f-8c8e-3b02c0478924 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ec25e5-76b7-482f-8c8e-3b02c0478924 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Request method failure captured: Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action HTTP/1.1 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 34 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMPLmSq_nTPTAVDTEt5XOlBA8qVWyvOmOS75E3TNdzpan0lurjDY0HhnKtUwAU2N4FVdXnSL_f9dU260q8dHDPwMKSySnwhzYbrdpUTqNYKx31Lw7GfmWqZB4HjSuQKopw5emZEwfVyDt5R2iiYEq4vJSImmjdZQQGbfaQFkw8EJQM Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f916001554eb4ed09be371252a2f28e5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0c8f475c0c9446a9939544c1a0f83b1e Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: {"addFloatingIp": {"address": ""}} Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b23af30e-41b7-4cc6-9eb4-4a2007246818', 'body': {'addFloatingIp': {'address': ''}}} Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '' Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:26:36.960728 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ec25e5-76b7-482f-8c8e-3b02c0478924 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9ec25e5-76b7-482f-8c8e-3b02c0478924 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action" status: 400 len: 142 microversion: 2.1 time: 0.022921 Sep 08 10:26:36.965049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1404/2980] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:36 2022] POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:36.970937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:36.972159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:36.982179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.983064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.983827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:36.986286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:36.987158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:36.987978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.255041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:37.264471 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55c7c185-5dac-49ee-a252-9c6430b8ad3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1274 microversion: 2.1 time: 0.299801 Sep 08 10:26:37.265147 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1405/2981] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:36 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1274 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:37.270600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5ae1cc4c-0927-4d6e-8465-b79730e9bd2f req-e8d85991-cf27-4e5e-bee2-e7cb61a33f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a6534a-2e40-4622-9b49-fe45eca2fc9f", "name": "network-vif-deleted", "tag": "a743004f-d463-44de-9406-6ac374d8d4ff"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:37.289220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5ae1cc4c-0927-4d6e-8465-b79730e9bd2f req-e8d85991-cf27-4e5e-bee2-e7cb61a33f2e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:37.289840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5ae1cc4c-0927-4d6e-8465-b79730e9bd2f req-e8d85991-cf27-4e5e-bee2-e7cb61a33f2e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:37.290552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5ae1cc4c-0927-4d6e-8465-b79730e9bd2f req-e8d85991-cf27-4e5e-bee2-e7cb61a33f2e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.327267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5ae1cc4c-0927-4d6e-8465-b79730e9bd2f req-e8d85991-cf27-4e5e-bee2-e7cb61a33f2e service nova] Creating event network-vif-deleted:a743004f-d463-44de-9406-6ac374d8d4ff for instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f on n-h1-833090-19 Sep 08 10:26:37.343755 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5ae1cc4c-0927-4d6e-8465-b79730e9bd2f req-e8d85991-cf27-4e5e-bee2-e7cb61a33f2e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076876 Sep 08 10:26:37.345055 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1406/2982] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:37.359382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:37.360619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:37.384476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:37.386291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:37.386857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.391885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:37.392616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:37.395429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.858086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:37.868519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:37.869990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:37.871166 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-71571da8-d20e-4db5-af59-825c72cb92ae tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.346292 Sep 08 10:26:37.871765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1577/2983] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:36 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:37.876107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-233d9e34-49e0-4aef-9f3b-ad2610d74907 req-9b4ee665-0036-4a69-b703-80478e08ba56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07", "name": "network-vif-plugged", "status": "completed", "tag": "b9f14c32-a2d5-463a-91c3-00d9280d4de3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:37.886567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-233d9e34-49e0-4aef-9f3b-ad2610d74907 req-9b4ee665-0036-4a69-b703-80478e08ba56 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:37.887089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-233d9e34-49e0-4aef-9f3b-ad2610d74907 req-9b4ee665-0036-4a69-b703-80478e08ba56 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:37.887722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-233d9e34-49e0-4aef-9f3b-ad2610d74907 req-9b4ee665-0036-4a69-b703-80478e08ba56 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.899611 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-233d9e34-49e0-4aef-9f3b-ad2610d74907 req-9b4ee665-0036-4a69-b703-80478e08ba56 service nova] Creating event network-vif-plugged:b9f14c32-a2d5-463a-91c3-00d9280d4de3 for instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 on n-h1-833090-19 Sep 08 10:26:37.904776 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-233d9e34-49e0-4aef-9f3b-ad2610d74907 req-9b4ee665-0036-4a69-b703-80478e08ba56 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031828 Sep 08 10:26:37.905425 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1578/2984] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:37.910899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:37.913534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:37.920022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:37.920520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:37.920964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.921679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:37.922139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:37.922576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:37.951649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:26:37.952063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquired lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:26:38.162637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fe839a7f6fe47e4bd827dc976ba58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '373352e1609148bf9315be6c3e335807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:38.172453 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5944a491-564b-42b1-9845-bdf4f99e92d9 tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 200 len: 1533 microversion: 2.1 time: 0.826167 Sep 08 10:26:38.182024 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1407/2985] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:37 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 1533 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:38.187563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:38.188418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:38.195787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.196584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.197221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.198006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.198394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.198825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.244073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Releasing lock "refresh_cache-b23af30e-41b7-4cc6-9eb4-4a2007246818" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:26:38.245071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] HTTP exception thrown: floating IP not found Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Request method failure captured: Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action HTTP/1.1 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 41 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMPLmSq_nTPTAVDTEt5XOlBA8qVWyvOmOS75E3TNdzpan0lurjDY0HhnKtUwAU2N4FVdXnSL_f9dU260q8dHDPwMKSySnwhzYbrdpUTqNYKx31Lw7GfmWqZB4HjSuQKopw5emZEwfVyDt5R2iiYEq4vJSImmjdZQQGbfaQFkw8EJQM Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f916001554eb4ed09be371252a2f28e5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0c8f475c0c9446a9939544c1a0f83b1e Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: exception: floating IP not found Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b23af30e-41b7-4cc6-9eb4-4a2007246818', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 08 10:26:38.246861 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Returning 404 to user: floating IP not found {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:38.250743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-894890fa-24cd-4b63-bae9-3c5074a51a51 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action" status: 404 len: 67 microversion: 2.1 time: 0.341964 Sep 08 10:26:38.254932 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1579/2986] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:37 2022] POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action => generated 67 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:26:38.259951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:38.260584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:38.267881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.268451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.268812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.269546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.270005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.270513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.307062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.307885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.308329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.308785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lazy-loading 'fault' on Instance uuid 8904ea32-ef8e-4736-bf82-af73eb0f90d4 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:26:38.428677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:38.437674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6159facd-833b-4a2c-a8bf-f3d8cd79dcb7 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 200 len: 1308 microversion: 2.1 time: 0.181255 Sep 08 10:26:38.445158 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1580/2987] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:38 2022] GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:38.457397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:38.458261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:38.466510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.467534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.468226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.469300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.470128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.470772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.594260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:38.613059 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f33118a-5f1f-441b-9f19-17134947849d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1321 microversion: 2.1 time: 0.429225 Sep 08 10:26:38.613642 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1408/2988] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:38 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:38.618850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-714b5d75-6fe4-48c1-94d5-4204456b6271 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Action: 'action', calling method: .version_select at 0x7f2353412280>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:38.781075 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-714b5d75-6fe4-48c1-94d5-4204456b6271 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-714b5d75-6fe4-48c1-94d5-4204456b6271 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Request method failure captured: Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action HTTP/1.1 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 44 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMPLmSq_nTPTAVDTEt5XOlBA8qVWyvOmOS75E3TNdzpan0lurjDY0HhnKtUwAU2N4FVdXnSL_f9dU260q8dHDPwMKSySnwhzYbrdpUTqNYKx31Lw7GfmWqZB4HjSuQKopw5emZEwfVyDt5R2iiYEq4vJSImmjdZQQGbfaQFkw8EJQM Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f916001554eb4ed09be371252a2f28e5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0c8f475c0c9446a9939544c1a0f83b1e Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: exception: Floating IP not found for address 0.0.0.0. Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b23af30e-41b7-4cc6-9eb4-4a2007246818', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 08 10:26:38.784306 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 08 10:26:38.789769 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:38.791679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-714b5d75-6fe4-48c1-94d5-4204456b6271 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:38.793413 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-714b5d75-6fe4-48c1-94d5-4204456b6271 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action" status: 404 len: 88 microversion: 2.1 time: 0.177916 Sep 08 10:26:38.800140 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1409/2989] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:38 2022] POST /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818/action => generated 88 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:26:38.806403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:38.807021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:38.821650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.822152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.822596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.823314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:38.823893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:38.824642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:38.945733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:38.968785 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2dbec7de-7fbf-48b5-a4bc-9f8828f2a493 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1318 microversion: 2.1 time: 0.520116 Sep 08 10:26:38.990693 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1581/2990] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:38 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:38.998227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:39.015454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:39.017364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:39.021689 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4786e167-3d0d-4221-9a7e-8f39268892d8 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1280 microversion: 2.1 time: 0.215093 Sep 08 10:26:39.030127 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1410/2991] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:38 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:39.062679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:39.066435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:39.093096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.093861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.094369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.096970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.097632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.098450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.100007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.108182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.108647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.109631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.109904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.110285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.181131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:39.380448 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04f8ac5b-f48d-41cf-8d40-9e45190fc8ae tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 204 len: 0 microversion: 2.1 time: 0.387676 Sep 08 10:26:39.384035 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1582/2992] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:38 2022] DELETE /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:39.396272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8904ea32-ef8e-4736-bf82-af73eb0f90d4", "name": "network-vif-deleted", "tag": "26b7b3d7-944c-4cf4-aace-77d8f31fbdc9"}, {"server_uuid": "89d7a858-d599-4332-b3f4-008f213a2721", "name": "network-vif-deleted", "tag": "4e3467bd-e282-4c69-883c-04c6703aff4d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:39.434710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.436042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.436946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.458328 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] Creating event network-vif-deleted:26b7b3d7-944c-4cf4-aace-77d8f31fbdc9 for instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 on n-h1-833090-19 Sep 08 10:26:39.459153 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] Creating event network-vif-deleted:4e3467bd-e282-4c69-883c-04c6703aff4d for instance 89d7a858-d599-4332-b3f4-008f213a2721 on n-h2-833090-19 Sep 08 10:26:39.470890 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1d1cfbb4-b8b1-40e6-b5ff-deb849e6634d req-f079f884-11d0-4748-b8a8-0fe25710b7b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085026 Sep 08 10:26:39.472877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1583/2993] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:39.481629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:39.484157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] [instance: 89d7a858-d599-4332-b3f4-008f213a2721] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:39.494635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.497067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.497793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.500062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.500775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.501448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.530674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] HTTP exception thrown: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Request method failure captured: Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 HTTP/1.1 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMbWG7pUn1nUP2fsxgislc_Qiv2HVtv_qn-dXwYpxSeZghUpbbvDNN1k-lCdTtxACvTQ7yFvgef1pW6u0Gz5Eb79n6ZySWBMcfrK7BxZ3T4K4bBMwSCeU5GjgcZFa9oedwPPImMp3hZjsuhFv5Xe_dRjCrp6zvLSbvM5LW0cgAzK8A Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 373352e1609148bf9315be6c3e335807 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1646267605 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/373352e1609148bf9315be6c3e335807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/373352e1609148bf9315be6c3e335807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/373352e1609148bf9315be6c3e335807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_373352e1609148bf9315be6c3e335807", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1646267605 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 373352e1609148bf9315be6c3e335807 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1646267605 Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1646267605-project Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5fe839a7f6fe47e4bd827dc976ba58ca Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1646267605-project Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '89d7a858-d599-4332-b3f4-008f213a2721'} Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:39.534291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. Sep 08 10:26:39.540388 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.542762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] Returning 404 to user: Instance 89d7a858-d599-4332-b3f4-008f213a2721 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:39.545390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ccb5254-ffc0-4e8a-b31c-a4211718827a tempest-ServersNegativeTestMultiTenantJSON-1646267605 tempest-ServersNegativeTestMultiTenantJSON-1646267605-project] 10.222.0.59 "GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721" status: 404 len: 111 microversion: 2.1 time: 0.070371 Sep 08 10:26:39.550752 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1584/2994] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:39 2022] GET /compute/v2.1/servers/89d7a858-d599-4332-b3f4-008f213a2721 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:39.561781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4c7443f9-58ea-4f18-90cc-f27d82a569ef req-5d705b20-478d-4c2a-8c20-0b26d8549b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1405cb-4996-473b-bed2-bcfee54ca83c", "tag": "2a512090-07ca-42d7-9ba8-29bf4e36c787"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:39.576346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4c7443f9-58ea-4f18-90cc-f27d82a569ef req-5d705b20-478d-4c2a-8c20-0b26d8549b9a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.576899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4c7443f9-58ea-4f18-90cc-f27d82a569ef req-5d705b20-478d-4c2a-8c20-0b26d8549b9a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.577338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4c7443f9-58ea-4f18-90cc-f27d82a569ef req-5d705b20-478d-4c2a-8c20-0b26d8549b9a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.603775 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4c7443f9-58ea-4f18-90cc-f27d82a569ef req-5d705b20-478d-4c2a-8c20-0b26d8549b9a service nova] Creating event network-changed:2a512090-07ca-42d7-9ba8-29bf4e36c787 for instance dc1405cb-4996-473b-bed2-bcfee54ca83c on n-h1-833090-19 Sep 08 10:26:39.611127 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4c7443f9-58ea-4f18-90cc-f27d82a569ef req-5d705b20-478d-4c2a-8c20-0b26d8549b9a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056784 Sep 08 10:26:39.612254 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1585/2995] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:39.618610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:39.619587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:39.626603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.627266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.627802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.628643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.629179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.630265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.682532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:39.695948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:39.697944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:39.699395 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a25eb781-afd1-40ae-ae2f-eda760131c3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.667289 Sep 08 10:26:39.712174 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1411/2996] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:39 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:39.725105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:39.726451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 8904ea32-ef8e-4736-bf82-af73eb0f90d4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:39.733149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.733992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.734666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.735685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.736356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.736993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.752431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 could not be found. Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 HTTP/1.1 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 could not be found. Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8904ea32-ef8e-4736-bf82-af73eb0f90d4'} Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 could not be found. Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 could not be found. Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:39.755145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 could not be found. Sep 08 10:26:39.759120 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:39.761353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance 8904ea32-ef8e-4736-bf82-af73eb0f90d4 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:39.762445 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d9d1357-060f-4821-a7f8-eb77e1785704 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4" status: 404 len: 111 microversion: 2.1 time: 0.048857 Sep 08 10:26:39.767448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1412/2997] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:39 2022] GET /compute/v2.1/servers/8904ea32-ef8e-4736-bf82-af73eb0f90d4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:39.773157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:39.774437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:39.780874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.781675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.782345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:39.783589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:39.784553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:39.785206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.045021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:40.055897 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e6f1ab68-24d3-464b-9745-11d9527f7d1a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1541 microversion: 2.1 time: 0.442218 Sep 08 10:26:40.056760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1586/2998] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:39 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1541 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:40.088260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:40.091495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: 53a6534a-2e40-4622-9b49-fe45eca2fc9f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:40.102663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.103638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.104506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.105534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.106218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.108774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.130214 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f could not be found. Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f HTTP/1.1 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f could not be found. Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '53a6534a-2e40-4622-9b49-fe45eca2fc9f'} Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f could not be found. Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f could not be found. Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:40.133217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f could not be found. Sep 08 10:26:40.137232 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:40.143762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance 53a6534a-2e40-4622-9b49-fe45eca2fc9f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:40.144714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3dcfab4e-c63f-4918-ab25-e89ee12eb16e tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f" status: 404 len: 111 microversion: 2.1 time: 0.069000 Sep 08 10:26:40.149603 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1587/2999] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:40 2022] GET /compute/v2.1/servers/53a6534a-2e40-4622-9b49-fe45eca2fc9f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:40.153250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:40.154080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:40.165291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.165816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.166257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.166989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.167863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.167980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.590698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:40.624629 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ccff4d43-eaa8-4d2b-99e6-b170c435efa1 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1321 microversion: 2.1 time: 0.855646 Sep 08 10:26:40.643056 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1413/3000] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:39 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1321 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:40.654783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:40.655782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:40.669883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.670684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.671312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.673224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.673857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.674804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.845473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:40.864552 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f414190-eb46-4244-a5a3-bfd3cccffb0a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1280 microversion: 2.1 time: 0.219409 Sep 08 10:26:40.865459 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1414/3001] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:40 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:40.887515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9bda3fd3-2cf8-4254-821e-f44584a6fd74 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:40.919775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:40.929216 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-32e02ea3-febb-47d2-aa6d-f90b9845d81d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1318 microversion: 2.1 time: 0.782443 Sep 08 10:26:40.940677 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1588/3002] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:40 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:40.960945 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9bda3fd3-2cf8-4254-821e-f44584a6fd74 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/a54b9ff8-9c36-4c06-b48d-dc8006ff95ee" status: 204 len: 0 microversion: 2.1 time: 0.087847 Sep 08 10:26:40.961585 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1415/3003] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:26:40 2022] DELETE /compute/v2.1/os-server-groups/a54b9ff8-9c36-4c06-b48d-dc8006ff95ee => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:40.963268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:40.963951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:40.977691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:40.978644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:40.987858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.988755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.989413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.989551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.990535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:40.991300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.991871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.992868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:40.993476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:40.999387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.000079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.005174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:41.047564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:41.110427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:41.175337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:41.189360 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-284ee1a6-37ce-4663-b88b-8ddf051bd89f tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 204 len: 0 microversion: 2.1 time: 0.221157 Sep 08 10:26:41.191383 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1416/3004] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:40 2022] DELETE /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:41.206809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:41.207159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:41.215131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.215778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.216168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:41.216934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.217306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.218313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:41.771738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:41.787012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:41.791822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:41.793505 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-297dff47-c92f-482f-9ade-5d4933a578c1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.848936 Sep 08 10:26:41.795089 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1589/3005] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:40 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:41.813353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:41.814203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:41.836684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.838214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.839987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:41.841365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.842013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.842640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:41.873139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:41.885997 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20f4383b-3e55-4413-9415-bdc50ea17127 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1541 microversion: 2.1 time: 0.688920 Sep 08 10:26:41.891786 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1417/3006] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:41 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1541 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:41.902339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:41.904297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:41.918458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.918965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.919409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:41.921508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:41.925271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:41.925794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:42.375958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:42.392177 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2294f31a-8535-4080-a50e-96f249f99f30 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1321 microversion: 2.1 time: 0.498993 Sep 08 10:26:42.394999 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1418/3007] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:41 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:42.404657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-290016af-8f77-47ec-af0f-fa7b5dcc5218 req-b65dd029-180a-41c5-9ecd-03c2639173f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1405cb-4996-473b-bed2-bcfee54ca83c", "name": "network-vif-plugged", "status": "completed", "tag": "2a512090-07ca-42d7-9ba8-29bf4e36c787"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:42.420713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-290016af-8f77-47ec-af0f-fa7b5dcc5218 req-b65dd029-180a-41c5-9ecd-03c2639173f5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:42.421575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-290016af-8f77-47ec-af0f-fa7b5dcc5218 req-b65dd029-180a-41c5-9ecd-03c2639173f5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:42.422523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-290016af-8f77-47ec-af0f-fa7b5dcc5218 req-b65dd029-180a-41c5-9ecd-03c2639173f5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:42.425074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:42.433512 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-37df75b9-64c4-42c7-a234-dcaeebab183b tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1470 microversion: 2.1 time: 0.630642 Sep 08 10:26:42.449309 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-290016af-8f77-47ec-af0f-fa7b5dcc5218 req-b65dd029-180a-41c5-9ecd-03c2639173f5 service nova] Creating event network-vif-plugged:2a512090-07ca-42d7-9ba8-29bf4e36c787 for instance dc1405cb-4996-473b-bed2-bcfee54ca83c on n-h1-833090-19 Sep 08 10:26:42.453168 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1590/3008] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:41 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1470 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:42.464935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:42.465561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:42.475163 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-290016af-8f77-47ec-af0f-fa7b5dcc5218 req-b65dd029-180a-41c5-9ecd-03c2639173f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075918 Sep 08 10:26:42.477195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1419/3009] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:42.479043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:42.481157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:42.481825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:42.485466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:42.486731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:42.487992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:42.531384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:42.533216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:42.533859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:42.546688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:42.547194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:42.547671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:42.549191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:42.549827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:42.550423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:43.289344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:43.303813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca45b0e5-febe-4354-9a07-6eb2c0a1aeb0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 0.849399 Sep 08 10:26:43.305028 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1591/3010] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:42 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:43.311906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:43.312865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:43.325755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:43.326555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:43.327183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:43.328803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:43.330639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:43.331721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:43.333099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:43.337835 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f9133b9-d910-487c-a3a9-e8a193d3ec7d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1508 microversion: 2.1 time: 0.858278 Sep 08 10:26:43.344172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1420/3011] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:42 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1508 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:43.349317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:43.355271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:43.367681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:43.368277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:43.380486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:43.381698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:43.382388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:43.382877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:44.419817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:44.431876 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f23fbef-48d6-43ac-8084-47ddceb4662d tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1541 microversion: 2.1 time: 1.086415 Sep 08 10:26:44.448264 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1421/3012] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:43 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1541 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:44.453805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:44.454776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:44.466410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:44.480476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:44.481048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:44.481906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:44.482458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:44.482991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:44.554119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:44.572471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:44.574785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:44.576764 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2bc2d5f4-2410-46a3-b19c-13540b30de04 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.269388 Sep 08 10:26:44.585702 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1592/3013] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:43 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:44.600674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:44.601674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:44.608715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:44.609450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:44.610005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:44.610911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:44.611757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:44.612461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:44.767583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:44.810620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:45.314253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:45.355661 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-784d49e0-8e0e-4475-aa75-4a737f5e8a5c tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1470 microversion: 2.1 time: 0.767375 Sep 08 10:26:45.356294 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1593/3014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:44 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1470 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:45.378539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:45.380903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:45.426285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.429148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.433101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.436976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.437730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.438504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.507130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:45.522256 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27b0a5c9-6465-4a7e-8aa6-f2557a59a7c2 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1508 microversion: 2.1 time: 1.072319 Sep 08 10:26:45.527881 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1422/3015] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:44 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1508 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:45.541846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:45.550425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:45.574212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.575217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.575845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.576486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lazy-loading 'fault' on Instance uuid a8c4b6e2-f598-4ed6-bc7b-570148c9e012 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:26:45.593226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.593878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.594427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.595578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.596462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.600162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.830862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee4290e94384a0bb1e802e65d312184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b99dcb58f641f0b4ec82fdb0103990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:45.842932 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2379f50b-14b5-4582-b1f7-e5bbdaff07bb tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 200 len: 1305 microversion: 2.1 time: 0.475832 Sep 08 10:26:45.844219 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1594/3016] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:45 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 1305 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:45.849369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-986085d6-639a-4a9a-aa61-c32e46179a3d req-cc218ae2-7b99-4d46-a60d-950e68e69419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23af30e-41b7-4cc6-9eb4-4a2007246818", "name": "network-vif-unplugged", "status": "completed", "tag": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:45.867379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-986085d6-639a-4a9a-aa61-c32e46179a3d req-cc218ae2-7b99-4d46-a60d-950e68e69419 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.868197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-986085d6-639a-4a9a-aa61-c32e46179a3d req-cc218ae2-7b99-4d46-a60d-950e68e69419 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.868883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-986085d6-639a-4a9a-aa61-c32e46179a3d req-cc218ae2-7b99-4d46-a60d-950e68e69419 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.884528 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-986085d6-639a-4a9a-aa61-c32e46179a3d req-cc218ae2-7b99-4d46-a60d-950e68e69419 service nova] Creating event network-vif-unplugged:b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 for instance b23af30e-41b7-4cc6-9eb4-4a2007246818 on n-h2-833090-19 Sep 08 10:26:45.892039 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-986085d6-639a-4a9a-aa61-c32e46179a3d req-cc218ae2-7b99-4d46-a60d-950e68e69419 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046168 Sep 08 10:26:45.893470 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1595/3017] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:45.903195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3f37b712-4f21-4fbc-b8d9-1979b8a11e5d req-1f54889f-4b82-48d8-90d5-085cb29c061f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c4b6e2-f598-4ed6-bc7b-570148c9e012", "name": "network-vif-deleted", "tag": "9d091496-0fba-4b75-a05e-0e54633ec4ca"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:45.926138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f37b712-4f21-4fbc-b8d9-1979b8a11e5d req-1f54889f-4b82-48d8-90d5-085cb29c061f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.927153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f37b712-4f21-4fbc-b8d9-1979b8a11e5d req-1f54889f-4b82-48d8-90d5-085cb29c061f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.928019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f37b712-4f21-4fbc-b8d9-1979b8a11e5d req-1f54889f-4b82-48d8-90d5-085cb29c061f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.949709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3f37b712-4f21-4fbc-b8d9-1979b8a11e5d req-1f54889f-4b82-48d8-90d5-085cb29c061f service nova] Creating event network-vif-deleted:9d091496-0fba-4b75-a05e-0e54633ec4ca for instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 on n-h2-833090-19 Sep 08 10:26:45.956094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3f37b712-4f21-4fbc-b8d9-1979b8a11e5d req-1f54889f-4b82-48d8-90d5-085cb29c061f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060418 Sep 08 10:26:45.957317 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1596/3018] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:45.966844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:45.967775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:45.976341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.977480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.978143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:45.979079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:45.979832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:45.980536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.024150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lazy-loading 'flavor' on Instance uuid dc1405cb-4996-473b-bed2-bcfee54ca83c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:26:46.140608 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02286959-f7c2-4f97-a524-c9b940233920 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c/action" status: 202 len: 0 microversion: 2.1 time: 0.181019 Sep 08 10:26:46.141957 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1597/3019] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:45 2022] POST /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:26:46.148410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:46.152746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:46.163706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.169695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.170546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.171376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.172012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.172608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.245002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.246440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.254025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.254758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lazy-loading 'fault' on Instance uuid b23af30e-41b7-4cc6-9eb4-4a2007246818 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:26:46.274878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:46.286937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2854d8b2-976a-4f14-959b-57973c2d9357 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 0.757265 Sep 08 10:26:46.289639 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1423/3020] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:45 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:46.296794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:46.299646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:46.317134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.320188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.320888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.327675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.329603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.330165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.414350 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a869e3c5-e70b-4097-bba0-a7d45165ea78 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "PUT /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1080 microversion: 2.1 time: 0.121560 Sep 08 10:26:46.421942 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1424/3021] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:26:46 2022] PUT /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1080 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:46.421942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:46.421942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:46.428637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.429126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.429563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.430271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.430727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.431302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.471407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8f475c0c9446a9939544c1a0f83b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916001554eb4ed09be371252a2f28e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:46.480914 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f50adf3-5d59-439b-a578-0b0c35c54f74 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 200 len: 1321 microversion: 2.1 time: 0.337268 Sep 08 10:26:46.498875 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1598/3022] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:46 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:46.498875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-aee17ee0-4682-47a6-b7df-3e349bdbf7f4 req-a1956a8a-a4cf-4471-b121-013f21fa4f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23af30e-41b7-4cc6-9eb4-4a2007246818", "name": "network-vif-deleted", "tag": "b3c0b3f7-a26b-495d-a154-cefe3de5b1c8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:46.498875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-aee17ee0-4682-47a6-b7df-3e349bdbf7f4 req-a1956a8a-a4cf-4471-b121-013f21fa4f91 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:46.498875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-aee17ee0-4682-47a6-b7df-3e349bdbf7f4 req-a1956a8a-a4cf-4471-b121-013f21fa4f91 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:46.498875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-aee17ee0-4682-47a6-b7df-3e349bdbf7f4 req-a1956a8a-a4cf-4471-b121-013f21fa4f91 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:46.515808 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-aee17ee0-4682-47a6-b7df-3e349bdbf7f4 req-a1956a8a-a4cf-4471-b121-013f21fa4f91 service nova] Creating event network-vif-deleted:b3c0b3f7-a26b-495d-a154-cefe3de5b1c8 for instance b23af30e-41b7-4cc6-9eb4-4a2007246818 on n-h2-833090-19 Sep 08 10:26:46.520668 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-aee17ee0-4682-47a6-b7df-3e349bdbf7f4 req-a1956a8a-a4cf-4471-b121-013f21fa4f91 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037492 Sep 08 10:26:46.521806 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1599/3023] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:46.662425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-147255733", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "465b46cd-9947-4ea9-8556-fdda27f9effe"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:46.760243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] validate_networks() for [('465b46cd-9947-4ea9-8556-fdda27f9effe', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:26:47.522568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:47.543324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:47.546450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:47.548127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db47caaa-8679-4831-a7cd-edc35076edc1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.132137 Sep 08 10:26:47.549236 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1425/3024] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:46 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:47.554189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:47.555299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:47.564393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:47.565339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:47.565994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:47.566954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:47.569073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:47.570354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.325890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:26:48.326370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:26:48.327058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:26:48.327670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:26:48.328277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:26:48.331903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:48.350294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.351185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.352925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.353956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.354557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.354887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.371584 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2698971b-221b-49ce-a435-75c614d84ad5 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1614 microversion: 2.1 time: 0.821022 Sep 08 10:26:48.374190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1426/3025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:47 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1614 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:48.381124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:48.381952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:48.389107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.390517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.391152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.392151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.392763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.393347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.396983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Getting quotas for project c0f02f4c27fd4785a841ff25e2b2437a. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:26:48.403019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Getting quotas for user 40700cd4da2543b58718a1b552bec697 and project c0f02f4c27fd4785a841ff25e2b2437a. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:26:48.417936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:26:48.421039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:26:48.490673 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ab8f392-e67d-4c66-bede-83a45b8349e8 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.963666 Sep 08 10:26:48.497537 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1600/3026] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:26:48.507158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:48.507877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] [instance: a8c4b6e2-f598-4ed6-bc7b-570148c9e012] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:48.523322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.523852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.524294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.525011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.525469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.525898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.570571 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] HTTP exception thrown: Instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 could not be found. Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Request method failure captured: Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 HTTP/1.1 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcJ3LCZgUbrwjewZFeeCdksuOeAXO8bsYg70pwi7_--1BZuDgHzOl56huYG0tjtgE92SwKeNmbQas5DuEwOLfCnf1s0ceuiLR-AnezCHlD5W1MHvOMzfrvpgPrGPeNU6CgH2U4tkE05qCUgThPRo_5ojXjUAi4-Ax-vDST6r4YSqnXI Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e6b99dcb58f641f0b4ec82fdb0103990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e6b99dcb58f641f0b4ec82fdb0103990", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e6b99dcb58f641f0b4ec82fdb0103990 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-441618201 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dee4290e94384a0bb1e802e65d312184 Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersOnMultiNodesTest-441618201-project Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 could not be found. Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'a8c4b6e2-f598-4ed6-bc7b-570148c9e012'} Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 could not be found. Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 could not be found. Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:48.576080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 could not be found. Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] Returning 404 to user: Instance a8c4b6e2-f598-4ed6-bc7b-570148c9e012 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:48.580998 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6381adf-dec1-43ac-9e07-0d41c8a31032 tempest-ServersOnMultiNodesTest-441618201 tempest-ServersOnMultiNodesTest-441618201-project] 10.222.0.59 "GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012" status: 404 len: 111 microversion: 2.1 time: 0.083872 Sep 08 10:26:48.583223 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1601/3027] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:48 2022] GET /compute/v2.1/servers/a8c4b6e2-f598-4ed6-bc7b-570148c9e012 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:48.590141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:48.594822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:48.609411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.613460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.614815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.615955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.616584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.617169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.662471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:48.673553 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36aa9927-48e7-400d-b766-59d17cecca12 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1506 microversion: 2.1 time: 0.298100 Sep 08 10:26:48.674210 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1427/3028] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:48 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:48.682453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:48.683076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] [instance: b23af30e-41b7-4cc6-9eb4-4a2007246818] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:48.704655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.705160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.719891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.720780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.721275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.723243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.767893 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] HTTP exception thrown: Instance b23af30e-41b7-4cc6-9eb4-4a2007246818 could not be found. Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Request method failure captured: Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 HTTP/1.1 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMPLmSq_nTPTAVDTEt5XOlBA8qVWyvOmOS75E3TNdzpan0lurjDY0HhnKtUwAU2N4FVdXnSL_f9dU260q8dHDPwMKSySnwhzYbrdpUTqNYKx31Lw7GfmWqZB4HjSuQKopw5emZEwfVyDt5R2iiYEq4vJSImmjdZQQGbfaQFkw8EJQM Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f916001554eb4ed09be371252a2f28e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f916001554eb4ed09be371252a2f28e5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f916001554eb4ed09be371252a2f28e5 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0c8f475c0c9446a9939544c1a0f83b1e Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b23af30e-41b7-4cc6-9eb4-4a2007246818 could not be found. Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b23af30e-41b7-4cc6-9eb4-4a2007246818'} Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23af30e-41b7-4cc6-9eb4-4a2007246818 could not be found. Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23af30e-41b7-4cc6-9eb4-4a2007246818 could not be found. Sep 08 10:26:48.773251 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23af30e-41b7-4cc6-9eb4-4a2007246818 could not be found. Sep 08 10:26:48.777101 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.780661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] Returning 404 to user: Instance b23af30e-41b7-4cc6-9eb4-4a2007246818 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:48.783189 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2d2c4a8-a28a-4afb-b556-a3c1a0ed9f3a tempest-FloatingIPsAssociationNegativeTestJSON-1323961235 tempest-FloatingIPsAssociationNegativeTestJSON-1323961235-project] 10.222.0.59 "GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818" status: 404 len: 111 microversion: 2.1 time: 0.107994 Sep 08 10:26:48.790677 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1428/3029] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:48 2022] GET /compute/v2.1/servers/b23af30e-41b7-4cc6-9eb4-4a2007246818 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:48.804899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:48.815767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:48.833006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.834662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.836068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.839116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:48.842599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:48.847073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:48.985169 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] HTTP exception thrown: Cannot 'migrate' instance dc1405cb-4996-473b-bed2-bcfee54ca83c while it is in vm_state suspended Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Request method failure captured: Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c/action HTTP/1.1 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMvwyELZYwoUcLpp7h_qvkRg15sWkvQ_NIES1cvIAnSFvA0f4vsKWUIhn0pM747TX85Wj-mC1GAOimfvOVE37CkrieizUBoRzQOK7zpoHiZHX3MuDHPMfZpdm2fNCkqMARKXgI56sE2pr3WYdJiwVSqGHV-LaNkGok7mt9ThnBM0sA Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db198c173f3e448fbfe8f68dd242a48d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9835d3d36d984860b326dbc05f604360 Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: {"migrate": {}} Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'migrate' instance dc1405cb-4996-473b-bed2-bcfee54ca83c while it is in vm_state suspended Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'dc1405cb-4996-473b-bed2-bcfee54ca83c', 'body': {'migrate': {}}} Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c in vm_state suspended. Cannot resize while the instance is in this state. Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:48.987433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance dc1405cb-4996-473b-bed2-bcfee54ca83c while it is in vm_state suspended Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance dc1405cb-4996-473b-bed2-bcfee54ca83c while it is in vm_state suspended Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Returning 409 to user: Cannot 'migrate' instance dc1405cb-4996-473b-bed2-bcfee54ca83c while it is in vm_state suspended {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:48.993059 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cc62f37-cbd2-48c5-a6ff-7274417ca2e0 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c/action" status: 409 len: 148 microversion: 2.1 time: 0.196254 Sep 08 10:26:48.998710 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1429/3030] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:48 2022] POST /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c/action => generated 148 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:26:49.009894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7f109b46-fb8d-452e-8a94-7cab53b2e366 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:49.030574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7f109b46-fb8d-452e-8a94-7cab53b2e366 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:49.188702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:49.210975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7f109b46-fb8d-452e-8a94-7cab53b2e366 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:49.218617 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7f109b46-fb8d-452e-8a94-7cab53b2e366 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1224 microversion: 2.1 time: 0.218495 Sep 08 10:26:49.242282 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1430/3031] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:48 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1224 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:49.242547 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-592a67ae-eb2b-4cb2-bb13-6760ab821828 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 0.641044 Sep 08 10:26:49.247992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7ce02a9f-3dbb-43b7-a46d-c691aac2334b req-2d60a73e-9770-4111-90ec-ac710c09113c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:49.250445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1602/3032] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:48 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:49.289112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:49.290080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:49.300674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:49.301301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:49.305560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:49.306446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:49.306578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7ce02a9f-3dbb-43b7-a46d-c691aac2334b req-2d60a73e-9770-4111-90ec-ac710c09113c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:49.307082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7ce02a9f-3dbb-43b7-a46d-c691aac2334b req-2d60a73e-9770-4111-90ec-ac710c09113c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:49.307208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:49.307580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7ce02a9f-3dbb-43b7-a46d-c691aac2334b req-2d60a73e-9770-4111-90ec-ac710c09113c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:49.308065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:49.340650 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7ce02a9f-3dbb-43b7-a46d-c691aac2334b req-2d60a73e-9770-4111-90ec-ac710c09113c service nova] Creating event network-changed:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:26:49.353840 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7ce02a9f-3dbb-43b7-a46d-c691aac2334b req-2d60a73e-9770-4111-90ec-ac710c09113c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124687 Sep 08 10:26:49.366166 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1431/3033] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:49.374055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:49.374969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:49.402362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:49.404855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:49.406483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:49.410957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:49.414619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:49.415660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:50.474443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:50.484332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:50.494605 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-05d8a5c4-ba4d-43f2-90c9-48e6ee30c6d0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1506 microversion: 2.1 time: 1.127161 Sep 08 10:26:50.496308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:50.498042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:50.499710 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-669102a3-707e-475d-bfa7-e78389e49840 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.245134 Sep 08 10:26:50.500221 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1603/3034] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:49 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:50.505742 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1432/3035] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:49 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1506 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:50.506420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca35fe5f-d56a-4871-928e-2238b8bf735f tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca35fe5f-d56a-4871-928e-2238b8bf735f tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Request method failure captured: Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8/action HTTP/1.1 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 39 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMvwyELZYwoUcLpp7h_qvkRg15sWkvQ_NIES1cvIAnSFvA0f4vsKWUIhn0pM747TX85Wj-mC1GAOimfvOVE37CkrieizUBoRzQOK7zpoHiZHX3MuDHPMfZpdm2fNCkqMARKXgI56sE2pr3WYdJiwVSqGHV-LaNkGok7mt9ThnBM0sA Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db198c173f3e448fbfe8f68dd242a48d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9835d3d36d984860b326dbc05f604360 Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: {"os-resetState": {"state": "invalid"}} Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:26:50.510502 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 10:26:50.516549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.517991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:50.518274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:50.519301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca35fe5f-d56a-4871-928e-2238b8bf735f tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:50.521923 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca35fe5f-d56a-4871-928e-2238b8bf735f tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8/action" status: 400 len: 144 microversion: 2.1 time: 0.019212 Sep 08 10:26:50.528488 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1604/3036] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:50 2022] POST /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8/action => generated 144 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:50.534581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:50.535073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:50.535809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:50.539591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:50.540022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:50.542840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:50.543396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:50.543868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:50.554132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:50.555081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:50.558187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:50.560319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:50.563722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:50.564601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:50.747212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:50.759809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7dbba3bf-ccf8-46d2-8116-65e92042a9c2 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1276 microversion: 2.1 time: 0.252212 Sep 08 10:26:50.760419 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1433/3037] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:50 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:50.787659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2890cc3-304b-4337-90ea-3064ce0cf133 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2890cc3-304b-4337-90ea-3064ce0cf133 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Request method failure captured: Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8/action HTTP/1.1 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 31 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMvwyELZYwoUcLpp7h_qvkRg15sWkvQ_NIES1cvIAnSFvA0f4vsKWUIhn0pM747TX85Wj-mC1GAOimfvOVE37CkrieizUBoRzQOK7zpoHiZHX3MuDHPMfZpdm2fNCkqMARKXgI56sE2pr3WYdJiwVSqGHV-LaNkGok7mt9ThnBM0sA Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db198c173f3e448fbfe8f68dd242a48d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9835d3d36d984860b326dbc05f604360 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: {"os-resetState": {"state": 1}} Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8', 'body': {'os-resetState': {'state': 1}}} Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 1 Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 10:26:50.812934 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 10:26:50.818488 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:50.820735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2890cc3-304b-4337-90ea-3064ce0cf133 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:50.821706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2890cc3-304b-4337-90ea-3064ce0cf133 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8/action" status: 400 len: 120 microversion: 2.1 time: 0.047226 Sep 08 10:26:50.827614 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1434/3038] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:50 2022] POST /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8/action => generated 120 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:50.838091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:50.842280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:50.874871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:50.875714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:50.876402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:50.878181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:50.880869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:50.881568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.008091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:26:51.008514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:26:51.008990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:26:51.009396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:26:51.009817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:26:51.028670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:51.115597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:51.123714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.124451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.125035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.125893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.126576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.127153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.166564 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ad281df-bf3f-4e37-bdeb-45f2918d567c tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "POST /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07/action" status: 202 len: 1112 microversion: 2.1 time: 0.337431 Sep 08 10:26:51.179413 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1435/3039] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:50 2022] POST /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07/action => generated 1112 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:26:51.191830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f92ff1b-7dcd-4720-9a6b-7519fcedeeb4 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:51.196148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f92ff1b-7dcd-4720-9a6b-7519fcedeeb4 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Failed to fetch instance by id 999 {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:26:51.200988 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9f92ff1b-7dcd-4720-9a6b-7519fcedeeb4 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f92ff1b-7dcd-4720-9a6b-7519fcedeeb4 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Request method failure captured: Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 37 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMvwyELZYwoUcLpp7h_qvkRg15sWkvQ_NIES1cvIAnSFvA0f4vsKWUIhn0pM747TX85Wj-mC1GAOimfvOVE37CkrieizUBoRzQOK7zpoHiZHX3MuDHPMfZpdm2fNCkqMARKXgI56sE2pr3WYdJiwVSqGHV-LaNkGok7mt9ThnBM0sA Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db198c173f3e448fbfe8f68dd242a48d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db198c173f3e448fbfe8f68dd242a48d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: db198c173f3e448fbfe8f68dd242a48d Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1705357331 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9835d3d36d984860b326dbc05f604360 Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1705357331-project-admin Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: {"os-resetState": {"state": "error"}} Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 999 could not be found. Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:51.210610 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:51.214791 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:51.214791 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 08 10:26:51.214791 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:51.221487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f92ff1b-7dcd-4720-9a6b-7519fcedeeb4 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:51.222654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f92ff1b-7dcd-4720-9a6b-7519fcedeeb4 tempest-ServersAdminNegativeTestJSON-1705357331 tempest-ServersAdminNegativeTestJSON-1705357331-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.041698 Sep 08 10:26:51.224652 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1436/3040] 10.222.0.59 () {60 vars in 1179 bytes} [Thu Sep 8 10:26:51 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:26:51.229972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:51.234730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:51.268092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.268691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.269162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.271105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.271678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.272133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.563122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:51.577306 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20242b7e-f432-4c60-ba46-62cc4fcd18e3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 1.047298 Sep 08 10:26:51.578129 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1605/3041] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:50 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:51.607082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:51.612110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:51.632255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.632772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.633222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.633957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.634424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.634852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.694921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:51.858087 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f59da6c-4efe-45a4-8c23-e05f23267795 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 204 len: 0 microversion: 2.1 time: 0.262413 Sep 08 10:26:51.862117 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1606/3042] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:51 2022] DELETE /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:51.869189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:51.870497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:51.877430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.877932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.878527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:51.879693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:51.880928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:51.881576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.051454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.086883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb4e019c-cfd4-4a8e-a964-9b2b8cf7ca35 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.860729 Sep 08 10:26:52.100529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1437/3043] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:51 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:52.105676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:52.106298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:52.129744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:52.131872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:52.132567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.133948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:52.134642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:52.135854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.350237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.386904 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f051dc2-b403-4b7a-96f5-49e639a044ad tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1282 microversion: 2.1 time: 0.282024 Sep 08 10:26:52.390571 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1438/3044] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:52 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:52.414070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:52.415051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:52.424961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:52.425521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:52.425976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.430941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.439972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:52.443793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:52.444578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.448843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.453919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.457176 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-198db2c4-d504-4530-a87e-95118b249527 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.593726 Sep 08 10:26:52.459886 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1607/3045] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:51 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:52.608682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:52.610516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:52.625334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:52.625918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:52.626437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.627155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:52.627619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:52.628059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:52.646238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:52.715204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.730223 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7672515-283b-4865-ab5b-ff96069189ed tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1467 microversion: 2.1 time: 0.337079 Sep 08 10:26:52.748022 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1439/3046] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:52 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1467 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:52.890754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:52.909557 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e462f2f-64eb-4d71-93b1-5591b2c3c73e tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 0.306497 Sep 08 10:26:52.925805 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1608/3047] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:52 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:53.113691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:53.114295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:53.128532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:53.129342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:53.131261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:53.132434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:53.133957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:53.134870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:53.417525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:53.430863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:53.449509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:53.450048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:53.450498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:53.453321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:53.453833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:53.458125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.057304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:54.075358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dc8781a-7a56-4c90-a7c3-45de079acf6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.965372 Sep 08 10:26:54.082437 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1440/3048] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:53 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:54.088129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:54.091479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:54.107580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.108087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.108537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.109257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.109724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.110154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.214822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:54.225748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45fe0333-a3a7-49a7-b3d1-992f61f17fa6 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.816472 Sep 08 10:26:54.226744 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1609/3049] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:53 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:26:54.246541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:54.247176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:54.258945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.259630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.260667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.262584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.263170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.263807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.678511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:54.688196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:54.698386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:54.700021 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a58cd3a-ece7-4090-a216-6f0b9f98f8f1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.615817 Sep 08 10:26:54.701106 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1441/3050] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:54 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:54.724255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:54.724884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:54.731212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.731748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.732193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.732920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.733379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.733811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.739902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:54.747666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f4ec07b-2869-4fc8-885f-806c8736c9b3 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1467 microversion: 2.1 time: 0.518499 Sep 08 10:26:54.748986 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1610/3051] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:54 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1467 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:54.760362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3ae57c3c-6e2e-4311-a3bc-a9a9dad7fbba req-9c5dd96e-7b91-4f72-9d44-1ab8302a28fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "name": "network-vif-plugged", "status": "completed", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:54.772413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3ae57c3c-6e2e-4311-a3bc-a9a9dad7fbba req-9c5dd96e-7b91-4f72-9d44-1ab8302a28fc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.776749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3ae57c3c-6e2e-4311-a3bc-a9a9dad7fbba req-9c5dd96e-7b91-4f72-9d44-1ab8302a28fc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.778436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3ae57c3c-6e2e-4311-a3bc-a9a9dad7fbba req-9c5dd96e-7b91-4f72-9d44-1ab8302a28fc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.800988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3ae57c3c-6e2e-4311-a3bc-a9a9dad7fbba req-9c5dd96e-7b91-4f72-9d44-1ab8302a28fc service nova] Creating event network-vif-plugged:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:26:54.810217 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3ae57c3c-6e2e-4311-a3bc-a9a9dad7fbba req-9c5dd96e-7b91-4f72-9d44-1ab8302a28fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059945 Sep 08 10:26:54.811068 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1611/3052] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:54.966333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Action: 'update', calling method: .version_select at 0x7f235110a1f0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:54.970354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.971203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.971748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.980530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:54.981130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:54.981711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:54.991135 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] HTTP exception thrown: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Request method failure captured: Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 HTTP/1.1 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 56 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcNuPZalQyme6rAkOgNc8ET1T-sftpobuPc6no2ByWgoxife8fujXwLSIBdHvWLzEuqvr5SoJs0uxhEX6vCLcIl0UxcLmr_bgP_MQvt7SdoF2FDAs7GpQB9W1E98TcIENOXBWeL2jm7xwZz9nPtlQwYeA5iU2jVSgbpICNZOe5MPH-E Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5f19cb7e8a4f40289e497cd0dbbf95ae Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5f19cb7e8a4f40289e497cd0dbbf95ae", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5f19cb7e8a4f40289e497cd0dbbf95ae Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 900a337539474ba0894c92a25c456a62 Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: exception: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:54.993475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Returning 404 to user: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-444c1321-1cb6-4d52-a5e5-6212dcb19884 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55" status: 404 len: 110 microversion: 2.53 time: 0.179065 Sep 08 10:26:55.004321 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1612/3053] 10.222.0.59 () {62 vars in 1309 bytes} [Thu Sep 8 10:26:54 2022] PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 => generated 110 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:55.007605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Action: 'update', calling method: .version_select at 0x7f23506859d0>, body: {"status": "disabled"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:55.011776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.012394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.012925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.023669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.026362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.026831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.032474 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] HTTP exception thrown: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Request method failure captured: Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 HTTP/1.1 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 22 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcNuPZalQyme6rAkOgNc8ET1T-sftpobuPc6no2ByWgoxife8fujXwLSIBdHvWLzEuqvr5SoJs0uxhEX6vCLcIl0UxcLmr_bgP_MQvt7SdoF2FDAs7GpQB9W1E98TcIENOXBWeL2jm7xwZz9nPtlQwYeA5iU2jVSgbpICNZOe5MPH-E Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5f19cb7e8a4f40289e497cd0dbbf95ae Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5f19cb7e8a4f40289e497cd0dbbf95ae", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5f19cb7e8a4f40289e497cd0dbbf95ae Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 900a337539474ba0894c92a25c456a62 Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: {"status": "disabled"} Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: exception: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55', 'body': {'status': 'disabled'}} Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:55.034395 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Returning 404 to user: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-abe6e89f-3191-4719-be79-9cb18467ad9f tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55" status: 404 len: 110 microversion: 2.53 time: 0.034319 Sep 08 10:26:55.044647 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1613/3054] 10.222.0.59 () {62 vars in 1309 bytes} [Thu Sep 8 10:26:55 2022] PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:55.052445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Action: 'update', calling method: .version_select at 0x7f235110bca0>, body: {"status": "enabled"} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:55.054821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.054821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.054821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.061136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.062142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.062861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.070888 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] HTTP exception thrown: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Request method failure captured: Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 HTTP/1.1 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 21 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcNuPZalQyme6rAkOgNc8ET1T-sftpobuPc6no2ByWgoxife8fujXwLSIBdHvWLzEuqvr5SoJs0uxhEX6vCLcIl0UxcLmr_bgP_MQvt7SdoF2FDAs7GpQB9W1E98TcIENOXBWeL2jm7xwZz9nPtlQwYeA5iU2jVSgbpICNZOe5MPH-E Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5f19cb7e8a4f40289e497cd0dbbf95ae Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5f19cb7e8a4f40289e497cd0dbbf95ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5f19cb7e8a4f40289e497cd0dbbf95ae", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5f19cb7e8a4f40289e497cd0dbbf95ae Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 900a337539474ba0894c92a25c456a62 Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: {"status": "enabled"} Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: exception: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55', 'body': {'status': 'enabled'}} Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:26:55.072805 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. Sep 08 10:26:55.079376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:26:55.087272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Returning 404 to user: Service 392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:55.087569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e983e71c-9e4e-47c9-9ce1-08b1cafc6ea9 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55" status: 404 len: 110 microversion: 2.53 time: 0.041083 Sep 08 10:26:55.088776 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1614/3055] 10.222.0.59 () {62 vars in 1309 bytes} [Thu Sep 8 10:26:55 2022] PUT /compute/v2.1/os-services/392a7b0c-9c6f-42d6-8ce9-fac0cef4fe55 => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:55.101580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.106575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.107444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.108218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.109213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.110205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.115684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.164837 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-939882af-b5ae-4481-ba0a-d452231b00e2 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.071012 Sep 08 10:26:55.174099 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1615/3056] 10.222.0.59 () {60 vars in 1178 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:26:55.180288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.181085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:55.190648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.191150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.191681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.195299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.195905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.196358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.419156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:55.429770 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c873668-0842-4c1f-a489-e4aedee0772f tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 0.716825 Sep 08 10:26:55.430827 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1442/3057] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:54 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:55.435980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.439731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.440393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.441082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.441925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.442476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.444287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.470623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49556e9c-7e91-498e-a35d-0010de0851d3 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038391 Sep 08 10:26:55.471803 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1443/3058] 10.222.0.59 () {60 vars in 1211 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:55.486167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.487196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:55.511890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.514263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.515821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.519113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.519887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.520599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.522639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:55.530949 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60bb0f8e-f4f2-4c2d-aec8-c1a0ef735a63 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.355087 Sep 08 10:26:55.532153 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1616/3059] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:55.543688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-de617002-7404-4d76-a65f-53f22fce48b8 req-f00096ee-483c-4f77-99a0-16d3b27631ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20d9657-9aa7-4fc8-bbc9-368466063a2b", "tag": "1860a14e-f929-4dce-a425-a27520e43a47"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:55.556702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de617002-7404-4d76-a65f-53f22fce48b8 req-f00096ee-483c-4f77-99a0-16d3b27631ba service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.557685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de617002-7404-4d76-a65f-53f22fce48b8 req-f00096ee-483c-4f77-99a0-16d3b27631ba service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.558402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de617002-7404-4d76-a65f-53f22fce48b8 req-f00096ee-483c-4f77-99a0-16d3b27631ba service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.571441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-de617002-7404-4d76-a65f-53f22fce48b8 req-f00096ee-483c-4f77-99a0-16d3b27631ba service nova] Creating event network-changed:1860a14e-f929-4dce-a425-a27520e43a47 for instance c20d9657-9aa7-4fc8-bbc9-368466063a2b on n-h2-833090-19 Sep 08 10:26:55.578609 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-de617002-7404-4d76-a65f-53f22fce48b8 req-f00096ee-483c-4f77-99a0-16d3b27631ba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044474 Sep 08 10:26:55.579841 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1617/3060] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:55.586465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.590564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.591235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.591789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.592855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.593496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.594052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.635319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64a5d6dd-3882-4006-be05-ceb6d2ea9302 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052648 Sep 08 10:26:55.636006 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1618/3061] 10.222.0.59 () {60 vars in 1178 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:55.649749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.655746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.656557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.657224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.659972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.662820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.663432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.701390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd477071-bbf8-4270-8842-29d508aff45c tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=n-d-833090-19&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.056450 Sep 08 10:26:55.702383 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1619/3062] 10.222.0.59 () {60 vars in 1237 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/os-services?host=n-d-833090-19&binary=xxx => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:55.715846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.728273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.729020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.730172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.732623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.733375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.734882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.774092 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cca62a54-7ae0-42b5-81b3-841c3727fe94 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.062777 Sep 08 10:26:55.775102 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1620/3063] 10.222.0.59 () {60 vars in 1178 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:55.789163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.790039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:55.801631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.802278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.803628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.804554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.805073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.805560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.840059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:55.862741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-928b9975-7daf-4bec-a50e-7f30d3dbff50 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.383186 Sep 08 10:26:55.872619 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1444/3064] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:55.878672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:55.879600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:55.887184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.887708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.888151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:55.888847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:55.889475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:55.890129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.044006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:56.053037 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-25bcff69-25aa-4ebe-93b9-7b351c1801b6 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 200 len: 1425 microversion: 2.1 time: 0.178688 Sep 08 10:26:56.053635 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1445/3065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 1425 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:56.078667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:56.085077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.086273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.086894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.087840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.088471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.089694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.123362 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-522c5f14-5080-40a8-a7e7-4b1a29e80b98 tempest-ServicesAdminNegativeV253TestJSON-955871565 tempest-ServicesAdminNegativeV253TestJSON-955871565-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.052029 Sep 08 10:26:56.124448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1446/3066] 10.222.0.59 () {60 vars in 1239 bytes} [Thu Sep 8 10:26:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:56.129790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-07fe04fd-95ca-4ef4-8df7-7a56f1103151 req-91b29a12-5e5e-42cf-a717-7d3d57645b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1405cb-4996-473b-bed2-bcfee54ca83c", "name": "network-vif-deleted", "tag": "2a512090-07ca-42d7-9ba8-29bf4e36c787"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:56.142069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-07fe04fd-95ca-4ef4-8df7-7a56f1103151 req-91b29a12-5e5e-42cf-a717-7d3d57645b79 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.142548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-07fe04fd-95ca-4ef4-8df7-7a56f1103151 req-91b29a12-5e5e-42cf-a717-7d3d57645b79 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.142974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-07fe04fd-95ca-4ef4-8df7-7a56f1103151 req-91b29a12-5e5e-42cf-a717-7d3d57645b79 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.156792 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-07fe04fd-95ca-4ef4-8df7-7a56f1103151 req-91b29a12-5e5e-42cf-a717-7d3d57645b79 service nova] Creating event network-vif-deleted:2a512090-07ca-42d7-9ba8-29bf4e36c787 for instance dc1405cb-4996-473b-bed2-bcfee54ca83c on n-h1-833090-19 Sep 08 10:26:56.163603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-07fe04fd-95ca-4ef4-8df7-7a56f1103151 req-91b29a12-5e5e-42cf-a717-7d3d57645b79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037632 Sep 08 10:26:56.165149 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1447/3067] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:26:56.199742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:56.214627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:56.218035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:56.220371 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-533163f8-54cb-4279-afcf-03a8377839c2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.436993 Sep 08 10:26:56.224994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1621/3068] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:55 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:56.362651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-180b7d9d-b263-4d56-90ad-1a4e9368317e tempest-ServicesAdminNegativeV253TestJSON-818276093 tempest-ServicesAdminNegativeV253TestJSON-818276093-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:56.366454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-180b7d9d-b263-4d56-90ad-1a4e9368317e tempest-ServicesAdminNegativeV253TestJSON-818276093 tempest-ServicesAdminNegativeV253TestJSON-818276093-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7adafb9696a14b1680a87bd5b278493c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634262d437da48038ec64679d89b8501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-180b7d9d-b263-4d56-90ad-1a4e9368317e tempest-ServicesAdminNegativeV253TestJSON-818276093 tempest-ServicesAdminNegativeV253TestJSON-818276093-project] Request method failure captured: Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcNtp5qKwaET2VQ7TAbSjzlpyesgcXACZJ_ePhfj9gBVbYV8gzQLErmbF0yGxHTGCn2dbvTRB-PFFqgotVOxtzjGO5MMY2P1nhKD3xm5HQc2680pWJ06B4X_bOGFtYX5WHD36K9ce3H7st_80WSgOdad2UUOhV9tT183pjaZjH6lZlY Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 634262d437da48038ec64679d89b8501 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-818276093 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/634262d437da48038ec64679d89b8501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/634262d437da48038ec64679d89b8501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/634262d437da48038ec64679d89b8501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_634262d437da48038ec64679d89b8501", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-818276093 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 634262d437da48038ec64679d89b8501 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-818276093 Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServicesAdminNegativeV253TestJSON-818276093-project Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7adafb9696a14b1680a87bd5b278493c Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-818276093-project Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: action_args: {} Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:26:56.377622 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-180b7d9d-b263-4d56-90ad-1a4e9368317e tempest-ServicesAdminNegativeV253TestJSON-818276093 tempest-ServicesAdminNegativeV253TestJSON-818276093-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-180b7d9d-b263-4d56-90ad-1a4e9368317e tempest-ServicesAdminNegativeV253TestJSON-818276093 tempest-ServicesAdminNegativeV253TestJSON-818276093-project] 10.222.0.59 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.214216 Sep 08 10:26:56.384174 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1448/3069] 10.222.0.59 () {60 vars in 1178 bytes} [Thu Sep 8 10:26:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:26:56.452631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:56.454023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:56.464392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.467243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.469665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.470691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.472387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.472886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.561354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:56.562312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:56.580193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.583382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.585882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:56.590924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:56.591668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:56.592338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.045390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:57.061187 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfcf0b49-b996-4695-8004-ca03d792bf79 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1322 microversion: 2.1 time: 0.612228 Sep 08 10:26:57.061804 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1622/3070] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:56 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:57.067153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:57.068836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:57.076882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.077852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.078553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.079500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.080283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.080876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.364803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:57.374851 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0077c780-023b-4070-825b-387b7ca37ec6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.822079 Sep 08 10:26:57.380576 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1449/3071] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:56 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:57.395223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:57.396683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: dc1405cb-4996-473b-bed2-bcfee54ca83c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:57.403861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.404643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.405300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.406483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.407148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.407804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.423872 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] HTTP exception thrown: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c could not be found. Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Request method failure captured: Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c HTTP/1.1 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcMtbZF6hlZSFRcLa1FjrsrTVcjNVSKdPLYGzKUSO4CeKTZ53NHNDxaZ3lxTxtpvzZXJTWSCcpR6vcLLC91zUI86tguy0jUIkx0-8z1tIDHy2edc0qYLH7pdHpBshcCE2Dw1J5hXrp9oScCdCjM3M9eCv11PZebOx3R8jx2a6iBvKUM Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: a77ca45fee15423ea87437641284786a Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-648766020 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a77ca45fee15423ea87437641284786a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a77ca45fee15423ea87437641284786a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a77ca45fee15423ea87437641284786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a77ca45fee15423ea87437641284786a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminNegativeTestJSON-648766020 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: a77ca45fee15423ea87437641284786a Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-648766020 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminNegativeTestJSON-648766020-project Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: af5cdc71c4cb43f48243af53f70800c6 Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminNegativeTestJSON-648766020-project Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c could not be found. Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'dc1405cb-4996-473b-bed2-bcfee54ca83c'} Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c could not be found. Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c could not be found. Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:57.425799 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c could not be found. Sep 08 10:26:57.430263 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:26:57.431865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Returning 404 to user: Instance dc1405cb-4996-473b-bed2-bcfee54ca83c could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:26:57.432929 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-826b9ca8-3e9a-4ad1-81a9-e4319edc149d tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c" status: 404 len: 111 microversion: 2.1 time: 0.051381 Sep 08 10:26:57.433712 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1450/3072] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:57 2022] GET /compute/v2.1/servers/dc1405cb-4996-473b-bed2-bcfee54ca83c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:26:57.438815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:57.439896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:57.448886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.449833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.450467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.451387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.452104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.452711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.497693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:57.510864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5d28a2d-ff63-4f65-a9b3-2189fce1e314 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.447536 Sep 08 10:26:57.511971 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1623/3073] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:57 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:57.517495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:57.518543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:57.526646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.527424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.528040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.528985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.529582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.530309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.564759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:26:57.691181 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0bf73efa-63ae-4cdc-8afb-aea7e804df92 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 204 len: 0 microversion: 2.1 time: 0.176314 Sep 08 10:26:57.692492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1624/3074] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:26:57 2022] DELETE /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:26:57.706060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:57.706982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:57.719104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.720077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.723416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.724681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:57.725946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:57.727585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:57.909778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:57.929242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:57.931742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:57.934875 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8004b1a5-8dbc-433a-a4c8-ba21f5d44c54 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.499631 Sep 08 10:26:57.940845 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1451/3075] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:57 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:58.023976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:58.039779 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a580b879-56ea-4903-b22c-98d0e0e3388a tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1477 microversion: 2.1 time: 0.341084 Sep 08 10:26:58.040524 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1625/3076] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:57 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:58.085163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:58.086556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:58.092923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.097112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.097575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.098335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.098959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.100250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.275205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:58.284033 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34b23771-f8c5-424f-b156-76b69c3220c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1516 microversion: 2.1 time: 0.203156 Sep 08 10:26:58.294920 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1452/3077] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:58 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:58.317965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:26:58.320572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:58.329474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.330095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.330550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.331276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.332042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.335002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.365449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lazy-loading 'flavor' on Instance uuid 3c163e66-1e2e-4fdb-b112-e878cbdf2662 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:26:58.406441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:58.407271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:58.418019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.418927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.419847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.419966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:58.421245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.422390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.423637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.508680 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67c4946c-c1b2-4712-a55d-ea374b74da76 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action" status: 200 len: 32 microversion: 2.1 time: 0.195238 Sep 08 10:26:58.512248 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1626/3078] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:26:58 2022] POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:26:58.526932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:58.529558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:58.540841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.541626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.542234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.543196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.544039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.544765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.570838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:58.874155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:58.884283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99281e95-f12e-4de0-8bc1-158d1b591d69 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.481854 Sep 08 10:26:58.901149 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1453/3079] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:58 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:58.906715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:58.907386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:58.916668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.917178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.917953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.918841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.919521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.920159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.959331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:58.971340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b46334c-aacd-489c-9db2-602bf85d9114 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.452870 Sep 08 10:26:58.975131 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1627/3080] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:58 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:58.982219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:58.982830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:58.993967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.994988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.995627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:58.996871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:58.997495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:58.998224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:59.216124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:59.664673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:59.684567 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a06e41de-c082-4e86-97d5-70182d613d44 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.781685 Sep 08 10:26:59.685172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1454/3081] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:58 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:26:59.696946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:59.697563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:59.728947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:59.730099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:59.730849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:59.731805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:59.737125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:59.737976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:59.776851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:26:59.794058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:59.807270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:59.813566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:26:59.820235 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-88563933-5317-410e-94cc-4aa99d721226 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.843743 Sep 08 10:26:59.821339 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1628/3082] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:26:58 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:26:59.916775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:26:59.917708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:26:59.926760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:59.928133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:59.932088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:26:59.933156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:26:59.933818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:26:59.934440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:00.482990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:00.500556 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-21f8b89c-66b0-429c-885b-896a12aaeb8e tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1477 microversion: 2.1 time: 0.814145 Sep 08 10:27:00.501974 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1455/3083] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:59 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1477 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:00.509716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:00.510705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:00.520199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:00.521720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:00.522412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:00.523377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:00.524645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:00.525503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:00.852503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:00.866771 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-94948418-c845-4b12-83c5-f8610d268a4e tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.952452 Sep 08 10:27:00.885673 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1629/3084] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:26:59 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:00.899072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:00.900063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:00.925419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:00.926372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:00.927024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:00.928105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:00.928725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:00.929310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:01.437174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:01.455688 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-521ae1fa-e3ca-48a2-96f0-4569731eedbb tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.951992 Sep 08 10:27:01.467507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1456/3085] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:00 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:01.467507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:01.467507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:01.479140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:01.480013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:01.480727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:01.481631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:01.482270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:01.482978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:01.514539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:01.524120 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f40d58c4-9a80-49be-945e-314c71bf31f7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.629885 Sep 08 10:27:01.524120 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1630/3086] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:00 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:01.724393 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63567877-2505-49d8-a1eb-9a8c6d6b1cbc tempest-TenantUsagesNegativeTestJSON-843032378 tempest-TenantUsagesNegativeTestJSON-843032378-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-07T10%3A27%3A01.424930&end=2022-09-09T10%3A27%3A01.424930" status: 404 len: 112 microversion: - time: 0.188207 Sep 08 10:27:01.725319 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1631/3087] 10.222.0.59 () {58 vars in 1316 bytes} [Thu Sep 8 10:27:01 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-07T10%3A27%3A01.424930&end=2022-09-09T10%3A27%3A01.424930 => generated 112 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:27:01.731655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:01.732722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:01.745687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:01.746538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:01.748053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:01.750028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:01.750892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:01.751830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:01.899959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5cdc71c4cb43f48243af53f70800c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ca45fee15423ea87437641284786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:01.909462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-236f83a3-3f23-4b70-a018-9c42697f7e66 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 200 len: 1435 microversion: 2.1 time: 0.183495 Sep 08 10:27:01.913063 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1632/3088] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:01 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 1435 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:01.922073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40e2b230-d9c2-4ed9-835a-4c522890b16b tempest-TenantUsagesNegativeTestJSON-843032378 tempest-TenantUsagesNegativeTestJSON-843032378-project-admin] Calling method '.version_select at 0x7f235545a160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:01.936317 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-40e2b230-d9c2-4ed9-835a-4c522890b16b tempest-TenantUsagesNegativeTestJSON-843032378 tempest-TenantUsagesNegativeTestJSON-843032378-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40e2b230-d9c2-4ed9-835a-4c522890b16b tempest-TenantUsagesNegativeTestJSON-843032378 tempest-TenantUsagesNegativeTestJSON-843032378-project-admin] Request method failure captured: Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-simple-tenant-usage/5756b0e64f9a496ea7284a10e9c5804e?start=2022-09-09T10%3A27%3A01.424930&end=2022-09-07T10%3A27%3A01.424930 HTTP/1.1 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN1YVbHoJEiv4Uboi_JPQBKTOnMpbRgF_AsSWjmeh65juWy4Q3c6RNXV06LTEF5w9YFRgvWPX8LZPFlcejPjGsIe3If0Mvt8LmFmKmbDTxL3UuCt2_GfJvl27-ZrXA-QJ9vTnu7xpwnbHXBoZ2EUK9lrxh1kYYZ75HVi7Bard-uyMg Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5e25f8b96b7d4da1aee5e979c4d78f1a Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-843032378 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e25f8b96b7d4da1aee5e979c4d78f1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e25f8b96b7d4da1aee5e979c4d78f1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e25f8b96b7d4da1aee5e979c4d78f1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e25f8b96b7d4da1aee5e979c4d78f1a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-843032378 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5e25f8b96b7d4da1aee5e979c4d78f1a Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-843032378 Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TenantUsagesNegativeTestJSON-843032378-project-admin Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5d049b6c2329488488ae40744a8bde9e Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-843032378-project-admin Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid start time. The start time cannot occur after the end time. Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '5756b0e64f9a496ea7284a10e9c5804e'} Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 08 10:27:01.949460 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:01.954900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40e2b230-d9c2-4ed9-835a-4c522890b16b tempest-TenantUsagesNegativeTestJSON-843032378 tempest-TenantUsagesNegativeTestJSON-843032378-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:01.956036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-40e2b230-d9c2-4ed9-835a-4c522890b16b tempest-TenantUsagesNegativeTestJSON-843032378 tempest-TenantUsagesNegativeTestJSON-843032378-project-admin] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage/5756b0e64f9a496ea7284a10e9c5804e?start=2022-09-09T10%3A27%3A01.424930&end=2022-09-07T10%3A27%3A01.424930" status: 400 len: 111 microversion: 2.1 time: 0.041855 Sep 08 10:27:01.957136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1633/3089] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Sep 8 10:27:01 2022] GET /compute/v2.1/os-simple-tenant-usage/5756b0e64f9a496ea7284a10e9c5804e?start=2022-09-09T10%3A27%3A01.424930&end=2022-09-07T10%3A27%3A01.424930 => generated 111 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:01.970044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-942da396-64f5-483d-8618-c72aee2e0e22 req-16f00e46-07af-4210-b10c-ba1bc24ba17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8", "name": "network-vif-deleted", "tag": "ce1eb31b-3be4-4bc5-b845-e5c0288b5f89"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:01.993394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-942da396-64f5-483d-8618-c72aee2e0e22 req-16f00e46-07af-4210-b10c-ba1bc24ba17b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:01.994138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-942da396-64f5-483d-8618-c72aee2e0e22 req-16f00e46-07af-4210-b10c-ba1bc24ba17b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:01.994792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-942da396-64f5-483d-8618-c72aee2e0e22 req-16f00e46-07af-4210-b10c-ba1bc24ba17b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.016037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:02.029609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:02.031055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:02.032257 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7eda8974-75ad-4059-bf43-9f2e1dfbb683 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.574609 Sep 08 10:27:02.035096 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-942da396-64f5-483d-8618-c72aee2e0e22 req-16f00e46-07af-4210-b10c-ba1bc24ba17b service nova] Creating event network-vif-deleted:ce1eb31b-3be4-4bc5-b845-e5c0288b5f89 for instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 on n-h1-833090-19 Sep 08 10:27:02.040664 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1457/3090] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:01 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:02.056014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-942da396-64f5-483d-8618-c72aee2e0e22 req-16f00e46-07af-4210-b10c-ba1bc24ba17b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097300 Sep 08 10:27:02.058195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1634/3091] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:02.070432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:02.073761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:02.088301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.089148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.089828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.091014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.091721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.092361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.306918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19863711-95ab-43a8-88bf-1477ee782b60 tempest-TenantUsagesNegativeTestJSON-990157 tempest-TenantUsagesNegativeTestJSON-990157-project] Calling method '.version_select at 0x7f23519ef040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:02.316482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19863711-95ab-43a8-88bf-1477ee782b60 tempest-TenantUsagesNegativeTestJSON-990157 tempest-TenantUsagesNegativeTestJSON-990157-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '19f80bee113f4c8c922fdc4f4e6df5be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5756b0e64f9a496ea7284a10e9c5804e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19863711-95ab-43a8-88bf-1477ee782b60 tempest-TenantUsagesNegativeTestJSON-990157 tempest-TenantUsagesNegativeTestJSON-990157-project] Request method failure captured: Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A27%3A01.424930&end=2022-09-09T10%3A27%3A01.424930&detailed=1 HTTP/1.1 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN0DdexDpwNRp6vQ1JhKZseGFtSa8GMSeBjmj82Bm6tCfv5r0D0oADvF7D65Kh-ZYIFAO7N9VcOdqTSiuzqgLa029xA9vG7K1QRCrbT6073iEIqGBHEOs1vtyQnCgHLC_hNuc-aafut9TFgVWzeKZXS3KlgToMJWjSCGYQEjcuWDs8 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5756b0e64f9a496ea7284a10e9c5804e Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-990157 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5756b0e64f9a496ea7284a10e9c5804e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5756b0e64f9a496ea7284a10e9c5804e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5756b0e64f9a496ea7284a10e9c5804e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5756b0e64f9a496ea7284a10e9c5804e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-990157 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5756b0e64f9a496ea7284a10e9c5804e Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-990157 Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TenantUsagesNegativeTestJSON-990157-project Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 19f80bee113f4c8c922fdc4f4e6df5be Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-990157-project Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: action_args: {} Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 10:27:02.323328 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19863711-95ab-43a8-88bf-1477ee782b60 tempest-TenantUsagesNegativeTestJSON-990157 tempest-TenantUsagesNegativeTestJSON-990157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:02.328926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19863711-95ab-43a8-88bf-1477ee782b60 tempest-TenantUsagesNegativeTestJSON-990157 tempest-TenantUsagesNegativeTestJSON-990157-project] 10.222.0.59 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A27%3A01.424930&end=2022-09-09T10%3A27%3A01.424930&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.266889 Sep 08 10:27:02.331793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1635/3092] 10.222.0.59 () {58 vars in 1335 bytes} [Thu Sep 8 10:27:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T10%3A27%3A01.424930&end=2022-09-09T10%3A27%3A01.424930&detailed=1 => generated 123 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:27:02.451280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c0a413a2-0256-40c2-b38b-13ddfd973e2e req-c81574dc-0d56-4139-8609-312ec4eb4d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20d9657-9aa7-4fc8-bbc9-368466063a2b", "name": "network-vif-plugged", "status": "completed", "tag": "1860a14e-f929-4dce-a425-a27520e43a47"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:02.470650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:02.480215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0a413a2-0256-40c2-b38b-13ddfd973e2e req-c81574dc-0d56-4139-8609-312ec4eb4d2e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.482042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0a413a2-0256-40c2-b38b-13ddfd973e2e req-c81574dc-0d56-4139-8609-312ec4eb4d2e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.482680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0a413a2-0256-40c2-b38b-13ddfd973e2e req-c81574dc-0d56-4139-8609-312ec4eb4d2e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.488529 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83e58256-81d6-4c2f-b772-aa2672413f24 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.442500 Sep 08 10:27:02.489793 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1458/3093] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:02 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:02.495868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:02.496709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:02.517972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.518764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.519393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.520810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c0a413a2-0256-40c2-b38b-13ddfd973e2e req-c81574dc-0d56-4139-8609-312ec4eb4d2e service nova] Creating event network-vif-plugged:1860a14e-f929-4dce-a425-a27520e43a47 for instance c20d9657-9aa7-4fc8-bbc9-368466063a2b on n-h2-833090-19 Sep 08 10:27:02.521371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.521997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.523159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.528266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c0a413a2-0256-40c2-b38b-13ddfd973e2e req-c81574dc-0d56-4139-8609-312ec4eb4d2e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080719 Sep 08 10:27:02.529032 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1636/3094] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:27:02.556087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:02.564991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:02.583492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.584904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.585658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:02.601328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:02.604087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:02.605865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.067864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:03.086936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ced705c0-e6be-4499-8d2b-2be1aa05e4c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.542403 Sep 08 10:27:03.091883 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1637/3095] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:02 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:03.093569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:03.094494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:03.096404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] [instance: 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:03.103057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:03.103882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:03.104756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.105576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:03.106324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:03.106838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.122617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] HTTP exception thrown: Instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 could not be found. Sep 08 10:27:03.124275 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5343160f-fecb-4253-9d9c-f6527ba8b212 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.631491 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Request method failure captured: Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 HTTP/1.1 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcMtbZF6hlZSFRcLa1FjrsrTVcjNVSKdPLYGzKUSO4CeKTZ53NHNDxaZ3lxTxtpvzZXJTWSCcpR6vcLLC91zUI86tguy0jUIkx0-8z1tIDHy2edc0qYLH7pdHpBshcCE2Dw1J5hXrp9oScCdCjM3M9eCv11PZebOx3R8jx2a6iBvKUM Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: a77ca45fee15423ea87437641284786a Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-648766020 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a77ca45fee15423ea87437641284786a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a77ca45fee15423ea87437641284786a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a77ca45fee15423ea87437641284786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a77ca45fee15423ea87437641284786a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersAdminNegativeTestJSON-648766020 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: a77ca45fee15423ea87437641284786a Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-648766020 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersAdminNegativeTestJSON-648766020-project Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: af5cdc71c4cb43f48243af53f70800c6 Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersAdminNegativeTestJSON-648766020-project Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 could not be found. Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8'} Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 could not be found. Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 could not be found. Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:03.124784 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 could not be found. Sep 08 10:27:03.129330 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:03.129803 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1459/3096] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:02 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:03.132279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] Returning 404 to user: Instance 6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:03.133498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b57dda0e-5991-46fd-8e7b-2756421d8f97 tempest-ServersAdminNegativeTestJSON-648766020 tempest-ServersAdminNegativeTestJSON-648766020-project] 10.222.0.59 "GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8" status: 404 len: 111 microversion: 2.1 time: 0.043735 Sep 08 10:27:03.134513 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1638/3097] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:03 2022] GET /compute/v2.1/servers/6218d2a9-e9e6-48ff-a3bf-6a16614ce7c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:27:03.136866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:03.137606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:03.150333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:03.150950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:03.151553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.152522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:03.153073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:03.153629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.514270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:03.515193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:03.529664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:03.531355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:03.533970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.541880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:03.549382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:03.549849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:03.766025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:03.777711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:03.779556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:03.781660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd1540a7-7704-4735-89ec-269d056630a7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.652318 Sep 08 10:27:03.797846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1460/3098] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:03 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:03.890479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:03.899945 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fca93b38-f64e-41aa-b9ef-0df698a7d03a tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.390338 Sep 08 10:27:03.912815 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1639/3099] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:03 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:04.111590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:04.112217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:04.127181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.127779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.128247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.128952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.129399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.129814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.155858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:04.163436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:04.179806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.180497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.181019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.181840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.182478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.182945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.671783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:04.683773 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3e304af8-34b0-4870-8273-1dbee2e3910a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.533420 Sep 08 10:27:04.687832 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1640/3100] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:04 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:04.706284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:04.717059 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29c9a3c8-13c4-41fd-b028-22534c4b7abe tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1324 microversion: 2.1 time: 0.609632 Sep 08 10:27:04.733006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1461/3101] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:04 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1324 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:04.809833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:04.810936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:04.815160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:04.833186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.842177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.842538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.843308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.843803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.844250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.925383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:04.926817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:04.944948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.946141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.947267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:04.949454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:04.952531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:04.953254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:05.404519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:05.414518 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10ce8108-20bd-4568-b2f6-c820f3359729 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.494306 Sep 08 10:27:05.415124 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1462/3102] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:04 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:05.457561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:05.475492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:05.479664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:05.481127 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ea43f0d-add3-45fd-8fc9-494301c3349a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.675192 Sep 08 10:27:05.485166 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1641/3103] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:04 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:05.711194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:05.712376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:05.725925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:05.731169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:05.731983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:05.733187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:05.734313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:05.735034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:05.735886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:05.742848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:05.743785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:05.751776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:05.756674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:05.757184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:05.757624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:05.758339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:05.758793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:05.759215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.099149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:06.183204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:06.195622 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e050bab-7723-4291-89de-e0692a7f6804 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.489111 Sep 08 10:27:06.196846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1463/3104] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:05 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:06.216542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:06.228772 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80eccb9e-13e4-4f24-8f86-7f50e71b7699 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1521 microversion: 2.1 time: 0.490404 Sep 08 10:27:06.230400 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1642/3105] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:05 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:06.261735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:06.262291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:06.283002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.285250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.286957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.288903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.291159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.291871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.357728 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] HTTP exception thrown: Action 999 not found Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Request method failure captured: Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b/os-instance-actions/999 HTTP/1.1 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcNlW-YI7lUHufAR5Rh_ZdBJDs5Efl5uIhylMzP8EGexTwerPvaNeF7v2z3uD2wUC9ffnHf0L5Oe6Jhp_7r93GrZ9Sb7Vmt8VJNZCmvM1Ts9QJYcSGL7xD7_NM7Q4ADUzLbsHYYeB65ioQiZW763qh83VtOFUH9daBS3o-COhYhAU1s Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: c0f02f4c27fd4785a841ff25e2b2437a Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c0f02f4c27fd4785a841ff25e2b2437a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: c0f02f4c27fd4785a841ff25e2b2437a Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-InstanceActionsNegativeTestJSON-1790296808-project Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 40700cd4da2543b58718a1b552bec697 Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1790296808-project Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: exception: Action 999 not found Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': 'c20d9657-9aa7-4fc8-bbc9-368466063a2b', 'id': '999'} Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 08 10:27:06.372679 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.376217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Returning 404 to user: Action 999 not found {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:06.376217 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d08bddd-c543-4f5a-a873-0bc26f7601ae tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.120383 Sep 08 10:27:06.376217 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1464/3106] 10.222.0.59 () {58 vars in 1308 bytes} [Thu Sep 8 10:27:06 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b/os-instance-actions/999 => generated 66 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:27:06.388285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43b9d12c-a0ab-4a6e-8d2e-1de3bed56de7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '.version_select at 0x7f23506859d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:06.388857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-43b9d12c-a0ab-4a6e-8d2e-1de3bed56de7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: 55c9af04-b423-4b42-803b-b03ce22e6db4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:06.396580 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-43b9d12c-a0ab-4a6e-8d2e-1de3bed56de7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] HTTP exception thrown: Instance 55c9af04-b423-4b42-803b-b03ce22e6db4 could not be found. Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43b9d12c-a0ab-4a6e-8d2e-1de3bed56de7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Request method failure captured: Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/55c9af04-b423-4b42-803b-b03ce22e6db4/os-instance-actions HTTP/1.1 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcNlW-YI7lUHufAR5Rh_ZdBJDs5Efl5uIhylMzP8EGexTwerPvaNeF7v2z3uD2wUC9ffnHf0L5Oe6Jhp_7r93GrZ9Sb7Vmt8VJNZCmvM1Ts9QJYcSGL7xD7_NM7Q4ADUzLbsHYYeB65ioQiZW763qh83VtOFUH9daBS3o-COhYhAU1s Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: c0f02f4c27fd4785a841ff25e2b2437a Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c0f02f4c27fd4785a841ff25e2b2437a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: c0f02f4c27fd4785a841ff25e2b2437a Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceActionsNegativeTestJSON-1790296808-project Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 40700cd4da2543b58718a1b552bec697 Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1790296808-project Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 55c9af04-b423-4b42-803b-b03ce22e6db4 could not be found. Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '55c9af04-b423-4b42-803b-b03ce22e6db4'} Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c9af04-b423-4b42-803b-b03ce22e6db4 could not be found. Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:27:06.401008 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c9af04-b423-4b42-803b-b03ce22e6db4 could not be found. Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c9af04-b423-4b42-803b-b03ce22e6db4 could not be found. Sep 08 10:27:06.406186 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:06.431403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43b9d12c-a0ab-4a6e-8d2e-1de3bed56de7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Returning 404 to user: Instance 55c9af04-b423-4b42-803b-b03ce22e6db4 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:06.433891 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-43b9d12c-a0ab-4a6e-8d2e-1de3bed56de7 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/55c9af04-b423-4b42-803b-b03ce22e6db4/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.051344 Sep 08 10:27:06.436936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1643/3107] 10.222.0.59 () {58 vars in 1296 bytes} [Thu Sep 8 10:27:06 2022] GET /compute/v2.1/servers/55c9af04-b423-4b42-803b-b03ce22e6db4/os-instance-actions => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:27:06.441309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:06.443397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:06.453834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:06.454359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:06.460968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.462834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.463124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.464132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.464271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.464588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.465322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.465811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.466331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.466880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.467595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.468267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.500123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:27:06.700914 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7657ffec-26bf-4e5e-865d-02a14acc6912 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 204 len: 0 microversion: 2.1 time: 0.258733 Sep 08 10:27:06.707632 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1644/3108] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:27:06 2022] DELETE /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:27:06.714679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:06.720420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:06.733816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.734309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.734747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.735478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.735936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.736363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.810302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:06.820717 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-728b2500-ffce-44c6-a652-a1afe21ae3e9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.383806 Sep 08 10:27:06.834834 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1465/3109] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:06 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:06.837864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:06.838630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:06.853175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.853590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.855648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:06.856614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:06.859011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:06.861331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:07.448085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:07.460720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:07.476081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:07.477434 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79b5a8c4-5ac6-4109-ac1e-cb77716648c8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.768492 Sep 08 10:27:07.481683 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1645/3110] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:06 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:07.489532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:07.496542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:07.529185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:07.529870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:07.530706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:07.531581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:07.532539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:07.533056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:07.582001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:07.611146 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-47d74215-adff-427f-8d75-f31aba6db1c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1527 microversion: 2.1 time: 0.784068 Sep 08 10:27:07.618267 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1466/3111] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:06 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1527 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:07.854724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:07.854724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:07.869398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:07.869918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:07.870339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:07.871118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:07.873979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:07.880485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:08.016610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:08.038207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c08939af-3fb6-4a88-95ef-069b3e8de674 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.554057 Sep 08 10:27:08.065102 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1646/3112] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:07 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:08.399343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:08.409665 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7fc93cac-94a8-479e-8220-074b67d8947b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.563081 Sep 08 10:27:08.412020 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1467/3113] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:07 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:08.511657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:08.512835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:08.524392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:08.525319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:08.526155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:08.527210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:08.527920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:08.528707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:09.004780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1938371994", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "1afcb5e7-b8a1-47bd-a9ce-6ef9966f63b5"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:09.050047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:09.069366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:09.073846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:09.077857 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b899f5e5-113b-4727-a241-f45480fd9be7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.569653 Sep 08 10:27:09.081046 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1647/3114] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:08 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:09.089580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:09.095324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:09.111083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:09.112990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:09.113508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] validate_networks() for [('1afcb5e7-b8a1-47bd-a9ce-6ef9966f63b5', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:27:09.114112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:09.117157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:09.118340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:09.118861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:09.151559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:10.215638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:10.224856 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a1a93c6-e7f8-4373-839d-16f1dee667ab tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1527 microversion: 2.1 time: 1.142025 Sep 08 10:27:10.241175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1648/3115] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:09 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1527 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:10.247646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:10.248638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:10.255153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:10.256748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:10.257488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:10.258493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:10.259215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:10.259940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:10.788464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:10.797347 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d1acb98-c379-4da3-9613-a27b0c3cb1c7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.554718 Sep 08 10:27:10.812142 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1649/3116] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:10 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:10.819147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:10.820171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:10.827135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:10.827882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:10.828555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:10.829507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:10.830171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:10.831241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.249937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:11.254228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:27:11.254710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:27:11.255118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:27:11.255555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:27:11.256507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:27:11.264807 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fb79af6d-1c08-44a2-bc05-074a129eef80 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.450004 Sep 08 10:27:11.265819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1650/3117] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:10 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:11.293693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.294938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.295692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.298511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.302506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.303513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.339431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for project 912e0307585e408ebefb443ebbae583e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:11.346034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for user 774190078d7b4c1d96c5921410a650ad and project 912e0307585e408ebefb443ebbae583e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:11.361837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:27:11.365074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:27:11.449440 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee96a236-fbaa-4995-8c56-eb09e5d9a904 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.825071 Sep 08 10:27:11.459084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1468/3118] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:27:11.464918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:11.470321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:11.481438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.481938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.482376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.483083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.483568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.488782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.537300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:11.542446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.543690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.544156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.550012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.550802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.554166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.606705 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-21cdb49e-99f8-4d08-b5b9-fbc8a10b8e65 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.339131 Sep 08 10:27:11.608303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1651/3119] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:27:11 2022] GET /compute/v2.1/os-services => generated 949 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:11.625211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-904bbeff-f32b-4f3c-9555-7221177b9d61 req-4ccd0d7b-3cfd-4496-ae81-615716b45901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20d9657-9aa7-4fc8-bbc9-368466063a2b", "name": "network-vif-deleted", "tag": "1860a14e-f929-4dce-a425-a27520e43a47"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:11.637552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-904bbeff-f32b-4f3c-9555-7221177b9d61 req-4ccd0d7b-3cfd-4496-ae81-615716b45901 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.638282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-904bbeff-f32b-4f3c-9555-7221177b9d61 req-4ccd0d7b-3cfd-4496-ae81-615716b45901 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.638990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-904bbeff-f32b-4f3c-9555-7221177b9d61 req-4ccd0d7b-3cfd-4496-ae81-615716b45901 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.656776 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-904bbeff-f32b-4f3c-9555-7221177b9d61 req-4ccd0d7b-3cfd-4496-ae81-615716b45901 service nova] Creating event network-vif-deleted:1860a14e-f929-4dce-a425-a27520e43a47 for instance c20d9657-9aa7-4fc8-bbc9-368466063a2b on n-h2-833090-19 Sep 08 10:27:11.664474 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-904bbeff-f32b-4f3c-9555-7221177b9d61 req-4ccd0d7b-3cfd-4496-ae81-615716b45901 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054348 Sep 08 10:27:11.665685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1652/3120] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:11.675623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:11.676672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:11.685824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.686754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.687429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.688444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.689278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.689963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.743327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:11.744567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:11.745240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:11.745921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lazy-loading 'fault' on Instance uuid c20d9657-9aa7-4fc8-bbc9-368466063a2b {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:27:11.963130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40700cd4da2543b58718a1b552bec697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f02f4c27fd4785a841ff25e2b2437a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:11.982992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8c2816f5-d58b-4a5e-92c5-d69e19dd4d8b tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 200 len: 1314 microversion: 2.1 time: 0.310243 Sep 08 10:27:11.985135 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1653/3121] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:11 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:12.020269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7d599745-cd5d-4ed2-afa1-b653d4bf5bcf tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:12.022821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7d599745-cd5d-4ed2-afa1-b653d4bf5bcf tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:12.241778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7d599745-cd5d-4ed2-afa1-b653d4bf5bcf tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:12.252588 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7d599745-cd5d-4ed2-afa1-b653d4bf5bcf tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1225 microversion: 2.1 time: 0.251562 Sep 08 10:27:12.254595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1654/3122] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:11 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:12.277613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:12.284361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:12.287757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:12.289006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:12.292412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:12.293308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:12.294443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:12.356590 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35f8624f-9985-4264-ac03-4f8ced220a16 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?host=n-d-833090-19" status: 200 len: 581 microversion: 2.1 time: 0.095051 Sep 08 10:27:12.361998 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1655/3123] 10.222.0.59 () {58 vars in 1174 bytes} [Thu Sep 8 10:27:12 2022] GET /compute/v2.1/os-services?host=n-d-833090-19 => generated 581 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:12.371441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:12.372504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:12.385966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:12.386711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:12.387394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:12.388394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:12.389059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:12.389982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:12.733871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:12.756753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:12.758580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:12.762805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-106a84d9-5cd8-4c7c-a9bb-a391a363f4ff tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.301779 Sep 08 10:27:12.768824 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1469/3124] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:11 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:12.792494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:12.793385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:12.805178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:12.808508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:12.809166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:12.810130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:12.813399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:12.814048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.561220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:13.571711 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e961fc4f-9867-4e44-814f-4c3d30afb498 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 1.208350 Sep 08 10:27:13.581428 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1656/3125] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:12 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:13.587350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:13.590916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.591390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.598639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.599745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.600685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.612245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.674699 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e3d941b-9813-4b79-a817-76f5f4aa2470 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.092023 Sep 08 10:27:13.675270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1657/3126] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:27:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:13.692524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:13.698332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] [instance: c20d9657-9aa7-4fc8-bbc9-368466063a2b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:13.721561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:13.736944 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0e881af-2fe5-4520-90e0-143c6d53b147 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1517 microversion: 2.1 time: 0.966663 Sep 08 10:27:13.737728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.738557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.739176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.740214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.744358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.745048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.751714 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1470/3127] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:12 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1517 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:13.756994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:13.771415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:13.796394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.796723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.797158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.797876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.798330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.798753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.807617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] HTTP exception thrown: Instance c20d9657-9aa7-4fc8-bbc9-368466063a2b could not be found. Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Request method failure captured: Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b HTTP/1.1 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcNlW-YI7lUHufAR5Rh_ZdBJDs5Efl5uIhylMzP8EGexTwerPvaNeF7v2z3uD2wUC9ffnHf0L5Oe6Jhp_7r93GrZ9Sb7Vmt8VJNZCmvM1Ts9QJYcSGL7xD7_NM7Q4ADUzLbsHYYeB65ioQiZW763qh83VtOFUH9daBS3o-COhYhAU1s Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: c0f02f4c27fd4785a841ff25e2b2437a Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c0f02f4c27fd4785a841ff25e2b2437a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c0f02f4c27fd4785a841ff25e2b2437a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: c0f02f4c27fd4785a841ff25e2b2437a Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1790296808 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-InstanceActionsNegativeTestJSON-1790296808-project Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 40700cd4da2543b58718a1b552bec697 Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1790296808-project Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance c20d9657-9aa7-4fc8-bbc9-368466063a2b could not be found. Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'c20d9657-9aa7-4fc8-bbc9-368466063a2b'} Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20d9657-9aa7-4fc8-bbc9-368466063a2b could not be found. Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20d9657-9aa7-4fc8-bbc9-368466063a2b could not be found. Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:13.809291 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20d9657-9aa7-4fc8-bbc9-368466063a2b could not be found. Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] Returning 404 to user: Instance c20d9657-9aa7-4fc8-bbc9-368466063a2b could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4a4816f-2070-4adc-99de-63bb370700c5 tempest-InstanceActionsNegativeTestJSON-1790296808 tempest-InstanceActionsNegativeTestJSON-1790296808-project] 10.222.0.59 "GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b" status: 404 len: 111 microversion: 2.1 time: 0.122046 Sep 08 10:27:13.814727 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1658/3128] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:13 2022] GET /compute/v2.1/servers/c20d9657-9aa7-4fc8-bbc9-368466063a2b => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:27:13.837012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:13.840733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.841218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.841653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.842383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.842850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.843259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.905359 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc6b3171-122c-4003-b377-7b148a679381 tempest-ServicesAdminTestJSON-1009300208 tempest-ServicesAdminTestJSON-1009300208-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.089900 Sep 08 10:27:13.905880 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1659/3129] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:27:13 2022] GET /compute/v2.1/os-services => generated 949 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:13.921265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:13.922059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:13.939248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.939773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.940210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:13.940913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:13.941541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:13.942158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:14.148419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:14.161433 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99638952-7334-4c56-a5a6-0328c2237c9d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1295 microversion: 2.1 time: 0.408233 Sep 08 10:27:14.165673 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1471/3130] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:13 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1295 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:14.608672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:14.609420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:14.625954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:14.626889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:14.627581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:14.630509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:14.634835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:14.637478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:15.131289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:15.146249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:15.148289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:15.149890 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67590c7d-daf3-4c75-80bb-b6053c2b171a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.233255 Sep 08 10:27:15.150664 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1660/3131] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:13 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:15.179534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:15.181165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:15.198486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:15.199859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:15.200785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:15.201824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:15.207208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:15.207935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:15.238344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:15.250892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:15.257975 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2c9ad5b7-2e83-42a7-98c7-b7d86fd3a216 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.653665 Sep 08 10:27:15.265524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1472/3132] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:14 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:15.279702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:15.279702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:15.315568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:15.316192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:15.316653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:15.317398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:15.319543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:15.320034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:15.605937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:15.618583 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ac3d426-1fdc-4a55-bf4e-d3c00cb60fb9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1283 microversion: 2.1 time: 0.351797 Sep 08 10:27:15.619193 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1473/3133] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:15 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1283 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:15.767252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:15.783909 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9fd5a142-e4eb-4d6a-a465-7d03fb9f5c58 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1523 microversion: 2.1 time: 0.625007 Sep 08 10:27:15.784885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1661/3134] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:15 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:16.190807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:16.192033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:16.228293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:16.228818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:16.229269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:16.230014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:16.237449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:16.238031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:16.299086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:16.306648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:16.326321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:16.329093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:16.329690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:16.332523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:16.338889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:16.340718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:17.748332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:17.789240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:17.791555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:17.795124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-157d6a39-a2d2-4c18-bef0-05a5ccfd1c15 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.614386 Sep 08 10:27:17.796386 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1474/3135] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:16 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:17.812911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:17.832627 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98815f48-9a33-40f4-a630-b19a11e065c0 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 1.543616 Sep 08 10:27:17.835936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1662/3136] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:16 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:17.850042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:17.851896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:17.868109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:17.868586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:17.869021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:17.869729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:17.877047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:17.877811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:18.427177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-373d6b3a-0e37-45ca-85eb-e528fe55ba01 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'create', calling method: .version_select at 0x7f23553c5820>, body: {"keypair": {"name": "tempest-keypair-1779031383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMmgqN37PIZXAbbzZpI04ERJ1bKhT5gZ+1e5HfyAzB3S0k+qBYD3zo0UW7eV7IWEExjWKw4uTtKbR4Qms9Rhm9+ju72D1eO8EFtZv0wzJOLAw0ShNcKvY5cM720Poi4qQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:18.477313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-373d6b3a-0e37-45ca-85eb-e528fe55ba01 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:18.486231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:18.504177 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7dd4a1de-3b05-4fad-afbc-5763ac926abe tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.660701 Sep 08 10:27:18.505471 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1663/3137] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:17 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:18.518101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:18.518748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:18.527195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-373d6b3a-0e37-45ca-85eb-e528fe55ba01 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for user 98c97cd324034c9297200125111c3029 and project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:18.529254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:18.530084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:18.531430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:18.534003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:18.542268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:18.543022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:18.634047 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-373d6b3a-0e37-45ca-85eb-e528fe55ba01 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.833596 Sep 08 10:27:18.636434 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1475/3138] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:27:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 839 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:27:18.656859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-790dfc18-77e9-4eee-bec1-fbfa537b5d0b req-03f6ac16-8463-4fe3-b3ca-d07c200ebd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "7ff24e51-954c-4345-b488-9f054da2ef8d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:18.701288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-790dfc18-77e9-4eee-bec1-fbfa537b5d0b req-03f6ac16-8463-4fe3-b3ca-d07c200ebd35 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:18.702030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-790dfc18-77e9-4eee-bec1-fbfa537b5d0b req-03f6ac16-8463-4fe3-b3ca-d07c200ebd35 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:18.702624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-790dfc18-77e9-4eee-bec1-fbfa537b5d0b req-03f6ac16-8463-4fe3-b3ca-d07c200ebd35 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:18.731573 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-790dfc18-77e9-4eee-bec1-fbfa537b5d0b req-03f6ac16-8463-4fe3-b3ca-d07c200ebd35 service nova] Creating event network-vif-plugged:7ff24e51-954c-4345-b488-9f054da2ef8d for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:18.751517 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-790dfc18-77e9-4eee-bec1-fbfa537b5d0b req-03f6ac16-8463-4fe3-b3ca-d07c200ebd35 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112698 Sep 08 10:27:18.752513 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1476/3139] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:18.828513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:18.829487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:18.848459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:18.848883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:18.849485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:18.850780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:18.860730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:18.861569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:19.357924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:19.369561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d1cdbc21-eb04-4080-84b1-24b8f307ec36 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1523 microversion: 2.1 time: 0.862040 Sep 08 10:27:19.371580 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1664/3140] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:18 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1523 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:19.380655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:19.382686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:19.414217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:19.414944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:19.420162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:19.421346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:19.422569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:19.426693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:20.067741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:20.079270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:20.081077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:20.082503 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-411109eb-96df-4cd2-bab1-3a287b265107 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.259688 Sep 08 10:27:20.102469 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1477/3141] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:18 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:27:20.107557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:20.108407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:20.116179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:20.117096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:20.117743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:20.118705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:20.119357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:20.119991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:20.447715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:20.463137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-653c0a19-bc7d-4144-a3ea-3085e56bcb6a tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 1.085692 Sep 08 10:27:20.463726 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1665/3142] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:19 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:20.479135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:20.482891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:20.497853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:20.498367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:20.498810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:20.503164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:20.503804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:20.504259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:21.041689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:21.053106 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5d90fd6-77cd-44a7-8441-e1d41e927871 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1523 microversion: 2.1 time: 0.588272 Sep 08 10:27:21.055921 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1666/3143] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:20 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1523 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:21.065955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:21.079938 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f42af7cf-183b-4b7e-b4d5-d51f756b37f8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.972585 Sep 08 10:27:21.081249 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1478/3144] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:20 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:21.108847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:21.109794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:21.118796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:21.121406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:21.122694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:21.124302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:21.132641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:21.133676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:21.490637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:21.491777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:21.495074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:21.510455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:21.511274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:21.511973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:21.512951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:21.514867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:21.517058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:22.013195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:22.033806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:22.035694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:22.037503 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e40db3a-6be0-4ae4-b4a4-7bdd4d8324af tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.933209 Sep 08 10:27:22.038824 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1667/3145] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:21 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:22.079346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:22.080187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:22.091039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:22.092053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:22.092651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:22.094075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:22.094775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:22.095326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:22.235072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:22.248740 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-888883ad-e8b7-45ef-8a20-5523375dccea tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.761130 Sep 08 10:27:22.265314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:22.267525 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1479/3146] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:21 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:22.274034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:22.274976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:22.290069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:22.290917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:22.291776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:22.292676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:22.294606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:22.296794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:22.753815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:22.768649 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5074ec19-8a0e-4c46-a8f6-2722cbdd146b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1523 microversion: 2.1 time: 0.692935 Sep 08 10:27:22.769524 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1668/3147] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:22 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:22.794863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2ea78a3f-0fce-4957-9643-0c75ef724577 req-eac65d51-5f79-426d-9bc4-4d510afa3883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4fcebd-7236-4534-bc3d-aa90843d1444", "tag": "654eeb6e-28bf-463d-8995-0090b5b3fdd6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:22.824043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2ea78a3f-0fce-4957-9643-0c75ef724577 req-eac65d51-5f79-426d-9bc4-4d510afa3883 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:22.824623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2ea78a3f-0fce-4957-9643-0c75ef724577 req-eac65d51-5f79-426d-9bc4-4d510afa3883 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:22.825982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2ea78a3f-0fce-4957-9643-0c75ef724577 req-eac65d51-5f79-426d-9bc4-4d510afa3883 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:22.856693 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2ea78a3f-0fce-4957-9643-0c75ef724577 req-eac65d51-5f79-426d-9bc4-4d510afa3883 service nova] Creating event network-changed:654eeb6e-28bf-463d-8995-0090b5b3fdd6 for instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 on n-h2-833090-19 Sep 08 10:27:22.871254 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2ea78a3f-0fce-4957-9643-0c75ef724577 req-eac65d51-5f79-426d-9bc4-4d510afa3883 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080687 Sep 08 10:27:22.872301 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1669/3148] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:22.998924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:23.011220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b12a5632-7859-4cee-9856-40bf9e22e667 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.741539 Sep 08 10:27:23.027264 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1480/3149] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:22 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:23.067343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:23.068656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:23.087264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.087806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.088236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.088958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.089539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.089842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.094450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:23.184357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c1919b23-2dc1-4a43-a5db-310fec9d3f2b req-4a66342b-e74e-44fb-a11b-ae4f99684033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "476853c2-0179-4c3b-bd7b-48ae101e3282"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:23.203573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c1919b23-2dc1-4a43-a5db-310fec9d3f2b req-4a66342b-e74e-44fb-a11b-ae4f99684033 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.204043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c1919b23-2dc1-4a43-a5db-310fec9d3f2b req-4a66342b-e74e-44fb-a11b-ae4f99684033 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.204481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c1919b23-2dc1-4a43-a5db-310fec9d3f2b req-4a66342b-e74e-44fb-a11b-ae4f99684033 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.230211 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c1919b23-2dc1-4a43-a5db-310fec9d3f2b req-4a66342b-e74e-44fb-a11b-ae4f99684033 service nova] Creating event network-vif-plugged:476853c2-0179-4c3b-bd7b-48ae101e3282 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:23.244303 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c1919b23-2dc1-4a43-a5db-310fec9d3f2b req-4a66342b-e74e-44fb-a11b-ae4f99684033 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063928 Sep 08 10:27:23.245248 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1481/3150] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:23.272891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:23.273798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:23.290472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.297129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.297958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.298925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.299621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.300293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.572500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:23.603913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:23.611426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:23.615127 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6d1f153-73c6-47d8-a6c4-6a6bf4fdf014 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.552617 Sep 08 10:27:23.618391 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1670/3151] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:23 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:23.795877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:23.796486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:23.806364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.808149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.810523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.811920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:23.812626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:23.815204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:23.880370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:24.190776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:24.199892 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f08a07ac-5b75-4080-bd65-49e507338dd3 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.931174 Sep 08 10:27:24.201055 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1482/3152] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:23 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:27:24.547932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:24.560551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8b05460-936a-4c0c-840e-bfd3d8540aef tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1523 microversion: 2.1 time: 0.768474 Sep 08 10:27:24.576421 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1671/3153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:23 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1523 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:24.576421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:24.576421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:24.594538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc5ccb0d-0169-45fe-8218-7a9dddcb5b73 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1698940321", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:24.597566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:24.598388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:24.604103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:24.606277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:24.608247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:24.610201 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-dc5ccb0d-0169-45fe-8218-7a9dddcb5b73 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] HTTP exception thrown: min_count must be <= max_count Sep 08 10:27:24.610474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc5ccb0d-0169-45fe-8218-7a9dddcb5b73 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Request method failure captured: Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 184 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOLExVJbhMqfiSY1ne2J2oOQjdagnb1rJR2SnWlF1snMQtr4RcMWAWH5F2WiUWJtRdOxb0NSNb1D1bauwvUodf4QEQ541p_OB9CxIbqEJk_pj9395WdJhys8_iIImAgimqHQqtCOkY2XIVuMZAvBpaJKp6Gy6TApN5C45mBWqdXSTE Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9e619770796a4ed4b73c09d6ca9c409a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4a09b621df014250b6a1e65e33ee7398 Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1698940321", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: exception: min_count must be <= max_count Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1698940321', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 08 10:27:24.612527 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:24.618248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc5ccb0d-0169-45fe-8218-7a9dddcb5b73 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Returning 400 to user: min_count must be <= max_count {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:24.619625 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dc5ccb0d-0169-45fe-8218-7a9dddcb5b73 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.417211 Sep 08 10:27:24.622118 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1483/3154] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:24 2022] POST /compute/v2.1/servers => generated 74 bytes in 420 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:27:24.648876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:24.650300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:24.673899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:24.676525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:24.677065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:24.680118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:24.682176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:24.686147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:25.262923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:25.275210 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60b1b8b1-beac-41a5-b937-4110106ca195 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.711675 Sep 08 10:27:25.289660 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1672/3155] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:24 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:25.291492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:25.298356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-443b6a0e-8f43-45b0-826e-5accf4cad761 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-362294111", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "max_count": 0}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-443b6a0e-8f43-45b0-826e-5accf4cad761 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Request method failure captured: Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 167 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOLExVJbhMqfiSY1ne2J2oOQjdagnb1rJR2SnWlF1snMQtr4RcMWAWH5F2WiUWJtRdOxb0NSNb1D1bauwvUodf4QEQ541p_OB9CxIbqEJk_pj9395WdJhys8_iIImAgimqHQqtCOkY2XIVuMZAvBpaJKp6Gy6TApN5C45mBWqdXSTE Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9e619770796a4ed4b73c09d6ca9c409a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4a09b621df014250b6a1e65e33ee7398 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-362294111", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "max_count": 0}} Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-362294111', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'max_count': 0}}} Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 0 Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:25.306766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:27:25.312278 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.314785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:25.314785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:25.316903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-443b6a0e-8f43-45b0-826e-5accf4cad761 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:25.318773 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-443b6a0e-8f43-45b0-826e-5accf4cad761 tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027837 Sep 08 10:27:25.319677 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1673/3156] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:25 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:25.323131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0d9c333-e6be-413f-b718-74f095ad9ad9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.680737 Sep 08 10:27:25.326176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-274156606", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2f851e4-04e3-4e98-8d14-1721acd59a0a"}], "security_groups": [{"name": "tempest-securitygroup--833792054"}], "key_name": "tempest-keypair-1779031383", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:25.351913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1484/3157] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:24 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:25.359590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:25.360516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:25.367780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:25.368567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:25.369214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:25.370142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:25.370824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:25.371553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:25.637168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] validate_networks() for [('e2f851e4-04e3-4e98-8d14-1721acd59a0a', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:27:25.659755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:25.670014 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-37b24f1e-19d2-49e5-8f19-d1b807a207dc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 0.314958 Sep 08 10:27:25.674179 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1485/3158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:25 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:25.682029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-8fe6a899-4d3a-400d-8973-39350f2ae261 req-62eab9b2-6351-4696-aad5-f49bb781a549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07", "name": "network-vif-plugged", "status": "completed", "tag": "b9f14c32-a2d5-463a-91c3-00d9280d4de3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:25.697554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8fe6a899-4d3a-400d-8973-39350f2ae261 req-62eab9b2-6351-4696-aad5-f49bb781a549 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:25.698400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8fe6a899-4d3a-400d-8973-39350f2ae261 req-62eab9b2-6351-4696-aad5-f49bb781a549 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:25.699056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8fe6a899-4d3a-400d-8973-39350f2ae261 req-62eab9b2-6351-4696-aad5-f49bb781a549 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:25.716465 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-8fe6a899-4d3a-400d-8973-39350f2ae261 req-62eab9b2-6351-4696-aad5-f49bb781a549 service nova] Creating event network-vif-plugged:b9f14c32-a2d5-463a-91c3-00d9280d4de3 for instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 on n-h1-833090-19 Sep 08 10:27:25.726690 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-8fe6a899-4d3a-400d-8973-39350f2ae261 req-62eab9b2-6351-4696-aad5-f49bb781a549 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050945 Sep 08 10:27:25.727850 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1486/3159] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:25.737943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b55c45fb-62d4-4d7b-8acf-99af5f0b444f tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-463899031", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "max_count": 2.5}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b55c45fb-62d4-4d7b-8acf-99af5f0b444f tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Request method failure captured: Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 169 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOLExVJbhMqfiSY1ne2J2oOQjdagnb1rJR2SnWlF1snMQtr4RcMWAWH5F2WiUWJtRdOxb0NSNb1D1bauwvUodf4QEQ541p_OB9CxIbqEJk_pj9395WdJhys8_iIImAgimqHQqtCOkY2XIVuMZAvBpaJKp6Gy6TApN5C45mBWqdXSTE Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9e619770796a4ed4b73c09d6ca9c409a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4a09b621df014250b6a1e65e33ee7398 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-463899031", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "max_count": 2.5}} Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-463899031', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'max_count': 2.5}}} Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 2.5 Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:25.744151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:27:25.749547 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:25.752926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b55c45fb-62d4-4d7b-8acf-99af5f0b444f tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:25.754223 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b55c45fb-62d4-4d7b-8acf-99af5f0b444f tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023984 Sep 08 10:27:25.755298 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1487/3160] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:25.762781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:25.763827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:25.774714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:25.775582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:25.776460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:25.777350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:25.777970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:25.778549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:26.626286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:26.646926 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4e7df82b-0575-45ec-b8ac-651bebd0e9cb tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1523 microversion: 2.1 time: 0.887857 Sep 08 10:27:26.663988 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1488/3161] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:25 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1523 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:26.691426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02dbe23b-9ece-4453-9989-e4f9f590b23e tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1221689664", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 0}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02dbe23b-9ece-4453-9989-e4f9f590b23e tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Request method failure captured: Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 168 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOLExVJbhMqfiSY1ne2J2oOQjdagnb1rJR2SnWlF1snMQtr4RcMWAWH5F2WiUWJtRdOxb0NSNb1D1bauwvUodf4QEQ541p_OB9CxIbqEJk_pj9395WdJhys8_iIImAgimqHQqtCOkY2XIVuMZAvBpaJKp6Gy6TApN5C45mBWqdXSTE Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9e619770796a4ed4b73c09d6ca9c409a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4a09b621df014250b6a1e65e33ee7398 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1221689664", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 0}} Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1221689664', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'min_count': 0}}} Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 0 Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:26.715559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 10:27:26.724636 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:26.736018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02dbe23b-9ece-4453-9989-e4f9f590b23e tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:26.736018 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02dbe23b-9ece-4453-9989-e4f9f590b23e tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.063006 Sep 08 10:27:26.740760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1489/3162] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:26.753759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:26.757852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:26.768617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:26.772040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:26.772788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:26.773961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:26.774704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:26.775397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:27.946909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:27.965287 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cfb57673-caba-406f-941d-f4c4aca8e00c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 1.221810 Sep 08 10:27:27.971927 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1490/3163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:26 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:27.982366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:27.982989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:28.013494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:28.013988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:28.014607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:28.015503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:28.016112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:28.016718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:28.127941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:27:28.129288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:27:28.129977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:27:28.130544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:27:28.131119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:27:28.149856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:28.158379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:28.159375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:28.161326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:28.162962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:28.163826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:28.218370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:28.234079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for user 98c97cd324034c9297200125111c3029 and project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:28.272991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:27:28.275369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:27:28.396002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b1e7820-c797-4b02-a420-3baaf4aa0d89 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.074831 Sep 08 10:27:28.402876 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1674/3164] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:27:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 3077 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:27:28.404441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:28.405220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:28.413676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:28.415344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:28.416119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:28.416716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:28.417548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:28.418122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:28.418660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:28.579492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:29.619506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:29.639074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:29.651437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:29.652706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4e8d2575-5521-4053-aa5b-6a7b1e8715e8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.679704 Sep 08 10:27:29.657838 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1491/3165] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:27 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:29.681422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0489675-c4ba-4a5f-9f7b-2d0cb7dd963c tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-28548538", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 2.5}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0489675-c4ba-4a5f-9f7b-2d0cb7dd963c tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Request method failure captured: Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 168 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOLExVJbhMqfiSY1ne2J2oOQjdagnb1rJR2SnWlF1snMQtr4RcMWAWH5F2WiUWJtRdOxb0NSNb1D1bauwvUodf4QEQ541p_OB9CxIbqEJk_pj9395WdJhys8_iIImAgimqHQqtCOkY2XIVuMZAvBpaJKp6Gy6TApN5C45mBWqdXSTE Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9e619770796a4ed4b73c09d6ca9c409a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9e619770796a4ed4b73c09d6ca9c409a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9e619770796a4ed4b73c09d6ca9c409a Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1057302006 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4a09b621df014250b6a1e65e33ee7398 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1057302006-project Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-28548538", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 2.5}} Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-28548538', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'min_count': 2.5}}} Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 2.5 Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:29.686276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0489675-c4ba-4a5f-9f7b-2d0cb7dd963c tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:29.690773 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0489675-c4ba-4a5f-9f7b-2d0cb7dd963c tempest-MultipleCreateNegativeTestJSON-1057302006 tempest-MultipleCreateNegativeTestJSON-1057302006-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028613 Sep 08 10:27:29.699790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1492/3166] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:29.710475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:29.711094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:29.739478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:29.750977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:29.751478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:29.755383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:29.755960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:29.758964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:29.848403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:29.872490 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-609eedac-9507-4356-ae82-831802fc5473 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1522 microversion: 2.1 time: 1.469336 Sep 08 10:27:29.873687 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1675/3167] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:28 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1522 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:29.881454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "ed356a2e-ef5c-4059-a100-4db728c7c7b5"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "084f648d-df8a-4900-8878-d6f4ecfd7b59"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "be64d2f2-5a29-40cc-bdb5-522ee1650ba5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:29.942380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:29.943142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:29.943756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:29.970797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Creating event network-vif-plugged:ed356a2e-ef5c-4059-a100-4db728c7c7b5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:29.971704 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Creating event network-vif-plugged:084f648d-df8a-4900-8878-d6f4ecfd7b59 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:29.972544 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] Creating event network-vif-plugged:be64d2f2-5a29-40cc-bdb5-522ee1650ba5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:29.980087 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-59e934c4-a24f-4e4b-9cea-4f54aaa9d06d req-7c2ee89f-1b9b-4560-a49b-1b2e1faebf0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.104773 Sep 08 10:27:29.981347 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1676/3168] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:30.002984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:30.004126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:30.013719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:30.014486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:30.015376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:30.016403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:30.017020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:30.017600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:30.310890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:30.325580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:30.357592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:30.360800 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ae0190e-4c43-4abb-a736-adc4ecb1e871 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1333 microversion: 2.20 time: 0.378114 Sep 08 10:27:30.376389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1677/3169] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:29 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1333 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:30.381757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:30.398313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:30.418109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:30.419023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:30.419788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:30.420780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:30.423055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:30.423777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:30.514125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:30.547052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cef9ce60-4766-4876-b3ca-6e8594269bb0 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1508 microversion: 2.1 time: 0.839503 Sep 08 10:27:30.548266 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1493/3170] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:29 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1508 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:30.858373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:30.860427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-991e1fdf-7695-42dc-aa8e-73e78eb101eb tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f23553c5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-867171187", "description": "tempest-description-1870679987"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:30.871617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a65d49d-a7e8-4f38-aa1e-280d9ac1b3e1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.493794 Sep 08 10:27:30.872768 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1678/3171] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:30 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:30.894563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:30.898532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:30.923267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:30.924022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:30.924649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:30.926377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:30.926840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:30.927272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.356503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:31.375830 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-676fc6cf-71bc-4434-8729-00f007abaa6b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 200 len: 1508 microversion: 2.1 time: 0.500733 Sep 08 10:27:31.377202 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1679/3172] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:30 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 1508 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:31.396571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:31.397603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:31.408901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:31.410376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:31.413916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.415078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:31.415813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:31.416643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.460691 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-991e1fdf-7695-42dc-aa8e-73e78eb101eb tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.911142 Sep 08 10:27:31.469082 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1494/3173] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:27:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:31.469082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:31.469082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:31.484944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:31.485572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:31.486028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.486765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:31.487224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:31.492132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.782959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:31.802582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:31.804962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:31.808757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:31.810471 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b5ee436-17a2-48b1-8607-5b98dbe20f25 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.431487 Sep 08 10:27:31.813144 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1680/3174] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:31 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:31.817396 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5910fa0-26c6-489b-af01-417f64d49b0c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1502 microversion: 2.1 time: 0.354495 Sep 08 10:27:31.830697 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1495/3175] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:31 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:31.844968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:31.845822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:31.853782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:31.854621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:31.855266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.856350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:31.857045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:31.857716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:31.927432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-465005644", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:31.988119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:32.003882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:32.006427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:32.010377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-988b8456-3f8a-41a5-ba20-7c206ecc5b5a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1339 microversion: 2.20 time: 0.171138 Sep 08 10:27:32.018234 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1496/3176] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:31 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1339 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:32.036131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] validate_networks() for [('44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:27:32.042886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:32.043649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:32.053302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:32.054775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:32.055278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:32.056091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:32.056579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:32.057229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:32.086129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:32.107103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:27:32.240858 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-874db044-8cd0-4276-86ef-60190bf227dc tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "DELETE /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 204 len: 0 microversion: 2.1 time: 0.219309 Sep 08 10:27:32.244558 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1497/3177] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:27:32 2022] DELETE /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:27:32.252501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a63fc20-4087-4f86-800d-6c03bba96d95 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f235535c940>, body: {"security_group_rule": {"parent_group_id": "952f81e7-2767-4cee-8497-909a67571371", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:33.087554 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a63fc20-4087-4f86-800d-6c03bba96d95 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.840910 Sep 08 10:27:33.094517 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1498/3178] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:32 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:33.100745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c576a1b-ec2b-4eeb-94c0-058799ee055d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'create', calling method: .version_select at 0x7f23553c5700>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-158083261", "description": "tempest-description-22497051"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:33.238554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:27:33.239034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:27:33.239445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:27:33.239893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:27:33.240306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:27:33.264731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:33.265227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:33.265641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:33.266362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:33.266815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:33.267242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:33.332228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Getting quotas for project 920596ac3512466ebd2e58a6dfc062cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:33.348751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Getting quotas for user f56ca90367aa4d748c3bca6b9b4a2dbd and project 920596ac3512466ebd2e58a6dfc062cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:33.389853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:27:33.394163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:27:33.470232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1de636ac-bfa5-4ce8-8cce-b6b6008a5047 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654762 Sep 08 10:27:33.479343 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1681/3179] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:27:33.492259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:33.495265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:33.509878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:33.514182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:33.514995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:33.519073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:33.520968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:33.521586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:33.576704 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c576a1b-ec2b-4eeb-94c0-058799ee055d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.480452 Sep 08 10:27:33.577727 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1499/3180] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:27:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:33.591699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "6c5df8e6-4c14-418d-a246-db3fd7c9961a"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-plugged", "status": "completed", "tag": "17fde0e0-1318-48b1-8837-bc941c736cff"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:33.624684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:33.628560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:33.633058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:33.669148 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] Creating event network-vif-plugged:6c5df8e6-4c14-418d-a246-db3fd7c9961a for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:33.669962 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] Creating event network-vif-plugged:17fde0e0-1318-48b1-8837-bc941c736cff for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:33.685110 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1bc57511-e0b0-4879-aa74-e95b2b3fc65b req-8783146b-8037-411b-a8c2-55b7f8935c71 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097227 Sep 08 10:27:33.689791 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1500/3181] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:33.706687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1706444889", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "7bea54b2-3154-47c8-835b-cf27d6e1658d"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:33.887082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] validate_networks() for [('7bea54b2-3154-47c8-835b-cf27d6e1658d', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:27:34.211033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:34.220124 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f20ad7f0-4ffa-4f5c-b588-97a4f50ce529 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.737395 Sep 08 10:27:34.228646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1682/3182] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:33 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:34.233830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:34.244086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:34.251137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:34.252036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:34.252810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:34.254712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:34.255428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:34.257126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:35.121517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:35.131917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:35.133359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:35.134510 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aa7dcba1-6e36-4539-91ab-bf99f19072f8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 0.904575 Sep 08 10:27:35.135059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1683/3183] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:34 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:35.139664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:35.143841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:35.152962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:35.153592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:35.153881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:35.154587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:35.155048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:35.155504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:35.774298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:35.800148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:35.802026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:35.803481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7993add3-42a0-4a10-86e2-375920a9e053 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1406 microversion: 2.20 time: 0.667327 Sep 08 10:27:35.832376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1684/3184] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:35 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1406 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:35.840081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-612eb03e-5677-4484-8686-d1792dbfca1d tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f23512ef5e0>, body: {"security_group_rule": {"parent_group_id": "952f81e7-2767-4cee-8497-909a67571371", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:36.052835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-612eb03e-5677-4484-8686-d1792dbfca1d tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: This rule already exists in group 952f81e7-2767-4cee-8497-909a67571371 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-612eb03e-5677-4484-8686-d1792dbfca1d tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 138 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: {"security_group_rule": {"parent_group_id": "952f81e7-2767-4cee-8497-909a67571371", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: exception: This rule already exists in group 952f81e7-2767-4cee-8497-909a67571371 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'security_group_rule': {'parent_group_id': '952f81e7-2767-4cee-8497-909a67571371', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 952f81e7-2767-4cee-8497-909a67571371 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 952f81e7-2767-4cee-8497-909a67571371 Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:36.057679 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:36.063802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:36.063802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:36.063802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 952f81e7-2767-4cee-8497-909a67571371 Sep 08 10:27:36.063802 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:36.063802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-612eb03e-5677-4484-8686-d1792dbfca1d tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 400 to user: This rule already exists in group 952f81e7-2767-4cee-8497-909a67571371 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:36.063802 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-612eb03e-5677-4484-8686-d1792dbfca1d tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.226801 Sep 08 10:27:36.064641 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1685/3185] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:35 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:36.074612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:36.075682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:36.097292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.098208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.098990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.102529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.103436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.104858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.147698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:27:36.148285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:27:36.150967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:27:36.151535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:27:36.155158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:27:36.173018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:36.183196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.183707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.184397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.185235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.185692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.186298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.239178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Getting quotas for project 0fac3ab51d9049bea3393313680eb6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:36.257956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Getting quotas for user 0218f274eff54ce8bf63b54e39df1820 and project 0fac3ab51d9049bea3393313680eb6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:36.267852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:36.281297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:27:36.281979 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e71805b5-a4b2-4f11-abcb-9cb53ed05710 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1281 microversion: 2.1 time: 0.214505 Sep 08 10:27:36.282858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1686/3186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:36 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:36.283296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:27:36.290308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-158083261"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:36.291128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:36.298462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.299321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.300085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.301100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.301778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.305266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.378501 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51cf36e3-9a50-4f4d-8e50-988fae95df2d tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.684388 Sep 08 10:27:36.379085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1501/3187] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:27:36.389945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-08279d43-e36c-4478-a9bf-a69d74cb9ce4 req-961514b8-2331-416e-8740-0b83fc6de9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:36.413915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08279d43-e36c-4478-a9bf-a69d74cb9ce4 req-961514b8-2331-416e-8740-0b83fc6de9db service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.414638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08279d43-e36c-4478-a9bf-a69d74cb9ce4 req-961514b8-2331-416e-8740-0b83fc6de9db service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.415877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08279d43-e36c-4478-a9bf-a69d74cb9ce4 req-961514b8-2331-416e-8740-0b83fc6de9db service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.446166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-08279d43-e36c-4478-a9bf-a69d74cb9ce4 req-961514b8-2331-416e-8740-0b83fc6de9db service nova] Creating event network-changed:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:27:36.455071 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-08279d43-e36c-4478-a9bf-a69d74cb9ce4 req-961514b8-2331-416e-8740-0b83fc6de9db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074592 Sep 08 10:27:36.457388 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1502/3188] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:36.465459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:36.466152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:36.472812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.473611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.474304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.475198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.476499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.477088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.631799 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Adding security group 14546bf1-4304-4ee6-a52a-6984662ab1d9 to port a4c67f93-78a8-4ab7-939a-dfea0dd47841 Sep 08 10:27:36.839151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:36.849337 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-edc0e894-6258-4f25-b869-c2bbc7dda184 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.389242 Sep 08 10:27:36.849953 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1503/3189] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:36 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:36.862467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-dea7b056-3912-441d-85bc-8dd32ef560d9 req-55a8a1a2-9424-4ebc-ae47-0e7120658b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4fcebd-7236-4534-bc3d-aa90843d1444", "name": "network-vif-plugged", "status": "completed", "tag": "654eeb6e-28bf-463d-8995-0090b5b3fdd6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:36.885109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dea7b056-3912-441d-85bc-8dd32ef560d9 req-55a8a1a2-9424-4ebc-ae47-0e7120658b01 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:36.885897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dea7b056-3912-441d-85bc-8dd32ef560d9 req-55a8a1a2-9424-4ebc-ae47-0e7120658b01 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:36.886338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-dea7b056-3912-441d-85bc-8dd32ef560d9 req-55a8a1a2-9424-4ebc-ae47-0e7120658b01 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:36.918088 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-dea7b056-3912-441d-85bc-8dd32ef560d9 req-55a8a1a2-9424-4ebc-ae47-0e7120658b01 service nova] Creating event network-vif-plugged:654eeb6e-28bf-463d-8995-0090b5b3fdd6 for instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 on n-h2-833090-19 Sep 08 10:27:36.926916 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-dea7b056-3912-441d-85bc-8dd32ef560d9 req-55a8a1a2-9424-4ebc-ae47-0e7120658b01 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073511 Sep 08 10:27:36.931831 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1504/3190] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:36.953947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-115d2133-f8b1-4444-b05a-20af0d5f4a0c tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f235535c550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:37.392194 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e06ddf91-d77f-4dab-9978-2ae5e58a402b tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action" status: 202 len: 0 microversion: 2.1 time: 1.107308 Sep 08 10:27:37.393479 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1687/3191] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:27:36 2022] POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:27:37.409617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ba347497-88dc-46b0-b29d-125d3e59a1b7 req-25cc9b34-5b8f-4c99-b81e-5343b95e9447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07", "name": "network-vif-deleted", "tag": "b9f14c32-a2d5-463a-91c3-00d9280d4de3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:37.425115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba347497-88dc-46b0-b29d-125d3e59a1b7 req-25cc9b34-5b8f-4c99-b81e-5343b95e9447 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:37.428059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba347497-88dc-46b0-b29d-125d3e59a1b7 req-25cc9b34-5b8f-4c99-b81e-5343b95e9447 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:37.429363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba347497-88dc-46b0-b29d-125d3e59a1b7 req-25cc9b34-5b8f-4c99-b81e-5343b95e9447 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:37.468648 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ba347497-88dc-46b0-b29d-125d3e59a1b7 req-25cc9b34-5b8f-4c99-b81e-5343b95e9447 service nova] Creating event network-vif-deleted:b9f14c32-a2d5-463a-91c3-00d9280d4de3 for instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 on n-h1-833090-19 Sep 08 10:27:37.500777 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ba347497-88dc-46b0-b29d-125d3e59a1b7 req-25cc9b34-5b8f-4c99-b81e-5343b95e9447 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103700 Sep 08 10:27:37.504211 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1688/3192] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:37.521244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:37.521962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:37.564864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:37.568215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:37.573171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:37.577237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:37.579418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:37.581844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:38.358455 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-115d2133-f8b1-4444-b05a-20af0d5f4a0c tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-group-rules/4c878d21-7a7a-45b0-a5fa-6dc2180f3b30" status: 202 len: 0 microversion: 2.1 time: 1.425221 Sep 08 10:27:38.359074 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1505/3193] 10.222.0.59 () {58 vars in 1287 bytes} [Thu Sep 8 10:27:36 2022] DELETE /compute/v2.1/os-security-group-rules/4c878d21-7a7a-45b0-a5fa-6dc2180f3b30 => generated 0 bytes in 1427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:27:38.364562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:38.370786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:38.378861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:38.380474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:38.381116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:38.382643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:38.383522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:38.386618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:38.623848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:38.636289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5944fcc-868e-4f2b-9413-55549bb81779 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1288 microversion: 2.1 time: 0.275416 Sep 08 10:27:38.637132 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1506/3194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:38 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1288 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:38.651255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:38.652199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:38.669785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:38.671451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:38.672608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:38.676573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:38.677295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:38.678341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:38.752906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:38.763396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:38.764872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:38.766064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e4033f0-37e7-47b7-bc6e-ef8599b2be43 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1879 microversion: 2.42 time: 1.259655 Sep 08 10:27:38.766635 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1689/3195] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:37 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1879 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:38.794601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:38.795544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:38.804917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:38.810261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:38.811046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:38.813125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:38.814396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:38.816043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:39.043131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:39.053128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:39.055454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:39.056925 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7860509-e006-43be-9dba-108eebb2dd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1406 microversion: 2.20 time: 0.418479 Sep 08 10:27:39.072089 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1507/3196] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:38 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:39.081160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-158083261"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:39.082118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:39.089079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:39.089901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:39.090603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:39.091599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:39.092284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:39.092984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:39.139701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:39.151168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-68412e60-2167-418f-9050-313bb4a88238 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1323 microversion: 2.1 time: 0.369370 Sep 08 10:27:39.152494 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1690/3197] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:38 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:39.159408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:39.161125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:39.169409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:39.170004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:39.170670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:39.172037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:39.172601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:39.173104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:39.540717 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.network.security_group_api [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Removing security group 14546bf1-4304-4ee6-a52a-6984662ab1d9 from port a4c67f93-78a8-4ab7-939a-dfea0dd47841 Sep 08 10:27:39.610523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:39.613987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:39.628522 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54ecc80c-e665-47a3-8495-079d44c732c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1325 microversion: 2.1 time: 0.474221 Sep 08 10:27:39.629281 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1691/3198] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:39 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:39.635225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c396fa95-7c3f-4b2f-892b-4f6eca0a70ac tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f2350a63b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-595895742", "description": "tempest-description-342554691"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:40.311308 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c396fa95-7c3f-4b2f-892b-4f6eca0a70ac tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.680644 Sep 08 10:27:40.313735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1692/3199] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:27:39 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:40.318915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:40.320311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:40.327786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:40.330081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:40.330834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:40.332571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:40.333328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:40.335500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:40.671190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ebe02b4-de42-4efb-afc3-8dd75a407e13 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action" status: 202 len: 0 microversion: 2.1 time: 1.597497 Sep 08 10:27:40.671960 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1508/3200] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:27:39 2022] POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action => generated 0 bytes in 1599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:27:40.679823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:40.680428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:40.705256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:40.707005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:40.710302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:40.712593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:40.713184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:40.716178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:40.939958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:40.951229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cb077a2-8c65-44c1-90c4-ad3d918d05a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1318 microversion: 2.1 time: 0.634941 Sep 08 10:27:40.952768 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1693/3201] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:40 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:40.958318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-55995e6a-b1cb-4ba3-ad51-511b450a1f09 req-daaa4785-0ed7-4543-8965-02e5668c0368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:40.970856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-55995e6a-b1cb-4ba3-ad51-511b450a1f09 req-daaa4785-0ed7-4543-8965-02e5668c0368 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:40.972398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-55995e6a-b1cb-4ba3-ad51-511b450a1f09 req-daaa4785-0ed7-4543-8965-02e5668c0368 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:40.973044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-55995e6a-b1cb-4ba3-ad51-511b450a1f09 req-daaa4785-0ed7-4543-8965-02e5668c0368 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:40.996466 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-55995e6a-b1cb-4ba3-ad51-511b450a1f09 req-daaa4785-0ed7-4543-8965-02e5668c0368 service nova] Creating event network-changed:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:27:41.004459 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-55995e6a-b1cb-4ba3-ad51-511b450a1f09 req-daaa4785-0ed7-4543-8965-02e5668c0368 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050217 Sep 08 10:27:41.006590 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1694/3202] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:41.025012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:41.027870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:41.048644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:41.049343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:41.052787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:41.054094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:41.054735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:41.055487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:41.394348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:41.415866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:41.418235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:41.420102 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62ff2c1a-84b1-46ca-9fe5-615478f6248b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2837 microversion: 2.42 time: 0.747179 Sep 08 10:27:41.420871 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1509/3203] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:40 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2837 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:41.426685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:41.427974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:41.436348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:41.438257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:41.439537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:41.440863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:41.441496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:41.442725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:41.728419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:41.742191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:41.750598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:41.751837 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2856e674-4135-4ecc-903c-24583f4085b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1406 microversion: 2.20 time: 0.743660 Sep 08 10:27:41.763806 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1695/3204] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:41 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1406 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:41.771023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c7042d6b-8f14-4bb9-bc74-fb192fb49f16 req-81a65aa3-df78-4733-9487-741bea06b524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:41.800836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c7042d6b-8f14-4bb9-bc74-fb192fb49f16 req-81a65aa3-df78-4733-9487-741bea06b524 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:41.801344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c7042d6b-8f14-4bb9-bc74-fb192fb49f16 req-81a65aa3-df78-4733-9487-741bea06b524 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:41.801778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c7042d6b-8f14-4bb9-bc74-fb192fb49f16 req-81a65aa3-df78-4733-9487-741bea06b524 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:41.826365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c7042d6b-8f14-4bb9-bc74-fb192fb49f16 req-81a65aa3-df78-4733-9487-741bea06b524 service nova] Creating event network-changed:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:27:41.832440 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c7042d6b-8f14-4bb9-bc74-fb192fb49f16 req-81a65aa3-df78-4733-9487-741bea06b524 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066967 Sep 08 10:27:41.834607 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1696/3205] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:41.842455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef61282b-1bff-455e-80f1-3dee8b64b529 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f235140d790>, body: {"security_group_rule": {"parent_group_id": "385911ed-8cbc-4e90-9d6e-403d2388b172", "ip_protocol": "tcp", "from_port": 897051681, "to_port": 22}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:42.364421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:42.365716 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-ef61282b-1bff-455e-80f1-3dee8b64b529 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Invalid port range 897051681:22. Former value cannot be greater than the later Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef61282b-1bff-455e-80f1-3dee8b64b529 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 145 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: {"security_group_rule": {"parent_group_id": "385911ed-8cbc-4e90-9d6e-403d2388b172", "ip_protocol": "tcp", "from_port": 897051681, "to_port": 22}} Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid port range 897051681:22. Former value cannot be greater than the later Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'security_group_rule': {'parent_group_id': '385911ed-8cbc-4e90-9d6e-403d2388b172', 'ip_protocol': 'tcp', 'from_port': 897051681, 'to_port': 22}}} Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 897051681:22. Former value cannot be greater than the later Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 897051681:22. Former value cannot be greater than the later Sep 08 10:27:42.368546 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 897051681:22. Former value cannot be greater than the later Sep 08 10:27:42.372482 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:42.377185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef61282b-1bff-455e-80f1-3dee8b64b529 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 400 to user: Invalid port range 897051681:22. Former value cannot be greater than the later {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:42.378443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef61282b-1bff-455e-80f1-3dee8b64b529 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.541859 Sep 08 10:27:42.380351 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26acb693-5356-4b8e-b936-4baf8930d56e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1323 microversion: 2.1 time: 0.958262 Sep 08 10:27:42.385045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1697/3206] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:41 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 550 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:42.391429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:42.392534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:42.395936 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1510/3207] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:41 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1323 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:42.402528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:42.403357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:42.404216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:42.404393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3177529f-75ff-40fb-af12-27edc4ca561c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'create', calling method: .version_select at 0x7f235535cb80>, body: {"pool": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:42.405433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:42.406260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:42.407814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:42.898734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:42.909914 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39c65000-967d-4120-ab83-bea117d02dc4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.522237 Sep 08 10:27:42.911270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1698/3208] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:42 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:42.918420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:42.919265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:42.926454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:42.927413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:42.928431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:42.929402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:42.930082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:42.930868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:43.231659 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d783d4e-876d-49fc-994c-58cd7224513a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.318687 Sep 08 10:27:43.232418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1699/3209] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:27:42 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225/os-interface => generated 1833 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:43.239928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:43.241127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:43.249720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:43.250329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:43.250861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:43.251700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:43.252280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:43.252810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:43.290696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:43.374101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:43.867185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:43.876479 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c6b296f-5aa0-43bc-90f6-2889fd5b5631 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1318 microversion: 2.1 time: 0.642725 Sep 08 10:27:43.877378 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1700/3210] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:43 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:43.883004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-637cc128-c708-47cd-ad08-e3d1437da42e req-08eef5cf-b2a0-4fe7-baeb-c208c1b3c3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "name": "network-vif-plugged", "status": "completed", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:43.895452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-637cc128-c708-47cd-ad08-e3d1437da42e req-08eef5cf-b2a0-4fe7-baeb-c208c1b3c3fc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:43.896224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-637cc128-c708-47cd-ad08-e3d1437da42e req-08eef5cf-b2a0-4fe7-baeb-c208c1b3c3fc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:43.896845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-637cc128-c708-47cd-ad08-e3d1437da42e req-08eef5cf-b2a0-4fe7-baeb-c208c1b3c3fc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:43.923821 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-637cc128-c708-47cd-ad08-e3d1437da42e req-08eef5cf-b2a0-4fe7-baeb-c208c1b3c3fc service nova] Creating event network-vif-plugged:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:27:43.931431 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-637cc128-c708-47cd-ad08-e3d1437da42e req-08eef5cf-b2a0-4fe7-baeb-c208c1b3c3fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052372 Sep 08 10:27:43.932640 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1701/3211] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:43.939628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-96266c24-e942-41ff-ab17-540883df79be tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f23509ffca0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-209819476", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:43.942255 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-96266c24-e942-41ff-ab17-540883df79be tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Security group id should be uuid Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-96266c24-e942-41ff-ab17-540883df79be tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 130 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-209819476", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group id should be uuid Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-209819476', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:43.944208 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:43.949544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 08 10:27:43.949544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:43.951148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-96266c24-e942-41ff-ab17-540883df79be tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 400 to user: Security group id should be uuid {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:43.952283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-96266c24-e942-41ff-ab17-540883df79be tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018335 Sep 08 10:27:43.953401 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1702/3212] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:43 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:27:43.958395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:43.959359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:43.969746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:43.970868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:43.971532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:43.972472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:43.973121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:43.973718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:44.893543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:44.904424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:44.906035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:44.907185 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e6339d49-78ab-490e-a94a-ba579977b5f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1406 microversion: 2.20 time: 0.952662 Sep 08 10:27:44.907790 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1703/3213] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:43 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1406 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:44.915263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:44.915932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:44.924234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:44.924851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:44.925204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:44.925920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:44.926551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:44.927386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:45.546559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:45.557616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2de1eac3-898e-4f72-9425-c9f4489c6eff tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.647727 Sep 08 10:27:45.560334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1704/3214] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:44 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:45.565334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-72fa6a5d-d3a2-4ba3-afda-31665fbef6de req-af60726e-ccca-4468-bd01-5ec84383fce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:45.577289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-72fa6a5d-d3a2-4ba3-afda-31665fbef6de req-af60726e-ccca-4468-bd01-5ec84383fce5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:45.578080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-72fa6a5d-d3a2-4ba3-afda-31665fbef6de req-af60726e-ccca-4468-bd01-5ec84383fce5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:45.578510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-72fa6a5d-d3a2-4ba3-afda-31665fbef6de req-af60726e-ccca-4468-bd01-5ec84383fce5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:45.594257 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-72fa6a5d-d3a2-4ba3-afda-31665fbef6de req-af60726e-ccca-4468-bd01-5ec84383fce5 service nova] Creating event network-changed:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:27:45.599950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-72fa6a5d-d3a2-4ba3-afda-31665fbef6de req-af60726e-ccca-4468-bd01-5ec84383fce5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037733 Sep 08 10:27:45.600735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1705/3215] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:45.607368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:45.608111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:45.623109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:45.623649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:45.624320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:45.625218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:45.626020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:45.626603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:46.139339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:46.148986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e851f3e9-323e-4cf9-af25-b13481757582 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1323 microversion: 2.1 time: 0.546022 Sep 08 10:27:46.149577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1706/3216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:45 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:46.156274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efb42f83-1479-4081-821b-ba7935c1fdca tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f2351110430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1677988904", "description": "tempest-description-1772069091"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:46.203318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:46.266329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:47.224439 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efb42f83-1479-4081-821b-ba7935c1fdca tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.071778 Sep 08 10:27:47.225475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1707/3217] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:27:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:47.231149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:47.232104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:47.240161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.240587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.241350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:47.254030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.255663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.256200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:47.712896 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3177529f-75ff-40fb-af12-27edc4ca561c tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.315712 Sep 08 10:27:47.714347 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1511/3218] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:27:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:47.720732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b316a5e2-afe2-47cc-a8bc-11a402535cac tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-26474299", "metadata": {"": ""}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b316a5e2-afe2-47cc-a8bc-11a402535cac tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action HTTP/1.1 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 105 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-26474299", "metadata": {"": ""}}} Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-26474299', 'metadata': {'': ''}}}} Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'': ''} Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:47.726895 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:47.730884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:47.740652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b316a5e2-afe2-47cc-a8bc-11a402535cac tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:47.742614 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b316a5e2-afe2-47cc-a8bc-11a402535cac tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action" status: 400 len: 170 microversion: 2.1 time: 0.025225 Sep 08 10:27:47.743565 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1512/3219] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Sep 8 10:27:47 2022] POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:47.749299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:47.750629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:47.761280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.762329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.762778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:47.763510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.763973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.764402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:47.768076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:47.779725 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05d967bb-8ba0-42b2-9054-463dd63d55a7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1318 microversion: 2.1 time: 0.552584 Sep 08 10:27:47.803494 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1708/3220] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:47 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:47.803494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5bd004a6-fad2-4bce-8850-d08d13718e60 req-dee4ab37-3f87-49be-b05c-34c2e9cde8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "name": "network-vif-plugged", "status": "completed", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:47.819057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5bd004a6-fad2-4bce-8850-d08d13718e60 req-dee4ab37-3f87-49be-b05c-34c2e9cde8d8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.819571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5bd004a6-fad2-4bce-8850-d08d13718e60 req-dee4ab37-3f87-49be-b05c-34c2e9cde8d8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.820040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5bd004a6-fad2-4bce-8850-d08d13718e60 req-dee4ab37-3f87-49be-b05c-34c2e9cde8d8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:47.836916 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5bd004a6-fad2-4bce-8850-d08d13718e60 req-dee4ab37-3f87-49be-b05c-34c2e9cde8d8 service nova] Creating event network-vif-plugged:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:27:47.845201 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5bd004a6-fad2-4bce-8850-d08d13718e60 req-dee4ab37-3f87-49be-b05c-34c2e9cde8d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053781 Sep 08 10:27:47.846275 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1709/3221] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:47.854523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:47.855515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:47.863268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.870046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.870788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:47.871794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:47.872469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:47.873089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:48.346848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:48.357446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:48.359493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:48.360868 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24597b74-f252-4c86-aeb2-42d11f461565 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1598 microversion: 2.20 time: 0.616211 Sep 08 10:27:48.362743 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1513/3222] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:27:47 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1598 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:27:48.367674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-611459d6-5f4e-4c9f-91c1-00b12367092f tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f2350ade4c0>, body: {"security_group_rule": {"parent_group_id": "5cc51682-71fc-4027-b1a4-6d1a9f2a7c45", "ip_protocol": "tempest-999-2122665158", "from_port": 22, "to_port": 22}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:48.429533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:48.439193 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5cbcd560-0489-4e8d-977d-2b0b7f5ca07d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1323 microversion: 2.1 time: 0.591437 Sep 08 10:27:48.439826 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1710/3223] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:47 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1323 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:48.445538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d47410-6b13-4157-a683-1cb5ab1c5171", "tag": "c78f099d-9515-447e-9ee3-ef3dfa8bac6d"}, {"name": "network-changed", "server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "tag": "ed356a2e-ef5c-4059-a100-4db728c7c7b5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:48.456235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:48.456748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:48.457182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:48.474237 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] Creating event network-changed:c78f099d-9515-447e-9ee3-ef3dfa8bac6d for instance 77d47410-6b13-4157-a683-1cb5ab1c5171 on n-h1-833090-19 Sep 08 10:27:48.475005 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] Creating event network-changed:ed356a2e-ef5c-4059-a100-4db728c7c7b5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:27:48.484352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1a0e1110-051d-4336-ad5d-9fa31966d7a4 req-6e401a66-2a66-4dc3-82df-ce2ecc9ea83d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042953 Sep 08 10:27:48.485551 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1711/3224] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:48.491239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.208"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:48.494208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:48.501149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:48.501637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:48.502393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:48.503311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:48.504003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:48.504436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:48.523924 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-611459d6-5f4e-4c9f-91c1-00b12367092f tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Invalid IP protocol tempest-999-2122665158. Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-611459d6-5f4e-4c9f-91c1-00b12367092f tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 157 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: {"security_group_rule": {"parent_group_id": "5cc51682-71fc-4027-b1a4-6d1a9f2a7c45", "ip_protocol": "tempest-999-2122665158", "from_port": 22, "to_port": 22}} Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid IP protocol tempest-999-2122665158. Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5cc51682-71fc-4027-b1a4-6d1a9f2a7c45', 'ip_protocol': 'tempest-999-2122665158', 'from_port': 22, 'to_port': 22}}} Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2122665158. Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2122665158. Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:48.525510 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2122665158. Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-611459d6-5f4e-4c9f-91c1-00b12367092f tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 400 to user: Invalid IP protocol tempest-999-2122665158. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-611459d6-5f4e-4c9f-91c1-00b12367092f tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.163132 Sep 08 10:27:48.529851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1514/3225] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:48 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:27:48.535758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "refresh_cache-3c163e66-1e2e-4fdb-b112-e878cbdf2662" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:27:48.535758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquired lock "refresh_cache-3c163e66-1e2e-4fdb-b112-e878cbdf2662" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:27:48.536470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:48.537129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:48.546572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:48.547789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:48.548414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:48.549937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:48.550599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:48.551110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:49.356901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:49.368790 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9367f1a5-cf75-42c4-a4ac-cf282079bc04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.839999 Sep 08 10:27:49.370713 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1515/3226] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:48 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:49.377753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:49.380054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:49.394358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:49.395574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:49.396748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:49.397737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:49.398678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:49.399751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:49.646356 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-511d9da9-cdbb-47f5-99ab-a21b9fcd6f77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.273941 Sep 08 10:27:49.647272 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1516/3227] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:27:49 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:27:49.653352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a3dcba4-9a2f-455d-be10-bfc613727609 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f23508674c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-983868220", "description": "tempest-description-36139659"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:50.363137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2a3dcba4-9a2f-455d-be10-bfc613727609 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.713576 Sep 08 10:27:50.364597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1517/3228] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:27:49 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:50.378120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:50.378791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:50.392901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:50.393424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:50.393872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:50.394637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:50.400666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:50.401771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:50.896573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:50.912459 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9a9d997-efa8-43a3-91c1-8cbcc41afae7 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1318 microversion: 2.1 time: 0.546350 Sep 08 10:27:50.913397 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1518/3229] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:50 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:50.918751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:50.923221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:50.934063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:50.934841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:50.935453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:50.936361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:50.937000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:50.937592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:51.707649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:51.723598 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67840697-b97a-4089-9a0d-bd7b9196c5ef tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.808333 Sep 08 10:27:51.725420 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1519/3230] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:50 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:51.884193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a135b412-b55d-46b1-8d48-7e774e929806 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Action: 'create', calling method: .version_select at 0x7f23511dea60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-44588394", "policies": ["affinity"]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:51.905695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a135b412-b55d-46b1-8d48-7e774e929806 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:51.912533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a135b412-b55d-46b1-8d48-7e774e929806 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:51.980637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a135b412-b55d-46b1-8d48-7e774e929806 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:51.990385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a135b412-b55d-46b1-8d48-7e774e929806 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:52.025036 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a135b412-b55d-46b1-8d48-7e774e929806 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.297851 Sep 08 10:27:52.031817 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1520/3231] 10.222.0.59 () {60 vars in 1174 bytes} [Thu Sep 8 10:27:51 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:52.038139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:52.039317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:52.047314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:52.047833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:52.048266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:52.048988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:52.049475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:52.050364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:52.096782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:27:52.410541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:52.423760 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e82e955c-e835-40e4-948e-68631b73cb0e tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1518 microversion: 2.1 time: 0.390725 Sep 08 10:27:52.424527 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1521/3232] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:52 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:52.438377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4790b6a2-3c4a-4933-a59c-5316d8e4ab20 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f23511f79d0>, body: {"security_group_rule": {"parent_group_id": "83130f9f-f2ae-4a35-97e6-ee174d6be26e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:52.652144 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-4790b6a2-3c4a-4933-a59c-5316d8e4ab20 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4790b6a2-3c4a-4933-a59c-5316d8e4ab20 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 138 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: {"security_group_rule": {"parent_group_id": "83130f9f-f2ae-4a35-97e6-ee174d6be26e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'security_group_rule': {'parent_group_id': '83130f9f-f2ae-4a35-97e6-ee174d6be26e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:27:52.654654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 10:27:52.660301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.661037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4790b6a2-3c4a-4933-a59c-5316d8e4ab20 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:52.662135 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4790b6a2-3c4a-4933-a59c-5316d8e4ab20 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.236321 Sep 08 10:27:52.667878 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1522/3233] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:52 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:52.675790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3035c815-98d6-4b97-bb11-f7c988dca20b req-b5e2fd1a-b1b9-4b34-934b-d231711d8c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:52.691295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3035c815-98d6-4b97-bb11-f7c988dca20b req-b5e2fd1a-b1b9-4b34-934b-d231711d8c73 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:52.692116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3035c815-98d6-4b97-bb11-f7c988dca20b req-b5e2fd1a-b1b9-4b34-934b-d231711d8c73 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:52.692767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3035c815-98d6-4b97-bb11-f7c988dca20b req-b5e2fd1a-b1b9-4b34-934b-d231711d8c73 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:52.705181 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3035c815-98d6-4b97-bb11-f7c988dca20b req-b5e2fd1a-b1b9-4b34-934b-d231711d8c73 service nova] Creating event network-changed:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:27:52.711439 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3035c815-98d6-4b97-bb11-f7c988dca20b req-b5e2fd1a-b1b9-4b34-934b-d231711d8c73 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041874 Sep 08 10:27:52.716573 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1523/3234] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:52.723166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b45b21fb-3be3-4dd4-bfa9-0821f3200795 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1452258087", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b45b21fb-3be3-4dd4-bfa9-0821f3200795 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action HTTP/1.1 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 619 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1452258087", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1452258087', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:52.737273 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:27:52.740536 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:52.745445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b45b21fb-3be3-4dd4-bfa9-0821f3200795 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:52.747383 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b45b21fb-3be3-4dd4-bfa9-0821f3200795 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action" status: 400 len: 938 microversion: 2.1 time: 0.029008 Sep 08 10:27:52.748837 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1524/3235] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Sep 8 10:27:52 2022] POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action => generated 938 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:52.753893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:52.755010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:52.763090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:52.763991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:52.764726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:52.765599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:52.766216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:52.766801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:53.095511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:53.104614 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-12e9f5a8-a101-4e21-8591-3c16d1df74c8 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1318 microversion: 2.1 time: 0.354521 Sep 08 10:27:53.105528 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1525/3236] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:52 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:53.112889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-735517ef-7e27-4558-b79a-daa52eae54a1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Action: 'create', calling method: .version_select at 0x7f2350c031f0>, body: {"server_group": {"name": "tempest-server-group-2048249495", "policies": ["affinity"]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:53.140406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-735517ef-7e27-4558-b79a-daa52eae54a1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:53.147525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-735517ef-7e27-4558-b79a-daa52eae54a1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:53.205292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-735517ef-7e27-4558-b79a-daa52eae54a1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:53.213107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-735517ef-7e27-4558-b79a-daa52eae54a1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:53.233165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-735517ef-7e27-4558-b79a-daa52eae54a1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.126297 Sep 08 10:27:53.234026 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1526/3237] 10.222.0.59 () {60 vars in 1173 bytes} [Thu Sep 8 10:27:53 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:53.245621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6eb41b8e-6a0b-416e-85af-1f565e590843 req-90e9d5ad-9162-463e-8de1-f69599f0a6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:53.251350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:53.258794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6eb41b8e-6a0b-416e-85af-1f565e590843 req-90e9d5ad-9162-463e-8de1-f69599f0a6b4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:53.259397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6eb41b8e-6a0b-416e-85af-1f565e590843 req-90e9d5ad-9162-463e-8de1-f69599f0a6b4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:53.260058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6eb41b8e-6a0b-416e-85af-1f565e590843 req-90e9d5ad-9162-463e-8de1-f69599f0a6b4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:53.272524 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6eb41b8e-6a0b-416e-85af-1f565e590843 req-90e9d5ad-9162-463e-8de1-f69599f0a6b4 service nova] Creating event network-changed:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:27:53.278671 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6eb41b8e-6a0b-416e-85af-1f565e590843 req-90e9d5ad-9162-463e-8de1-f69599f0a6b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037798 Sep 08 10:27:53.280299 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1527/3238] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:53.286380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3460a406-1f77-4056-b8b7-fc20156e630a tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'create', calling method: .version_select at 0x7f23508600d0>, body: {"pool": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:53.409765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Updating instance_info_cache with network_info: [{"id": "a4c67f93-78a8-4ab7-939a-dfea0dd47841", "address": "fa:16:3e:31:43:cd", "network": {"id": "4f0de39b-d817-4530-ae18-dfb9d8c66246", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-135912942-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fc7ce418fdf848f78fdd52ab736dbf94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4c67f93-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:27:53.425037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Releasing lock "refresh_cache-3c163e66-1e2e-4fdb-b112-e878cbdf2662" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:27:53.426233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1f2ff3e-d2e1-4ce3-b93c-b064fc235bc2 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action" status: 202 len: 0 microversion: 2.1 time: 4.939270 Sep 08 10:27:53.426854 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1712/3239] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:27:48 2022] POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action => generated 0 bytes in 4941 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:27:53.431650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-fee4a5a3-ec2c-4c97-9fd9-2a19e7b28926 req-06cd0bc5-91e9-48e6-a4ed-e38ef8063986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d47410-6b13-4157-a683-1cb5ab1c5171", "name": "network-vif-plugged", "status": "completed", "tag": "c78f099d-9515-447e-9ee3-ef3dfa8bac6d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:53.441395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fee4a5a3-ec2c-4c97-9fd9-2a19e7b28926 req-06cd0bc5-91e9-48e6-a4ed-e38ef8063986 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:53.441869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fee4a5a3-ec2c-4c97-9fd9-2a19e7b28926 req-06cd0bc5-91e9-48e6-a4ed-e38ef8063986 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:53.442318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fee4a5a3-ec2c-4c97-9fd9-2a19e7b28926 req-06cd0bc5-91e9-48e6-a4ed-e38ef8063986 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:53.453833 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-fee4a5a3-ec2c-4c97-9fd9-2a19e7b28926 req-06cd0bc5-91e9-48e6-a4ed-e38ef8063986 service nova] Creating event network-vif-plugged:c78f099d-9515-447e-9ee3-ef3dfa8bac6d for instance 77d47410-6b13-4157-a683-1cb5ab1c5171 on n-h1-833090-19 Sep 08 10:27:53.458767 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-fee4a5a3-ec2c-4c97-9fd9-2a19e7b28926 req-06cd0bc5-91e9-48e6-a4ed-e38ef8063986 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030603 Sep 08 10:27:53.459393 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1713/3240] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:53.465034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2337d814-6b72-4f8a-8b3b-a5305180ff6a tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f235140d940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-872586360", "description": "tempest-description-630729757"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:54.102425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2337d814-6b72-4f8a-8b3b-a5305180ff6a tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.641730 Sep 08 10:27:54.118965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1714/3241] 10.222.0.59 () {60 vars in 1180 bytes} [Thu Sep 8 10:27:53 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:54.123968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:54.124755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:54.131510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:54.132196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:54.132935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:54.133805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:54.134267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:54.134698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:54.874860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:54.890267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b7e1b2e-fcc9-44b2-956a-c2df5bbf5152 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.769994 Sep 08 10:27:54.892884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1715/3242] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:54 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:54.898854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b85a23a8-3a52-4533-845a-a255fae374d5 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Action: 'create', calling method: .version_select at 0x7f2351e48550>, body: {"server_group": {"name": "tempest-server-group-2048249495", "policies": ["affinity"]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:54.925042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b85a23a8-3a52-4533-845a-a255fae374d5 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:54.938031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b85a23a8-3a52-4533-845a-a255fae374d5 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:54.995511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:55.006484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b85a23a8-3a52-4533-845a-a255fae374d5 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:55.013821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b85a23a8-3a52-4533-845a-a255fae374d5 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:55.030220 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b85a23a8-3a52-4533-845a-a255fae374d5 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.135794 Sep 08 10:27:55.031114 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1716/3243] 10.222.0.59 () {60 vars in 1173 bytes} [Thu Sep 8 10:27:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:55.036419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.208"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:55.336761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:55.344118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:55.344659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:55.345177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:55.346035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:55.346597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:55.347068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:55.793705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "refresh_cache-3c163e66-1e2e-4fdb-b112-e878cbdf2662" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:27:55.794216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquired lock "refresh_cache-3c163e66-1e2e-4fdb-b112-e878cbdf2662" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:27:57.267643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3460a406-1f77-4056-b8b7-fc20156e630a tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.986003 Sep 08 10:27:57.268257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1528/3244] 10.222.0.59 () {60 vars in 1170 bytes} [Thu Sep 8 10:27:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:57.274055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f4f0e23-61e4-414a-8335-10e23172ac02 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f2350c031f0>, body: {"security_group_rule": {"parent_group_id": "e244019c-1dea-4ee3-b384-847e35f4da64", "ip_protocol": "tcp", "from_port": 22, "to_port": 182721768}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:57.468144 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-0f4f0e23-61e4-414a-8335-10e23172ac02 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Invalid port range 22:182721768. Valid TCP ports should be between 1-65535 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f4f0e23-61e4-414a-8335-10e23172ac02 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 145 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: {"security_group_rule": {"parent_group_id": "e244019c-1dea-4ee3-b384-847e35f4da64", "ip_protocol": "tcp", "from_port": 22, "to_port": 182721768}} Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid port range 22:182721768. Valid TCP ports should be between 1-65535 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e244019c-1dea-4ee3-b384-847e35f4da64', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 182721768}}} Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:182721768. Valid TCP ports should be between 1-65535 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:182721768. Valid TCP ports should be between 1-65535 Sep 08 10:27:57.469845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:182721768. Valid TCP ports should be between 1-65535 Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f4f0e23-61e4-414a-8335-10e23172ac02 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 400 to user: Invalid port range 22:182721768. Valid TCP ports should be between 1-65535 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:57.474660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f4f0e23-61e4-414a-8335-10e23172ac02 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.202071 Sep 08 10:27:57.478213 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1529/3245] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:57 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:57.483338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:57.484122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:57.491723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:57.492715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:57.493159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:57.493878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:57.494324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:57.494757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:57.499155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:57.609607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:27:57.836538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:57.844980 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51b45f8b-a0c6-4a25-b1c8-f355447d2659 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1508 microversion: 2.1 time: 0.365479 Sep 08 10:27:57.845563 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1530/3246] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:57 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:57.869641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:57.870517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:57.878400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:57.878881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:57.879311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:57.880044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:57.880487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:57.880907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:58.165553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:58.178233 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b6e6163-ae89-4736-a089-58d0da6a0b49 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.316761 Sep 08 10:27:58.179392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1531/3247] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:57 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:58.185218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73af12a6-fadd-42c8-81e4-0a890fd818f7 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:58.224533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-73af12a6-fadd-42c8-81e4-0a890fd818f7 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/748a1439-cc91-4ed1-8ad7-1cf8e64018ad" status: 204 len: 0 microversion: 2.1 time: 0.043408 Sep 08 10:27:58.228826 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1532/3248] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:27:58 2022] DELETE /compute/v2.1/os-server-groups/748a1439-cc91-4ed1-8ad7-1cf8e64018ad => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:27:58.230921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-616370164", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:58.293382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] validate_networks() for [('44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:27:58.486684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Updating instance_info_cache with network_info: [{"id": "a4c67f93-78a8-4ab7-939a-dfea0dd47841", "address": "fa:16:3e:31:43:cd", "network": {"id": "4f0de39b-d817-4530-ae18-dfb9d8c66246", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-135912942-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fc7ce418fdf848f78fdd52ab736dbf94", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4c67f93-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:27:58.495641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:27:58.503256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Releasing lock "refresh_cache-3c163e66-1e2e-4fdb-b112-e878cbdf2662" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:27:58.508456 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42b3afe9-a44e-4527-9c98-17b01df976dd tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action" status: 202 len: 0 microversion: 2.1 time: 3.475904 Sep 08 10:27:58.509078 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1717/3249] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:27:55 2022] POST /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662/action => generated 0 bytes in 3477 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:27:58.514247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Action: 'create', calling method: .version_select at 0x7f235098eee0>, body: {"security_group_rule": {"parent_group_id": "5cc23215-1b85-4852-8348-f1e1f1bdc194", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:58.550938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:27:58.551647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Neutron security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:27:58.552233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.552233 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 138 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: {"security_group_rule": {"parent_group_id": "5cc23215-1b85-4852-8348-f1e1f1bdc194", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5cc23215-1b85-4852-8348-f1e1f1bdc194', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:27:58.555027 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 404 to user: Security group 5cc23215-1b85-4852-8348-f1e1f1bdc194 does not exist Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-d381a512-baec-4c78-b6e8-3a8c5775bd31'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:58.560020 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78158a20-e18b-4f7b-ac4e-91b0a4200369 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.046394 Sep 08 10:27:58.563780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1718/3250] 10.222.0.59 () {60 vars in 1195 bytes} [Thu Sep 8 10:27:58 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:27:58.568055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-076b3a36-7dc6-4af4-ba4d-5f2499bd820b req-ddab31c6-fd24-49f1-8970-495adb5d3d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:58.578537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-076b3a36-7dc6-4af4-ba4d-5f2499bd820b req-ddab31c6-fd24-49f1-8970-495adb5d3d9c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:58.579105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-076b3a36-7dc6-4af4-ba4d-5f2499bd820b req-ddab31c6-fd24-49f1-8970-495adb5d3d9c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:58.579376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-076b3a36-7dc6-4af4-ba4d-5f2499bd820b req-ddab31c6-fd24-49f1-8970-495adb5d3d9c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:58.592368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-076b3a36-7dc6-4af4-ba4d-5f2499bd820b req-ddab31c6-fd24-49f1-8970-495adb5d3d9c service nova] Creating event network-changed:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:27:58.598618 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-076b3a36-7dc6-4af4-ba4d-5f2499bd820b req-ddab31c6-fd24-49f1-8970-495adb5d3d9c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033660 Sep 08 10:27:58.599225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1719/3251] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:58.605760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:58.606782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:58.613514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:58.614177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:58.614416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:58.615109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:58.615774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:58.623609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:58.966096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:58.974345 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-259758bb-094b-4b25-b162-7bb3a2b5e2b9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1508 microversion: 2.1 time: 0.373754 Sep 08 10:27:58.974938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1720/3252] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:58 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:58.979640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62ca104a-d774-4f26-8d6e-76cf78ff439a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62ca104a-d774-4f26-8d6e-76cf78ff439a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action HTTP/1.1 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 285 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:58.983939 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62ca104a-d774-4f26-8d6e-76cf78ff439a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-62ca104a-d774-4f26-8d6e-76cf78ff439a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action" status: 400 len: 619 microversion: 2.1 time: 0.009540 Sep 08 10:27:58.989757 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1721/3253] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Sep 8 10:27:58 2022] POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:27:58.995984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5751bfd9-9bd9-49ec-b30f-09ddec660976 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:59.020182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5751bfd9-9bd9-49ec-b30f-09ddec660976 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.029108 Sep 08 10:27:59.021111 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1722/3254] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:27:58 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:27:59.028096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-892eda5b-488e-4bdb-a5a9-56cc9900f5cf tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '.version_select at 0x7f235135f280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:59.093585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:27:59.094121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:27:59.094769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:27:59.095321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:27:59.095872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:27:59.105695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.106278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.106826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.107688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.108177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.108611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.129155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Getting quotas for project 920596ac3512466ebd2e58a6dfc062cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:27:59.135399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Getting quotas for user f56ca90367aa4d748c3bca6b9b4a2dbd and project 920596ac3512466ebd2e58a6dfc062cb. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:27:59.149271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:27:59.151615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:27:59.214050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d6b5542-c93b-453a-871f-10513d0a4abc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977340 Sep 08 10:27:59.221173 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1533/3255] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:27:59.221173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f23554c45e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:59.255919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG neutronclient.v2_0.client [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist", "detail": ""}} {{(pid=122456) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:27:59.256778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.security_group_api [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Neutron security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e not found {{(pid=122456) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 08 10:27:59.257380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] HTTP exception thrown: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.257380 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Request method failure captured: Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-security-group-rules/ab1c582b-8c25-4710-9223-7eb0973bf22e HTTP/1.1 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOSvxC0Ms0-_5JZfsyUDQ_q8dapchPzy_2FbMNBzBRuzguC7nss-9h7phaMPAewvQdFF2-P8MTQZ8EnlvuAcid6CTQTy_GDI7r3X1kzHMIfaTyHmdteiY4fh1pzw7BweIXSJfpYNzgsihSO-sBI1jvZOLPSUZllde7_5Ygyw78HKIg Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c2c4e78451e4ad3a32d29e5cfbf6d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c2c4e78451e4ad3a32d29e5cfbf6d20", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0c2c4e78451e4ad3a32d29e5cfbf6d20 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4016726d8d974a13bdd4b412d5482e49 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-61471033-project Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: exception: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab1c582b-8c25-4710-9223-7eb0973bf22e'} Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:27:59.260002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Returning 404 to user: Security group rule ab1c582b-8c25-4710-9223-7eb0973bf22e does not exist Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: Neutron server returns request_ids: ['req-731302c3-eb90-4569-9d4c-4867513a8316'] {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6dc3a0d-308c-4542-8682-52ec9ffc28b0 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-group-rules/ab1c582b-8c25-4710-9223-7eb0973bf22e" status: 404 len: 199 microversion: 2.1 time: 0.046916 Sep 08 10:27:59.266003 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1534/3256] 10.222.0.59 () {58 vars in 1287 bytes} [Thu Sep 8 10:27:59 2022] DELETE /compute/v2.1/os-security-group-rules/ab1c582b-8c25-4710-9223-7eb0973bf22e => generated 199 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:27:59.274688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:59.275438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:59.282920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.283573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.284268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.285048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.285580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.286078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.696997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:59.710401 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85cc7cca-7106-4eaf-924f-911a24ad6519 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.444376 Sep 08 10:27:59.721820 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1535/3257] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:59 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:59.729270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:27:59.732959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:59.739544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.740266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.740668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.741452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.742011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.742507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.822321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5369105-9c27-476a-8b95-bfbd2ca811c4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "PUT /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1080 microversion: 2.1 time: 0.099058 Sep 08 10:27:59.824356 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1536/3258] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:27:59 2022] PUT /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1080 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:59.829103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a32c4a02-e7d0-4a1f-b175-858335e3db12 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:59.863783 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a32c4a02-e7d0-4a1f-b175-858335e3db12 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/6d502d1c-717a-4dc2-9d72-b9618bfd23e9" status: 204 len: 0 microversion: 2.1 time: 0.039003 Sep 08 10:27:59.864516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1537/3259] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:27:59 2022] DELETE /compute/v2.1/os-server-groups/6d502d1c-717a-4dc2-9d72-b9618bfd23e9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:27:59.869959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:27:59.870933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:27:59.877880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.878458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.878902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.879655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:27:59.880313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:27:59.880749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:27:59.980356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:27:59.989232 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0bf01d19-c70b-46ad-9170-32bc06cf6e7c tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1219 microversion: 2.1 time: 0.123286 Sep 08 10:27:59.990241 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1538/3260] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:27:59 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:27:59.995335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3cc9e28a-4cf5-48c0-bf83-4a490c221e70 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f23508674c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:00.653962 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3cc9e28a-4cf5-48c0-bf83-4a490c221e70 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/e244019c-1dea-4ee3-b384-847e35f4da64" status: 202 len: 0 microversion: 2.1 time: 0.662427 Sep 08 10:28:00.657561 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1539/3261] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:27:59 2022] DELETE /compute/v2.1/os-security-groups/e244019c-1dea-4ee3-b384-847e35f4da64 => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:00.666456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:00.667811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:00.678223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:00.680194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:00.681156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:00.682458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:00.684012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:00.685204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:00.729675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-892eda5b-488e-4bdb-a5a9-56cc9900f5cf tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/0c3dd096-cc09-4dee-bcd1-f15f1d09a8e4" status: 202 len: 0 microversion: 2.1 time: 1.707445 Sep 08 10:28:00.730362 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1723/3262] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:27:59 2022] DELETE /compute/v2.1/os-floating-ips/0c3dd096-cc09-4dee-bcd1-f15f1d09a8e4 => generated 0 bytes in 1709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:00.736186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:00.737151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:00.745025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:00.745579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:00.746017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:00.746790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:00.747245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:00.747693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.014021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:01.022280 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee75b535-c128-4361-9194-ed8744451f88 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 0.366138 Sep 08 10:28:01.022909 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1540/3263] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:00 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:01.023167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:01.028840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe2e4ce6-b4ba-44e6-91c8-51ea9c8fafcc tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:01.040065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe2e4ce6-b4ba-44e6-91c8-51ea9c8fafcc tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.015066 Sep 08 10:28:01.040848 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1541/3264] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:28:01 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:01.045153 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2e6529d-b365-4794-9c63-a433e11de110 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1506 microversion: 2.1 time: 0.313132 Sep 08 10:28:01.045822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-06c09d57-cf9d-4293-9827-fcdb9a9ee734 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f23512c6430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:01.045992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1724/3265] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:00 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:01.060015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-77e65536-deea-4b80-a6e5-d3c35e7c83c6 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '.version_select at 0x7f23509840d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:01.552806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-77e65536-deea-4b80-a6e5-d3c35e7c83c6 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/14546bf1-4304-4ee6-a52a-6984662ab1d9" status: 202 len: 0 microversion: 2.1 time: 0.505100 Sep 08 10:28:01.555538 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1725/3266] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:28:01 2022] DELETE /compute/v2.1/os-security-groups/14546bf1-4304-4ee6-a52a-6984662ab1d9 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:01.563204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:01.565551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:01.568565 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-06c09d57-cf9d-4293-9827-fcdb9a9ee734 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/83130f9f-f2ae-4a35-97e6-ee174d6be26e" status: 202 len: 0 microversion: 2.1 time: 0.526496 Sep 08 10:28:01.569162 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1542/3267] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:28:01 2022] DELETE /compute/v2.1/os-security-groups/83130f9f-f2ae-4a35-97e6-ee174d6be26e => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:01.580440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1815652168"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:01.582595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:01.586901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.587537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.589363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.589363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.589824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.590897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.612967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.613462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.613901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.614708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.615242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.615770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.719219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:01.728168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44be34f8-8281-4872-8847-b50ff95d2e7b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1281 microversion: 2.1 time: 0.170298 Sep 08 10:28:01.729407 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1726/3268] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:01 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:01.734067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a5a3e9dd-85e6-4fc6-9d9e-efe6beb425a9 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Action: 'create', calling method: .version_select at 0x7f23509841f0>, body: {"server_group": {"name": "tempest-server-group-98942786", "policies": ["affinity"]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:01.754295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a5a3e9dd-85e6-4fc6-9d9e-efe6beb425a9 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:01.761740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a5a3e9dd-85e6-4fc6-9d9e-efe6beb425a9 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:01.808729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a5a3e9dd-85e6-4fc6-9d9e-efe6beb425a9 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:01.813941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a5a3e9dd-85e6-4fc6-9d9e-efe6beb425a9 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:01.829658 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a5a3e9dd-85e6-4fc6-9d9e-efe6beb425a9 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.099015 Sep 08 10:28:01.830954 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1727/3269] 10.222.0.59 () {60 vars in 1173 bytes} [Thu Sep 8 10:28:01 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:01.840112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:01.841466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:01.850483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.851859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.852485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.853476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.854100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.854689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.873115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42e8db1d-1e65-42a6-b751-a863fd7558bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action" status: 202 len: 0 microversion: 2.1 time: 0.299175 Sep 08 10:28:01.888336 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1543/3270] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:01 2022] POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:28:01.903995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:01.905592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:01.919996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.921700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.922772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.923892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:01.925891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:01.926909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:01.964420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:02.073276 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14e37a3a-2cc9-4ea1-8b09-7ee71c1d2e77 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 204 len: 0 microversion: 2.1 time: 0.181239 Sep 08 10:28:02.079758 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1544/3271] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:01 2022] DELETE /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:02.086911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a339c74-9b14-4199-a2d1-7ce45fb73231 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f2351248a60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.217439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:02.228409 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5788cd87-1efc-41c6-9765-56ee3f17b92b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1506 microversion: 2.1 time: 0.395763 Sep 08 10:28:02.229069 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1728/3272] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:01 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:02.234855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bac875f7-19da-4640-b4c4-c6a347bda659 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.266644 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bac875f7-19da-4640-b4c4-c6a347bda659 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/211e2341-1dc9-41cc-a138-f30362132e53" status: 204 len: 0 microversion: 2.1 time: 0.036260 Sep 08 10:28:02.267835 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1729/3273] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:02 2022] DELETE /compute/v2.1/os-server-groups/211e2341-1dc9-41cc-a138-f30362132e53 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:02.274128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-28084115"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:02.276743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:02.283812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.284413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.284925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.285704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.286348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.286780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.319674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Cannot 'createImage' instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 while it is in task_state image_snapshot Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action HTTP/1.1 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 83 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-28084115"}} Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot 'createImage' instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 while it is in task_state image_snapshot Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-28084115'}}} Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:28:02.321888 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 while it is in task_state image_snapshot Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 while it is in task_state image_snapshot Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 409 to user: Cannot 'createImage' instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 while it is in task_state image_snapshot {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e540e1a-3fbb-454e-b29b-e4a17b2eb0bb tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action" status: 409 len: 159 microversion: 2.1 time: 0.054297 Sep 08 10:28:02.326536 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1730/3274] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:02 2022] POST /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444/action => generated 159 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:28:02.329344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.329957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:02.336195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.336681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.337123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.337813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.338273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.338694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.598535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:02.606434 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a339c74-9b14-4199-a2d1-7ce45fb73231 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/5cc51682-71fc-4027-b1a4-6d1a9f2a7c45" status: 202 len: 0 microversion: 2.1 time: 0.524323 Sep 08 10:28:02.607132 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1545/3275] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:28:02 2022] DELETE /compute/v2.1/os-security-groups/5cc51682-71fc-4027-b1a4-6d1a9f2a7c45 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:02.612832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:02.613517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-780bdaf2-5ed0-4e9d-8e37-8d0e0d43eb84 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1508 microversion: 2.1 time: 0.287249 Sep 08 10:28:02.615770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:02.616463 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1731/3276] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:02 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:02.622619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25c328ed-228d-423b-bae7-ac3c0b077e3a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.639747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.640333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.640855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.641756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.642220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.642544 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25c328ed-228d-423b-bae7-ac3c0b077e3a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.023025 Sep 08 10:28:02.642802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.643533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1732/3277] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:28:02 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:02.651600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59ba7f2b-cd9e-4b35-aa36-2a2696aefde8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '.version_select at 0x7f2351424670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.728104 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-119c07c6-3338-4b63-82b0-e8bf95261175 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "PUT /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1082 microversion: 2.1 time: 0.119684 Sep 08 10:28:02.740350 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1546/3278] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:28:02 2022] PUT /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1082 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:02.745729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7f1ca377-fe18-4e15-a952-74b768737478 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f2355370ca0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.789937 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59ba7f2b-cd9e-4b35-aa36-2a2696aefde8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/images/f3c2a21e-4647-4a52-b7ea-5e269a37bcfd" status: 204 len: 0 microversion: 2.1 time: 0.144281 Sep 08 10:28:02.790521 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1733/3279] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:02 2022] DELETE /compute/v2.1/images/f3c2a21e-4647-4a52-b7ea-5e269a37bcfd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:02.795222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78c78912-c7e1-4dbc-bdc4-e2e38fce78ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Action: 'create', calling method: .version_select at 0x7f2351086b80>, body: {"server_group": {"name": "tempest-server-group-1020877087", "policies": ["anti-affinity"]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:02.814103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-78c78912-c7e1-4dbc-bdc4-e2e38fce78ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:02.820204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-78c78912-c7e1-4dbc-bdc4-e2e38fce78ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:02.865684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-78c78912-c7e1-4dbc-bdc4-e2e38fce78ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:02.871790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-78c78912-c7e1-4dbc-bdc4-e2e38fce78ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_groups'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:02.885606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78c78912-c7e1-4dbc-bdc4-e2e38fce78ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.094035 Sep 08 10:28:02.886461 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1734/3280] 10.222.0.59 () {60 vars in 1173 bytes} [Thu Sep 8 10:28:02 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:02.891134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:02.892008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:02.897671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.898157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.899164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:02.899902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:02.900356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:02.900784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.162196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:03.170890 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8b8ade12-fd1a-48b3-bca5-59525e5d5177 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1508 microversion: 2.1 time: 0.283216 Sep 08 10:28:03.171746 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1735/3281] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:02 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:03.188737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.189430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:03.191400 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7f1ca377-fe18-4e15-a952-74b768737478 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/385911ed-8cbc-4e90-9d6e-403d2388b172" status: 202 len: 0 microversion: 2.1 time: 0.452351 Sep 08 10:28:03.192718 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1547/3282] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:28:02 2022] DELETE /compute/v2.1/os-security-groups/385911ed-8cbc-4e90-9d6e-403d2388b172 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:03.197714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.198310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.198442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.198634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.199034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:03.199540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.200114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.200547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.205498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.206090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.206525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.207253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.207713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.208148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.489433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:03.498271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74147e12-5444-47b8-ab48-81cdda15e46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1533 microversion: 2.1 time: 0.304159 Sep 08 10:28:03.506381 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1548/3283] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:03 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1533 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:03.506381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-656fa625-3047-458f-8a76-921f710c9748 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.508501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:03.516664 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20edc461-dd37-4f10-8c99-bbbca4d381ff tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.332356 Sep 08 10:28:03.517250 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1736/3284] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:03 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:03.524394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.527506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:03.539186 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-656fa625-3047-458f-8a76-921f710c9748 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/6f12ecf1-a515-455d-92fe-b551cac7a4cf" status: 204 len: 0 microversion: 2.1 time: 0.038356 Sep 08 10:28:03.539980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.540386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.541093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.541976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.542097 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1549/3285] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:03 2022] DELETE /compute/v2.1/os-server-groups/6f12ecf1-a515-455d-92fe-b551cac7a4cf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:03.542962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.543674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.548263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34e958b6-ec26-4bb8-9879-366c173986d6 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] Calling method '.version_select at 0x7f23508675e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.811888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:03.819852 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6a34880-574a-4980-b0d2-8ea36322da68 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1508 microversion: 2.1 time: 0.300326 Sep 08 10:28:03.820958 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1737/3286] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:03 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:03.825543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-94265360-4ce5-45bc-adef-63fe98336496 req-8b1fb8a9-9453-4766-9c7a-14b0e3cb10ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae6e08b-1d05-4cf7-a9c0-c19b64c15007", "tag": "9c4ca470-d6ff-437b-8710-29c8d5a6b880"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:03.835707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94265360-4ce5-45bc-adef-63fe98336496 req-8b1fb8a9-9453-4766-9c7a-14b0e3cb10ea service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.836766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94265360-4ce5-45bc-adef-63fe98336496 req-8b1fb8a9-9453-4766-9c7a-14b0e3cb10ea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.837212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94265360-4ce5-45bc-adef-63fe98336496 req-8b1fb8a9-9453-4766-9c7a-14b0e3cb10ea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.849721 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-94265360-4ce5-45bc-adef-63fe98336496 req-8b1fb8a9-9453-4766-9c7a-14b0e3cb10ea service nova] Creating event network-changed:9c4ca470-d6ff-437b-8710-29c8d5a6b880 for instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 on n-h2-833090-19 Sep 08 10:28:03.855840 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-94265360-4ce5-45bc-adef-63fe98336496 req-8b1fb8a9-9453-4766-9c7a-14b0e3cb10ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033608 Sep 08 10:28:03.857134 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1738/3287] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:03.864254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3147fb4-53fe-4c03-af2b-8456da8aba14 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.871116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:03.877472 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3147fb4-53fe-4c03-af2b-8456da8aba14 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.018805 Sep 08 10:28:03.878589 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1739/3288] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:28:03 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:03.883528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.885412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:03.892781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.893641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.894491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.895662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.896129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.896559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.981848 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34e958b6-ec26-4bb8-9879-366c173986d6 tempest-SecurityGroupRulesNegativeTestJSON-61471033 tempest-SecurityGroupRulesNegativeTestJSON-61471033-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/952f81e7-2767-4cee-8497-909a67571371" status: 202 len: 0 microversion: 2.1 time: 0.438168 Sep 08 10:28:03.982563 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1550/3289] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:28:03 2022] DELETE /compute/v2.1/os-security-groups/952f81e7-2767-4cee-8497-909a67571371 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:28:03.988429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:03.989003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:03.996452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.997102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.997550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:03.998261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:03.998716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:03.999171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.030064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:04.104673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:04.143654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-053a8622-03ae-4628-9af7-15a3d705d9f6 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "DELETE /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 204 len: 0 microversion: 2.1 time: 0.159657 Sep 08 10:28:04.144325 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1551/3290] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:03 2022] DELETE /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:04.152393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-726065270", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "cab68ce7-7aef-4e35-9806-ccd7e861e8f8"}]}, "os:scheduler_hints": {"group": "62574170-ec20-4d69-9e91-65ac8bc32328"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:04.162396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:04.171372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8f5a5cd-3244-409b-8554-0b499dcd1367 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1508 microversion: 2.1 time: 0.291791 Sep 08 10:28:04.172425 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1740/3291] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:03 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:04.190354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:04.191103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:04.198401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.199131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.199811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.200705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.201966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.202568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.227522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] validate_networks() for [('cab68ce7-7aef-4e35-9806-ccd7e861e8f8', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:04.241476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:04.309708 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.compute.api [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Instance is already in deleting state, ignoring this request Sep 08 10:28:04.310751 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-835e80df-dce8-44c7-b1a2-721f215a51c3 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "DELETE /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 204 len: 0 microversion: 2.1 time: 0.137129 Sep 08 10:28:04.311632 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1741/3292] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:04 2022] DELETE /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:04.319606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:04.321173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:04.328052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.328533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.328978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.329734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.330171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.330794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.538282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:04.548337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b827f50d-d54c-45e1-b579-ab5dad90d095 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1514 microversion: 2.1 time: 0.232718 Sep 08 10:28:04.549227 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1742/3293] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:04 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:04.556189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:04.556189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:04.563239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.564264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.564911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.565895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.566510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.567248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.794044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:04.803118 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b602c1e-ccdc-4b57-bb25-8b8378c81e5a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1533 microversion: 2.1 time: 0.252520 Sep 08 10:28:04.815683 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1743/3294] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:04 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1533 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:04.815683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:04.815683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:04.816694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.817187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.817631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.818465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.818934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.819366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.849042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:04.849612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:04.850189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:04.850700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:04.851223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:04.874655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.875334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.875935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.876817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:04.877377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:04.878455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:04.897142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:04.902617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:04.924056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:04.926741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:04.970740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:04.976272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:04.981200 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72775793-5eb8-42a1-b3fb-3727c45617d2 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.175082 Sep 08 10:28:04.991535 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1744/3295] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:04 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:04.991903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:04.991903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:05.037043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:05.043205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Getting quotas for user 2a657ffe97bb40da9d1664162ddd3c07 and project ad1120a50d0c440ba3580ad6ce3aded4. Resources: {'server_group_members'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:05.082026 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-25525cde-7695-45d4-b2a9-a4607cc154ca tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935903 Sep 08 10:28:05.090407 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1552/3296] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:28:05.095534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-132a9a50-c26a-40ed-8fff-32a4edb99445 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:05.096189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-132a9a50-c26a-40ed-8fff-32a4edb99445 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:05.167234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-132a9a50-c26a-40ed-8fff-32a4edb99445 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:05.175330 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-132a9a50-c26a-40ed-8fff-32a4edb99445 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1212 microversion: 2.1 time: 0.084503 Sep 08 10:28:05.176256 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1745/3297] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:05 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:05.197724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:05.198454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:05.205577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:05.206168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:05.207720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:05.208593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:05.209156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:05.209658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:05.370136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:05.380309 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-881cea10-5f23-415d-a4ec-b0a921ffed3d tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1508 microversion: 2.1 time: 0.187086 Sep 08 10:28:05.381314 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1553/3298] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:05 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:05.573071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:05.574068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:05.580065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:05.580413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:05.581084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:05.582040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:05.582583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:05.583009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:05.613224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:05.829448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:05.830111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:05.837224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:05.838038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:05.838611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:05.839321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:05.839987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:05.840413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:05.871014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:05.881226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76a4e23b-8f79-4f96-9866-4232c9eae1c9 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1514 microversion: 2.1 time: 0.312598 Sep 08 10:28:05.884146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1746/3299] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:05 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:06.005766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:06.006304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:06.020568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:06.021658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:06.022599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:06.025084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:06.025950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:06.026547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:06.447625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:06.479183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:06.484367 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d61e8df2-eec2-4dbd-b5fe-34406af09556 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1533 microversion: 2.1 time: 0.657598 Sep 08 10:28:06.486903 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1554/3300] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:05 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1533 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:06.505409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:06.508505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:06.510325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e699e8cd-db6c-4421-b3a3-b81f2414e4de tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.508562 Sep 08 10:28:06.516719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1747/3301] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:06 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:06.547743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:06.549673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:06.551926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:06.552765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:06.553326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:06.553539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:06.554257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:06.554836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:06.569673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:06.570387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:06.571934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:06.572800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:06.574516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:06.579111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.194143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:07.209438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2fea40c9-f8e9-4b48-964d-0a2aaf514983 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1264 microversion: 2.1 time: 0.721013 Sep 08 10:28:07.211616 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1555/3302] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:06 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1264 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:07.224928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-16ed0e32-9c2b-41c3-a5cc-e7aaee690095 req-8d5cdc9f-d48b-48f8-b1a0-f533c4940402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d47410-6b13-4157-a683-1cb5ab1c5171", "name": "network-vif-deleted", "tag": "c78f099d-9515-447e-9ee3-ef3dfa8bac6d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:07.238294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-16ed0e32-9c2b-41c3-a5cc-e7aaee690095 req-8d5cdc9f-d48b-48f8-b1a0-f533c4940402 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.239003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-16ed0e32-9c2b-41c3-a5cc-e7aaee690095 req-8d5cdc9f-d48b-48f8-b1a0-f533c4940402 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.239643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-16ed0e32-9c2b-41c3-a5cc-e7aaee690095 req-8d5cdc9f-d48b-48f8-b1a0-f533c4940402 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.259060 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-16ed0e32-9c2b-41c3-a5cc-e7aaee690095 req-8d5cdc9f-d48b-48f8-b1a0-f533c4940402 service nova] Creating event network-vif-deleted:c78f099d-9515-447e-9ee3-ef3dfa8bac6d for instance 77d47410-6b13-4157-a683-1cb5ab1c5171 on n-h1-833090-19 Sep 08 10:28:07.265956 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-16ed0e32-9c2b-41c3-a5cc-e7aaee690095 req-8d5cdc9f-d48b-48f8-b1a0-f533c4940402 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052787 Sep 08 10:28:07.267388 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1556/3303] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:07.275545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:07.276509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:07.285570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.286311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.286748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.287695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.288492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.289546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.359521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.360586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.361665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.362710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lazy-loading 'fault' on Instance uuid 77d47410-6b13-4157-a683-1cb5ab1c5171 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:28:07.366692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:07.381031 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15474185-a2de-4f19-beb0-7b3175d8ad61 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1508 microversion: 2.1 time: 0.843654 Sep 08 10:28:07.381621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1748/3304] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:06 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:07.448335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0218f274eff54ce8bf63b54e39df1820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fac3ab51d9049bea3393313680eb6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:07.456965 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6834c670-bf65-48c9-813c-26175163e31b tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 200 len: 1308 microversion: 2.1 time: 0.187294 Sep 08 10:28:07.457561 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1557/3305] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:07 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:07.516030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:07.518807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:07.537344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:07.538409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:07.544251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.548878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.549837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.550984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.552907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.553918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.556444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.560814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.561543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:07.564084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:07.564696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:07.565243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.208895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:08.230707 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-21e4f6ca-acd5-4a8b-8822-bb1430787e9b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1533 microversion: 2.1 time: 0.719974 Sep 08 10:28:08.246418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1749/3306] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:07 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1533 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:08.259867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-30bf3a2f-0787-408f-a03f-f7e413aad1a9 req-271f9c7d-11e6-4391-8731-d4efc00330d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c163e66-1e2e-4fdb-b112-e878cbdf2662", "name": "network-vif-deleted", "tag": "a4c67f93-78a8-4ab7-939a-dfea0dd47841"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:08.280759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:08.291445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-30bf3a2f-0787-408f-a03f-f7e413aad1a9 req-271f9c7d-11e6-4391-8731-d4efc00330d5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.292253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-593380ba-31f6-49fa-82c2-0b6d4cc9c419 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.761291 Sep 08 10:28:08.293688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-30bf3a2f-0787-408f-a03f-f7e413aad1a9 req-271f9c7d-11e6-4391-8731-d4efc00330d5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.294602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-30bf3a2f-0787-408f-a03f-f7e413aad1a9 req-271f9c7d-11e6-4391-8731-d4efc00330d5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.320801 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1558/3307] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:07 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:08.328166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.328926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.342232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.342724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.343163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.343934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.344393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.344823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.351257 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-30bf3a2f-0787-408f-a03f-f7e413aad1a9 req-271f9c7d-11e6-4391-8731-d4efc00330d5 service nova] Creating event network-vif-deleted:a4c67f93-78a8-4ab7-939a-dfea0dd47841 for instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 on n-h1-833090-19 Sep 08 10:28:08.399841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-30bf3a2f-0787-408f-a03f-f7e413aad1a9 req-271f9c7d-11e6-4391-8731-d4efc00330d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143961 Sep 08 10:28:08.404561 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1750/3308] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:08.446179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.448699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.475787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.476418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.476791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.480762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.481257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.481714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.614724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.616133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.619719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.620587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lazy-loading 'fault' on Instance uuid 3c163e66-1e2e-4fdb-b112-e878cbdf2662 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:28:08.707020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b57454fca148df87413c061b96f431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ce418fdf848f78fdd52ab736dbf94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:08.715064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1255bbc4-f669-4011-8b53-a649ff085ffc tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 200 len: 1312 microversion: 2.1 time: 0.293277 Sep 08 10:28:08.715797 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1751/3309] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:08 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:08.721491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-843b9d1c-7853-4a0d-87e2-4ceff2d41b5e req-d3ff7852-cdbf-4fb4-a9e3-f33210d66c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4fcebd-7236-4534-bc3d-aa90843d1444", "name": "network-vif-plugged", "status": "completed", "tag": "654eeb6e-28bf-463d-8995-0090b5b3fdd6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:08.739355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-843b9d1c-7853-4a0d-87e2-4ceff2d41b5e req-d3ff7852-cdbf-4fb4-a9e3-f33210d66c4b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.740198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-843b9d1c-7853-4a0d-87e2-4ceff2d41b5e req-d3ff7852-cdbf-4fb4-a9e3-f33210d66c4b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.740888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-843b9d1c-7853-4a0d-87e2-4ceff2d41b5e req-d3ff7852-cdbf-4fb4-a9e3-f33210d66c4b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.756616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-843b9d1c-7853-4a0d-87e2-4ceff2d41b5e req-d3ff7852-cdbf-4fb4-a9e3-f33210d66c4b service nova] Creating event network-vif-plugged:654eeb6e-28bf-463d-8995-0090b5b3fdd6 for instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 on n-h2-833090-19 Sep 08 10:28:08.763451 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-843b9d1c-7853-4a0d-87e2-4ceff2d41b5e req-d3ff7852-cdbf-4fb4-a9e3-f33210d66c4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045030 Sep 08 10:28:08.764577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1752/3310] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:08.771731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.772741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 77d47410-6b13-4157-a683-1cb5ab1c5171] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.779767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.780513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.781205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.782134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.782755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.783183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.797897 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] HTTP exception thrown: Instance 77d47410-6b13-4157-a683-1cb5ab1c5171 could not be found. Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Request method failure captured: Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 HTTP/1.1 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcL3Dg81pXl82nqXwgGdCOEG2LIlyuKkSBlhdjvtPYXPawP6_TcnCin7zfrv3RS-jVBofT-_mZSPGKu--9Rcrt2RCYmlhs2k8khdat74MF58D1UN2xxtlavukWbU9AI7utk0vVB25U22t6H05EddPfilB3GE7l_iS17w7usGI6jpQf0 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0fac3ab51d9049bea3393313680eb6ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0218f274eff54ce8bf63b54e39df1820 Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 77d47410-6b13-4157-a683-1cb5ab1c5171 could not be found. Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '77d47410-6b13-4157-a683-1cb5ab1c5171'} Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d47410-6b13-4157-a683-1cb5ab1c5171 could not be found. Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d47410-6b13-4157-a683-1cb5ab1c5171 could not be found. Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.799960 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d47410-6b13-4157-a683-1cb5ab1c5171 could not be found. Sep 08 10:28:08.805437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.806764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Returning 404 to user: Instance 77d47410-6b13-4157-a683-1cb5ab1c5171 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:08.807901 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f9c553d8-9363-449f-914c-b6513a42c490 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171" status: 404 len: 111 microversion: 2.1 time: 0.041646 Sep 08 10:28:08.810998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:08.815960 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1753/3311] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:08 2022] GET /compute/v2.1/servers/77d47410-6b13-4157-a683-1cb5ab1c5171 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:08.822234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c09df9a5-f476-4471-b462-dfd6b3911dab tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1312 microversion: 2.1 time: 0.499708 Sep 08 10:28:08.823528 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1559/3312] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:08 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1312 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:08.829112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.829646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.842233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.843995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.844481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.845191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.845651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.846082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.863099 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] HTTP exception thrown: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Request method failure captured: Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 HTTP/1.1 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcL3Dg81pXl82nqXwgGdCOEG2LIlyuKkSBlhdjvtPYXPawP6_TcnCin7zfrv3RS-jVBofT-_mZSPGKu--9Rcrt2RCYmlhs2k8khdat74MF58D1UN2xxtlavukWbU9AI7utk0vVB25U22t6H05EddPfilB3GE7l_iS17w7usGI6jpQf0 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0fac3ab51d9049bea3393313680eb6ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0218f274eff54ce8bf63b54e39df1820 Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07'} Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:08.865681 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Returning 404 to user: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce445a6b-7fd9-4e43-91c8-faa5c3bfa704 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "DELETE /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 404 len: 111 microversion: 2.1 time: 0.045259 Sep 08 10:28:08.870475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1754/3313] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:08 2022] DELETE /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:28:08.876609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.877233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.887117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.887657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.888293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.889015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.889472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.889908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.905248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] HTTP exception thrown: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Request method failure captured: Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 HTTP/1.1 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcL3Dg81pXl82nqXwgGdCOEG2LIlyuKkSBlhdjvtPYXPawP6_TcnCin7zfrv3RS-jVBofT-_mZSPGKu--9Rcrt2RCYmlhs2k8khdat74MF58D1UN2xxtlavukWbU9AI7utk0vVB25U22t6H05EddPfilB3GE7l_iS17w7usGI6jpQf0 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0fac3ab51d9049bea3393313680eb6ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0218f274eff54ce8bf63b54e39df1820 Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07'} Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.906952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. Sep 08 10:28:08.911308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.913108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Returning 404 to user: Instance 00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:08.914536 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7899f5e-ac04-48e5-afd1-e7ccb13890b4 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07" status: 404 len: 111 microversion: 2.1 time: 0.041585 Sep 08 10:28:08.915200 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1560/3314] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:08 2022] GET /compute/v2.1/servers/00d73e01-e4a0-4f57-bc58-bf3dc7ccdc07 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:08.923501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.924306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.931358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.931885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.932323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.933368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.933902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.934413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.953530 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] HTTP exception thrown: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Request method failure captured: Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 HTTP/1.1 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcL3Dg81pXl82nqXwgGdCOEG2LIlyuKkSBlhdjvtPYXPawP6_TcnCin7zfrv3RS-jVBofT-_mZSPGKu--9Rcrt2RCYmlhs2k8khdat74MF58D1UN2xxtlavukWbU9AI7utk0vVB25U22t6H05EddPfilB3GE7l_iS17w7usGI6jpQf0 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0fac3ab51d9049bea3393313680eb6ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0218f274eff54ce8bf63b54e39df1820 Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'fb87b182-a7ea-4da4-9c78-b82f740179f8'} Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:08.955226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Returning 404 to user: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:08.960000 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-13eaeaa5-ac66-4f1b-9450-3b71c375cc17 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 404 len: 111 microversion: 2.1 time: 0.037160 Sep 08 10:28:08.962067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1755/3315] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:08 2022] DELETE /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:08.968846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:08.969588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] [instance: fb87b182-a7ea-4da4-9c78-b82f740179f8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:08.976631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.977268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.977749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.978733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:08.979254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:08.979788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:08.996974 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] HTTP exception thrown: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Request method failure captured: Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 HTTP/1.1 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcL3Dg81pXl82nqXwgGdCOEG2LIlyuKkSBlhdjvtPYXPawP6_TcnCin7zfrv3RS-jVBofT-_mZSPGKu--9Rcrt2RCYmlhs2k8khdat74MF58D1UN2xxtlavukWbU9AI7utk0vVB25U22t6H05EddPfilB3GE7l_iS17w7usGI6jpQf0 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0fac3ab51d9049bea3393313680eb6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0fac3ab51d9049bea3393313680eb6ac", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0fac3ab51d9049bea3393313680eb6ac Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1743047697 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0218f274eff54ce8bf63b54e39df1820 Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerDiskConfigTestJSON-1743047697-project Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'fb87b182-a7ea-4da4-9c78-b82f740179f8'} Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:08.998655 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] Returning 404 to user: Instance fb87b182-a7ea-4da4-9c78-b82f740179f8 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:09.002641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fdef44a6-45c7-4383-85d7-65ab20f13e57 tempest-ServerDiskConfigTestJSON-1743047697 tempest-ServerDiskConfigTestJSON-1743047697-project] 10.222.0.59 "GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8" status: 404 len: 111 microversion: 2.1 time: 0.035196 Sep 08 10:28:09.005102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1561/3316] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:08 2022] GET /compute/v2.1/servers/fb87b182-a7ea-4da4-9c78-b82f740179f8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:09.262878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:09.263527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:09.277465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.278212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.278833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.279883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.284206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.285106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.308200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-870ef1c3-3031-417e-b390-1aedda9821d4 req-275095bd-95d9-4988-afc5-490f31f5f0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddb7826-f34b-49f6-895d-55c91e3d02e6", "tag": "fd7eb266-d8a0-4295-bdae-1e3be7c8ce71"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:09.324961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-870ef1c3-3031-417e-b390-1aedda9821d4 req-275095bd-95d9-4988-afc5-490f31f5f0d5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.327545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-870ef1c3-3031-417e-b390-1aedda9821d4 req-275095bd-95d9-4988-afc5-490f31f5f0d5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.328236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-870ef1c3-3031-417e-b390-1aedda9821d4 req-275095bd-95d9-4988-afc5-490f31f5f0d5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.344466 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-870ef1c3-3031-417e-b390-1aedda9821d4 req-275095bd-95d9-4988-afc5-490f31f5f0d5 service nova] Creating event network-changed:fd7eb266-d8a0-4295-bdae-1e3be7c8ce71 for instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 on n-h1-833090-19 Sep 08 10:28:09.355056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-870ef1c3-3031-417e-b390-1aedda9821d4 req-275095bd-95d9-4988-afc5-490f31f5f0d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051934 Sep 08 10:28:09.356764 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1562/3317] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:09.363554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:09.364259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:09.375663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.376258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.376775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.377719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.378359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.378867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.702819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:09.712498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9dc2edb5-2dd5-4081-8a72-95327cb582c7 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1539 microversion: 2.1 time: 0.455574 Sep 08 10:28:09.713420 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1756/3318] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:09 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1539 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:09.746524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:09.747059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] [instance: 3c163e66-1e2e-4fdb-b112-e878cbdf2662] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:09.753424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.754166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.754603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.755303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.755914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.756345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.771715 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] HTTP exception thrown: Instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 could not be found. Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Request method failure captured: Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 HTTP/1.1 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcNX8qABY--_4g5b7HgeYgQBYzvjL23PQXD_Op0SHHNEgZBxJtehRdivASnFvNUsQeEybOJeJzCGCMkDtDjGEAoeeWQaHIlDruabpaIx8K8z7mRGI8ieYpe-EdO_YPGyzgSy546_b0xUb3Zwcz7jjUbtN5lRaVnRfye1nZ5illiBVl0 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: fc7ce418fdf848f78fdd52ab736dbf94 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-527888413 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fc7ce418fdf848f78fdd52ab736dbf94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fc7ce418fdf848f78fdd52ab736dbf94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fc7ce418fdf848f78fdd52ab736dbf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fc7ce418fdf848f78fdd52ab736dbf94", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-527888413 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: fc7ce418fdf848f78fdd52ab736dbf94 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-527888413 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueTestJSONUnderV235-527888413-project Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 07b57454fca148df87413c061b96f431 Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-527888413-project Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 could not be found. Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3c163e66-1e2e-4fdb-b112-e878cbdf2662'} Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 could not be found. Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 could not be found. Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.774886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 could not be found. Sep 08 10:28:09.780190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:09.780694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] Returning 404 to user: Instance 3c163e66-1e2e-4fdb-b112-e878cbdf2662 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:09.783442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d88b126a-3bd8-4d93-84bb-c952e12b85b7 tempest-ServerRescueTestJSONUnderV235-527888413 tempest-ServerRescueTestJSONUnderV235-527888413-project] 10.222.0.59 "GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662" status: 404 len: 111 microversion: 2.1 time: 0.040324 Sep 08 10:28:09.787593 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1757/3319] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:09 2022] GET /compute/v2.1/servers/3c163e66-1e2e-4fdb-b112-e878cbdf2662 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:28:09.812868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:09.832433 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f2d843c8-fb8f-4761-aab8-28db45d64780 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.472394 Sep 08 10:28:09.833216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1563/3320] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:09 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:09.847614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:09.848909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:09.857432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.858717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.859339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:09.860248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:09.861024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:09.861735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:10.207227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:10.216839 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2df6e89-b763-4d3d-a79a-32bd865cb6ce tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1312 microversion: 2.1 time: 0.373722 Sep 08 10:28:10.231539 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1758/3321] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:09 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:10.738460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:10.743652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:10.754864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:10.755750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:10.757068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:10.759040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:10.759958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:10.760621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:10.859309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:10.860976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:10.874451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:10.875070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:10.875654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:10.876475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:10.877197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:10.877843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:11.435240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:11.455718 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91b2cf47-ac2c-4d8f-b147-d56cea2b5aa3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1539 microversion: 2.1 time: 0.721559 Sep 08 10:28:11.456238 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1564/3322] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:10 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1539 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:11.465389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:11.466246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:11.474664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:11.475304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:11.475957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:11.477280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:11.477778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:11.478283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:11.602520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:11.618528 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19be89ed-9886-4721-a0f2-78d413fe2a47 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.763954 Sep 08 10:28:11.624122 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1759/3323] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:10 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:11.636543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5dcae902-2658-4a42-aca8-156a8f8d0de3 req-7ff050ef-6c4d-4455-b4f5-06a0259bbde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae6e08b-1d05-4cf7-a9c0-c19b64c15007", "name": "network-vif-plugged", "status": "completed", "tag": "9c4ca470-d6ff-437b-8710-29c8d5a6b880"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:11.676571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5dcae902-2658-4a42-aca8-156a8f8d0de3 req-7ff050ef-6c4d-4455-b4f5-06a0259bbde6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:11.677488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5dcae902-2658-4a42-aca8-156a8f8d0de3 req-7ff050ef-6c4d-4455-b4f5-06a0259bbde6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:11.678554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5dcae902-2658-4a42-aca8-156a8f8d0de3 req-7ff050ef-6c4d-4455-b4f5-06a0259bbde6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:11.695398 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5dcae902-2658-4a42-aca8-156a8f8d0de3 req-7ff050ef-6c4d-4455-b4f5-06a0259bbde6 service nova] Creating event network-vif-plugged:9c4ca470-d6ff-437b-8710-29c8d5a6b880 for instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 on n-h2-833090-19 Sep 08 10:28:11.701288 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5dcae902-2658-4a42-aca8-156a8f8d0de3 req-7ff050ef-6c4d-4455-b4f5-06a0259bbde6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074924 Sep 08 10:28:11.706576 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1760/3324] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:11.922289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:11.932222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb2a56e1-6b85-4b49-bbf9-4f03e661b153 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1312 microversion: 2.1 time: 0.471426 Sep 08 10:28:11.933623 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1565/3325] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:11 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:12.482072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:12.484022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:12.510384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:12.512302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:12.513018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:12.513945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:12.516248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:12.516939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:12.658851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:12.659647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:12.687990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:12.688489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:12.689180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:12.689991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:12.690532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:12.691991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:13.149673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:13.157232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:13.176364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f99ab038-8b48-4e63-bd9c-ceaa7459da2d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.527395 Sep 08 10:28:13.183289 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1566/3326] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:12 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:13.184553 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95c49bda-348f-43a1-96f4-5714eed4108c tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1539 microversion: 2.1 time: 0.705765 Sep 08 10:28:13.187346 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1761/3327] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:12 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1539 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:13.193646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:13.194556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:13.221277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:13.222646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:13.224055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:13.227438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:13.228226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:13.229747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:13.563668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:13.585307 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd107ce5-0895-416d-8357-7f9852c1da82 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1312 microversion: 2.1 time: 0.397672 Sep 08 10:28:13.600529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1567/3328] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:13 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:14.207491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:14.208635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:14.214192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:14.215441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:14.223820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.224398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.224848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.225555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.225699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.226020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.226441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.226918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.228261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.229268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.230842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.231476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.558875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:14.586036 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58013116-15ff-43a4-8f8d-31c550e16cd8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1539 microversion: 2.1 time: 0.377021 Sep 08 10:28:14.610665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1568/3329] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:14 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1539 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:14.617837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:14.644039 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7993ae85-cbd0-4b6e-ac7e-a77fcc905ccc tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1323 microversion: 2.1 time: 0.441073 Sep 08 10:28:14.644377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-803181a3-48ac-48b5-ab71-617d4ad40d95 req-62a364ed-eadd-4d73-92ae-a47f8850f61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddb7826-f34b-49f6-895d-55c91e3d02e6", "name": "network-vif-plugged", "status": "completed", "tag": "fd7eb266-d8a0-4295-bdae-1e3be7c8ce71"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:14.645103 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1762/3330] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:14 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:14.650474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:14.658274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:14.661700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-803181a3-48ac-48b5-ab71-617d4ad40d95 req-62a364ed-eadd-4d73-92ae-a47f8850f61b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.669960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-803181a3-48ac-48b5-ab71-617d4ad40d95 req-62a364ed-eadd-4d73-92ae-a47f8850f61b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.672369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-803181a3-48ac-48b5-ab71-617d4ad40d95 req-62a364ed-eadd-4d73-92ae-a47f8850f61b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.677871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.678345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.678958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.680423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:14.681134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:14.681716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:14.690505 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-803181a3-48ac-48b5-ab71-617d4ad40d95 req-62a364ed-eadd-4d73-92ae-a47f8850f61b service nova] Creating event network-vif-plugged:fd7eb266-d8a0-4295-bdae-1e3be7c8ce71 for instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 on n-h1-833090-19 Sep 08 10:28:14.697052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-803181a3-48ac-48b5-ab71-617d4ad40d95 req-62a364ed-eadd-4d73-92ae-a47f8850f61b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082194 Sep 08 10:28:14.703017 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1569/3331] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:14.975757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:14.987743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-638c2682-3ec6-45fe-a146-3827be01d375 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1312 microversion: 2.1 time: 0.341314 Sep 08 10:28:15.006017 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1763/3332] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:14 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:15.624019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:15.625464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:15.635163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:15.645858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:15.657195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:15.659418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:15.661537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:15.663651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:15.665320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:15.666033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:15.678981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:15.680833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:15.687161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=26 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:15.705020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:15.707741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:15.709960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:15.711311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:15.713588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:15.714672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:16.562444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:16.573159 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8887195b-18f3-47e9-9990-11849eef98a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 200 len: 1518 microversion: 2.1 time: 0.899949 Sep 08 10:28:16.578978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1764/3333] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:15 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 1518 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:16.603260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:16.603921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:16.612656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:16.613574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:16.614208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:16.615734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:16.616727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:16.617965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:16.645285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:16.656292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45e6a103-9a95-4fa0-97d0-a1cb2ee381e9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1521 microversion: 2.1 time: 1.039330 Sep 08 10:28:16.673552 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1570/3334] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:15 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1521 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:16.684206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.184"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:16.687364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:16.695002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:16.695980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:16.696735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:16.697811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:16.698530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:16.699272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:16.732450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:28:16.733038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquired lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:28:16.975153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:16.984706 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c732a90-4515-4d6b-9c83-5d5e73c05cee tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1498 microversion: 2.1 time: 0.399054 Sep 08 10:28:16.985497 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1765/3335] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:16 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:16.993029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:16.996290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:17.010275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.012963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.013667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.015952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.016699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.017539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.100287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:17.153605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:17.240836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0b57f12-6d88-465f-9362-6eb9b1dee0f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 204 len: 0 microversion: 2.1 time: 0.251168 Sep 08 10:28:17.241599 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1766/3336] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:16 2022] DELETE /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:17.249818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8dd8c604-f07c-418d-b165-d8e21c615990 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:17.273703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.server_groups [None req-8dd8c604-f07c-418d-b165-d8e21c615990 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Querying cell 52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) for 1 instances {{(pid=122457) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:28:17.274860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dd8c604-f07c-418d-b165-d8e21c615990 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.276261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dd8c604-f07c-418d-b165-d8e21c615990 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.277029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dd8c604-f07c-418d-b165-d8e21c615990 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.321592 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8dd8c604-f07c-418d-b165-d8e21c615990 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/62574170-ec20-4d69-9e91-65ac8bc32328" status: 200 len: 220 microversion: 2.1 time: 0.077596 Sep 08 10:28:17.326205 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1767/3337] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:28:17 2022] GET /compute/v2.1/os-server-groups/62574170-ec20-4d69-9e91-65ac8bc32328 => generated 220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:17.332855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:17.333763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:17.343726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.344444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.345090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.346387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.347010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.347628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.654681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:17.669683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c434ee8c-e938-438e-b0f7-294c06520885 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1527 microversion: 2.1 time: 0.342048 Sep 08 10:28:17.672237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1768/3338] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:17 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1527 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:17.678873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:17.686472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:17.726530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.729472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.733381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.734875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:17.738450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:17.738965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:17.804870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:17.986013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19f3fb0e-dc0f-47af-bc1a-a2d63c7a3982 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 204 len: 0 microversion: 2.1 time: 0.310648 Sep 08 10:28:17.986684 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1769/3339] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:17 2022] DELETE /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:17.999884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:18.000655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:18.022036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:18.023064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:18.024271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:18.025192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:18.025830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:18.026469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:18.505485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:18.520384 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb5bb935-16e4-40d7-b3c1-7aaa114b9bac tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1504 microversion: 2.1 time: 0.526462 Sep 08 10:28:18.523389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1770/3340] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:17 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:18.705677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:18.706303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:18.717860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:18.718413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:18.720430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:18.721241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:18.721715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:18.722148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:19.236740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:19.249739 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c84a0422-08c2-424e-ba5a-a95e2bd4770d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1527 microversion: 2.1 time: 0.549319 Sep 08 10:28:19.250335 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1771/3341] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:18 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1527 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:19.468505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Building network info cache for instance {{(pid=122456) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:28:19.470983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:19.501167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4a82c700-297a-4424-b3b5-b7c6e918fafb req-b6cebca2-30c9-47eb-a0eb-9091623f8c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:19.518767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4a82c700-297a-4424-b3b5-b7c6e918fafb req-b6cebca2-30c9-47eb-a0eb-9091623f8c67 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:19.528247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4a82c700-297a-4424-b3b5-b7c6e918fafb req-b6cebca2-30c9-47eb-a0eb-9091623f8c67 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:19.528930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4a82c700-297a-4424-b3b5-b7c6e918fafb req-b6cebca2-30c9-47eb-a0eb-9091623f8c67 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:19.553139 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4a82c700-297a-4424-b3b5-b7c6e918fafb req-b6cebca2-30c9-47eb-a0eb-9091623f8c67 service nova] Creating event network-changed:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:28:19.564027 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4a82c700-297a-4424-b3b5-b7c6e918fafb req-b6cebca2-30c9-47eb-a0eb-9091623f8c67 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068262 Sep 08 10:28:19.564817 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1772/3342] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:28:19.594324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:19.595245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:19.611780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:19.612282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:19.612721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:19.613435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:19.614711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:19.615157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:20.993809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a657ffe97bb40da9d1664162ddd3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1120a50d0c440ba3580ad6ce3aded4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:21.010514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d9caf0e-3682-414e-ae9d-4b7f71750816 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 200 len: 1504 microversion: 2.1 time: 1.441944 Sep 08 10:28:21.011889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1773/3343] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:19 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 1504 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:21.077756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4049674a-05be-404d-a7b2-1d65bced78ef req-56003d3a-0474-4043-abae-0cf03d4f0227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4fcebd-7236-4534-bc3d-aa90843d1444", "name": "network-vif-unplugged", "status": "completed", "tag": "654eeb6e-28bf-463d-8995-0090b5b3fdd6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:21.103488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4049674a-05be-404d-a7b2-1d65bced78ef req-56003d3a-0474-4043-abae-0cf03d4f0227 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:21.111605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4049674a-05be-404d-a7b2-1d65bced78ef req-56003d3a-0474-4043-abae-0cf03d4f0227 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:21.117662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4049674a-05be-404d-a7b2-1d65bced78ef req-56003d3a-0474-4043-abae-0cf03d4f0227 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:21.146687 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4049674a-05be-404d-a7b2-1d65bced78ef req-56003d3a-0474-4043-abae-0cf03d4f0227 service nova] Creating event network-vif-unplugged:654eeb6e-28bf-463d-8995-0090b5b3fdd6 for instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 on n-h2-833090-19 Sep 08 10:28:21.164775 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4049674a-05be-404d-a7b2-1d65bced78ef req-56003d3a-0474-4043-abae-0cf03d4f0227 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149346 Sep 08 10:28:21.167686 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1774/3344] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:21.183345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:21.185071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:21.195218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:21.196758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:21.197454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:21.198842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:21.199577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:21.200247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.626224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:22.645176 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-710872ee-0cbe-4e30-bc3b-3b1e2c067a27 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1527 microversion: 2.1 time: 1.475795 Sep 08 10:28:22.646050 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1775/3345] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:21 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1527 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:22.675931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-526c8c5c-efbc-422f-963f-532c82b8d548 req-61d1e3d6-5fa0-4a81-aac1-2bb014e43d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddb7826-f34b-49f6-895d-55c91e3d02e6", "name": "network-vif-deleted", "tag": "fd7eb266-d8a0-4295-bdae-1e3be7c8ce71"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:22.703683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-526c8c5c-efbc-422f-963f-532c82b8d548 req-61d1e3d6-5fa0-4a81-aac1-2bb014e43d33 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.704439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-526c8c5c-efbc-422f-963f-532c82b8d548 req-61d1e3d6-5fa0-4a81-aac1-2bb014e43d33 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.708043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-526c8c5c-efbc-422f-963f-532c82b8d548 req-61d1e3d6-5fa0-4a81-aac1-2bb014e43d33 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.741183 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-526c8c5c-efbc-422f-963f-532c82b8d548 req-61d1e3d6-5fa0-4a81-aac1-2bb014e43d33 service nova] Creating event network-vif-deleted:fd7eb266-d8a0-4295-bdae-1e3be7c8ce71 for instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 on n-h1-833090-19 Sep 08 10:28:22.759753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-526c8c5c-efbc-422f-963f-532c82b8d548 req-61d1e3d6-5fa0-4a81-aac1-2bb014e43d33 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100856 Sep 08 10:28:22.760716 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1776/3346] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:22.766554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:22.767257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:22.774164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.774920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.775555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.777203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.777885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.778666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.799289 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 HTTP/1.1 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0ddb7826-f34b-49f6-895d-55c91e3d02e6'} Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:22.801817 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.807297 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.812833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:22.813993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d7c9d13-9485-4da6-90ed-b82f7592f7d6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 404 len: 111 microversion: 2.1 time: 0.052156 Sep 08 10:28:22.815891 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1777/3347] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:22 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:22.839262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0c65fe9-22b4-47e0-b92d-3d2c674288e1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:22.878716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.server_groups [None req-e0c65fe9-22b4-47e0-b92d-3d2c674288e1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Querying cell 52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) for 1 instances {{(pid=122457) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:28:22.879480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0c65fe9-22b4-47e0-b92d-3d2c674288e1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.880064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0c65fe9-22b4-47e0-b92d-3d2c674288e1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.880619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0c65fe9-22b4-47e0-b92d-3d2c674288e1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.894461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e0c65fe9-22b4-47e0-b92d-3d2c674288e1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.062540 Sep 08 10:28:22.903499 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1778/3348] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:28:22 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:22.908996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7d0d1a8-ad83-4857-910f-93eadc6ef5fe tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:22.917446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:22.929047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.server_groups [None req-a7d0d1a8-ad83-4857-910f-93eadc6ef5fe tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Querying cell 52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) for 1 instances {{(pid=122457) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 10:28:22.930450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1a8-ad83-4857-910f-93eadc6ef5fe tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.930940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1a8-ad83-4857-910f-93eadc6ef5fe tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.931599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1a8-ad83-4857-910f-93eadc6ef5fe tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.945661 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7d0d1a8-ad83-4857-910f-93eadc6ef5fe tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/os-server-groups/62574170-ec20-4d69-9e91-65ac8bc32328" status: 200 len: 182 microversion: 2.1 time: 0.040851 Sep 08 10:28:22.947126 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1779/3349] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:28:22 2022] GET /compute/v2.1/os-server-groups/62574170-ec20-4d69-9e91-65ac8bc32328 => generated 182 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:22.959339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:22.961065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:22.967983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.968720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.969327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.970207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:22.970825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:22.971546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:22.987320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 HTTP/1.1 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0ddb7826-f34b-49f6-895d-55c91e3d02e6'} Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:22.989136 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:22.994076 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:22.995691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:22.996723 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0899f59-3085-4462-975e-32133e6d22b1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 404 len: 111 microversion: 2.1 time: 0.041979 Sep 08 10:28:23.001497 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1780/3350] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:22 2022] DELETE /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:28:23.009079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.011187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] [instance: 0ddb7826-f34b-49f6-895d-55c91e3d02e6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:23.019544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:23.020220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:23.020851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:23.021733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:23.022354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:23.023138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:23.041793 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 HTTP/1.1 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0ddb7826-f34b-49f6-895d-55c91e3d02e6'} Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.043563 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. Sep 08 10:28:23.047423 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.055985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance 0ddb7826-f34b-49f6-895d-55c91e3d02e6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:23.057249 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0ea6726-bf25-4ae2-857e-2e14b05bb81a tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6" status: 404 len: 111 microversion: 2.1 time: 0.053956 Sep 08 10:28:23.062054 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1781/3351] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:23 2022] GET /compute/v2.1/servers/0ddb7826-f34b-49f6-895d-55c91e3d02e6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:23.067157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c900d911-501c-4272-9815-91925d82fb51 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.074956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c900d911-501c-4272-9815-91925d82fb51 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance group 6f12ecf1-a515-455d-92fe-b551cac7a4cf could not be found. Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c900d911-501c-4272-9815-91925d82fb51 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-server-groups/6f12ecf1-a515-455d-92fe-b551cac7a4cf HTTP/1.1 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance group 6f12ecf1-a515-455d-92fe-b551cac7a4cf could not be found. Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6f12ecf1-a515-455d-92fe-b551cac7a4cf'} Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6f12ecf1-a515-455d-92fe-b551cac7a4cf could not be found. Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6f12ecf1-a515-455d-92fe-b551cac7a4cf could not be found. Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.077016 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.081912 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.081912 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.081912 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:23.081912 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:23.081912 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6f12ecf1-a515-455d-92fe-b551cac7a4cf could not be found. Sep 08 10:28:23.081912 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.084364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c900d911-501c-4272-9815-91925d82fb51 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance group 6f12ecf1-a515-455d-92fe-b551cac7a4cf could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:23.085466 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c900d911-501c-4272-9815-91925d82fb51 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/6f12ecf1-a515-455d-92fe-b551cac7a4cf" status: 404 len: 117 microversion: 2.1 time: 0.022166 Sep 08 10:28:23.091683 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1782/3352] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:23 2022] DELETE /compute/v2.1/os-server-groups/6f12ecf1-a515-455d-92fe-b551cac7a4cf => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:23.096807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f079f76-4517-4e5d-a50d-15d5f8892de6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.108864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-0f079f76-4517-4e5d-a50d-15d5f8892de6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance group 211e2341-1dc9-41cc-a138-f30362132e53 could not be found. Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f079f76-4517-4e5d-a50d-15d5f8892de6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-server-groups/211e2341-1dc9-41cc-a138-f30362132e53 HTTP/1.1 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance group 211e2341-1dc9-41cc-a138-f30362132e53 could not be found. Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '211e2341-1dc9-41cc-a138-f30362132e53'} Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 211e2341-1dc9-41cc-a138-f30362132e53 could not be found. Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 211e2341-1dc9-41cc-a138-f30362132e53 could not be found. Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.111275 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.116049 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.116049 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.116049 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:23.116049 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:23.116049 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 211e2341-1dc9-41cc-a138-f30362132e53 could not be found. Sep 08 10:28:23.116049 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.117240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f079f76-4517-4e5d-a50d-15d5f8892de6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance group 211e2341-1dc9-41cc-a138-f30362132e53 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:23.118800 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f079f76-4517-4e5d-a50d-15d5f8892de6 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/211e2341-1dc9-41cc-a138-f30362132e53" status: 404 len: 117 microversion: 2.1 time: 0.025882 Sep 08 10:28:23.122842 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1783/3353] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:23 2022] DELETE /compute/v2.1/os-server-groups/211e2341-1dc9-41cc-a138-f30362132e53 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:23.128632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a036a94e-ef81-4518-81fb-3f48a8aa3ab1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.135694 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a036a94e-ef81-4518-81fb-3f48a8aa3ab1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance group 6d502d1c-717a-4dc2-9d72-b9618bfd23e9 could not be found. Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a036a94e-ef81-4518-81fb-3f48a8aa3ab1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-server-groups/6d502d1c-717a-4dc2-9d72-b9618bfd23e9 HTTP/1.1 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance group 6d502d1c-717a-4dc2-9d72-b9618bfd23e9 could not be found. Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6d502d1c-717a-4dc2-9d72-b9618bfd23e9'} Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6d502d1c-717a-4dc2-9d72-b9618bfd23e9 could not be found. Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6d502d1c-717a-4dc2-9d72-b9618bfd23e9 could not be found. Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.137497 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.142796 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.142796 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.142796 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:23.142796 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:23.142796 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6d502d1c-717a-4dc2-9d72-b9618bfd23e9 could not be found. Sep 08 10:28:23.142796 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.144848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a036a94e-ef81-4518-81fb-3f48a8aa3ab1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance group 6d502d1c-717a-4dc2-9d72-b9618bfd23e9 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:23.146433 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a036a94e-ef81-4518-81fb-3f48a8aa3ab1 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/6d502d1c-717a-4dc2-9d72-b9618bfd23e9" status: 404 len: 117 microversion: 2.1 time: 0.022377 Sep 08 10:28:23.147181 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1784/3354] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:23 2022] DELETE /compute/v2.1/os-server-groups/6d502d1c-717a-4dc2-9d72-b9618bfd23e9 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:23.156754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b7f1a4c-2cc6-4099-a020-a83b03232373 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.165961 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3b7f1a4c-2cc6-4099-a020-a83b03232373 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] HTTP exception thrown: Instance group 748a1439-cc91-4ed1-8ad7-1cf8e64018ad could not be found. Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b7f1a4c-2cc6-4099-a020-a83b03232373 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Request method failure captured: Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-server-groups/748a1439-cc91-4ed1-8ad7-1cf8e64018ad HTTP/1.1 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOleX-eWhacYFJZ8ou8ultd3TdziBPxEKVOHWr5hUgoqs_w11r6prAGhlgX-maUIUWULOYdBliISeoyQqP1hQOHij4GxRvcbIkGvnF7j1hhDu7FX-ZzQknm1V4asVfSwproQc2NEVHbAN7pQO6g3EHxGZV4vTdoUjW4CCR3SB_M1cM Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ad1120a50d0c440ba3580ad6ce3aded4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ad1120a50d0c440ba3580ad6ce3aded4", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: ad1120a50d0c440ba3580ad6ce3aded4 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerGroupTestJSON-374030491 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2a657ffe97bb40da9d1664162ddd3c07 Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerGroupTestJSON-374030491-project Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance group 748a1439-cc91-4ed1-8ad7-1cf8e64018ad could not be found. Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '748a1439-cc91-4ed1-8ad7-1cf8e64018ad'} Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 748a1439-cc91-4ed1-8ad7-1cf8e64018ad could not be found. Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 748a1439-cc91-4ed1-8ad7-1cf8e64018ad could not be found. Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.167862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:23.172657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:23.172657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:23.172657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:23.172657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:23.172657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 748a1439-cc91-4ed1-8ad7-1cf8e64018ad could not be found. Sep 08 10:28:23.172657 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:23.175309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b7f1a4c-2cc6-4099-a020-a83b03232373 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Returning 404 to user: Instance group 748a1439-cc91-4ed1-8ad7-1cf8e64018ad could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:23.176411 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b7f1a4c-2cc6-4099-a020-a83b03232373 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/748a1439-cc91-4ed1-8ad7-1cf8e64018ad" status: 404 len: 117 microversion: 2.1 time: 0.023708 Sep 08 10:28:23.181797 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1785/3355] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:23 2022] DELETE /compute/v2.1/os-server-groups/748a1439-cc91-4ed1-8ad7-1cf8e64018ad => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:23.187095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1711285f-2f6c-4786-a88d-787a6a5c1312 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.227786 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1711285f-2f6c-4786-a88d-787a6a5c1312 tempest-ServerGroupTestJSON-374030491 tempest-ServerGroupTestJSON-374030491-project] 10.222.0.59 "DELETE /compute/v2.1/os-server-groups/62574170-ec20-4d69-9e91-65ac8bc32328" status: 204 len: 0 microversion: 2.1 time: 0.044496 Sep 08 10:28:23.232364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1786/3356] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 10:28:23 2022] DELETE /compute/v2.1/os-server-groups/62574170-ec20-4d69-9e91-65ac8bc32328 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:23.376363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Updating instance_info_cache with network_info: [{"id": "120d9440-40b6-46ea-81e3-169683549ad7", "address": "fa:16:3e:82:f3:a7", "network": {"id": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-428633397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "920596ac3512466ebd2e58a6dfc062cb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap120d9440-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122456) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:28:23.421030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Releasing lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:28:23.437965 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67480c64-e986-4d2c-bee7-40dd1f7d95b0 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action" status: 202 len: 0 microversion: 2.1 time: 6.756407 Sep 08 10:28:23.440935 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1571/3357] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:16 2022] POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action => generated 0 bytes in 6767 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:28:23.450313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.184"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:23.453308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:23.479238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:23.482295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:23.492209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:23.493641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:23.494135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:23.494580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:23.532380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "refresh_cache-1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:28:23.533229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquired lock "refresh_cache-1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:28:23.677658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:23.678689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:23.703819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:23.704749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:23.707557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:23.708623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:23.709226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:23.714918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:23.865441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:23.901485 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e2a4caba-21b6-4269-b919-56cb3b6070ea tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1485 microversion: 2.1 time: 0.227367 Sep 08 10:28:23.904632 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1572/3358] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:23 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1485 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:24.114095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0cae2e31-4b03-4717-8953-1e29d5159817 req-559ad5f3-82ab-4797-b6f5-adee2b76e9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4fcebd-7236-4534-bc3d-aa90843d1444", "name": "network-vif-deleted", "tag": "654eeb6e-28bf-463d-8995-0090b5b3fdd6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:24.137771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0cae2e31-4b03-4717-8953-1e29d5159817 req-559ad5f3-82ab-4797-b6f5-adee2b76e9a3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:24.139603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0cae2e31-4b03-4717-8953-1e29d5159817 req-559ad5f3-82ab-4797-b6f5-adee2b76e9a3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:24.141349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0cae2e31-4b03-4717-8953-1e29d5159817 req-559ad5f3-82ab-4797-b6f5-adee2b76e9a3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:24.191501 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0cae2e31-4b03-4717-8953-1e29d5159817 req-559ad5f3-82ab-4797-b6f5-adee2b76e9a3 service nova] Creating event network-vif-deleted:654eeb6e-28bf-463d-8995-0090b5b3fdd6 for instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 on n-h2-833090-19 Sep 08 10:28:24.204914 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0cae2e31-4b03-4717-8953-1e29d5159817 req-559ad5f3-82ab-4797-b6f5-adee2b76e9a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095951 Sep 08 10:28:24.209386 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1573/3359] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:24.936493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:24.937397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:24.952633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:24.953447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:24.955131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:24.956795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:24.957746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:24.959157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:25.052648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:25.054737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:25.055109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:25.058260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lazy-loading 'fault' on Instance uuid 8d4fcebd-7236-4534-bc3d-aa90843d1444 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:28:25.188368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:25.202492 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63e3fd10-1bba-49fb-8c30-e0c836ea69e3 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 200 len: 1315 microversion: 2.1 time: 0.273164 Sep 08 10:28:25.205474 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1574/3360] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:24 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:25.802562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1383750447", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "d06385c5-4287-4ee4-86b7-9e8945ed3e03"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:25.927431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] validate_networks() for [('d06385c5-4287-4ee4-86b7-9e8945ed3e03', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:27.668141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:27.669190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:27.669190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:27.670705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:27.671439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:27.707839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:27.708882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:27.709480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:27.712479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:27.713242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:27.716294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:27.753783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Getting quotas for project a5244a29ef7a41ddb5a67391c24dcecd. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:27.763160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Getting quotas for user b1ed45f4eb0c4218a27d6ce03f2fc3c3 and project a5244a29ef7a41ddb5a67391c24dcecd. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:27.783387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:27.791638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:27.870805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e660a54f-bfb1-4367-baae-34974481cce7 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.335229 Sep 08 10:28:27.871716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1575/3361] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:28:27.885807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:27.888933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:27.910396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:27.910977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:27.912590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:27.915089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:27.915916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:27.916358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:27.939809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 HTTP/1.1 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444'} Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:27.941712 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-379267a7-cc4f-491f-accb-4ca9b405903a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 404 len: 111 microversion: 2.1 time: 0.069413 Sep 08 10:28:27.947411 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1576/3362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:27 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:27.949125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ef4c16a-af7d-47a1-b3b7-0fbc949c781c tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:27.949747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ef4c16a-af7d-47a1-b3b7-0fbc949c781c tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:28.108108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ef4c16a-af7d-47a1-b3b7-0fbc949c781c tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:28.116807 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ef4c16a-af7d-47a1-b3b7-0fbc949c781c tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1217 microversion: 2.1 time: 0.171575 Sep 08 10:28:28.117398 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1577/3363] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:27 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:28.152151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cdcaa1f7-4cf0-415f-a3b1-962dd42a55c1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'create', calling method: .version_select at 0x7f23553df430>, body: {"keypair": {"name": "tempest-keypair-1221911279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwsddy1EHhYtJfnl2Z64id+O5P8UE+zgZXTd6uekkRwyLr8DTdA6xFY6uR+EqXOTZi0eHPYAVfDSCTcYuYomz0J2SosMCUPVSqkyUpGKP17hsCJxK1PnO1J3W19lW/uTw=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:28.188264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-cdcaa1f7-4cf0-415f-a3b1-962dd42a55c1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for project 912e0307585e408ebefb443ebbae583e. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:28.200411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-cdcaa1f7-4cf0-415f-a3b1-962dd42a55c1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for user 774190078d7b4c1d96c5921410a650ad and project 912e0307585e408ebefb443ebbae583e. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:28.220389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:28.250388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cdcaa1f7-4cf0-415f-a3b1-962dd42a55c1 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107126 Sep 08 10:28:28.274708 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1578/3364] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:28:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:29.143223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:29.144185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:29.172675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:29.178715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:29.180937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:29.186861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:29.189574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:29.191579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:29.962004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:29.974834 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-499d85d1-4fbe-404f-b956-820b0e4d7729 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1213 microversion: 2.1 time: 0.837375 Sep 08 10:28:29.997140 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1579/3365] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:29 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1213 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:30.998860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:31.000635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:31.018656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:31.020100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:31.022078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:31.024772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:31.025763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:31.029083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:31.257854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:31.287275 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9bdf0bfa-e203-42dd-b161-dd49ddf1d1b3 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1275 microversion: 2.1 time: 0.291567 Sep 08 10:28:31.291727 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1580/3366] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:30 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:31.394737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-395f371e-700e-4847-a302-a03a07108f72 req-7cfd8e67-4829-41a5-b109-bdabfe7769dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:31.421819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-395f371e-700e-4847-a302-a03a07108f72 req-7cfd8e67-4829-41a5-b109-bdabfe7769dd service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:31.424735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-395f371e-700e-4847-a302-a03a07108f72 req-7cfd8e67-4829-41a5-b109-bdabfe7769dd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:31.427080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-395f371e-700e-4847-a302-a03a07108f72 req-7cfd8e67-4829-41a5-b109-bdabfe7769dd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:31.465613 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-395f371e-700e-4847-a302-a03a07108f72 req-7cfd8e67-4829-41a5-b109-bdabfe7769dd service nova] Creating event network-changed:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:28:31.474459 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-395f371e-700e-4847-a302-a03a07108f72 req-7cfd8e67-4829-41a5-b109-bdabfe7769dd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085341 Sep 08 10:28:31.480384 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1581/3367] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:28:31.717372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.neutron [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] re-assign floating IP 172.25.4.184 from instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 Sep 08 10:28:31.799292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:28:32.318937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:32.320312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:32.360411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:32.361087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:32.361433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:32.362213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:32.362696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:32.364401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:33.460437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:33.822310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:33.840650 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-22fdb5e2-157e-4bfe-b450-2554eecac29e tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1317 microversion: 2.1 time: 1.526507 Sep 08 10:28:33.842299 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1582/3368] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:32 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1317 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:28:33.990806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-396606522", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:34.350111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] validate_networks() for [('5c418c27-a2cd-44f8-b76b-f5c1929bd451', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:34.493514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Updating instance_info_cache with network_info: [{"id": "120d9440-40b6-46ea-81e3-169683549ad7", "address": "fa:16:3e:82:f3:a7", "network": {"id": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-428633397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "920596ac3512466ebd2e58a6dfc062cb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap120d9440-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:28:34.528520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:28:36.654833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:36.655398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:36.655741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:36.656335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:36.656923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:36.676412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:36.677328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:36.678559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:36.679662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:36.680959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:36.681747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:36.724144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for project 41785319e3f242ca9cd86981db6e1789. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:36.755972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for user 3cc1615daf5e4df5900068455d7109ee and project 41785319e3f242ca9cd86981db6e1789. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:36.811512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:36.814463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:36.892503 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81dc1298-6eea-455d-bc85-b00b0de111fa tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.045159 Sep 08 10:28:36.893183 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1583/3369] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:28:36.899157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7388baf4-ae25-4e11-996d-62ba051c383f req-b9913403-f9d5-417e-947d-7b53d9206ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae6e08b-1d05-4cf7-a9c0-c19b64c15007", "tag": "9c4ca470-d6ff-437b-8710-29c8d5a6b880"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:36.912906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7388baf4-ae25-4e11-996d-62ba051c383f req-b9913403-f9d5-417e-947d-7b53d9206ca1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:36.913747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7388baf4-ae25-4e11-996d-62ba051c383f req-b9913403-f9d5-417e-947d-7b53d9206ca1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:36.914415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7388baf4-ae25-4e11-996d-62ba051c383f req-b9913403-f9d5-417e-947d-7b53d9206ca1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:36.931319 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7388baf4-ae25-4e11-996d-62ba051c383f req-b9913403-f9d5-417e-947d-7b53d9206ca1 service nova] Creating event network-changed:9c4ca470-d6ff-437b-8710-29c8d5a6b880 for instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 on n-h2-833090-19 Sep 08 10:28:36.937222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7388baf4-ae25-4e11-996d-62ba051c383f req-b9913403-f9d5-417e-947d-7b53d9206ca1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042385 Sep 08 10:28:36.938439 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1584/3370] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:36.944137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:36.947711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:36.962886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:36.977971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:36.978473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:36.979239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:36.979740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:36.980170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:37.307671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Updating instance_info_cache with network_info: [{"id": "9c4ca470-d6ff-437b-8710-29c8d5a6b880", "address": "fa:16:3e:26:88:6a", "network": {"id": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-428633397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "920596ac3512466ebd2e58a6dfc062cb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9c4ca470-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:28:37.346391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Releasing lock "refresh_cache-1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:28:37.349673 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8d3e316-fce9-4350-ab11-2c9248450ebb tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007/action" status: 202 len: 0 microversion: 2.1 time: 13.903831 Sep 08 10:28:37.362475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1787/3371] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:23 2022] POST /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007/action => generated 0 bytes in 13917 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:28:37.367995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1487187746", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:37.485751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] validate_networks() for [('1afcb5e7-b8a1-47bd-a9ce-6ef9966f63b5', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:37.764880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:37.789316 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cb6cc1d-c66c-4baa-aef9-7977b132ccc1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1317 microversion: 2.1 time: 0.849259 Sep 08 10:28:37.791922 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1585/3372] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:36 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:38.313580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-871956456", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:38.384485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] validate_networks() for [('3b487269-4740-45dc-98cf-b12ae1e77a96', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:39.827349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:39.828025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:39.828311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:39.828844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:39.829077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:39.833408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:39.834362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:39.835018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:39.835445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:39.837310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:39.839180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:39.839934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:39.841093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:39.841849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:39.842296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:39.842910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:39.850434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:39.851173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:39.862443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:39.863384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:39.864380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for project 912e0307585e408ebefb443ebbae583e. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:39.865885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:39.866425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:39.873076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for user 774190078d7b4c1d96c5921410a650ad and project 912e0307585e408ebefb443ebbae583e. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:39.892796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Getting quotas for project 0b5041fc5a4741f9a8eebb8b686ca3ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:39.894105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:39.897461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:39.900368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Getting quotas for user a34267c34f0d4c61ba99351e74383a2b and project 0b5041fc5a4741f9a8eebb8b686ca3ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:39.918775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:39.921828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:39.985900 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7fa4c2d1-e16e-47d9-9504-b457a0b06826 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192107 Sep 08 10:28:39.986852 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1586/3373] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:28:39.992204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:39.994110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:39.994981 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54578bb9-c3db-420e-ac53-4002c8d8bb22 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.631089 Sep 08 10:28:39.996172 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1788/3374] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:28:40.007338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:40.008187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:40.010264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:40.012261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:40.013095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:40.013820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:40.015591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.184"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:40.534744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:40.543312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:40.545667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:40.547122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:40.550084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:40.552247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:40.552718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:40.942822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:40.968027 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0f91af8-252c-4ea7-b9a5-e41c2ce0f426 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1321 microversion: 2.1 time: 0.974696 Sep 08 10:28:40.969116 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1587/3375] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:39 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1321 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:40.994407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.004866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:41.024750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.026182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.028765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.031591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.032409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.033101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.156343 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] HTTP exception thrown: Floating IP 172.25.4.184 is not associated with instance 86fe817d-f7cc-4f48-933e-a98ad9896c54. Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Request method failure captured: Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action HTTP/1.1 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 49 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOT1pTwPprCmiRrPFKlC-TEr9fLWfJ3n2y_Y2dNi8cOjBLbM1ILGsW3_wm96qtC25ttD9oHv2cK_FhPxtwI-AAPOWyfo12HRUA8LGv2dAmBbn46TA6-_Cq2m8wCrGrUKsB8-e43hT_XYmBUJQPGj9rLOFYsdZM9IoDG-boVmXnQ7pk Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_920596ac3512466ebd2e58a6dfc062cb", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: f56ca90367aa4d748c3bca6b9b4a2dbd Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: {"removeFloatingIp": {"address": "172.25.4.184"}} Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: exception: Floating IP 172.25.4.184 is not associated with instance 86fe817d-f7cc-4f48-933e-a98ad9896c54. Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '86fe817d-f7cc-4f48-933e-a98ad9896c54', 'body': {'removeFloatingIp': {'address': '172.25.4.184'}}} Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.184 is not associated with instance 86fe817d-f7cc-4f48-933e-a98ad9896c54. Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.184 is not associated with instance 86fe817d-f7cc-4f48-933e-a98ad9896c54. Sep 08 10:28:41.159221 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:41.175660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Returning 409 to user: Floating IP 172.25.4.184 is not associated with instance 86fe817d-f7cc-4f48-933e-a98ad9896c54. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:41.178579 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-903d3749-edd8-4a3c-9419-89ac1b99c1cd tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action" status: 409 len: 146 microversion: 2.1 time: 1.180331 Sep 08 10:28:41.182019 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1789/3376] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:39 2022] POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action => generated 146 bytes in 1185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:28:41.193573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c88ab0f8-b0b8-4315-8f25-35ab17dab64f req-6a13328b-dbc5-4da5-8efd-39bd29d0f50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605da060-84f2-4af2-8945-90e9bf93a8c6", "tag": "01038648-4d16-4f04-9a18-6218c7cf5da5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:41.220705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c88ab0f8-b0b8-4315-8f25-35ab17dab64f req-6a13328b-dbc5-4da5-8efd-39bd29d0f50a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.221599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c88ab0f8-b0b8-4315-8f25-35ab17dab64f req-6a13328b-dbc5-4da5-8efd-39bd29d0f50a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.222423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c88ab0f8-b0b8-4315-8f25-35ab17dab64f req-6a13328b-dbc5-4da5-8efd-39bd29d0f50a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.239384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:41.244571 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c88ab0f8-b0b8-4315-8f25-35ab17dab64f req-6a13328b-dbc5-4da5-8efd-39bd29d0f50a service nova] Creating event network-changed:01038648-4d16-4f04-9a18-6218c7cf5da5 for instance 605da060-84f2-4af2-8945-90e9bf93a8c6 on n-h1-833090-19 Sep 08 10:28:41.253167 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c88ab0f8-b0b8-4315-8f25-35ab17dab64f req-6a13328b-dbc5-4da5-8efd-39bd29d0f50a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069463 Sep 08 10:28:41.254217 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1790/3377] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:41.282287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.286445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:41.303789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.306614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.307962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.311419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.313955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.315150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.530944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:41.540605 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe31af36-3c51-47a0-a35d-cb00093ddfa5 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1317 microversion: 2.1 time: 0.559126 Sep 08 10:28:41.542128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1588/3378] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:40 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:41.550406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.552651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:41.577094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.577930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.578638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.579633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.580346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.581120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.795232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:41.813683 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-320387f7-3586-4b30-88a9-aedf891c91ec tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1275 microversion: 2.1 time: 0.268583 Sep 08 10:28:41.833171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1589/3379] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:41.833171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:41.835181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:41.856941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.858017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.860962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.864894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:41.865070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:41.866620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:41.904505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:41.924515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:41.931330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:41.933492 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83ef6238-2840-4b38-970b-c9134da6f236 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2956 microversion: 2.42 time: 0.678091 Sep 08 10:28:41.934964 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1791/3380] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2956 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:41.948736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.184"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:42.097364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:42.119710 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-feb3d2f4-455e-4636-bd4a-17a6765d4b26 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1277 microversion: 2.1 time: 0.297398 Sep 08 10:28:42.120699 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1590/3381] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:41 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:42.130906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1305040027", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:42.262427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:42.265902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] validate_networks() for [('5c418c27-a2cd-44f8-b76b-f5c1929bd451', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:42.268623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:42.269109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:42.269543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:42.270232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:42.270684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:42.271123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:42.755353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "refresh_cache-1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:28:42.755877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquired lock "refresh_cache-1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:28:43.568481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:43.568975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:43.569362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:43.569769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:43.570178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:43.586230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:43.587328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:43.587809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:43.593016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:43.593503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:43.594232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:43.639800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for project 41785319e3f242ca9cd86981db6e1789. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:43.651989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for user 3cc1615daf5e4df5900068455d7109ee and project 41785319e3f242ca9cd86981db6e1789. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:43.681912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:43.690800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:43.797012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42825c10-c800-4e71-b7b4-5dd38c172bac tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.673509 Sep 08 10:28:43.797693 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1591/3382] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:28:43.807395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a2c7e05a-056b-4257-8c05-b4ad946df805 req-08dcceff-5f33-4f28-a3f3-df15e75027c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed661293-2de7-4a28-8de8-d4b538451e23", "tag": "cd4be0f7-1cea-4fbc-af31-35d0c3bd5ebd"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:43.825936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2c7e05a-056b-4257-8c05-b4ad946df805 req-08dcceff-5f33-4f28-a3f3-df15e75027c7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:43.828172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2c7e05a-056b-4257-8c05-b4ad946df805 req-08dcceff-5f33-4f28-a3f3-df15e75027c7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:43.828650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2c7e05a-056b-4257-8c05-b4ad946df805 req-08dcceff-5f33-4f28-a3f3-df15e75027c7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:43.842638 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a2c7e05a-056b-4257-8c05-b4ad946df805 req-08dcceff-5f33-4f28-a3f3-df15e75027c7 service nova] Creating event network-changed:cd4be0f7-1cea-4fbc-af31-35d0c3bd5ebd for instance ed661293-2de7-4a28-8de8-d4b538451e23 on n-h1-833090-19 Sep 08 10:28:43.847769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a2c7e05a-056b-4257-8c05-b4ad946df805 req-08dcceff-5f33-4f28-a3f3-df15e75027c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046616 Sep 08 10:28:43.848927 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1592/3383] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:43.855324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:43.857195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:43.866785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:43.867555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:43.868816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:43.869770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:43.870449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:43.871099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:44.140619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b75bef5-4e1a-405a-8503-a0dcba4ff6fd tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.290190 Sep 08 10:28:44.141294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1593/3384] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:28:43 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225/os-interface => generated 1833 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:28:44.157065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:44.157898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:44.170384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:44.170893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:44.171343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:44.174212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:44.174721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:44.175170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:44.654595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:28:44.667940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:44.683224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de231740-7ad8-4cec-8429-5f4a7d7cc1a1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1317 microversion: 2.1 time: 0.540773 Sep 08 10:28:44.684201 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1594/3385] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:44 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:44.714853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:44.715898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:44.731352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:44.732185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:44.732806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:44.733773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:44.734413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:44.735083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:44.786103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:45.283864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:45.294915 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c9f6d0a-a618-4729-bbf5-fd40a310a127 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1323 microversion: 2.1 time: 0.594518 Sep 08 10:28:45.300622 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1595/3386] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:44 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:45.306586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:45.316408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:45.335914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.336423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.336915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.337641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.338290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.342525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.497814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:45.516119 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2e68ca91-0228-42d3-8a51-593be24e58a8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1283 microversion: 2.1 time: 0.210751 Sep 08 10:28:45.516967 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1596/3387] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:45 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:45.542175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:45.544409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:45.557254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.558060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.558709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.559780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.560414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.561053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.677197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:45.690446 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c1a7353-cace-4748-b0d0-e280f0552b4f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1274 microversion: 2.1 time: 0.153567 Sep 08 10:28:45.696155 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1597/3388] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:45 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:45.710027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9a9f6243-6cd5-462f-8303-ffb6de0b206c req-6266c244-ce9d-4fef-8dd1-60acc8f76eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae6e08b-1d05-4cf7-a9c0-c19b64c15007", "tag": "9c4ca470-d6ff-437b-8710-29c8d5a6b880"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:45.732896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a9f6243-6cd5-462f-8303-ffb6de0b206c req-6266c244-ce9d-4fef-8dd1-60acc8f76eea service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.733701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a9f6243-6cd5-462f-8303-ffb6de0b206c req-6266c244-ce9d-4fef-8dd1-60acc8f76eea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.734325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9a9f6243-6cd5-462f-8303-ffb6de0b206c req-6266c244-ce9d-4fef-8dd1-60acc8f76eea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.765285 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9a9f6243-6cd5-462f-8303-ffb6de0b206c req-6266c244-ce9d-4fef-8dd1-60acc8f76eea service nova] Creating event network-changed:9c4ca470-d6ff-437b-8710-29c8d5a6b880 for instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 on n-h2-833090-19 Sep 08 10:28:45.770937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9a9f6243-6cd5-462f-8303-ffb6de0b206c req-6266c244-ce9d-4fef-8dd1-60acc8f76eea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073372 Sep 08 10:28:45.772215 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1598/3389] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:45.785770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d0d4811d-424c-4a7f-8b48-5f3c0d3e5281 req-be05da43-8738-4e6f-99c3-b0f6c635683b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605da060-84f2-4af2-8945-90e9bf93a8c6", "name": "network-vif-plugged", "status": "completed", "tag": "01038648-4d16-4f04-9a18-6218c7cf5da5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:45.808419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d0d4811d-424c-4a7f-8b48-5f3c0d3e5281 req-be05da43-8738-4e6f-99c3-b0f6c635683b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.808908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d0d4811d-424c-4a7f-8b48-5f3c0d3e5281 req-be05da43-8738-4e6f-99c3-b0f6c635683b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.809350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d0d4811d-424c-4a7f-8b48-5f3c0d3e5281 req-be05da43-8738-4e6f-99c3-b0f6c635683b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.840588 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d0d4811d-424c-4a7f-8b48-5f3c0d3e5281 req-be05da43-8738-4e6f-99c3-b0f6c635683b service nova] Creating event network-vif-plugged:01038648-4d16-4f04-9a18-6218c7cf5da5 for instance 605da060-84f2-4af2-8945-90e9bf93a8c6 on n-h1-833090-19 Sep 08 10:28:45.856115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d0d4811d-424c-4a7f-8b48-5f3c0d3e5281 req-be05da43-8738-4e6f-99c3-b0f6c635683b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081999 Sep 08 10:28:45.857464 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1599/3390] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:45.874450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:45.875824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:45.883056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.884212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.888094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:45.888868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:45.889350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:45.889800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.473499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:46.483043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ef64b69-7d36-44ea-b23e-0f1386e921f1 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1317 microversion: 2.1 time: 0.623662 Sep 08 10:28:46.484009 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1600/3391] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:45 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:46.489230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:46.489856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:46.497849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.498597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.499242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.500166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.500800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.501360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.515515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Updating instance_info_cache with network_info: [{"id": "9c4ca470-d6ff-437b-8710-29c8d5a6b880", "address": "fa:16:3e:26:88:6a", "network": {"id": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-428633397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "920596ac3512466ebd2e58a6dfc062cb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9c4ca470-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:28:46.532610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Releasing lock "refresh_cache-1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:28:46.535702 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61ca889c-e2c0-488e-b334-43e1e6b4cc86 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007/action" status: 202 len: 0 microversion: 2.1 time: 4.597913 Sep 08 10:28:46.537501 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1792/3392] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:41 2022] POST /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007/action => generated 0 bytes in 4602 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:28:46.545050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:46.545674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:46.556632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.557124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.557626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.558339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.558792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.559218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.695981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:46.715541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93627f19-14dc-43f8-bbaf-03bd11066d8e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1283 microversion: 2.1 time: 0.176054 Sep 08 10:28:46.717295 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1793/3393] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:46 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:46.730225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:46.730891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:46.740579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.741128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.741767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.744284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.744975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.745641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.783036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:46.789650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:46.806124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b071dd97-805c-43c8-8969-6d4813c7cd0d tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1323 microversion: 2.1 time: 0.313973 Sep 08 10:28:46.811505 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1601/3394] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:46 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:46.823222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:46.824980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:46.832659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.834373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.835917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.837185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.843029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:46.843701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:46.930153 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-86139c2b-2341-43e9-aa04-7eb65374bf9b tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 204 len: 0 microversion: 2.1 time: 0.211372 Sep 08 10:28:46.942894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1794/3395] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:46 2022] DELETE /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:46.960268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:46.971266 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-41cc14f2-be93-4a5b-8faf-59e85ea5964f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1280 microversion: 2.1 time: 0.162947 Sep 08 10:28:46.977017 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1602/3396] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:46 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1280 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:46.985265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.184"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:46.988275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:46.998448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:46.998993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.000340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:47.001846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:47.002338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.002837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:47.042329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:28:47.042733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquired lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:28:47.180834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0cf64101-e968-4189-b7a6-d1b55b3d8c27 req-6eef3954-e46e-434f-9a2d-40e91efb9209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541859cb-5429-4394-b8c2-4345316dbb41", "tag": "98a670a9-5efe-4be3-88c3-ea60ce7922b3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:47.204539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0cf64101-e968-4189-b7a6-d1b55b3d8c27 req-6eef3954-e46e-434f-9a2d-40e91efb9209 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:47.206532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0cf64101-e968-4189-b7a6-d1b55b3d8c27 req-6eef3954-e46e-434f-9a2d-40e91efb9209 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.207194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0cf64101-e968-4189-b7a6-d1b55b3d8c27 req-6eef3954-e46e-434f-9a2d-40e91efb9209 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:47.222809 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0cf64101-e968-4189-b7a6-d1b55b3d8c27 req-6eef3954-e46e-434f-9a2d-40e91efb9209 service nova] Creating event network-changed:98a670a9-5efe-4be3-88c3-ea60ce7922b3 for instance 541859cb-5429-4394-b8c2-4345316dbb41 on n-h1-833090-19 Sep 08 10:28:47.232086 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0cf64101-e968-4189-b7a6-d1b55b3d8c27 req-6eef3954-e46e-434f-9a2d-40e91efb9209 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286167 Sep 08 10:28:47.235155 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1795/3397] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:47.508350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:47.510493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:47.520811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:47.521448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.521735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:47.522460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:47.522919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.523350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:47.956224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:47.967264 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed858ab2-b2c6-4d7a-9876-af33eae9ccde tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1317 microversion: 2.1 time: 0.463143 Sep 08 10:28:47.967886 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1796/3398] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:47 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:47.979287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:47.980240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:47.987504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:47.988301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.988809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:47.989590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:47.990115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:47.990727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:48.619437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:48.633340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc3def41-df2f-4242-9992-88082ea11916 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1325 microversion: 2.1 time: 0.664104 Sep 08 10:28:48.649936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1797/3399] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:47 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1325 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:48.649936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:48.649936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:48.656773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:48.657279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:48.657792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:48.658629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:48.659320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:48.659958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:49.393707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:49.413363 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6bf58d8b-1de3-491a-81ba-77e07b7764a2 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1323 microversion: 2.1 time: 0.777241 Sep 08 10:28:49.428163 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1798/3400] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:48 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1323 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:49.444530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-497b7393-e42d-498f-be8a-a324278bd16e req-6e6e50bb-036e-41f6-b347-c80eee4e5d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed661293-2de7-4a28-8de8-d4b538451e23", "name": "network-vif-plugged", "status": "completed", "tag": "cd4be0f7-1cea-4fbc-af31-35d0c3bd5ebd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:49.457654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-497b7393-e42d-498f-be8a-a324278bd16e req-6e6e50bb-036e-41f6-b347-c80eee4e5d58 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:49.458616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-497b7393-e42d-498f-be8a-a324278bd16e req-6e6e50bb-036e-41f6-b347-c80eee4e5d58 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:49.459262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-497b7393-e42d-498f-be8a-a324278bd16e req-6e6e50bb-036e-41f6-b347-c80eee4e5d58 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:49.483847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-497b7393-e42d-498f-be8a-a324278bd16e req-6e6e50bb-036e-41f6-b347-c80eee4e5d58 service nova] Creating event network-vif-plugged:cd4be0f7-1cea-4fbc-af31-35d0c3bd5ebd for instance ed661293-2de7-4a28-8de8-d4b538451e23 on n-h1-833090-19 Sep 08 10:28:49.495936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-497b7393-e42d-498f-be8a-a324278bd16e req-6e6e50bb-036e-41f6-b347-c80eee4e5d58 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065711 Sep 08 10:28:49.501626 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1799/3401] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:49.510379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:49.514342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:49.520915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:49.521484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:49.521988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:49.522760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:49.523296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:49.523818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:49.857475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:49.881334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:50.456449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:50.468870 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8cf22fad-adc0-4cfc-b652-72bb7f4ab21b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.965516 Sep 08 10:28:50.469723 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1800/3402] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:49 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:50.474806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:50.475684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:50.490616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:50.491524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:50.492267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:50.493778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:50.494417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:50.495016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:51.055477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:51.072970 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0a9a5b6-6d09-4d71-9f67-9230dda1fa53 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1506 microversion: 2.1 time: 0.601231 Sep 08 10:28:51.073561 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1801/3403] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:50 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:51.079146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a20f77e1-d850-4128-a2a3-2aa6761d9716 req-da332015-bc69-4934-ab8d-bcc8f03e0bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54135dcc-b26a-46bc-a635-b70c97ee1554", "tag": "cc98a7d4-7d51-4756-940b-09b5894b6179"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:51.095840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a20f77e1-d850-4128-a2a3-2aa6761d9716 req-da332015-bc69-4934-ab8d-bcc8f03e0bf0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:51.096564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a20f77e1-d850-4128-a2a3-2aa6761d9716 req-da332015-bc69-4934-ab8d-bcc8f03e0bf0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:51.097368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a20f77e1-d850-4128-a2a3-2aa6761d9716 req-da332015-bc69-4934-ab8d-bcc8f03e0bf0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:51.113804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a20f77e1-d850-4128-a2a3-2aa6761d9716 req-da332015-bc69-4934-ab8d-bcc8f03e0bf0 service nova] Creating event network-changed:cc98a7d4-7d51-4756-940b-09b5894b6179 for instance 54135dcc-b26a-46bc-a635-b70c97ee1554 on n-h1-833090-19 Sep 08 10:28:51.122725 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a20f77e1-d850-4128-a2a3-2aa6761d9716 req-da332015-bc69-4934-ab8d-bcc8f03e0bf0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047444 Sep 08 10:28:51.123621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1802/3404] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:51.130468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:51.131273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:51.139669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:51.140293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:51.140862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:51.141683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:51.142249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:51.142829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:51.628571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Building network info cache for instance {{(pid=122456) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:28:51.632209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:51.640845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02eb7872-a958-42ae-b6c3-57ece797d25b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1325 microversion: 2.1 time: 0.516213 Sep 08 10:28:51.651923 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1803/3405] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:51 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:51.664550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:51.665642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:51.674869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:51.675357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:51.675836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:51.676750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:51.677202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:51.677622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.133247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:52.145831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7d75920d-7227-436b-b2b6-b7cb30e18967 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1323 microversion: 2.1 time: 0.486172 Sep 08 10:28:52.147418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1804/3406] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:51 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:52.153505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:52.154409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:52.170157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.170682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.171320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.172130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.172591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.173196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.201117 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-68c461e7-2c12-4312-851f-124e3a5e17fd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6/ips" status: 200 len: 109 microversion: 2.1 time: 0.052153 Sep 08 10:28:52.201716 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1805/3407] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:28:52 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:52.207254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-23583499-8e6d-45e8-ac5d-a017db27f6c1 req-00b4d0e3-8116-45fa-bb8f-466337a9b60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae6e08b-1d05-4cf7-a9c0-c19b64c15007", "name": "network-vif-deleted", "tag": "9c4ca470-d6ff-437b-8710-29c8d5a6b880"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:52.219449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-23583499-8e6d-45e8-ac5d-a017db27f6c1 req-00b4d0e3-8116-45fa-bb8f-466337a9b60f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.219981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-23583499-8e6d-45e8-ac5d-a017db27f6c1 req-00b4d0e3-8116-45fa-bb8f-466337a9b60f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.220419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-23583499-8e6d-45e8-ac5d-a017db27f6c1 req-00b4d0e3-8116-45fa-bb8f-466337a9b60f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.233402 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-23583499-8e6d-45e8-ac5d-a017db27f6c1 req-00b4d0e3-8116-45fa-bb8f-466337a9b60f service nova] Creating event network-vif-deleted:9c4ca470-d6ff-437b-8710-29c8d5a6b880 for instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 on n-h2-833090-19 Sep 08 10:28:52.239057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-23583499-8e6d-45e8-ac5d-a017db27f6c1 req-00b4d0e3-8116-45fa-bb8f-466337a9b60f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Sep 08 10:28:52.240289 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1806/3408] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:52.246599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:52.247619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:52.254246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.254750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.255190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.255995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.256401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.256831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.845365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:52.855718 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-73ef1913-ebbf-4351-8fee-64de4c87fc6d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.613850 Sep 08 10:28:52.857224 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1807/3409] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:52 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:52.877155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:52.878117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:52.888691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.889506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.890429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.891639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.892311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.892904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.898238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:52.927668 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c387bf6-1d61-4678-b7c6-ae60e1b5b0da tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6/ips" status: 200 len: 109 microversion: 2.1 time: 0.068362 Sep 08 10:28:52.935095 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1808/3410] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:28:52 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6/ips => generated 109 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:52.939674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:52.940294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:52.948289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.948784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.949220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:52.950513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:52.950973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:52.951401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.460593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:53.469972 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f2f7c91-b9a6-4532-9ff2-fe751635279e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1325 microversion: 2.1 time: 0.533973 Sep 08 10:28:53.471575 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1809/3411] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:52 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:53.480099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e3f71f91-bb06-4eb4-ae2c-4b06ac60ddaa req-e4aa66b4-bb29-468b-b9d2-973bcec38669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541859cb-5429-4394-b8c2-4345316dbb41", "name": "network-vif-plugged", "status": "completed", "tag": "98a670a9-5efe-4be3-88c3-ea60ce7922b3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:53.496417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e3f71f91-bb06-4eb4-ae2c-4b06ac60ddaa req-e4aa66b4-bb29-468b-b9d2-973bcec38669 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.497395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e3f71f91-bb06-4eb4-ae2c-4b06ac60ddaa req-e4aa66b4-bb29-468b-b9d2-973bcec38669 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.498180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e3f71f91-bb06-4eb4-ae2c-4b06ac60ddaa req-e4aa66b4-bb29-468b-b9d2-973bcec38669 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.518635 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e3f71f91-bb06-4eb4-ae2c-4b06ac60ddaa req-e4aa66b4-bb29-468b-b9d2-973bcec38669 service nova] Creating event network-vif-plugged:98a670a9-5efe-4be3-88c3-ea60ce7922b3 for instance 541859cb-5429-4394-b8c2-4345316dbb41 on n-h1-833090-19 Sep 08 10:28:53.526097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e3f71f91-bb06-4eb4-ae2c-4b06ac60ddaa req-e4aa66b4-bb29-468b-b9d2-973bcec38669 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052450 Sep 08 10:28:53.527132 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1810/3412] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:53.547440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:53.549431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:53.557513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.558253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.558900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.559863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.560567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.561202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.601320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-abd4bf47-ecda-41d3-9ec9-840cc318316b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6/ips/tempest-ServerAddressesTestJSON-369757906-network" status: 200 len: 94 microversion: 2.1 time: 0.072221 Sep 08 10:28:53.611777 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1811/3413] 10.222.0.59 () {58 vars in 1398 bytes} [Thu Sep 8 10:28:53 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6/ips/tempest-ServerAddressesTestJSON-369757906-network => generated 94 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:28:53.617178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:53.618074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:53.621679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:53.624723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.625634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.626424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.627065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.627893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.628349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.659295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Updating instance_info_cache with network_info: [{"id": "120d9440-40b6-46ea-81e3-169683549ad7", "address": "fa:16:3e:82:f3:a7", "network": {"id": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-428633397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "920596ac3512466ebd2e58a6dfc062cb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap120d9440-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122456) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:28:53.671596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=30 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:53.679720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Releasing lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:28:53.680655 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16c6feaa-da77-442a-9a4d-bb42ed93400d tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action" status: 202 len: 0 microversion: 2.1 time: 6.702203 Sep 08 10:28:53.684710 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1603/3414] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:46 2022] POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action => generated 0 bytes in 6707 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:28:53.690425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:53.690916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:53.698400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.699125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.699815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.701281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:53.701885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:53.702467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:53.739998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:53.812833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:53.820297 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-00a56c48-efbd-4c3b-8220-1dd1e6f622bd tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "DELETE /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 204 len: 0 microversion: 2.1 time: 0.133674 Sep 08 10:28:53.821202 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1604/3415] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:53 2022] DELETE /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:53.828314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ec821bb-e939-45ea-aae3-2fbb7ae32f2f tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '.version_select at 0x7f2351734280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:53.989791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:53.998424 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a07872f-b392-4208-b7ed-923ead72c934 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1323 microversion: 2.1 time: 0.385242 Sep 08 10:28:53.999006 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1812/3416] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:53 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:54.019781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:54.021298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:54.027546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.028043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.028474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.029177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.029627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.030066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.283819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ec821bb-e939-45ea-aae3-2fbb7ae32f2f tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/os-floating-ips/6dee0413-5cca-4b58-a491-2ab316f892a3" status: 200 len: 184 microversion: 2.1 time: 0.459632 Sep 08 10:28:54.284651 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1605/3417] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:28:53 2022] GET /compute/v2.1/os-floating-ips/6dee0413-5cca-4b58-a491-2ab316f892a3 => generated 184 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:54.290436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:54.291182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:54.298992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.299512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.299963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.300679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.301138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.301568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.304531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:54.314279 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56452135-989b-48b5-b42c-9ea8467d1e28 tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1512 microversion: 2.1 time: 0.301540 Sep 08 10:28:54.315036 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1813/3418] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:53 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:54.320479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.184"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:54.597338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:54.602830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:54.609048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.609558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.610002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.610723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.611183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.611638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.617641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5cbac7e8-930a-4d85-867e-ac0fd30297b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.331732 Sep 08 10:28:54.619156 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1606/3419] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:54 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:54.623975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}, {"name": "network-changed", "server_uuid": "a8165897-981d-4253-af24-45c63192b227", "tag": "a9600c2b-4955-4603-a053-45d1dcb05f5c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:54.635696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.636252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.636745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.652659 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] Creating event network-changed:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:28:54.653597 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] Creating event network-changed:a9600c2b-4955-4603-a053-45d1dcb05f5c for instance a8165897-981d-4253-af24-45c63192b227 on n-h2-833090-19 Sep 08 10:28:54.663649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c00889f8-dda2-453b-927a-9aa585211386 req-b1c1866e-5e67-4061-a093-e8463846952f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043103 Sep 08 10:28:54.669601 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1607/3420] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:54.687710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:54.688957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:54.697885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.698805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.699596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.700473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:54.701114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:54.701765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:54.950532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:54.959779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5eef05e-c6b5-431f-a473-f80dbebbdaf8 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1325 microversion: 2.1 time: 0.288145 Sep 08 10:28:54.959983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 10:28:54.960412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquired lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 10:28:54.960665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1608/3421] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:54 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:55.031592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1894572780", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:55.100272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] validate_networks() for [('e11d9c72-d8ba-4c51-b31a-0ad86ec288cb', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:28:56.160669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:28:56.162237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:28:56.162930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:28:56.163739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:28:56.164334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:28:56.181064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:56.181860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:56.182900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:56.183899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:56.184526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:56.186093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:56.217855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Getting quotas for project 8c8cca3886ea40b1b3f7c8792ecdd289. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:28:56.224914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Getting quotas for user cb4b005426b049e7b96829b732f8f8a8 and project 8c8cca3886ea40b1b3f7c8792ecdd289. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:28:56.244538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:28:56.248048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:28:56.328110 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46735ee0-8f41-4bd3-8893-318a426abf74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.366021 Sep 08 10:28:56.328916 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1609/3422] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:28:56.333436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:56.339854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:56.353835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:56.354374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:56.354835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:56.355605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:56.359584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:56.360174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:56.363829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Building network info cache for instance {{(pid=122457) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 10:28:56.872667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:56.886663 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8d97e272-4478-43fd-b7b8-804b984557dc tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1518 microversion: 2.1 time: 0.553688 Sep 08 10:28:56.903619 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1610/3423] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:56 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1518 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:56.903619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:56.903619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:56.919925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:56.923195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:56.923728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:56.925547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:56.940916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:56.942230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:57.745336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ed45f4eb0c4218a27d6ce03f2fc3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5244a29ef7a41ddb5a67391c24dcecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:57.762160 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e48e6cf-c04f-43ae-908c-6ff1bfd8d66b tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 200 len: 1512 microversion: 2.1 time: 0.871450 Sep 08 10:28:57.763072 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1611/3424] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:56 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 1512 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:57.771055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:57.771703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:57.788074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:57.788578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:57.791597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:57.792891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:57.793534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:57.796002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.354143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:58.369771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f0da233d-1f08-434c-982c-44fb3557f89c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.605412 Sep 08 10:28:58.371028 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1612/3425] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:57 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:58.376827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:58.377451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:58.398363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.399164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.401042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.402402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.403606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.404696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.427691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:28:58.532986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Updating instance_info_cache with network_info: [{"id": "120d9440-40b6-46ea-81e3-169683549ad7", "address": "fa:16:3e:82:f3:a7", "network": {"id": "44f5e06e-6e8b-4f9f-9754-7c27bd37f5c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-428633397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "920596ac3512466ebd2e58a6dfc062cb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap120d9440-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122457) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:28:58.549049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Releasing lock "refresh_cache-86fe817d-f7cc-4f48-933e-a98ad9896c54" {{(pid=122457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 10:28:58.550274 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7a7a6456-6065-4151-bad4-587407a36ced tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action" status: 202 len: 0 microversion: 2.1 time: 4.234008 Sep 08 10:28:58.551082 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1814/3426] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:28:54 2022] POST /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54/action => generated 0 bytes in 4235 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 10:28:58.556537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:58.557154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:58.563765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.566087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.566722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.567670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.568286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.568954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.692943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:58.720913 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-903a7fce-7888-4053-a818-28a4e280e4fb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1266 microversion: 2.1 time: 0.167729 Sep 08 10:28:58.721237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:28:58.726446 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1815/3427] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:58 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:58.729712 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59ae6695-ba89-4344-8143-d4f188c557f6 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1325 microversion: 2.1 time: 0.357335 Sep 08 10:28:58.730307 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1613/3428] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:58 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:28:58.733965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4c8a26b2-71e4-4fb2-b17b-c0cf5063dc67 req-e036d552-5978-47cd-b6c3-baf0e9ea7ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:58.734999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ebb8fd06-584b-42eb-8b3c-eb64bc7b0d5f req-950be424-1824-4862-b91d-01d2336017a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54135dcc-b26a-46bc-a635-b70c97ee1554", "name": "network-vif-plugged", "status": "completed", "tag": "cc98a7d4-7d51-4756-940b-09b5894b6179"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:58.760467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4c8a26b2-71e4-4fb2-b17b-c0cf5063dc67 req-e036d552-5978-47cd-b6c3-baf0e9ea7ed7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.760950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4c8a26b2-71e4-4fb2-b17b-c0cf5063dc67 req-e036d552-5978-47cd-b6c3-baf0e9ea7ed7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.761671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ebb8fd06-584b-42eb-8b3c-eb64bc7b0d5f req-950be424-1824-4862-b91d-01d2336017a6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.762146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ebb8fd06-584b-42eb-8b3c-eb64bc7b0d5f req-950be424-1824-4862-b91d-01d2336017a6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.762926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4c8a26b2-71e4-4fb2-b17b-c0cf5063dc67 req-e036d552-5978-47cd-b6c3-baf0e9ea7ed7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.765143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ebb8fd06-584b-42eb-8b3c-eb64bc7b0d5f req-950be424-1824-4862-b91d-01d2336017a6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.782327 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ebb8fd06-584b-42eb-8b3c-eb64bc7b0d5f req-950be424-1824-4862-b91d-01d2336017a6 service nova] Creating event network-vif-plugged:cc98a7d4-7d51-4756-940b-09b5894b6179 for instance 54135dcc-b26a-46bc-a635-b70c97ee1554 on n-h1-833090-19 Sep 08 10:28:58.789716 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ebb8fd06-584b-42eb-8b3c-eb64bc7b0d5f req-950be424-1824-4862-b91d-01d2336017a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058179 Sep 08 10:28:58.790812 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1614/3429] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:58.796118 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4c8a26b2-71e4-4fb2-b17b-c0cf5063dc67 req-e036d552-5978-47cd-b6c3-baf0e9ea7ed7 service nova] Creating event network-changed:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:28:58.796438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d80a8163-a341-4c34-8b9a-61d0253d5afb tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1699866888", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:58.816604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4c8a26b2-71e4-4fb2-b17b-c0cf5063dc67 req-e036d552-5978-47cd-b6c3-baf0e9ea7ed7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084713 Sep 08 10:28:58.818531 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1816/3430] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d80a8163-a341-4c34-8b9a-61d0253d5afb tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 243 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1699866888", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1699866888', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3b487269-4740-45dc-98cf-b12ae1e77a96'}]}}} Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:58.823893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:58.828197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.831183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d80a8163-a341-4c34-8b9a-61d0253d5afb tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:58.832297 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d80a8163-a341-4c34-8b9a-61d0253d5afb tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.040342 Sep 08 10:28:58.835275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a4c2a6c0-5e8e-4e13-932d-2ab13ddfa60b req-079ca043-acce-4338-b613-a6d79d929da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605da060-84f2-4af2-8945-90e9bf93a8c6", "name": "network-vif-deleted", "tag": "01038648-4d16-4f04-9a18-6218c7cf5da5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:58.840283 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1615/3431] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:58 2022] POST /compute/v2.1/servers => generated 175 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:28:58.851888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:58.854034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:58.861643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a4c2a6c0-5e8e-4e13-932d-2ab13ddfa60b req-079ca043-acce-4338-b613-a6d79d929da2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.862128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a4c2a6c0-5e8e-4e13-932d-2ab13ddfa60b req-079ca043-acce-4338-b613-a6d79d929da2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.862556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a4c2a6c0-5e8e-4e13-932d-2ab13ddfa60b req-079ca043-acce-4338-b613-a6d79d929da2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.867811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.868731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.869415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.870382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.871325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.871996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.878879 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a4c2a6c0-5e8e-4e13-932d-2ab13ddfa60b req-079ca043-acce-4338-b613-a6d79d929da2 service nova] Creating event network-vif-deleted:01038648-4d16-4f04-9a18-6218c7cf5da5 for instance 605da060-84f2-4af2-8945-90e9bf93a8c6 on n-h1-833090-19 Sep 08 10:28:58.886678 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a4c2a6c0-5e8e-4e13-932d-2ab13ddfa60b req-079ca043-acce-4338-b613-a6d79d929da2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064707 Sep 08 10:28:58.887816 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1817/3432] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:28:58.895354 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] HTTP exception thrown: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Request method failure captured: Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 HTTP/1.1 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOT1pTwPprCmiRrPFKlC-TEr9fLWfJ3n2y_Y2dNi8cOjBLbM1ILGsW3_wm96qtC25ttD9oHv2cK_FhPxtwI-AAPOWyfo12HRUA8LGv2dAmBbn46TA6-_Cq2m8wCrGrUKsB8-e43hT_XYmBUJQPGj9rLOFYsdZM9IoDG-boVmXnQ7pk Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_920596ac3512466ebd2e58a6dfc062cb", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: f56ca90367aa4d748c3bca6b9b4a2dbd Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1ae6e08b-1d05-4cf7-a9c0-c19b64c15007'} Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:58.897072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:58.902398 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.903105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:58.903105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] [instance: 605da060-84f2-4af2-8945-90e9bf93a8c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:58.906841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Returning 404 to user: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:58.908422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5d7a4cf-7e23-4f03-a9df-219870ede3b8 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 404 len: 111 microversion: 2.1 time: 0.066721 Sep 08 10:28:58.909592 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1616/3433] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:58 2022] DELETE /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:58.914730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.915259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.918388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.918530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:58.919130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0854dace-1ca9-4cc6-b93f-e40c09197d50 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:58.919291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:58.920071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0854dace-1ca9-4cc6-b93f-e40c09197d50 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: f7aed8e6-aaec-4558-8c08-6ea977b534f0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:58.921659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:58.927424 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-0854dace-1ca9-4cc6-b93f-e40c09197d50 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] HTTP exception thrown: Instance f7aed8e6-aaec-4558-8c08-6ea977b534f0 could not be found. Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0854dace-1ca9-4cc6-b93f-e40c09197d50 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/f7aed8e6-aaec-4558-8c08-6ea977b534f0/metadata HTTP/1.1 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f7aed8e6-aaec-4558-8c08-6ea977b534f0 could not be found. Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': 'f7aed8e6-aaec-4558-8c08-6ea977b534f0'} Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7aed8e6-aaec-4558-8c08-6ea977b534f0 could not be found. Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7aed8e6-aaec-4558-8c08-6ea977b534f0 could not be found. Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.936466 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.941764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:58.941764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:58.941764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7aed8e6-aaec-4558-8c08-6ea977b534f0 could not be found. Sep 08 10:28:58.941764 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.941764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0854dace-1ca9-4cc6-b93f-e40c09197d50 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 404 to user: Instance f7aed8e6-aaec-4558-8c08-6ea977b534f0 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:58.941764 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0854dace-1ca9-4cc6-b93f-e40c09197d50 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/f7aed8e6-aaec-4558-8c08-6ea977b534f0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.028621 Sep 08 10:28:58.950416 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] HTTP exception thrown: Instance 605da060-84f2-4af2-8945-90e9bf93a8c6 could not be found. Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Request method failure captured: Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 HTTP/1.1 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPJlHmbQGwrOYOqjkhRlfKcUZ7t9MJ7Z7RxWZLnbK2lZrS3e2Lm5GEZZQ-ovGYbpXFLCUF7SGjiqANJyEIpKiQ4eVQEJkROXW9WF5MG5pY7RYN6Th_FFREOckzTT16dBPlwzMDE8BA1JSAyoV5HYzWMZ00_2nCU54KC_FO97h-csDk Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: a5244a29ef7a41ddb5a67391c24dcecd Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerAddressesTestJSON-858579196 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a5244a29ef7a41ddb5a67391c24dcecd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a5244a29ef7a41ddb5a67391c24dcecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a5244a29ef7a41ddb5a67391c24dcecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a5244a29ef7a41ddb5a67391c24dcecd", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerAddressesTestJSON-858579196 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: a5244a29ef7a41ddb5a67391c24dcecd Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerAddressesTestJSON-858579196 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerAddressesTestJSON-858579196-project Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: b1ed45f4eb0c4218a27d6ce03f2fc3c3 Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerAddressesTestJSON-858579196-project Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 605da060-84f2-4af2-8945-90e9bf93a8c6 could not be found. Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '605da060-84f2-4af2-8945-90e9bf93a8c6'} Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605da060-84f2-4af2-8945-90e9bf93a8c6 could not be found. Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605da060-84f2-4af2-8945-90e9bf93a8c6 could not be found. Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:58.952440 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605da060-84f2-4af2-8945-90e9bf93a8c6 could not be found. Sep 08 10:28:58.957376 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:58.957919 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1617/3434] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:28:58 2022] GET /compute/v2.1/servers/f7aed8e6-aaec-4558-8c08-6ea977b534f0/metadata => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:58.959262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] Returning 404 to user: Instance 605da060-84f2-4af2-8945-90e9bf93a8c6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:58.960420 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a4633c04-8a3b-4aee-be06-b045bc4793bf tempest-ServerAddressesTestJSON-858579196 tempest-ServerAddressesTestJSON-858579196-project] 10.222.0.59 "GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6" status: 404 len: 111 microversion: 2.1 time: 0.070950 Sep 08 10:28:58.962707 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1818/3435] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:58 2022] GET /compute/v2.1/servers/605da060-84f2-4af2-8945-90e9bf93a8c6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:58.975194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:58.976332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:59.020458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:59.021412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:59.022338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:59.023847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:59.026240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:59.027744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:59.045579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc2bf36f-94dd-4ae8-a269-542dd0a35c5c tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-694291189", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc2bf36f-94dd-4ae8-a269-542dd0a35c5c tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 498 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-694291189", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-694291189', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b487269-4740-45dc-98cf-b12ae1e77a96'}]}}} Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:28:59.052175 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.055358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.062820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc2bf36f-94dd-4ae8-a269-542dd0a35c5c tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:59.065606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc2bf36f-94dd-4ae8-a269-542dd0a35c5c tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026389 Sep 08 10:28:59.069246 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] HTTP exception thrown: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:59.070245 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1819/3436] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:59 2022] POST /compute/v2.1/servers => generated 687 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Request method failure captured: Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 HTTP/1.1 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOT1pTwPprCmiRrPFKlC-TEr9fLWfJ3n2y_Y2dNi8cOjBLbM1ILGsW3_wm96qtC25ttD9oHv2cK_FhPxtwI-AAPOWyfo12HRUA8LGv2dAmBbn46TA6-_Cq2m8wCrGrUKsB8-e43hT_XYmBUJQPGj9rLOFYsdZM9IoDG-boVmXnQ7pk Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_920596ac3512466ebd2e58a6dfc062cb", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: f56ca90367aa4d748c3bca6b9b4a2dbd Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1ae6e08b-1d05-4cf7-a9c0-c19b64c15007'} Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.111097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Returning 404 to user: Instance 1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:59.123823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0ada1b30-181f-43da-a749-b5015bbef2a5 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007" status: 404 len: 111 microversion: 2.1 time: 0.155633 Sep 08 10:28:59.125844 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1618/3437] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:58 2022] GET /compute/v2.1/servers/1ae6e08b-1d05-4cf7-a9c0-c19b64c15007 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:59.131563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2ac7849-5a28-4eaf-b9d0-583be1c716b9 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '.version_select at 0x7f2350634e50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:59.156321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b506b323-7c99-44eb-96c2-3a7a603199fd tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-584414221", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b506b323-7c99-44eb-96c2-3a7a603199fd tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 499 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-584414221", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-584414221', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b487269-4740-45dc-98cf-b12ae1e77a96'}]}}} Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:28:59.160645 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b506b323-7c99-44eb-96c2-3a7a603199fd tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:59.164970 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b506b323-7c99-44eb-96c2-3a7a603199fd tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009862 Sep 08 10:28:59.171974 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1619/3438] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:59 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:28:59.217622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9acc6ff0-158f-4b5f-98c4-c7f7895b2196 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-673273645", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9acc6ff0-158f-4b5f-98c4-c7f7895b2196 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 753 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-673273645", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-673273645', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b487269-4740-45dc-98cf-b12ae1e77a96'}]}}} Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:28:59.223083 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:28:59.226391 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:28:59.241104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.241104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.241104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9acc6ff0-158f-4b5f-98c4-c7f7895b2196 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:59.241104 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9acc6ff0-158f-4b5f-98c4-c7f7895b2196 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012603 Sep 08 10:28:59.241104 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1620/3439] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:28:59 2022] POST /compute/v2.1/servers => generated 1197 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 08 10:28:59.287522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f08dd03a-3a2b-4b0c-b51c-ebbaf8451096 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1694959134", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f08dd03a-3a2b-4b0c-b51c-ebbaf8451096 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 1266 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1694959134", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3b487269-4740-45dc-98cf-b12ae1e77a96"}]}} Sep 08 10:28:59.292619 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1694959134', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3b487269-4740-45dc-98cf-b12ae1e77a96'}]}}} Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.294751 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:28:59.296324 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:28:59.298404 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 10:28:59.298404 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.298404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f08dd03a-3a2b-4b0c-b51c-ebbaf8451096 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:59.298404 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f08dd03a-3a2b-4b0c-b51c-ebbaf8451096 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010748 Sep 08 10:28:59.298404 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1621/3440] 10.222.0.59 () {60 vars in 1148 bytes} [Thu Sep 8 10:28:59 2022] POST /compute/v2.1/servers => generated 2221 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 08 10:28:59.304386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2bb4b820-293b-46bb-aefb-77e33a915455 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:59.305137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2bb4b820-293b-46bb-aefb-77e33a915455 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 9ec839ee-8abc-4b28-98d5-6599b2591c5e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:59.311839 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2bb4b820-293b-46bb-aefb-77e33a915455 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] HTTP exception thrown: Instance 9ec839ee-8abc-4b28-98d5-6599b2591c5e could not be found. Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2bb4b820-293b-46bb-aefb-77e33a915455 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/9ec839ee-8abc-4b28-98d5-6599b2591c5e/metadata/test2 HTTP/1.1 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9ec839ee-8abc-4b28-98d5-6599b2591c5e could not be found. Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': '9ec839ee-8abc-4b28-98d5-6599b2591c5e', 'id': 'test2'} Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec839ee-8abc-4b28-98d5-6599b2591c5e could not be found. Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec839ee-8abc-4b28-98d5-6599b2591c5e could not be found. Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:28:59.314019 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:28:59.318725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:28:59.318725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:28:59.318725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec839ee-8abc-4b28-98d5-6599b2591c5e could not be found. Sep 08 10:28:59.318725 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:28:59.318725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2bb4b820-293b-46bb-aefb-77e33a915455 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 404 to user: Instance 9ec839ee-8abc-4b28-98d5-6599b2591c5e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:28:59.320094 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2bb4b820-293b-46bb-aefb-77e33a915455 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/9ec839ee-8abc-4b28-98d5-6599b2591c5e/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.018134 Sep 08 10:28:59.323997 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1622/3441] 10.222.0.59 () {58 vars in 1281 bytes} [Thu Sep 8 10:28:59 2022] GET /compute/v2.1/servers/9ec839ee-8abc-4b28-98d5-6599b2591c5e/metadata/test2 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:28:59.338210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:59.338714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:59.345677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:59.346170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:59.346824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:59.347572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:59.348037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:59.348470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:59.377048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:28:59.502578 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd9ed92b-1d5a-4998-81e3-f3a018df89ff tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "DELETE /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 204 len: 0 microversion: 2.1 time: 0.167651 Sep 08 10:28:59.503162 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1623/3442] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:28:59 2022] DELETE /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:28:59.515277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:28:59.516111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:28:59.523746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:59.524870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:59.525345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:28:59.526129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:28:59.526706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:28:59.527170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:00.190730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:00.205936 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b54151cd-c890-4931-a33a-dbe4ea2d1ced tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.698841 Sep 08 10:29:00.207095 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1624/3443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:28:59 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:00.214044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:00.215738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:00.224024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:00.224883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:00.226687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:00.228367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:00.229086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:00.230215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:00.572349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:00.583110 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e88f725-a8c4-4dfb-8bc9-0987de9f1f39 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1524 microversion: 2.1 time: 0.374713 Sep 08 10:29:00.584015 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1625/3444] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:00 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1524 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:00.589186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:00.590052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:00.597471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:00.598125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:00.598671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:00.599523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:00.600062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:00.600601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:00.965974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:00.975506 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-19dd63c5-ffe6-4ecf-8459-7439b5490f79 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.390173 Sep 08 10:29:00.991491 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1626/3445] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:00 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:00.997232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:00.999598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:01.007932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.010730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.011876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.012881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.013500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.014134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.100149 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2ac7849-5a28-4eaf-b9d0-583be1c716b9 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "DELETE /compute/v2.1/os-floating-ips/6dee0413-5cca-4b58-a491-2ab316f892a3" status: 202 len: 0 microversion: 2.1 time: 1.971708 Sep 08 10:29:01.102175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1820/3446] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:28:59 2022] DELETE /compute/v2.1/os-floating-ips/6dee0413-5cca-4b58-a491-2ab316f892a3 => generated 0 bytes in 1975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:29:01.112740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-852eb3cb-7af6-4edb-91a9-06e436a104d6 req-0b591089-a117-4969-801e-46795f49e455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8165897-981d-4253-af24-45c63192b227", "name": "network-vif-plugged", "status": "completed", "tag": "a9600c2b-4955-4603-a053-45d1dcb05f5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:01.135321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-852eb3cb-7af6-4edb-91a9-06e436a104d6 req-0b591089-a117-4969-801e-46795f49e455 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.136177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-852eb3cb-7af6-4edb-91a9-06e436a104d6 req-0b591089-a117-4969-801e-46795f49e455 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.137374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-852eb3cb-7af6-4edb-91a9-06e436a104d6 req-0b591089-a117-4969-801e-46795f49e455 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.154939 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-852eb3cb-7af6-4edb-91a9-06e436a104d6 req-0b591089-a117-4969-801e-46795f49e455 service nova] Creating event network-vif-plugged:a9600c2b-4955-4603-a053-45d1dcb05f5c for instance a8165897-981d-4253-af24-45c63192b227 on n-h2-833090-19 Sep 08 10:29:01.161770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-852eb3cb-7af6-4edb-91a9-06e436a104d6 req-0b591089-a117-4969-801e-46795f49e455 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056442 Sep 08 10:29:01.163248 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1821/3447] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:01.170787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:01.171791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:01.179433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.180252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.181075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.181806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.182267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.182701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.216077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:29:01.359111 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d5203a6-08bc-4128-a377-598839245515 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 204 len: 0 microversion: 2.1 time: 0.190198 Sep 08 10:29:01.359888 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1822/3448] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:01 2022] DELETE /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:01.375924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:01.377069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:01.389848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.404537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.405077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.405914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.412198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.413554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.520592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:01.531129 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9737f86b-77ab-4fd8-86ba-28e25e172967 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1325 microversion: 2.1 time: 0.538114 Sep 08 10:29:01.531913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1627/3449] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:00 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1325 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:01.542494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:01.544949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:01.553892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.556587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.557092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.558060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.558534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.558998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.780010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:01.791157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34d55fa8-53d8-40e8-a7f9-65ca5fdbb6ae tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.429755 Sep 08 10:29:01.800287 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1823/3450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:01 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:01.813360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:01.814817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:01.821441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.824074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.833314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.834325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:01.834804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:01.835237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:01.839185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:01.848338 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb44195a-ff59-4d08-b4af-41d542e89fc3 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1524 microversion: 2.1 time: 0.314715 Sep 08 10:29:01.855705 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1628/3451] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:01 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1524 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:02.000336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:02.001368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:02.008744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.009246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.010147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.011031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.011709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.012143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.079274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:02.089763 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f90dd93-5269-4ccd-9f31-c4ee320b4891 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1524 microversion: 2.1 time: 0.288099 Sep 08 10:29:02.090795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1824/3452] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:01 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:02.252672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:02.271252 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-90f89316-20b8-4e87-b662-4b8869c7d2a8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.275517 Sep 08 10:29:02.285291 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1629/3453] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:01 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:02.490609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e22ce597-f255-4584-bfa1-1032a9890104 req-709896a7-0beb-4606-ac6a-22cc6dc93431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df528d15-892b-4880-a5d9-c5bf4f33e60b", "tag": "35461c57-49b0-4c75-a9d2-efea812bf8d6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:02.507096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e22ce597-f255-4584-bfa1-1032a9890104 req-709896a7-0beb-4606-ac6a-22cc6dc93431 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.507594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e22ce597-f255-4584-bfa1-1032a9890104 req-709896a7-0beb-4606-ac6a-22cc6dc93431 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.508050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e22ce597-f255-4584-bfa1-1032a9890104 req-709896a7-0beb-4606-ac6a-22cc6dc93431 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.533849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e22ce597-f255-4584-bfa1-1032a9890104 req-709896a7-0beb-4606-ac6a-22cc6dc93431 service nova] Creating event network-changed:35461c57-49b0-4c75-a9d2-efea812bf8d6 for instance df528d15-892b-4880-a5d9-c5bf4f33e60b on n-h2-833090-19 Sep 08 10:29:02.539421 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e22ce597-f255-4584-bfa1-1032a9890104 req-709896a7-0beb-4606-ac6a-22cc6dc93431 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054498 Sep 08 10:29:02.540642 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1825/3454] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:02.559277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:02.559912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:02.568572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.569070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.569514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.570233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.570692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.571918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.798868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:02.810743 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f2d68974-8d51-430b-9d01-85896dc7bd2e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1521 microversion: 2.1 time: 0.255263 Sep 08 10:29:02.811447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1630/3455] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:02 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:02.828297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:02.829368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:02.843813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:02.844156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:02.845046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:02.846591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.847419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.848150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.849241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.849776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.850381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.853212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.853708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.854521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:02.856448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:02.856964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:02.857403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.233089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:03.242043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d523da1a-2019-4435-9132-e27c95005a01 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1521 microversion: 2.1 time: 0.402305 Sep 08 10:29:03.245995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:03.268924 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba300db9-5902-422f-a1ce-bb03176c178d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1322 microversion: 2.1 time: 0.445658 Sep 08 10:29:03.269623 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1631/3456] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:02 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:03.285925 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1826/3457] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:02 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:03.286158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:03.286158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:03.286420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:03.292003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:03.297136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.297892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.298537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.299077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.299670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.299940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.300476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.300664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.301353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.301907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.302035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.302502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.729671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:03.745811 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be887bd3-1299-4193-bd22-b6d2bb49a8ac tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1524 microversion: 2.1 time: 0.472619 Sep 08 10:29:03.747548 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1632/3458] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:03 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1524 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:03.766376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1155101233"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:03.769565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:03.773959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:03.778235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.779255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.780021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.781237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.782141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.782761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.785282 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0000e351-25c3-45c7-b810-c898030b1a19 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1524 microversion: 2.1 time: 0.508441 Sep 08 10:29:03.786791 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1827/3459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:03 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1524 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:03.800086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:03.800955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:03.821006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.821549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.821982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:03.822686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:03.823131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:03.823579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:04.072927 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54eeacab-4f73-4fea-a52a-fd7628cb62f9 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554/action" status: 202 len: 0 microversion: 2.1 time: 0.310349 Sep 08 10:29:04.077047 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1633/3460] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:03 2022] POST /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:29:04.091795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99e681f4-6825-4856-8883-056848046688 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '.version_select at 0x7f2351388310>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:04.324559 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99e681f4-6825-4856-8883-056848046688 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4" status: 204 len: 0 microversion: 2.1 time: 0.240066 Sep 08 10:29:04.325484 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1634/3461] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:04 2022] DELETE /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:04.331608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-60412392-e125-4423-899e-238825207231 req-33c3d3d7-a099-4bf9-9f20-c3ad95ce4d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541859cb-5429-4394-b8c2-4345316dbb41", "name": "network-vif-deleted", "tag": "98a670a9-5efe-4be3-88c3-ea60ce7922b3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:04.343962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60412392-e125-4423-899e-238825207231 req-33c3d3d7-a099-4bf9-9f20-c3ad95ce4d4a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:04.344731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60412392-e125-4423-899e-238825207231 req-33c3d3d7-a099-4bf9-9f20-c3ad95ce4d4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:04.345339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60412392-e125-4423-899e-238825207231 req-33c3d3d7-a099-4bf9-9f20-c3ad95ce4d4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:04.361226 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-60412392-e125-4423-899e-238825207231 req-33c3d3d7-a099-4bf9-9f20-c3ad95ce4d4a service nova] Creating event network-vif-deleted:98a670a9-5efe-4be3-88c3-ea60ce7922b3 for instance 541859cb-5429-4394-b8c2-4345316dbb41 on n-h1-833090-19 Sep 08 10:29:04.367565 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-60412392-e125-4423-899e-238825207231 req-33c3d3d7-a099-4bf9-9f20-c3ad95ce4d4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Sep 08 10:29:04.369493 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1635/3462] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:04.378637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:04.379947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:04.387639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:04.388403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:04.389070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:04.390009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:04.390709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:04.391233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:04.617899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:04.629014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3b74b1b-e9bd-4f16-bbac-c86d9489d81c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.839381 Sep 08 10:29:04.630368 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1828/3463] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:03 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:04.648900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d5e04ca-6d6f-481b-b1aa-02be59cd961a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '.version_select at 0x7f2350a4fee0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:04.685487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8d5e04ca-6d6f-481b-b1aa-02be59cd961a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Image not found. Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d5e04ca-6d6f-481b-b1aa-02be59cd961a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4 HTTP/1.1 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6496274d-18d8-4bb2-849c-3256afd5ced4'} Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6496274d-18d8-4bb2-849c-3256afd5ced4 Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:04.687883 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6496274d-18d8-4bb2-849c-3256afd5ced4 could not be found. Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d5e04ca-6d6f-481b-b1aa-02be59cd961a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d5e04ca-6d6f-481b-b1aa-02be59cd961a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4" status: 404 len: 62 microversion: 2.1 time: 0.058486 Sep 08 10:29:04.692713 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1829/3464] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:29:04 2022] GET /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:04.700125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:04.700811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:04.708574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:04.709074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:04.709520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:04.710228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:04.710763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:04.711232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:04.715733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:04.825366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:04.827885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:04.835062 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-935dd448-00a7-42e0-bfad-f6144d027ae9 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1515 microversion: 2.1 time: 0.462388 Sep 08 10:29:04.836319 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1636/3465] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:04 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:04.988883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:05.017537 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6836f2f3-397e-492c-9431-afa49080129e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1533 microversion: 2.1 time: 0.321267 Sep 08 10:29:05.018134 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1830/3466] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:04 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1533 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:05.034990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c2bd3e40-d64a-4beb-a0cc-ab8f7d90f097 req-08fc5462-905f-4546-a422-06cebf16c5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fe817d-f7cc-4f48-933e-a98ad9896c54", "name": "network-vif-deleted", "tag": "120d9440-40b6-46ea-81e3-169683549ad7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:05.041681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:05.043171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:05.046844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c2bd3e40-d64a-4beb-a0cc-ab8f7d90f097 req-08fc5462-905f-4546-a422-06cebf16c5e5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.046991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c2bd3e40-d64a-4beb-a0cc-ab8f7d90f097 req-08fc5462-905f-4546-a422-06cebf16c5e5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.047429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c2bd3e40-d64a-4beb-a0cc-ab8f7d90f097 req-08fc5462-905f-4546-a422-06cebf16c5e5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.080048 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c2bd3e40-d64a-4beb-a0cc-ab8f7d90f097 req-08fc5462-905f-4546-a422-06cebf16c5e5 service nova] Creating event network-vif-deleted:120d9440-40b6-46ea-81e3-169683549ad7 for instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 on n-h1-833090-19 Sep 08 10:29:05.085469 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c2bd3e40-d64a-4beb-a0cc-ab8f7d90f097 req-08fc5462-905f-4546-a422-06cebf16c5e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247845 Sep 08 10:29:05.086723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1637/3467] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:05.092703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.094932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:05.096073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:05.096863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.097938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.101755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.102465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.102905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.103427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.103954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.105071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.105968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.106434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.106957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.145817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.146618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.147697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.148392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lazy-loading 'fault' on Instance uuid 541859cb-5429-4394-b8c2-4345316dbb41 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:05.203377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34267c34f0d4c61ba99351e74383a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5041fc5a4741f9a8eebb8b686ca3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:05.217726 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-61524bc7-f701-466e-a9a2-9e5e2dddf021 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 200 len: 1313 microversion: 2.1 time: 0.126176 Sep 08 10:29:05.233500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1638/3468] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:05 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:05.239504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:05.241350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56ca90367aa4d748c3bca6b9b4a2dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920596ac3512466ebd2e58a6dfc062cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:05.248159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:05.253377 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff9bc3ce-1356-4f54-8dd3-491831b9da27 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 200 len: 1308 microversion: 2.1 time: 0.216287 Sep 08 10:29:05.257496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.258441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.259996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.260964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.261726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.262396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.272701 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1831/3469] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:05 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:05.295567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'flavor' on Instance uuid a8165897-981d-4253-af24-45c63192b227 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:05.391618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14fc9e15-9acf-4edc-a969-acc9ad18e4f1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action" status: 200 len: 32 microversion: 2.1 time: 0.156238 Sep 08 10:29:05.392492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1639/3470] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:05 2022] POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:29:05.404487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:05.405567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:05.412495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.412986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.413426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.425421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.426150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.426603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.562930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:05.570877 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-37f2e04f-eddd-477e-80ec-1a815768a0d7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.170945 Sep 08 10:29:05.571515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1832/3471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:05 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:05.654272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:05.655131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:05.662723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.663134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.663598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.664353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:05.666421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:05.666564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:05.855672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:05.865149 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f086803-1dc8-4d55-bdf8-ae90d7cd3c03 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.216121 Sep 08 10:29:05.879490 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1640/3472] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:05 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:06.043854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:06.045167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:06.051952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.052597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.052866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.053564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.054014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.054433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.200171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:06.220452 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c69f0106-fcd5-4cf2-b0e9-c442fab3a18f tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1539 microversion: 2.1 time: 0.180902 Sep 08 10:29:06.221250 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1833/3473] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:06 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:06.252054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:06.252888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] [instance: 541859cb-5429-4394-b8c2-4345316dbb41] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:06.262712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:06.263450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:06.269632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.270535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.271355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.272179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.272889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.273386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.286821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:06.287564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] [instance: 86fe817d-f7cc-4f48-933e-a98ad9896c54] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:06.295812 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] HTTP exception thrown: Instance 541859cb-5429-4394-b8c2-4345316dbb41 could not be found. Sep 08 10:29:06.297057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Request method failure captured: Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 HTTP/1.1 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPULLRLfo90AKUrYld-o31gIU8n3f_K1GFGNHaAkoA7n_ebQfSAHoEzVC5Q1mdB08GWc_rCu-Z82TEOd9fgMQadL70Y7HcAQkBGdCguL62iRciA436mdqNLa6KIMZ6rjfomsj8UVmGbD5_taFNPCBF2QmWDOGdrB3paJhVnD-UA4U0 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5041fc5a4741f9a8eebb8b686ca3ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5041fc5a4741f9a8eebb8b686ca3ef", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 0b5041fc5a4741f9a8eebb8b686ca3ef Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-57936924 Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: a34267c34f0d4c61ba99351e74383a2b Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-57936924-project Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 541859cb-5429-4394-b8c2-4345316dbb41 could not be found. Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '541859cb-5429-4394-b8c2-4345316dbb41'} Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541859cb-5429-4394-b8c2-4345316dbb41 could not be found. Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541859cb-5429-4394-b8c2-4345316dbb41 could not be found. Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.297546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541859cb-5429-4394-b8c2-4345316dbb41 could not be found. Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] Returning 404 to user: Instance 541859cb-5429-4394-b8c2-4345316dbb41 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8588a3a1-1e42-4372-8e56-adb566161f77 tempest-ServerMetadataNegativeTestJSON-57936924 tempest-ServerMetadataNegativeTestJSON-57936924-project] 10.222.0.59 "GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41" status: 404 len: 111 microversion: 2.1 time: 0.053247 Sep 08 10:29:06.302855 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1641/3474] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:06 2022] GET /compute/v2.1/servers/541859cb-5429-4394-b8c2-4345316dbb41 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:06.304274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.305110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.306064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.306681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.307411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.326894 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] HTTP exception thrown: Instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 could not be found. Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Request method failure captured: Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 HTTP/1.1 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOT1pTwPprCmiRrPFKlC-TEr9fLWfJ3n2y_Y2dNi8cOjBLbM1ILGsW3_wm96qtC25ttD9oHv2cK_FhPxtwI-AAPOWyfo12HRUA8LGv2dAmBbn46TA6-_Cq2m8wCrGrUKsB8-e43hT_XYmBUJQPGj9rLOFYsdZM9IoDG-boVmXnQ7pk Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/920596ac3512466ebd2e58a6dfc062cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_920596ac3512466ebd2e58a6dfc062cb", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 920596ac3512466ebd2e58a6dfc062cb Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-48470462 Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: f56ca90367aa4d748c3bca6b9b4a2dbd Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-48470462-project Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 could not be found. Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '86fe817d-f7cc-4f48-933e-a98ad9896c54'} Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 could not be found. Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 could not be found. Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.328592 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 could not be found. Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] Returning 404 to user: Instance 86fe817d-f7cc-4f48-933e-a98ad9896c54 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:06.333890 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59bf968b-4208-48f0-bc41-8d4d18850273 tempest-FloatingIPsAssociationTestJSON-48470462 tempest-FloatingIPsAssociationTestJSON-48470462-project] 10.222.0.59 "GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54" status: 404 len: 111 microversion: 2.1 time: 0.049471 Sep 08 10:29:06.336472 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1834/3475] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:06 2022] GET /compute/v2.1/servers/86fe817d-f7cc-4f48-933e-a98ad9896c54 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:06.594427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:06.595503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:06.601833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.602698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.603385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.604394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.605081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.605743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.879512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:06.889879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:06.890493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:06.902471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.903414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c33a8c7f-3267-44c8-aa30-b19a38bf2e79 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.311172 Sep 08 10:29:06.905376 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1642/3476] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:06 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:06.923415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.924036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:06.924934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:06.925655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:06.926153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:07.226803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:07.239002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1dd3f54-e294-4f14-9031-8124fc116d8f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.353545 Sep 08 10:29:07.247314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:07.247991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:07.253280 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1835/3477] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:06 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:07.283899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:07.284563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:07.285024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:07.285894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:07.286362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:07.286989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:07.682676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:07.696020 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b9b53c04-894d-4455-91a0-4e89d7a1309b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1534 microversion: 2.1 time: 0.452870 Sep 08 10:29:07.710682 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1643/3478] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:07 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1534 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:07.928307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:07.929279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:07.936467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:07.936951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:07.937680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:07.938815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:07.939634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:07.940409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:08.281132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:08.282944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:08.294491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:08.295405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:08.296312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:08.297267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:08.298547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:08.299250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:08.328593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:08.340674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9287002c-8ed9-43be-bbfc-12dc4818a9e6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.415407 Sep 08 10:29:08.355493 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1836/3479] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:07 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:08.676061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:08.695198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6849ce4d-290b-497e-a7a3-e2e823973455 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.417831 Sep 08 10:29:08.696157 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1644/3480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:08 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:08.723451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:08.724366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:08.731172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:08.731990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:08.733287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:08.734221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:08.734880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:08.735529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:09.019089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:09.033072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b128e254-87e7-462f-ab37-4251cd20bfb2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1521 microversion: 2.1 time: 0.312885 Sep 08 10:29:09.034136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1837/3481] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:08 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:09.078605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:09.079245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:09.089302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:09.090146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:09.090832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:09.092008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:09.092947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:09.093833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:09.135000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:29:09.296089 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ea4a9df-0492-41b7-860e-447670c92185 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 204 len: 0 microversion: 2.1 time: 0.234054 Sep 08 10:29:09.297542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1645/3482] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:09 2022] DELETE /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:09.306239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:09.307110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:09.329422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:09.331000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:09.332054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:09.333296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:09.333926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:09.334703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:09.369471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:09.371072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:09.373457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:09.393117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:09.395213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:09.396016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:09.399176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:09.424196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:09.425089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:10.175891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:10.188422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4308e490-04be-4341-b92f-895e53972491 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1527 microversion: 2.1 time: 0.883120 Sep 08 10:29:10.189223 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1838/3483] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:09 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1527 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:10.203436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:10.204250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:10.216955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:10.217592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:10.220191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:10.221051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:10.221619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:10.222951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:10.257552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:10.266821 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1efd724-838f-4d5f-b102-d9ec6514cf59 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.902064 Sep 08 10:29:10.273530 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1646/3484] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:09 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:10.517756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:10.531038 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-41f430f4-b562-460a-8f9c-891c1964a512 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.339650 Sep 08 10:29:10.550456 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1839/3485] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:10 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:11.221665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:11.223732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:11.233844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:11.234778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:11.235510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:11.236508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:11.237247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:11.237983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:11.309269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:11.310139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:11.318786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:11.321118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:11.322452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:11.323730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:11.324742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:11.325565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:11.666367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:11.685380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-703dcc83-af67-407a-a80e-b00f099dc73b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1527 microversion: 2.1 time: 0.470024 Sep 08 10:29:11.705972 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1647/3486] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:11 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1527 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:11.730663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:11.731902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:11.774161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:11.785833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:11.786697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:11.792613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:11.797197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:11.798023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:11.925584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:11.950959 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0e5d1b4-338d-410f-86b5-6772c099f800 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.649650 Sep 08 10:29:11.958678 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1840/3487] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:11 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:12.315804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:12.340262 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39f892eb-9b1a-4bb4-9216-1a3ad9d2bdd5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.631976 Sep 08 10:29:12.341472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1648/3488] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:11 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:12.639191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a6193da6-8a7b-43a8-bc03-8c174bf910fb req-e2ce71a9-a2a0-4b09-a7c6-0ca2442cca2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54135dcc-b26a-46bc-a635-b70c97ee1554", "name": "network-vif-deleted", "tag": "cc98a7d4-7d51-4756-940b-09b5894b6179"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:12.714389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:12.715879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:12.722134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a6193da6-8a7b-43a8-bc03-8c174bf910fb req-e2ce71a9-a2a0-4b09-a7c6-0ca2442cca2c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:12.722631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a6193da6-8a7b-43a8-bc03-8c174bf910fb req-e2ce71a9-a2a0-4b09-a7c6-0ca2442cca2c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:12.723073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a6193da6-8a7b-43a8-bc03-8c174bf910fb req-e2ce71a9-a2a0-4b09-a7c6-0ca2442cca2c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:12.727001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:12.732164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:12.732806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:12.733663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:12.734248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:12.736216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:12.760913 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a6193da6-8a7b-43a8-bc03-8c174bf910fb req-e2ce71a9-a2a0-4b09-a7c6-0ca2442cca2c service nova] Creating event network-vif-deleted:cc98a7d4-7d51-4756-940b-09b5894b6179 for instance 54135dcc-b26a-46bc-a635-b70c97ee1554 on n-h1-833090-19 Sep 08 10:29:12.779630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a6193da6-8a7b-43a8-bc03-8c174bf910fb req-e2ce71a9-a2a0-4b09-a7c6-0ca2442cca2c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151889 Sep 08 10:29:12.788296 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1841/3489] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:12.980953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:12.981815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:12.993009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:12.993326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:12.993960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:12.995573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:12.996266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:12.997108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:13.019245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:13.030618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35f6e742-ee22-45b0-a9a1-688b2a72af66 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 200 len: 1310 microversion: 2.1 time: 0.320730 Sep 08 10:29:13.037419 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1649/3490] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:12 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:13.374198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:13.375566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:13.389107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:13.389614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:13.390170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:13.392262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:13.392819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:13.393265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:13.589747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:13.613003 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b938c330-5d38-4fb8-97e5-9b9cea58b017 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.640866 Sep 08 10:29:13.614104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1842/3491] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:12 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:13.857994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:13.862445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:13.870740 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70820ac8-5e21-4d91-b1f9-e9518ed5397a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.508504 Sep 08 10:29:13.877228 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1650/3492] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:13 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:13.953080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1165376000", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "2b88b5af-6369-4f9d-a3e0-a1aae9ba6b43"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:14.046798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] validate_networks() for [('2b88b5af-6369-4f9d-a3e0-a1aae9ba6b43', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:29:14.064791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:14.092534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:14.093319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:14.093319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:14.093679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:14.094633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:14.095540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:14.096165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:14.115271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 HTTP/1.1 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '54135dcc-b26a-46bc-a635-b70c97ee1554'} Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:14.124514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8fb7db0-153f-48e5-b187-cfb24386f79e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 404 len: 111 microversion: 2.1 time: 0.070681 Sep 08 10:29:14.129660 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1651/3493] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:14 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:14.300887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1847921901", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:14.402628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] validate_networks() for [('1afcb5e7-b8a1-47bd-a9ce-6ef9966f63b5', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:29:14.971045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:29:14.971506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:29:14.972092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:29:14.972514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:29:14.973022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:29:14.985765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:14.986393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:14.986920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:14.987881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:14.988630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:14.989274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.020510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Getting quotas for project 2780d87bb2d145af92bae72ece6f8005. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:15.026392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Getting quotas for user 2d9a9cd8f4f34fc684e291c2cba42c78 and project 2780d87bb2d145af92bae72ece6f8005. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:15.045778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:29:15.048135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:29:15.131697 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-91be1f40-fa5e-4c5d-be61-b9659d67abb8 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415706 Sep 08 10:29:15.132676 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1843/3494] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:29:15.206383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:29:15.206807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:29:15.210029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:29:15.210488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:29:15.210916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:29:15.225618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.226305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.226759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.227743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.228212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.228660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.250264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for project 912e0307585e408ebefb443ebbae583e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:15.257500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Getting quotas for user 774190078d7b4c1d96c5921410a650ad and project 912e0307585e408ebefb443ebbae583e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:15.277065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:29:15.291618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:29:15.375509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42b9de99-d3a3-4213-a9d1-b1b1d1e5f2b0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.082922 Sep 08 10:29:15.376363 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1652/3495] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:29:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:29:15.382400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:15.383478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:15.393253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.393918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.394854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.395954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.396565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.397336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.501115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-bb1ea8ce-2be0-4cab-83f7-a7ddd60d9833 req-eb1c7d07-fc1e-4eae-a2f2-7bc19a59c450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df528d15-892b-4880-a5d9-c5bf4f33e60b", "name": "network-vif-plugged", "status": "completed", "tag": "35461c57-49b0-4c75-a9d2-efea812bf8d6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:15.524410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bb1ea8ce-2be0-4cab-83f7-a7ddd60d9833 req-eb1c7d07-fc1e-4eae-a2f2-7bc19a59c450 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.526470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bb1ea8ce-2be0-4cab-83f7-a7ddd60d9833 req-eb1c7d07-fc1e-4eae-a2f2-7bc19a59c450 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.527636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bb1ea8ce-2be0-4cab-83f7-a7ddd60d9833 req-eb1c7d07-fc1e-4eae-a2f2-7bc19a59c450 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.558645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-bb1ea8ce-2be0-4cab-83f7-a7ddd60d9833 req-eb1c7d07-fc1e-4eae-a2f2-7bc19a59c450 service nova] Creating event network-vif-plugged:35461c57-49b0-4c75-a9d2-efea812bf8d6 for instance df528d15-892b-4880-a5d9-c5bf4f33e60b on n-h2-833090-19 Sep 08 10:29:15.571153 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-bb1ea8ce-2be0-4cab-83f7-a7ddd60d9833 req-eb1c7d07-fc1e-4eae-a2f2-7bc19a59c450 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433979 Sep 08 10:29:15.575175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1844/3496] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:15.587843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:15.590440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:15.605936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.607038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.608022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.608889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:15.609499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:15.610201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:15.889279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:15.900167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ead43aea-62c2-4399-873d-6e7fcff7fe35 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.521875 Sep 08 10:29:15.902021 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1653/3497] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:15 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:15.920962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3db3170a-9557-48e7-bd9b-2a0e3c291c0b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:15.921975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3db3170a-9557-48e7-bd9b-2a0e3c291c0b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:16.131263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3db3170a-9557-48e7-bd9b-2a0e3c291c0b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:16.153414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3db3170a-9557-48e7-bd9b-2a0e3c291c0b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1225 microversion: 2.1 time: 0.249460 Sep 08 10:29:16.154618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1654/3498] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:15 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:16.194854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-33c181c0-5020-4b10-9a20-7041b28639fa tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:16.198360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-33c181c0-5020-4b10-9a20-7041b28639fa tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:16.219075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:16.229345 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1314 microversion: 2.1 time: 0.648722 Sep 08 10:29:16.230036 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1845/3499] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:15 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:16.231201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:16.232363 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83b46701-2988-4eb9-9d44-145321b94e74 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001285 Sep 08 10:29:16.232923 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1846/3500] 10.222.0.59 () {56 vars in 886 bytes} [Thu Sep 8 10:29:16 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 10:29:16.346641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-33c181c0-5020-4b10-9a20-7041b28639fa tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:16.359553 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-33c181c0-5020-4b10-9a20-7041b28639fa tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1225 microversion: 2.1 time: 0.203662 Sep 08 10:29:16.364319 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1655/3501] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:16 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:16.864796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf710e07-e2ef-4bbf-9ade-879c6cc59e68 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Calling method '.version_select at 0x7f23506a74c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:16.897289 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-bf710e07-e2ef-4bbf-9ade-879c6cc59e68 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] HTTP exception thrown: Image not found. Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf710e07-e2ef-4bbf-9ade-879c6cc59e68 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Request method failure captured: Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/686107a9-db33-4457-a6d1-5451c1abec50/metadata/os_distro HTTP/1.1 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP8NuPEZpFhUs3eGTusyLgctMSvTfGfAnsmGZT2Ix02v9BtVwb7qV9Scyxs9BP6fyAtrZ0ycwU1XXo2d2sq_UA8fmQqAMr_VWyI75VSH8pPJZOW7myfpgiM7ElYFMz33ewIlV7buNJLW1WrvOaI5oKwz0gbe8i-ZXcWEo4MBiv-bss Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db88630c9d6041cf95b644461e04e594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db88630c9d6041cf95b644461e04e594", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7d8488821b094d47a285fd5b1b3e9258 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'image_id': '686107a9-db33-4457-a6d1-5451c1abec50', 'id': 'os_distro'} Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 686107a9-db33-4457-a6d1-5451c1abec50 Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:16.909364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 686107a9-db33-4457-a6d1-5451c1abec50 could not be found. Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:16.914072 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.922081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf710e07-e2ef-4bbf-9ade-879c6cc59e68 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:16.923799 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf710e07-e2ef-4bbf-9ade-879c6cc59e68 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] 10.222.0.59 "DELETE /compute/v2.1/images/686107a9-db33-4457-a6d1-5451c1abec50/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.348835 Sep 08 10:29:16.924414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1847/3502] 10.222.0.59 () {58 vars in 1293 bytes} [Thu Sep 8 10:29:16 2022] DELETE /compute/v2.1/images/686107a9-db33-4457-a6d1-5451c1abec50/metadata/os_distro => generated 62 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:16.932696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:16.934068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:16.944465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:16.945381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:16.946352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:16.947422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:16.948154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:16.948779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:16.950412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c926992f-5ee9-426d-be2b-79c6e65588fa tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Calling method '.version_select at 0x7f235140ddc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:16.986428 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c926992f-5ee9-426d-be2b-79c6e65588fa tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] HTTP exception thrown: Image not found. Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c926992f-5ee9-426d-be2b-79c6e65588fa tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Request method failure captured: Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/images/5507d23c-ec28-4112-816e-8450e471216e/metadata/os_version HTTP/1.1 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP8NuPEZpFhUs3eGTusyLgctMSvTfGfAnsmGZT2Ix02v9BtVwb7qV9Scyxs9BP6fyAtrZ0ycwU1XXo2d2sq_UA8fmQqAMr_VWyI75VSH8pPJZOW7myfpgiM7ElYFMz33ewIlV7buNJLW1WrvOaI5oKwz0gbe8i-ZXcWEo4MBiv-bss Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db88630c9d6041cf95b644461e04e594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db88630c9d6041cf95b644461e04e594", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7d8488821b094d47a285fd5b1b3e9258 Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'image_id': '5507d23c-ec28-4112-816e-8450e471216e', 'id': 'os_version'} Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5507d23c-ec28-4112-816e-8450e471216e Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:16.988660 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5507d23c-ec28-4112-816e-8450e471216e could not be found. Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c926992f-5ee9-426d-be2b-79c6e65588fa tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c926992f-5ee9-426d-be2b-79c6e65588fa tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] 10.222.0.59 "GET /compute/v2.1/images/5507d23c-ec28-4112-816e-8450e471216e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.060281 Sep 08 10:29:17.001980 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1848/3503] 10.222.0.59 () {58 vars in 1293 bytes} [Thu Sep 8 10:29:16 2022] GET /compute/v2.1/images/5507d23c-ec28-4112-816e-8450e471216e/metadata/os_version => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:17.008065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cfa05af7-6866-451c-a0aa-3902551b4dbd tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Calling method '.version_select at 0x7f23506c41f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:17.070295 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-cfa05af7-6866-451c-a0aa-3902551b4dbd tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] HTTP exception thrown: Image not found. Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cfa05af7-6866-451c-a0aa-3902551b4dbd tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Request method failure captured: Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/images/436027b7-c1de-4a5d-b2ed-f46b3a58d718/metadata HTTP/1.1 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP8NuPEZpFhUs3eGTusyLgctMSvTfGfAnsmGZT2Ix02v9BtVwb7qV9Scyxs9BP6fyAtrZ0ycwU1XXo2d2sq_UA8fmQqAMr_VWyI75VSH8pPJZOW7myfpgiM7ElYFMz33ewIlV7buNJLW1WrvOaI5oKwz0gbe8i-ZXcWEo4MBiv-bss Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db88630c9d6041cf95b644461e04e594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db88630c9d6041cf95b644461e04e594", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7d8488821b094d47a285fd5b1b3e9258 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'image_id': '436027b7-c1de-4a5d-b2ed-f46b3a58d718'} Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 436027b7-c1de-4a5d-b2ed-f46b3a58d718 Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:17.072884 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 436027b7-c1de-4a5d-b2ed-f46b3a58d718 could not be found. Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cfa05af7-6866-451c-a0aa-3902551b4dbd tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cfa05af7-6866-451c-a0aa-3902551b4dbd tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] 10.222.0.59 "GET /compute/v2.1/images/436027b7-c1de-4a5d-b2ed-f46b3a58d718/metadata" status: 404 len: 62 microversion: 2.1 time: 0.077621 Sep 08 10:29:17.082902 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1849/3504] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 10:29:16 2022] GET /compute/v2.1/images/436027b7-c1de-4a5d-b2ed-f46b3a58d718/metadata => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:17.096501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a165e85-fb0e-41a9-bc76-69dc08a24dea tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Action: 'update_all', calling method: .version_select at 0x7f23506c4280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:17.129596 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-7a165e85-fb0e-41a9-bc76-69dc08a24dea tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] HTTP exception thrown: Image not found. Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a165e85-fb0e-41a9-bc76-69dc08a24dea tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Request method failure captured: Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/images/9716352a-175e-4873-b1d0-5127f405ed27/metadata HTTP/1.1 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 57 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP8NuPEZpFhUs3eGTusyLgctMSvTfGfAnsmGZT2Ix02v9BtVwb7qV9Scyxs9BP6fyAtrZ0ycwU1XXo2d2sq_UA8fmQqAMr_VWyI75VSH8pPJZOW7myfpgiM7ElYFMz33ewIlV7buNJLW1WrvOaI5oKwz0gbe8i-ZXcWEo4MBiv-bss Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db88630c9d6041cf95b644461e04e594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db88630c9d6041cf95b644461e04e594", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7d8488821b094d47a285fd5b1b3e9258 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'image_id': '9716352a-175e-4873-b1d0-5127f405ed27', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9716352a-175e-4873-b1d0-5127f405ed27 Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:17.132099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9716352a-175e-4873-b1d0-5127f405ed27 could not be found. Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:17.137236 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.143657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a165e85-fb0e-41a9-bc76-69dc08a24dea tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:17.143657 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7a165e85-fb0e-41a9-bc76-69dc08a24dea tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] 10.222.0.59 "PUT /compute/v2.1/images/9716352a-175e-4873-b1d0-5127f405ed27/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062437 Sep 08 10:29:17.144597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1850/3505] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:29:17 2022] PUT /compute/v2.1/images/9716352a-175e-4873-b1d0-5127f405ed27/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:29:17.154948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99fd2c18-3a6f-427f-a6ac-a31b171f6a9f tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Action: 'update', calling method: .version_select at 0x7f23517f9e50>, body: {"meta": {"os_distro": "alt"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:17.192318 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-99fd2c18-3a6f-427f-a6ac-a31b171f6a9f tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] HTTP exception thrown: Image not found. Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99fd2c18-3a6f-427f-a6ac-a31b171f6a9f tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Request method failure captured: Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/images/c182735a-8826-4cf5-a928-a1ba52cb2b88/metadata/os_distro HTTP/1.1 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 30 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP8NuPEZpFhUs3eGTusyLgctMSvTfGfAnsmGZT2Ix02v9BtVwb7qV9Scyxs9BP6fyAtrZ0ycwU1XXo2d2sq_UA8fmQqAMr_VWyI75VSH8pPJZOW7myfpgiM7ElYFMz33ewIlV7buNJLW1WrvOaI5oKwz0gbe8i-ZXcWEo4MBiv-bss Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db88630c9d6041cf95b644461e04e594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db88630c9d6041cf95b644461e04e594", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7d8488821b094d47a285fd5b1b3e9258 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: {"meta": {"os_distro": "alt"}} Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'image_id': 'c182735a-8826-4cf5-a928-a1ba52cb2b88', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c182735a-8826-4cf5-a928-a1ba52cb2b88 Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:17.196165 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c182735a-8826-4cf5-a928-a1ba52cb2b88 could not be found. Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99fd2c18-3a6f-427f-a6ac-a31b171f6a9f tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99fd2c18-3a6f-427f-a6ac-a31b171f6a9f tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] 10.222.0.59 "PUT /compute/v2.1/images/c182735a-8826-4cf5-a928-a1ba52cb2b88/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.048353 Sep 08 10:29:17.205730 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1851/3506] 10.222.0.59 () {60 vars in 1310 bytes} [Thu Sep 8 10:29:17 2022] PUT /compute/v2.1/images/c182735a-8826-4cf5-a928-a1ba52cb2b88/metadata/os_distro => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:17.213189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:17.213189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:17.225256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:17.225827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:17.227077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:17.228592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:17.229067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:17.229553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:17.664664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:17.675265 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0a5710d7-17a5-4b38-ab69-5de762bd3dcf tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1295 microversion: 2.1 time: 0.474900 Sep 08 10:29:17.680601 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1852/3507] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:17 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1295 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:17.698146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37f3cd59-b0fe-43d8-801f-f31c90cd2912 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Action: 'create', calling method: .version_select at 0x7f235547d8b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:17.777286 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-37f3cd59-b0fe-43d8-801f-f31c90cd2912 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] HTTP exception thrown: Image not found. Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37f3cd59-b0fe-43d8-801f-f31c90cd2912 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Request method failure captured: Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/images/5a22cdb8-0a92-40c9-9a34-076dde4781d4/metadata HTTP/1.1 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 57 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP8NuPEZpFhUs3eGTusyLgctMSvTfGfAnsmGZT2Ix02v9BtVwb7qV9Scyxs9BP6fyAtrZ0ycwU1XXo2d2sq_UA8fmQqAMr_VWyI75VSH8pPJZOW7myfpgiM7ElYFMz33ewIlV7buNJLW1WrvOaI5oKwz0gbe8i-ZXcWEo4MBiv-bss Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db88630c9d6041cf95b644461e04e594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db88630c9d6041cf95b644461e04e594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db88630c9d6041cf95b644461e04e594", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db88630c9d6041cf95b644461e04e594 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7d8488821b094d47a285fd5b1b3e9258 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2040142175-project Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'image_id': '5a22cdb8-0a92-40c9-9a34-076dde4781d4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a22cdb8-0a92-40c9-9a34-076dde4781d4 Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 10:29:17.780634 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a22cdb8-0a92-40c9-9a34-076dde4781d4 could not be found. Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:17.785978 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:17.791560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37f3cd59-b0fe-43d8-801f-f31c90cd2912 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:17.792624 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-37f3cd59-b0fe-43d8-801f-f31c90cd2912 tempest-ImagesMetadataNegativeTestJSON-2040142175 tempest-ImagesMetadataNegativeTestJSON-2040142175-project] 10.222.0.59 "POST /compute/v2.1/images/5a22cdb8-0a92-40c9-9a34-076dde4781d4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.111027 Sep 08 10:29:17.798622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1853/3508] 10.222.0.59 () {60 vars in 1281 bytes} [Thu Sep 8 10:29:17 2022] POST /compute/v2.1/images/5a22cdb8-0a92-40c9-9a34-076dde4781d4/metadata => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:17.815495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:17.817416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:17.841541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:17.843271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:17.843969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:17.847272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:17.848351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:17.848911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.205066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:18.216073 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-195762e3-2838-4ab0-8525-bb39e26e5a4a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 1.291586 Sep 08 10:29:18.216758 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1656/3509] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:16 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:18.238004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:18.238726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:18.250194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.251505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.252295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.253403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.254100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.254697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.375454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:18.385962 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85b0e756-f124-4670-b529-ffc2bd8242d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1499 microversion: 2.1 time: 0.584330 Sep 08 10:29:18.407613 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1854/3510] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:17 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1499 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:18.419441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:18.422098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:18.428660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.429516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.429962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.430700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.431156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.431878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.454516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:18.468950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lazy-loading 'flavor' on Instance uuid df528d15-892b-4880-a5d9-c5bf4f33e60b {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:18.478870 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a923cbf-356d-4169-9eda-75b0bf0204da tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1283 microversion: 2.1 time: 0.256412 Sep 08 10:29:18.484510 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1657/3511] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:18 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1283 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:18.532267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:18.620274 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e649e72-1076-4906-9b32-8b2fd565485b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "POST /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b/action" status: 200 len: 32 microversion: 2.1 time: 0.204286 Sep 08 10:29:18.621754 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1855/3512] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:18 2022] POST /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:29:18.634415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:18.635371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:18.644887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.645663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.646321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.647640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.648317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.648960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.699928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:18.700643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:18.717064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.717563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.718128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.718853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:18.719311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:18.719764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:18.919901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:18.942446 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4637d3b5-949a-4902-93bf-c9ab50ce2dec tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1283 microversion: 2.1 time: 0.247717 Sep 08 10:29:18.950701 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1856/3513] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:18 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1283 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:19.226816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:19.245501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:19.246345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:19.256509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:19.258338 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d96278ae-6bf6-43f3-beeb-5d583816589f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.630612 Sep 08 10:29:19.260328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:19.278286 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1658/3514] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:18 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:19.279018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:19.280091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:19.280856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:19.281504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:19.506037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:19.506645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:19.518338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:19.518971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:19.519406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:19.528360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:19.528849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:19.529291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:19.948151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:19.963261 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-566e9b57-578c-4f64-81a9-bb7f3b5b6a66 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.720869 Sep 08 10:29:19.973239 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1857/3515] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:19 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:19.987239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:19.987900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:20.007067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:20.012320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:20.012823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:20.023907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:20.023907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:20.023907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:20.470732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:20.481923 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c53e2976-6e89-497c-bdb3-5007498cdc7e tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1325 microversion: 2.1 time: 0.979771 Sep 08 10:29:20.486432 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1659/3516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:19 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1325 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:20.502941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3bf46690-13b6-4d85-8435-a2f152db6602 req-b4f269c2-627f-406e-bf8e-38dd634b78e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879f59d6-96f5-405c-aa07-05b909d599b1", "tag": "69e42279-e88c-4c6b-88bd-c519c2137b3b"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:20.527802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3bf46690-13b6-4d85-8435-a2f152db6602 req-b4f269c2-627f-406e-bf8e-38dd634b78e6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:20.533567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3bf46690-13b6-4d85-8435-a2f152db6602 req-b4f269c2-627f-406e-bf8e-38dd634b78e6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:20.534311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3bf46690-13b6-4d85-8435-a2f152db6602 req-b4f269c2-627f-406e-bf8e-38dd634b78e6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:20.559901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3bf46690-13b6-4d85-8435-a2f152db6602 req-b4f269c2-627f-406e-bf8e-38dd634b78e6 service nova] Creating event network-changed:69e42279-e88c-4c6b-88bd-c519c2137b3b for instance 879f59d6-96f5-405c-aa07-05b909d599b1 on n-h1-833090-19 Sep 08 10:29:20.577470 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3bf46690-13b6-4d85-8435-a2f152db6602 req-b4f269c2-627f-406e-bf8e-38dd634b78e6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089508 Sep 08 10:29:20.578705 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1660/3517] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:20.589351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:20.591147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:20.592151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:20.607150 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4ea35cd-ba1f-4518-b322-ad9f44fc889b tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.631382 Sep 08 10:29:20.608337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:20.615628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1858/3518] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:19 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:20.616499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:20.617124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:20.618791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:20.619432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:20.620074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:20.959263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-53f83582-38b4-47b2-bce6-c0ec655e21b8 tempest-ComputeTenantNetworksTest-418576812 tempest-ComputeTenantNetworksTest-418576812-project] Calling method '.version_select at 0x7f2350565ee0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:20.970686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:20.984408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5632d9bd-a71f-4d84-9422-c1ec63197637 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.401069 Sep 08 10:29:20.985062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1661/3519] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:20 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:21.000342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:21.001372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:21.012898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:21.014406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:21.018412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:21.019619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:21.021428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:21.023112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:21.408386 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-53f83582-38b4-47b2-bce6-c0ec655e21b8 tempest-ComputeTenantNetworksTest-418576812 tempest-ComputeTenantNetworksTest-418576812-project] 10.222.0.59 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.791189 Sep 08 10:29:21.409172 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1859/3520] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:29:20 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:21.422449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80b2c59a-9706-4a78-9bdd-82b7efc3e819 tempest-ComputeTenantNetworksTest-418576812 tempest-ComputeTenantNetworksTest-418576812-project] Calling method '.version_select at 0x7f2350565310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:21.628571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:21.644354 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a6903f3a-2001-4f74-9561-087f4a0aa107 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.652205 Sep 08 10:29:21.645047 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1662/3521] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:20 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:21.657047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:21.657972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:21.673549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:21.676477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:21.678860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:21.681993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:21.683996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:21.684734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.058731 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80b2c59a-9706-4a78-9bdd-82b7efc3e819 tempest-ComputeTenantNetworksTest-418576812 tempest-ComputeTenantNetworksTest-418576812-project] 10.222.0.59 "GET /compute/v2.1/os-tenant-networks/e4557ea6-f889-49cd-bce6-b4f4a70fd6a2" status: 200 len: 140 microversion: 2.1 time: 0.640309 Sep 08 10:29:22.066934 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1860/3522] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:29:21 2022] GET /compute/v2.1/os-tenant-networks/e4557ea6-f889-49cd-bce6-b4f4a70fd6a2 => generated 140 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:29:22.074829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:22.076213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:22.083728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:22.084407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:22.084963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.085760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:22.086522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:22.087113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.392936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:22.410065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e320a74-2c86-420d-9a99-253774abe46d tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1325 microversion: 2.1 time: 0.762143 Sep 08 10:29:22.430340 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1663/3523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:21 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1325 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:22.438085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:22.439079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:22.452315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:22.453240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:22.454148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.456616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:22.457327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:22.458318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.506618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:22.518045 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fd3528a0-dfa9-4b42-826d-6a493da2ea0d tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.449630 Sep 08 10:29:22.520383 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1861/3524] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:22 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:22.675327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:22.676121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:22.683679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:22.684630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:22.685249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.686139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:22.686789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:22.687513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:22.946967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:22.966453 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-713d4529-37ef-4e89-9a92-69e01147419c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.532984 Sep 08 10:29:22.967506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1664/3525] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:22 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:23.096199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:23.115203 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5430c444-01cb-45d2-9c8a-a3ed184f7037 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.443231 Sep 08 10:29:23.117819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1862/3526] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:22 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:23.185646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a8e66e00-bd06-482c-b111-4ad33d9f07fd req-59d0765c-336b-44e1-bb9e-0215dfac9dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ee93ba-2267-491e-a036-ffb903f2463e", "tag": "6cad23c6-b0fd-4fbd-be93-958dd567d4c5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:23.201380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a8e66e00-bd06-482c-b111-4ad33d9f07fd req-59d0765c-336b-44e1-bb9e-0215dfac9dfb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:23.202014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a8e66e00-bd06-482c-b111-4ad33d9f07fd req-59d0765c-336b-44e1-bb9e-0215dfac9dfb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:23.202706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a8e66e00-bd06-482c-b111-4ad33d9f07fd req-59d0765c-336b-44e1-bb9e-0215dfac9dfb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:23.227502 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a8e66e00-bd06-482c-b111-4ad33d9f07fd req-59d0765c-336b-44e1-bb9e-0215dfac9dfb service nova] Creating event network-changed:6cad23c6-b0fd-4fbd-be93-958dd567d4c5 for instance 62ee93ba-2267-491e-a036-ffb903f2463e on n-h1-833090-19 Sep 08 10:29:23.235495 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a8e66e00-bd06-482c-b111-4ad33d9f07fd req-59d0765c-336b-44e1-bb9e-0215dfac9dfb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064787 Sep 08 10:29:23.236627 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1665/3527] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:23.443261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:23.444977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:23.468861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:23.469761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:23.472871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:23.473936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:23.475411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:23.476783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:23.546535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:23.547809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:23.558533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:23.562663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:23.565773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:23.568167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:23.568715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:23.569664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.009572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:24.025136 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de6dfbf5-b4ba-4d74-b62d-7123391d8bb4 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1325 microversion: 2.1 time: 0.590060 Sep 08 10:29:24.026948 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1863/3528] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:23 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1325 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:24.033173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:24.035362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:24.060065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:24.060854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:24.061462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.062357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:24.062985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:24.063530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.068259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:24.085135 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e57cbec0-308e-49f9-be31-a0a18a3d4c19 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.538817 Sep 08 10:29:24.086529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1666/3529] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:23 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:24.141262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:24.142196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:24.154125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:24.154634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:24.155086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.156270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:24.156387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:24.156769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.415261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:24.435856 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e93280e2-109e-4197-b70c-d4020b687769 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.407245 Sep 08 10:29:24.443193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1864/3530] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:24 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:24.449629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:24.450421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:24.465712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:24.466498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:24.467168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.468144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:24.468858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:24.469547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:24.475259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:24.489213 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84290754-bd95-45d8-bd47-2493e328180c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.351843 Sep 08 10:29:24.492229 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1667/3531] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:24 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:24.518414 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e663e1ac-8635-432e-a1ee-349b4119dd28 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/ips" status: 200 len: 152 microversion: 2.20 time: 0.073792 Sep 08 10:29:24.519662 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1865/3532] 10.222.0.59 () {60 vars in 1289 bytes} [Thu Sep 8 10:29:24 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/ips => generated 152 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:29:25.008392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-04b2ebd6-1c0e-41c0-bb07-31143acedb1d req-ab0abd39-02ab-4025-ad8a-e774f89158cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879f59d6-96f5-405c-aa07-05b909d599b1", "name": "network-vif-plugged", "status": "completed", "tag": "69e42279-e88c-4c6b-88bd-c519c2137b3b"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:25.034481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-04b2ebd6-1c0e-41c0-bb07-31143acedb1d req-ab0abd39-02ab-4025-ad8a-e774f89158cc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.038248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-04b2ebd6-1c0e-41c0-bb07-31143acedb1d req-ab0abd39-02ab-4025-ad8a-e774f89158cc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.038714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-04b2ebd6-1c0e-41c0-bb07-31143acedb1d req-ab0abd39-02ab-4025-ad8a-e774f89158cc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.053406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:25.054024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:25.063874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:25.063874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:25.084789 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-04b2ebd6-1c0e-41c0-bb07-31143acedb1d req-ab0abd39-02ab-4025-ad8a-e774f89158cc service nova] Creating event network-vif-plugged:69e42279-e88c-4c6b-88bd-c519c2137b3b for instance 879f59d6-96f5-405c-aa07-05b909d599b1 on n-h1-833090-19 Sep 08 10:29:25.086099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.088137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.090128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.093134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.093975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.094817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.096054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-04b2ebd6-1c0e-41c0-bb07-31143acedb1d req-ab0abd39-02ab-4025-ad8a-e774f89158cc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092237 Sep 08 10:29:25.097179 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1668/3533] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:25.116565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:25.117748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:25.134507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.134708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.135228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.136516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.137006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.137535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.241398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:25.617164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:25.631074 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.522809 Sep 08 10:29:25.632433 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1669/3534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:25 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:25.635299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:25.636644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f03068cc-99d9-46d9-aa4d-df3e9082dece tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003171 Sep 08 10:29:25.662634 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1670/3535] 10.222.0.59 () {56 vars in 886 bytes} [Thu Sep 8 10:29:25 2022] GET /compute/ => generated 377 bytes in 29 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 10:29:25.671449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:25.672514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:25.695792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.697092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.707091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.709082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.709816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.710507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.804343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:25.817822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cadf1926-4f94-474d-9455-b43eccc10285 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1325 microversion: 2.1 time: 0.769066 Sep 08 10:29:25.820549 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1866/3536] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:25 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1325 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:25.829413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:25.837013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:25.852561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.857881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.858850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:25.859869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:25.863708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:25.865374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:26.249479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:26.262323 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.598204 Sep 08 10:29:26.262934 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1671/3537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:25 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:26.273160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:26.275225 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001985 Sep 08 10:29:26.283578 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1672/3538] 10.222.0.59 () {54 vars in 1035 bytes} [Thu Sep 8 10:29:26 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 08 10:29:26.285596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:26.289394 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001700 Sep 08 10:29:26.293235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1673/3539] 10.222.0.59 () {54 vars in 1041 bytes} [Thu Sep 8 10:29:26 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:26.302549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:26.305366 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04c24ad5-42c7-4b13-8dd9-5ed8d584e4ed tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003002 Sep 08 10:29:26.306350 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1674/3540] 10.222.0.59 () {56 vars in 886 bytes} [Thu Sep 8 10:29:26 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 10:29:26.309364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:26.320212 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a919f9d6-c69d-469d-8c5b-0b9acece9c56 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.498542 Sep 08 10:29:26.326646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1867/3541] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:25 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:26.661975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:26.663415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:26.667922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:26.679350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:26.680347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:26.681098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:26.682366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:26.683187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:26.684503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:26.840958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:26.842170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:26.848918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:26.849598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:26.850219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:26.851121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:26.851773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:26.852363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.294931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:27.297653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:27.309126 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aec83d68-2184-4710-a3d4-152fe8efd879 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.652477 Sep 08 10:29:27.309408 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b22b449-90bf-4484-a84c-83665f1917e2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1325 microversion: 2.1 time: 0.472267 Sep 08 10:29:27.314083 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1868/3542] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:26 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1325 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:27.324180 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1675/3543] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:26 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:27.328407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:27.329643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:27.350806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:27.350806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:27.350806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.351531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:27.351913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:27.353249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.373156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:27.375518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:27.391407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:27.392795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:27.393737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.403311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:27.406342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:27.407639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.935699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:27.938436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:27.951799 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec0aa967-52d2-40d2-8229-6782686f1143 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.592521 Sep 08 10:29:27.952943 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1676/3544] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:27 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:27.959545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:27.960572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:27.972366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:27.973175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:27.973977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.975069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:27.975786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:27.976404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:27.982442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:28.012488 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8924440-ab36-494e-954b-eb9df80219bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.697065 Sep 08 10:29:28.013427 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1869/3545] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:27 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:28.016001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lazy-loading 'flavor' on Instance uuid f9caece1-c0d1-4b20-bb15-9156d669bcd8 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:28.338347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:28.339360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:28.356544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.357066 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-181cbd1b-3c51-4699-b2a0-c05835c333d9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/action" status: 202 len: 0 microversion: 2.20 time: 0.402435 Sep 08 10:29:28.357701 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1677/3546] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:29:27 2022] POST /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:28.364785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.366211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.369315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.370142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.371711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.396769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:28.397808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:28.415601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.416070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.416512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.417236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.417680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.418109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.868190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:28.878011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9319087b-8b6e-4839-97c5-fb39c486b6c2 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1521 microversion: 2.1 time: 0.519071 Sep 08 10:29:28.892001 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1678/3547] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:28 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:28.905206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:28.906301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:28.916244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.917142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.917804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.918683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:28.919319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.920030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.920699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.929145 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c83443a-eb5e-4531-8159-771a0f5dbb7c tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.595032 Sep 08 10:29:28.929761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1870/3548] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:28 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:28.956171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:28.956670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:28.969396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.969899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.970337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:28.971047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:28.971525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:28.971957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.032978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:29:29.148090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:29.222054 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-397874eb-ad2f-4a74-bb38-6ec4143be13b tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 204 len: 0 microversion: 2.1 time: 0.290835 Sep 08 10:29:29.224435 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1871/3549] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:28 2022] DELETE /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:29.233213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:29.234334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:29.241360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.242345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.243025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.244131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.244802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.245441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.270452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:29.284333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:29.286079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:29.287328 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a620cc8b-ab10-4cc7-9cb4-1d51bcd27888 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.393708 Sep 08 10:29:29.287940 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1679/3550] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:28 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:29.301877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0f7fdd8e-4106-48e7-abd6-fb8b3c6b1bd6 req-e5f5097b-fdc9-4ebb-8442-a52c8391fafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ee93ba-2267-491e-a036-ffb903f2463e", "name": "network-vif-plugged", "status": "completed", "tag": "6cad23c6-b0fd-4fbd-be93-958dd567d4c5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:29.319870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f7fdd8e-4106-48e7-abd6-fb8b3c6b1bd6 req-e5f5097b-fdc9-4ebb-8442-a52c8391fafa service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.320639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f7fdd8e-4106-48e7-abd6-fb8b3c6b1bd6 req-e5f5097b-fdc9-4ebb-8442-a52c8391fafa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.321439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0f7fdd8e-4106-48e7-abd6-fb8b3c6b1bd6 req-e5f5097b-fdc9-4ebb-8442-a52c8391fafa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.338903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0f7fdd8e-4106-48e7-abd6-fb8b3c6b1bd6 req-e5f5097b-fdc9-4ebb-8442-a52c8391fafa service nova] Creating event network-vif-plugged:6cad23c6-b0fd-4fbd-be93-958dd567d4c5 for instance 62ee93ba-2267-491e-a036-ffb903f2463e on n-h1-833090-19 Sep 08 10:29:29.345487 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0f7fdd8e-4106-48e7-abd6-fb8b3c6b1bd6 req-e5f5097b-fdc9-4ebb-8442-a52c8391fafa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049918 Sep 08 10:29:29.346377 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1680/3551] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:29.355973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:29.360154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:29.378221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.378950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.379543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.380552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.381237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.381904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.702742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:29.708788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:29.736678 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62f16646-b267-4ff4-b00d-60b7a54b47ac tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.388910 Sep 08 10:29:29.742094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db149609-2866-49a2-99ac-059e94182cc2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.514558 Sep 08 10:29:29.744575 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1872/3552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:29 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:29.748878 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1681/3553] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:29 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:29.763796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:29.764923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:29.772775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.779128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.780726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.781672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.782294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.782899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.959277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:29.960131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:29.971140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.972203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.972888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:29.973792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:29.974581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:29.975174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:30.143070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:30.154398 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38908a49-9fdf-42d2-8083-3a88cc0d7771 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1527 microversion: 2.1 time: 0.405397 Sep 08 10:29:30.155002 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1873/3554] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:29 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1527 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:30.316326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:30.317250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:30.324695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:30.325183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:30.325612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:30.339675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:30.340276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:30.340857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:30.346977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:30.355348 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de959028-66e6-466d-9fca-517870c8075f tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1325 microversion: 2.1 time: 0.402654 Sep 08 10:29:30.357456 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1682/3555] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:29 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:30.594331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:30.605255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:30.609233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:30.610479 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80df9cd2-0f91-4076-b01b-79bd6e699c5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.298129 Sep 08 10:29:30.611045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1874/3556] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:30 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:29:30.754200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1077997689", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "c678b0fe-19e7-424f-ad7d-2bc025cb97d5"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:30.766812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:30.767516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:30.788057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:30.788816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:30.789320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:30.790210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:30.790882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:30.791350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:30.825211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] validate_networks() for [('c678b0fe-19e7-424f-ad7d-2bc025cb97d5', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:29:31.115326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:31.125613 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-769e05a0-8a48-4405-85f2-02b298c9624a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.362716 Sep 08 10:29:31.128547 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1875/3557] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:30 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:31.134988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:31.138280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:31.142553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:31.154029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.159720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.161375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.162348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.162995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.163629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.516993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:31.528211 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34f4e957-596f-487a-b31e-cf7031cccd83 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.397622 Sep 08 10:29:31.528807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1876/3558] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:31 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:31.535519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:31.536124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:31.552364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.552859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.553301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.554010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.554475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.554883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.611899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:29:31.617962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:29:31.619657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:29:31.620288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:29:31.620914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:29:31.637360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.638217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.639017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.640183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.640824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.641423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.678379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Getting quotas for project 72acb15b9873499e806c576dbc4807be. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:31.693162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Getting quotas for user 69552444b08f405489f39ac149739240 and project 72acb15b9873499e806c576dbc4807be. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:31.726578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:29:31.731117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:29:31.809468 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-613571d8-e081-47aa-9604-1b6812529346 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.222817 Sep 08 10:29:31.810555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1683/3559] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:29:31.823821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:31.824588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:31.847248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:31.862592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:31.866480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.867213 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85d038c2-53c3-41df-b478-4a96af1e9499 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1527 microversion: 2.1 time: 0.335218 Sep 08 10:29:31.867840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.868619 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1877/3560] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:31 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:31.869756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.872533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.874177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.874994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.879810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:31.883272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:31.900238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.900823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.901667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:31.903273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:31.903974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:31.904470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.330780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:32.341678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:32.351641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0835a339-311a-41c9-93d6-6a60786b2315 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1522 microversion: 2.1 time: 0.532993 Sep 08 10:29:32.352341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:32.355312 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1684/3561] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:31 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:32.373326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5b84aedb-0e72-4762-855c-0e974c2c8a5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:32.376565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5b84aedb-0e72-4762-855c-0e974c2c8a5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:32.378858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:32.380510 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4aef115c-74ed-4bc2-aafe-f662d4874704 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.509060 Sep 08 10:29:32.381299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1878/3562] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:31 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:32.402095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:32.403025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:32.412208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.412910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.413539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.414741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.415411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.416028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.598223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b84aedb-0e72-4762-855c-0e974c2c8a5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:32.611570 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5b84aedb-0e72-4762-855c-0e974c2c8a5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1216 microversion: 2.1 time: 0.252364 Sep 08 10:29:32.612625 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1685/3563] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:32 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:32.632244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:32.632812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:32.643312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.643955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.644412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.647919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.648493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.649250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.705489 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] HTTP exception thrown: Instance is not a member of specified network Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Request method failure captured: Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e/ips/invalid HTTP/1.1 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcP58GdqacXf3k1E4o-GVgrwH8QHt0GbFn_0TBlG9T0l8ldhrUz8qcow4ZPk6QZyLF4vED0SkAO2kIc6LCT6IkW6cLQ5Gk9SQqdFgvhWZ2VQADynTYkIq6LRZhqcA1cQGhkd6iD9QZkqAluMk7ZTH7l-C3NQHpx3nz0Y21PpBwJPZz0 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 2780d87bb2d145af92bae72ece6f8005 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2780d87bb2d145af92bae72ece6f8005", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 2780d87bb2d145af92bae72ece6f8005 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerAddressesNegativeTestJSON-1799739766-project Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2d9a9cd8f4f34fc684e291c2cba42c78 Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1799739766-project Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance is not a member of specified network Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': '62ee93ba-2267-491e-a036-ffb903f2463e', 'id': 'invalid'} Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 08 10:29:32.714029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.717890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:32.717890 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f0c2dda-4487-4b8c-9419-cc618e9435c9 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.101791 Sep 08 10:29:32.717890 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1686/3564] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:29:32 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e/ips/invalid => generated 91 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:32.730535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:32.732657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:32.746918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.747430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.747883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.748651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.749189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.749695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.755850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:32.769343 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85200f76-ed82-4afa-b031-ef78fd5e811e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.386466 Sep 08 10:29:32.770736 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1879/3565] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:32 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:32.778165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f39fa923-480f-44f9-9195-4aaa6fd7c38e tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:32.778996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f39fa923-480f-44f9-9195-4aaa6fd7c38e tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Failed to fetch instance by id 999 {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:29:32.779748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f39fa923-480f-44f9-9195-4aaa6fd7c38e tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] HTTP exception thrown: Instance 999 could not be found. Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f39fa923-480f-44f9-9195-4aaa6fd7c38e tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Request method failure captured: Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcP58GdqacXf3k1E4o-GVgrwH8QHt0GbFn_0TBlG9T0l8ldhrUz8qcow4ZPk6QZyLF4vED0SkAO2kIc6LCT6IkW6cLQ5Gk9SQqdFgvhWZ2VQADynTYkIq6LRZhqcA1cQGhkd6iD9QZkqAluMk7ZTH7l-C3NQHpx3nz0Y21PpBwJPZz0 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 2780d87bb2d145af92bae72ece6f8005 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2780d87bb2d145af92bae72ece6f8005", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 2780d87bb2d145af92bae72ece6f8005 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerAddressesNegativeTestJSON-1799739766-project Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 2d9a9cd8f4f34fc684e291c2cba42c78 Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1799739766-project Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 999 could not be found. Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '999'} Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 08 10:29:32.781931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:32.791063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f39fa923-480f-44f9-9195-4aaa6fd7c38e tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:32.792096 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f39fa923-480f-44f9-9195-4aaa6fd7c38e tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019942 Sep 08 10:29:32.792665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1880/3566] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:29:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:32.802390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4ddbcfd9-80d0-4277-826a-8a8f9757b93b req-52fc702d-be4f-4f44-958c-1487627d05ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879f59d6-96f5-405c-aa07-05b909d599b1", "name": "network-vif-deleted", "tag": "69e42279-e88c-4c6b-88bd-c519c2137b3b"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:32.834151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4ddbcfd9-80d0-4277-826a-8a8f9757b93b req-52fc702d-be4f-4f44-958c-1487627d05ce service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.834947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4ddbcfd9-80d0-4277-826a-8a8f9757b93b req-52fc702d-be4f-4f44-958c-1487627d05ce service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.835779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4ddbcfd9-80d0-4277-826a-8a8f9757b93b req-52fc702d-be4f-4f44-958c-1487627d05ce service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.859547 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4ddbcfd9-80d0-4277-826a-8a8f9757b93b req-52fc702d-be4f-4f44-958c-1487627d05ce service nova] Creating event network-vif-deleted:69e42279-e88c-4c6b-88bd-c519c2137b3b for instance 879f59d6-96f5-405c-aa07-05b909d599b1 on n-h1-833090-19 Sep 08 10:29:32.866684 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4ddbcfd9-80d0-4277-826a-8a8f9757b93b req-52fc702d-be4f-4f44-958c-1487627d05ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070980 Sep 08 10:29:32.869706 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1881/3567] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:32.881281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:32.885996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:32.905235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.906217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.908056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.909867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:32.911964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:32.912679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:32.962919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:29:33.105182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e807a303-2cbf-4f67-9c9d-038facf2a3a1 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "DELETE /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 204 len: 0 microversion: 2.1 time: 0.233374 Sep 08 10:29:33.109797 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1882/3568] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:32 2022] DELETE /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:33.117240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:33.118987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:33.125164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:33.127562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.134937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3eae86ce-1a33-4e85-8c0c-383a9571d929 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.417179 Sep 08 10:29:33.135580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1687/3569] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:32 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:33.141582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.142459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.143923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.144804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.145536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.145660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:33.146218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:33.154616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.155108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.155777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.156657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.157387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.157980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.236658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.236658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.237097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.237534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lazy-loading 'fault' on Instance uuid 879f59d6-96f5-405c-aa07-05b909d599b1 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:33.369951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:33.379151 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46801afa-cd2e-4066-9b78-1a3d501b28a0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1315 microversion: 2.1 time: 0.267612 Sep 08 10:29:33.380189 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1883/3570] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:33 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:33.414495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:33.415150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:33.425637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.426133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.426573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.427296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.432193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.433014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.625505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:33.650937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf47dbf4-579e-4e4f-927b-112427263605 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1528 microversion: 2.1 time: 0.508480 Sep 08 10:29:33.655395 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1688/3571] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:33 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1528 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:33.677570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:33.678851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:33.686070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.690565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.691412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:33.692459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:33.693146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:33.693798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.096318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.109190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5de311cd-c833-4b19-b78f-0dc4208698eb tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1212 microversion: 2.1 time: 0.448749 Sep 08 10:29:34.124104 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1689/3572] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:33 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1212 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:34.137323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:34.137959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:34.144958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.145740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.146339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.147543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.148172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.148765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.197961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.207927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.210316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.211817 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e2967b4-4fe9-42f9-bbe8-9e3bb473fdee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.802221 Sep 08 10:29:34.212992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1884/3573] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:33 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:34.217864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:34.219703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:34.227216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.228905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.229701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.230709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.231404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.232148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.547916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.555913 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c417919-5189-4fb9-8914-ccca965a7def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.430204 Sep 08 10:29:34.556504 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1690/3574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:34 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:34.584134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:34.591664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:34.608107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.620174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e691e87-a803-4325-a3ca-8f5fcbf7babb tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.405756 Sep 08 10:29:34.632242 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1885/3575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:34 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:34.632668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.632668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.632668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.632668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.632668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.632668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.677979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:34.678652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:34.694130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.694762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.695213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.695965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.696946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.697385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.724853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:34.725366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:34.725813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:34.726274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lazy-loading 'fault' on Instance uuid 879f59d6-96f5-405c-aa07-05b909d599b1 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:34.846061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774190078d7b4c1d96c5921410a650ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e0307585e408ebefb443ebbae583e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:34.856461 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c6ca15d-b954-4b54-8fcb-5b8495e4b16a tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 200 len: 1315 microversion: 2.1 time: 0.294662 Sep 08 10:29:34.857475 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1691/3576] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:34 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:35.124253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:35.139985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:35.140833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:35.141818 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab90da0e-c900-4f14-a97a-6f7697e62800 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1528 microversion: 2.1 time: 0.467702 Sep 08 10:29:35.143427 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1886/3577] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:34 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1528 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:35.163572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.164460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.165259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.166219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.166981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.167671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.244323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:35.244985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:35.256059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.258303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.258854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.262730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.263263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.265493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.269003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:35.280745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0680fa5-c425-4f03-9350-c47340d6c95a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1268 microversion: 2.1 time: 0.146835 Sep 08 10:29:35.293323 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1692/3578] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:35 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:35.460628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6fc4a633-b019-4d8c-b8b0-1f1f2e1576a5 req-fcef2156-5382-4994-9a40-fe3dc84ca7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ee93ba-2267-491e-a036-ffb903f2463e", "name": "network-vif-deleted", "tag": "6cad23c6-b0fd-4fbd-be93-958dd567d4c5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:35.480786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6fc4a633-b019-4d8c-b8b0-1f1f2e1576a5 req-fcef2156-5382-4994-9a40-fe3dc84ca7f4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.484507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6fc4a633-b019-4d8c-b8b0-1f1f2e1576a5 req-fcef2156-5382-4994-9a40-fe3dc84ca7f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.485046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6fc4a633-b019-4d8c-b8b0-1f1f2e1576a5 req-fcef2156-5382-4994-9a40-fe3dc84ca7f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.518191 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6fc4a633-b019-4d8c-b8b0-1f1f2e1576a5 req-fcef2156-5382-4994-9a40-fe3dc84ca7f4 service nova] Creating event network-vif-deleted:6cad23c6-b0fd-4fbd-be93-958dd567d4c5 for instance 62ee93ba-2267-491e-a036-ffb903f2463e on n-h1-833090-19 Sep 08 10:29:35.536231 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6fc4a633-b019-4d8c-b8b0-1f1f2e1576a5 req-fcef2156-5382-4994-9a40-fe3dc84ca7f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075398 Sep 08 10:29:35.536483 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1693/3579] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:35.580730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:35.582116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:35.591720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.592210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.596220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.597230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.599735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.600380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.630451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:35.862196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:35.874080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:35.877107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:35.879000 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-299b4e34-b1d7-44be-a77c-8aa4753044ab tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.642023 Sep 08 10:29:35.892579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1887/3580] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:35 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:35.921220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:35.922132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:35.935185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.935834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.936285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.937013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:35.937447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:35.937904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:35.943501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:36.076451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:36.087701 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1008c6cd-dd8e-45ec-bd73-4b93588a11e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.512914 Sep 08 10:29:36.088314 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1694/3581] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:35 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:36.093850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.094458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 879f59d6-96f5-405c-aa07-05b909d599b1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:36.108311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.109091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.109718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.110769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.111422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.112870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.131779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 879f59d6-96f5-405c-aa07-05b909d599b1 could not be found. Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 HTTP/1.1 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 879f59d6-96f5-405c-aa07-05b909d599b1 could not be found. Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '879f59d6-96f5-405c-aa07-05b909d599b1'} Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879f59d6-96f5-405c-aa07-05b909d599b1 could not be found. Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879f59d6-96f5-405c-aa07-05b909d599b1 could not be found. Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.134561 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879f59d6-96f5-405c-aa07-05b909d599b1 could not be found. Sep 08 10:29:36.140068 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.142245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 879f59d6-96f5-405c-aa07-05b909d599b1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:36.143332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-033b08c7-5144-476b-aa22-a2be4ace1817 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1" status: 404 len: 111 microversion: 2.1 time: 0.053906 Sep 08 10:29:36.146987 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1695/3582] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:36 2022] GET /compute/v2.1/servers/879f59d6-96f5-405c-aa07-05b909d599b1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:36.164659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9b56587-512e-4f6b-9d2e-0531bb7dd4e0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '.version_select at 0x7f2350b13c10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.203917 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c9b56587-512e-4f6b-9d2e-0531bb7dd4e0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Image not found. Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9b56587-512e-4f6b-9d2e-0531bb7dd4e0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4 HTTP/1.1 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: exception: Image not found. Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6496274d-18d8-4bb2-849c-3256afd5ced4'} Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6496274d-18d8-4bb2-849c-3256afd5ced4 to delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6496274d-18d8-4bb2-849c-3256afd5ced4 could not be found. Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.205719 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9b56587-512e-4f6b-9d2e-0531bb7dd4e0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Image not found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9b56587-512e-4f6b-9d2e-0531bb7dd4e0 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4" status: 404 len: 62 microversion: 2.1 time: 0.048634 Sep 08 10:29:36.211059 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1696/3583] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:36 2022] DELETE /compute/v2.1/images/6496274d-18d8-4bb2-849c-3256afd5ced4 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:36.220203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.220203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:36.226103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.226634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.227197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.228852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.229445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.229890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.293994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:36.307966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.308114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3bd3efbb-84e4-4cc0-9654-ef3794e8b78b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.396222 Sep 08 10:29:36.308470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.309074 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1888/3584] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:35 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:36.309218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.309412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lazy-loading 'fault' on Instance uuid 62ee93ba-2267-491e-a036-ffb903f2463e {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:36.332478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.333338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:36.341424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.342340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.343065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.344683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.345276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.345877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.364686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 HTTP/1.1 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '54135dcc-b26a-46bc-a635-b70c97ee1554'} Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:36.366390 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c59ab7e4-aa66-47f1-baa7-b6b0f08c9f04 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 404 len: 111 microversion: 2.1 time: 0.042467 Sep 08 10:29:36.370771 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1889/3585] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:36 2022] DELETE /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:36.373721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.374345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:36.383775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.384851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.385485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.386385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.386850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.387282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.470540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9a9cd8f4f34fc684e291c2cba42c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2780d87bb2d145af92bae72ece6f8005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:36.480533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2dd9cfcf-5120-48c0-b9a1-1a8ca2386fb7 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 200 len: 1315 microversion: 2.1 time: 0.270839 Sep 08 10:29:36.481129 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1697/3586] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:36 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:36.487589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.488215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 54135dcc-b26a-46bc-a635-b70c97ee1554] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:36.495445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.496331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.496990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.497925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.498592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.499247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.502348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:36.511221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f99e2286-342a-4c4c-8c2e-230569b32f5a tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1274 microversion: 2.1 time: 0.141258 Sep 08 10:29:36.512098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1890/3587] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:36 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 HTTP/1.1 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '54135dcc-b26a-46bc-a635-b70c97ee1554'} Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:36.522078 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 54135dcc-b26a-46bc-a635-b70c97ee1554 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35e463dd-e3c8-412f-a7ed-15d420288847 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554" status: 404 len: 111 microversion: 2.1 time: 0.038451 Sep 08 10:29:36.526803 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1698/3588] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:36 2022] GET /compute/v2.1/servers/54135dcc-b26a-46bc-a635-b70c97ee1554 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:36.535107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe25f390-acda-450b-a3c5-526fff5609e5 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '.version_select at 0x7f23554e9f70>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.559421 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe25f390-acda-450b-a3c5-526fff5609e5 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221911279" status: 202 len: 0 microversion: 2.1 time: 0.029275 Sep 08 10:29:36.563270 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1699/3589] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221911279 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:29:36.908618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:36.909828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:36.917077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.919423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.920385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:36.921711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:36.922685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:36.923272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.112037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.112658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:37.119442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.119969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.120437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.121138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.121589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.122013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.318349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:37.335762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:37.337795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:37.339104 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-641aebd4-137d-4325-b3c8-896559c692ed tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.435641 Sep 08 10:29:37.339855 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1891/3590] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:36 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:37.347795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-210d4c32-8747-43d6-8b26-a2ed215a9ecc tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '.version_select at 0x7f2350522700>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.372730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-210d4c32-8747-43d6-8b26-a2ed215a9ecc tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Image not found. Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-210d4c32-8747-43d6-8b26-a2ed215a9ecc tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/images/f3c2a21e-4647-4a52-b7ea-5e269a37bcfd HTTP/1.1 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: exception: Image not found. Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f3c2a21e-4647-4a52-b7ea-5e269a37bcfd'} Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f3c2a21e-4647-4a52-b7ea-5e269a37bcfd to delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3c2a21e-4647-4a52-b7ea-5e269a37bcfd could not be found. Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.374584 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-210d4c32-8747-43d6-8b26-a2ed215a9ecc tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Image not found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-210d4c32-8747-43d6-8b26-a2ed215a9ecc tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/images/f3c2a21e-4647-4a52-b7ea-5e269a37bcfd" status: 404 len: 62 microversion: 2.1 time: 0.035560 Sep 08 10:29:37.380090 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1892/3591] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:37 2022] DELETE /compute/v2.1/images/f3c2a21e-4647-4a52-b7ea-5e269a37bcfd => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:29:37.387565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.388289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:37.396837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.397429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.397966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.398834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.399443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.400016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.513031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:37.528351 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da464cc3-c1b7-4808-acb9-e91df3ff3d47 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.420772 Sep 08 10:29:37.528955 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1700/3592] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:37 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:37.547520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.550584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:37.567820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.568671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.569374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.570407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.571316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.572600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.601709 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 HTTP/1.1 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444'} Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:37.604195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:37.610000 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2dd631a6-d465-435b-a1c5-7ae9266a2784 tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 404 len: 111 microversion: 2.1 time: 0.075730 Sep 08 10:29:37.612414 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1701/3593] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:37 2022] DELETE /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:37.629383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.630021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] [instance: 62ee93ba-2267-491e-a036-ffb903f2463e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:37.636811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.637310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.637752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.638474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.639160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.639342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.661511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] HTTP exception thrown: Instance 62ee93ba-2267-491e-a036-ffb903f2463e could not be found. Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Request method failure captured: Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e HTTP/1.1 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcP58GdqacXf3k1E4o-GVgrwH8QHt0GbFn_0TBlG9T0l8ldhrUz8qcow4ZPk6QZyLF4vED0SkAO2kIc6LCT6IkW6cLQ5Gk9SQqdFgvhWZ2VQADynTYkIq6LRZhqcA1cQGhkd6iD9QZkqAluMk7ZTH7l-C3NQHpx3nz0Y21PpBwJPZz0 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 2780d87bb2d145af92bae72ece6f8005 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2780d87bb2d145af92bae72ece6f8005"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2780d87bb2d145af92bae72ece6f8005", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 2780d87bb2d145af92bae72ece6f8005 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1799739766 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerAddressesNegativeTestJSON-1799739766-project Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 2d9a9cd8f4f34fc684e291c2cba42c78 Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1799739766-project Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 62ee93ba-2267-491e-a036-ffb903f2463e could not be found. Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '62ee93ba-2267-491e-a036-ffb903f2463e'} Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ee93ba-2267-491e-a036-ffb903f2463e could not be found. Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ee93ba-2267-491e-a036-ffb903f2463e could not be found. Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.663865 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ee93ba-2267-491e-a036-ffb903f2463e could not be found. Sep 08 10:29:37.670249 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.673135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] Returning 404 to user: Instance 62ee93ba-2267-491e-a036-ffb903f2463e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:37.674017 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2f40ad81-00a8-4595-b7a7-e6d56b90f691 tempest-ServerAddressesNegativeTestJSON-1799739766 tempest-ServerAddressesNegativeTestJSON-1799739766-project] 10.222.0.59 "GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e" status: 404 len: 111 microversion: 2.1 time: 0.062471 Sep 08 10:29:37.675123 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1702/3594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:37 2022] GET /compute/v2.1/servers/62ee93ba-2267-491e-a036-ffb903f2463e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:37.682107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.682972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:37.695306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.696150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.696861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.697799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.698465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.699104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.936206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:37.944981 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e6e2942-dcd9-4385-bfb0-32d8b8b96214 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.566720 Sep 08 10:29:37.946315 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1893/3595] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:37 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:37.951864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:37.952929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] [instance: 8d4fcebd-7236-4534-bc3d-aa90843d1444] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:37.959634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.960607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.961277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.962909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:37.963639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:37.965211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:37.991222 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] HTTP exception thrown: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Request method failure captured: Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 HTTP/1.1 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcN8nnjVnVVfbMvtIlpfKsa2adPsHh2_Y-mDnBUrVKB-00R9sNxZAfca1_da0tZyq-Ka0fBQR9790pcRzFIzo3McCnUMjBfzopJaOYOJ4AjgTvZnKfVbgOdcr616zFswWjNL_Spl6RvPaKXLEB6VqY94NZBnxqKgXXnA3XUtopfGxVE Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/912e0307585e408ebefb443ebbae583e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/912e0307585e408ebefb443ebbae583e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_912e0307585e408ebefb443ebbae583e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 912e0307585e408ebefb443ebbae583e Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462 Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 774190078d7b4c1d96c5921410a650ad Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1289399462-project Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8d4fcebd-7236-4534-bc3d-aa90843d1444'} Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:37.996093 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] Returning 404 to user: Instance 8d4fcebd-7236-4534-bc3d-aa90843d1444 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ca09fe5-8586-4b20-8681-5c4ffb31a1df tempest-ImagesOneServerNegativeTestJSON-1289399462 tempest-ImagesOneServerNegativeTestJSON-1289399462-project] 10.222.0.59 "GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444" status: 404 len: 111 microversion: 2.1 time: 0.049377 Sep 08 10:29:38.000486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1894/3596] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:37 2022] GET /compute/v2.1/servers/8d4fcebd-7236-4534-bc3d-aa90843d1444 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:38.021097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:38.031920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-afc127ac-6302-41d8-b624-3002544f2f81 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.354712 Sep 08 10:29:38.033173 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1703/3597] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:37 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:38.366911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:38.367892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:38.375616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:38.376199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:38.376834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:38.377569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:38.378351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:38.378777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:38.557263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:38.558572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:38.565772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:38.567448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:38.568145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:38.569435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:38.569914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:38.570347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:38.730676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:38.739383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:38.745648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:38.746862 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb73dc12-7848-4d75-a593-7cca90fba138 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.384136 Sep 08 10:29:38.747542 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1895/3598] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:38 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:38.943972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:38.953665 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa19982f-ac37-47b6-802a-5236b328c7c8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.402153 Sep 08 10:29:38.954264 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1704/3599] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:38 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:38.985721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:38.985980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7edec161-1628-435d-b2d9-3362d4f3b58b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: .version_select at 0x7f23506a7af0>, body: {"keypair": {"name": "tempest-keypair-1480904515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz8tt6EACSNdHiKcem9SpQmbsfUjK/X2hwhjDxpoQ8z7ATl3LEYn66p/5p2I6t3R1vhhm2yPi0LeobAI6u7uxxxohkUx4258b13mCGgkUIsIK7vuc04sOn5vWOpRGdm3g=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:38.988184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:39.002461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.006529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-7edec161-1628-435d-b2d9-3362d4f3b58b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for project 1ee1af948aad445daad7abcd11441316. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:39.007772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.008260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.009635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.010136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.010572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.013306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-7edec161-1628-435d-b2d9-3362d4f3b58b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for user 0dd35046e12b46a59478ad7dbe2339c9 and project 1ee1af948aad445daad7abcd11441316. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:39.048491 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7edec161-1628-435d-b2d9-3362d4f3b58b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158925 Sep 08 10:29:39.049784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1896/3600] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:29:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:39.063543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:39.066548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:39.083287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.084075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.085794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.090386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.091382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.093330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.406094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:39.422112 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-039e066e-6127-4daa-af56-9fef7d94551c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.448937 Sep 08 10:29:39.423105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1705/3601] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:38 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:39.476480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:39.495852 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56a02493-14ab-4a95-9165-e4c58a32bf44 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.432972 Sep 08 10:29:39.501515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1897/3602] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:39 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:39.677917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6c86b19e-b9e6-4b47-aa26-4bbbd6602d0b req-5a482796-f508-46b6-813e-e5788d7bf3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e5b4d9-a3e3-47bd-b2e3-c336e146d113", "tag": "832bec86-bc53-426a-81cf-6cc206c63e0d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:39.696393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6c86b19e-b9e6-4b47-aa26-4bbbd6602d0b req-5a482796-f508-46b6-813e-e5788d7bf3ec service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.697197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6c86b19e-b9e6-4b47-aa26-4bbbd6602d0b req-5a482796-f508-46b6-813e-e5788d7bf3ec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.697909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6c86b19e-b9e6-4b47-aa26-4bbbd6602d0b req-5a482796-f508-46b6-813e-e5788d7bf3ec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.716511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6c86b19e-b9e6-4b47-aa26-4bbbd6602d0b req-5a482796-f508-46b6-813e-e5788d7bf3ec service nova] Creating event network-changed:832bec86-bc53-426a-81cf-6cc206c63e0d for instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 on n-h1-833090-19 Sep 08 10:29:39.723957 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6c86b19e-b9e6-4b47-aa26-4bbbd6602d0b req-5a482796-f508-46b6-813e-e5788d7bf3ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051064 Sep 08 10:29:39.725230 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1706/3603] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:39.778532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:39.779158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:39.790903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.791400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.791867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.792578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.793027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.793453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.980415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:39.981117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:39.994409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.994409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.994409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:39.994810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:39.995099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:39.995551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:40.294496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:40.303647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:40.305622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:40.307699 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07e48155-4b15-4328-a0eb-8efe0ffd1604 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.534977 Sep 08 10:29:40.309196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1898/3604] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:39 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:40.445178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:40.445814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:40.464019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:40.465982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:40.466719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:40.467710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:40.471851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:40.472780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:40.530061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:40.541941 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f1d079b-c8e9-4edb-a3ef-964cbb2408f0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.565717 Sep 08 10:29:40.546177 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1707/3605] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:39 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:40.569119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:40.576341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:40.583658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:40.584162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:40.584606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:40.588118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:40.589025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:40.589784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:40.867753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:40.882299 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03d1ce27-b38a-494f-81b6-89eabddb3e6d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.441097 Sep 08 10:29:40.882909 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1899/3606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:40 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:40.976768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:40.990196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ab1394d-9406-422e-b4c8-6d15aa2355a3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.431977 Sep 08 10:29:40.991374 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1708/3607] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:40 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:41.342640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:41.343404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:41.351681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:41.352198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:41.352709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:41.354402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:41.355905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:41.357072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:41.571888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:41.572510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:41.599160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:41.599693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:41.600141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:41.600866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:41.601325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:41.601755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:41.611777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:41.621429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:41.629946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:41.637347 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b92afb8-9189-4e89-abb2-fafe4ed14e26 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.303570 Sep 08 10:29:41.653226 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1900/3608] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:41 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:41.680442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:41.909019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:41.909644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:41.918025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:41.918514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:41.924154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:41.925458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:41.926107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:41.926709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:42.203092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:42.218193 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a8f59950-19d9-44e9-ba2e-8e954fd8e9b4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.313267 Sep 08 10:29:42.235495 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1901/3609] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:41 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:42.235495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:42.235495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:42.249218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:42.257519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:42.258055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:42.258832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:42.260451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:42.260964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:42.329659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:42.356966 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc704962-7c47-4cbf-ae73-f303b591aeb0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1521 microversion: 2.1 time: 0.788387 Sep 08 10:29:42.358836 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1709/3610] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:41 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:42.667225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:42.668209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:42.676182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:42.677769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:42.683196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:42.683909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:42.684860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:42.697054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:42.697895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:42.719040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:42.730171 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8856451-82cd-4a45-a65b-a1209565b601 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.501745 Sep 08 10:29:42.733758 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1902/3611] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:42 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:43.082677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:43.100139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:43.102586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:43.106465 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3afcf6ca-be40-4ba7-996e-29fb18c83416 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.443663 Sep 08 10:29:43.124398 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1710/3612] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:42 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:29:43.252236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:43.253209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:43.271455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:43.272273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:43.272763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:43.273822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:43.274430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:43.275492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:43.387425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:43.388017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:43.402067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:43.406433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:43.407172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:43.408129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:43.408910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:43.409521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:43.630962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:43.641343 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6fc2342-c566-48cf-9e09-5d9fcdeea647 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.393603 Sep 08 10:29:43.658203 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1903/3613] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:43 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:43.762831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:43.763622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:43.778819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:43.779709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:43.781094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:43.782877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:43.783535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:43.784426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:43.809511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:43.822992 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd6cb687-cbeb-44e9-bdc3-83201e61feea tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1501 microversion: 2.1 time: 0.440507 Sep 08 10:29:43.826776 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1711/3614] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:43 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1501 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:43.843887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1013686845", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2697db8c-2227-4a3c-87af-732f9cbcc5d8"}], "security_groups": [{"name": "tempest-securitygroup--1913642039"}], "key_name": "tempest-keypair-1480904515", "user_data": "}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:44.075902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] validate_networks() for [('2697db8c-2227-4a3c-87af-732f9cbcc5d8', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:29:44.081541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:44.090668 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9cb43641-c001-46eb-98eb-238d49865095 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.332954 Sep 08 10:29:44.091533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1904/3615] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:43 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:44.097478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:44.098314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:44.105650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:44.106361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:44.107908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:44.108826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:44.109462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:44.110064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:44.381053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:44.396077 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-43f5f62a-fb15-4c55-998d-2e98ea81dfc5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1515 microversion: 2.1 time: 0.303244 Sep 08 10:29:44.398104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1905/3616] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:44 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:44.445482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:44.447953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:44.471517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:44.473534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:44.475618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:44.484294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:44.485769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:44.486684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.092498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:45.114587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:45.125565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:45.127693 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-baeea4d0-a371-48d1-9fee-3a900d10d6fd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.714347 Sep 08 10:29:45.143981 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1906/3617] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:44 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:45.154574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7810b55-9004-4347-a366-ef2b79094959 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:45.157495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7810b55-9004-4347-a366-ef2b79094959 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: f570f510-bee3-4c2d-9bbd-ba35895ac2cb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:45.165075 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e7810b55-9004-4347-a366-ef2b79094959 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Instance f570f510-bee3-4c2d-9bbd-ba35895ac2cb could not be found. Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7810b55-9004-4347-a366-ef2b79094959 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/f570f510-bee3-4c2d-9bbd-ba35895ac2cb/action HTTP/1.1 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 14 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: {"rescue": {}} Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f570f510-bee3-4c2d-9bbd-ba35895ac2cb could not be found. Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f570f510-bee3-4c2d-9bbd-ba35895ac2cb', 'body': {'rescue': {}}} Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f570f510-bee3-4c2d-9bbd-ba35895ac2cb could not be found. Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f570f510-bee3-4c2d-9bbd-ba35895ac2cb could not be found. Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:45.172646 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f570f510-bee3-4c2d-9bbd-ba35895ac2cb could not be found. Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7810b55-9004-4347-a366-ef2b79094959 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 404 to user: Instance f570f510-bee3-4c2d-9bbd-ba35895ac2cb could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7810b55-9004-4347-a366-ef2b79094959 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/f570f510-bee3-4c2d-9bbd-ba35895ac2cb/action" status: 404 len: 111 microversion: 2.1 time: 0.029495 Sep 08 10:29:45.178647 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1907/3618] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:45 2022] POST /compute/v2.1/servers/f570f510-bee3-4c2d-9bbd-ba35895ac2cb/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:45.182494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:45.183573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:45.191034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.191668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.191668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.191668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.191668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.191668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.238124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:29:45.239399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:29:45.240141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:29:45.240730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:29:45.241388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:29:45.253810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.255794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.256771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.257718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.260285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.260890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.294587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for project 1ee1af948aad445daad7abcd11441316. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:45.302049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for user 0dd35046e12b46a59478ad7dbe2339c9 and project 1ee1af948aad445daad7abcd11441316. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:45.354319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:29:45.357450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:29:45.410166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:45.418900 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-40822493-ed95-4b84-adc8-9e146eea134b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.580410 Sep 08 10:29:45.420751 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1712/3619] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:29:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:29:45.421095 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-75e083f8-38ea-488c-8f2f-992185ede5e0 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.243653 Sep 08 10:29:45.421789 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1908/3620] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:45 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:45.427384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:45.428258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:45.437729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.438275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.438710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.439433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.439919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.440340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.443851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:45.445169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:45.466261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.468345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.470629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.486338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.489054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.491804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.509624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:45.640622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eef6ac3e-86fc-4cd5-8815-703999d29d21 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action" status: 202 len: 0 microversion: 2.1 time: 0.206579 Sep 08 10:29:45.644754 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1909/3621] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:45 2022] POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:29:45.649301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b724eaf-89af-4c01-9699-aa81216080c2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:45.650083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b724eaf-89af-4c01-9699-aa81216080c2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:45.673657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:45.686469 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1016ed06-2ab2-475e-b5c2-f08237556047 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.264244 Sep 08 10:29:45.687742 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1713/3622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:45 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:45.692880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0a62827e-d2fb-46ba-979b-da2225d34c1e req-0a49eeaa-6f69-4156-8994-0bbbd97fa4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e5b4d9-a3e3-47bd-b2e3-c336e146d113", "name": "network-vif-plugged", "status": "completed", "tag": "832bec86-bc53-426a-81cf-6cc206c63e0d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:45.729556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0a62827e-d2fb-46ba-979b-da2225d34c1e req-0a49eeaa-6f69-4156-8994-0bbbd97fa4c5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.732046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0a62827e-d2fb-46ba-979b-da2225d34c1e req-0a49eeaa-6f69-4156-8994-0bbbd97fa4c5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.733794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0a62827e-d2fb-46ba-979b-da2225d34c1e req-0a49eeaa-6f69-4156-8994-0bbbd97fa4c5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.767002 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0a62827e-d2fb-46ba-979b-da2225d34c1e req-0a49eeaa-6f69-4156-8994-0bbbd97fa4c5 service nova] Creating event network-vif-plugged:832bec86-bc53-426a-81cf-6cc206c63e0d for instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 on n-h1-833090-19 Sep 08 10:29:45.774188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b724eaf-89af-4c01-9699-aa81216080c2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:45.776903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0a62827e-d2fb-46ba-979b-da2225d34c1e req-0a49eeaa-6f69-4156-8994-0bbbd97fa4c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087616 Sep 08 10:29:45.777910 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1714/3623] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:45.787991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:45.788907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:45.789873 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b724eaf-89af-4c01-9699-aa81216080c2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1238 microversion: 2.1 time: 0.140938 Sep 08 10:29:45.790712 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1910/3624] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:45 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1238 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:45.819291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.822158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.822622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:45.832563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:45.833326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:45.835210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.161186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:46.161832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:46.171390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.172639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.175065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.176021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.179407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.180241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.200207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:46.215082 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-099710f8-83e0-43eb-98f2-8553afd39c0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1520 microversion: 2.1 time: 0.433510 Sep 08 10:29:46.232694 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1715/3625] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:45 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:46.408024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:46.419738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:46.421206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:46.423504 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aac5d7f7-3bc2-4e52-bded-61478f01b522 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1744 microversion: 2.20 time: 0.267134 Sep 08 10:29:46.424126 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1911/3626] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:46 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1744 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:46.449035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:46.452440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:46.466051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.466771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.467675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.471562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.472320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.472820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.692516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:46.701134 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-414f4c45-eb41-4612-8863-3013e65ee67c tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.260430 Sep 08 10:29:46.702143 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1716/3627] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:46 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:46.725929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:46.726891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:46.738871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.739362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.739982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.744174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.744855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.745382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.814096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:46.814707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:46.822834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.823709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.824399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.825789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:46.826395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:46.826928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:46.850901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:46.944664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:46.954662 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e282450d-5f14-445f-b20f-436d4dde1211 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1234 microversion: 2.1 time: 0.144268 Sep 08 10:29:46.956085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1717/3628] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:46 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1234 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:47.013254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:47.022221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec1f7117-1f83-4131-981e-d2844f510c25 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1316 microversion: 2.1 time: 0.303544 Sep 08 10:29:47.025679 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1912/3629] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:46 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:47.249792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:47.250594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:47.259641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.261018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.262998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.264052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.267504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.268167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.437151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:47.452029 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8caaae73-43de-499d-b9c9-1735c931a81b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1500 microversion: 2.1 time: 0.204217 Sep 08 10:29:47.452677 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1718/3630] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:47 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1500 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:47.457891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:47.459393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:47.466491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.467065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.467897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.468845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.469512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.470284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.479419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:47.482020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:47.488192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.488677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.489109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.489810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.490253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.490867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.525033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'flavor' on Instance uuid ed661293-2de7-4a28-8de8-d4b538451e23 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:47.548242 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Cannot 'rescue' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state paused Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action HTTP/1.1 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 14 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: {"rescue": {}} Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'rescue' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state paused Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ed661293-2de7-4a28-8de8-d4b538451e23', 'body': {'rescue': {}}} Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed661293-2de7-4a28-8de8-d4b538451e23 in vm_state paused. Cannot rescue while the instance is in this state. Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state paused Sep 08 10:29:47.551003 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state paused Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 409 to user: Cannot 'rescue' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state paused {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-158388d4-fa38-4418-85c7-53e52b27d3e4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action" status: 409 len: 144 microversion: 2.1 time: 0.082074 Sep 08 10:29:47.560524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1719/3631] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:47 2022] POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action => generated 144 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:29:47.563768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:47.564721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:47.572455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.573212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.573705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.575168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.575597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.576352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.665717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:47.668655 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e9f8ca5-0fdf-4e8e-ba99-d9695787d311 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action" status: 202 len: 0 microversion: 2.1 time: 0.109045 Sep 08 10:29:47.672790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1720/3632] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:47 2022] POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:29:47.677712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:47.679755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:47.681671 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f0dd0ff-c295-4caa-8dc0-590b21a27156 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1744 microversion: 2.20 time: 0.230614 Sep 08 10:29:47.687622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1913/3633] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:47 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:47.691546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:47.694028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:47.702935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.703635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.704417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.704907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.705429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.705920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.727024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:47.728585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:47.740328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.741105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.741543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:47.742263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:47.742710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:47.743128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.063109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:48.071578 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a7a0370-7fac-4208-a5fa-c6502126853f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.348585 Sep 08 10:29:48.073225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1914/3634] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:47 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:48.078062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.078667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:48.084875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.085369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.085808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.086510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.087048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.087677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.088581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:48.104808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88b60789-b484-4617-a25c-b7a16fa87726 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1507 microversion: 2.1 time: 0.421547 Sep 08 10:29:48.106470 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1721/3635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:47 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:48.112498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.112873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:48.122673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.123157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.123644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.125501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.126277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.126839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.219046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:48.234297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7296094-15a2-4a49-b9b5-1727c1d57a40 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1296 microversion: 2.1 time: 0.159684 Sep 08 10:29:48.234961 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1915/3636] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:48.444333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:48.444867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d2a2fe0f-4e6c-4d2a-85e4-6ffbe870ea29 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f23505274c0>, body: {"keypair": {"name": "tempest-keypair-147603312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcxE2e/opJttsGtK/3ShwMJLYIPQSPsy3EFAIhbfbpcGslDnLX3Z54AQiGvQG8nk39SRlh7HjLYw6JeSHLPKRnGbYa7+WNBodBvJfmfHhQ7VSCctB8WGVmO8kYtRNWrgg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:48.458528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0ee89693-dc8b-4eac-9e3e-312586cb3ef0 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1504 microversion: 2.1 time: 0.350521 Sep 08 10:29:48.460104 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1722/3637] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:48.479016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d2a2fe0f-4e6c-4d2a-85e4-6ffbe870ea29 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:48.482350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.482857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:48.489498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:48.492760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:48.492934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.493513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.494443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.496014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.496493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.496923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.497046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d2a2fe0f-4e6c-4d2a-85e4-6ffbe870ea29 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:48.528301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:29:48.546327 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d2a2fe0f-4e6c-4d2a-85e4-6ffbe870ea29 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.309553 Sep 08 10:29:48.553808 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1916/3638] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 318 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:29:48.561784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6c18bcec-bca1-40a4-a303-eea28c00c968 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23505633a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.575550 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6c18bcec-bca1-40a4-a303-eea28c00c968 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-147603312" status: 200 len: 512 microversion: 2.2 time: 0.019437 Sep 08 10:29:48.579099 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1917/3639] 10.222.0.59 () {60 vars in 1255 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-147603312 => generated 512 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:48.593240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c790944b-f65a-4f64-b767-e2cf872851c7 req-f9fc8ad1-f585-41d6-9433-ba61884a7bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "name": "network-vif-plugged", "status": "completed", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:48.618700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c790944b-f65a-4f64-b767-e2cf872851c7 req-f9fc8ad1-f585-41d6-9433-ba61884a7bcc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.622874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c790944b-f65a-4f64-b767-e2cf872851c7 req-f9fc8ad1-f585-41d6-9433-ba61884a7bcc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.623491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c790944b-f65a-4f64-b767-e2cf872851c7 req-f9fc8ad1-f585-41d6-9433-ba61884a7bcc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.640954 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e9f68eb7-ba01-41f6-9cb3-1d87aba022e8 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "DELETE /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 204 len: 0 microversion: 2.1 time: 0.162939 Sep 08 10:29:48.645866 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1723/3640] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:48 2022] DELETE /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:29:48.655978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f229e2f-f842-4045-a022-8e51f4043f84 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f2350bb61f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.662546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c790944b-f65a-4f64-b767-e2cf872851c7 req-f9fc8ad1-f585-41d6-9433-ba61884a7bcc service nova] Creating event network-vif-plugged:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:29:48.679166 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c790944b-f65a-4f64-b767-e2cf872851c7 req-f9fc8ad1-f585-41d6-9433-ba61884a7bcc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098275 Sep 08 10:29:48.680178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1918/3641] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:48.683561 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f229e2f-f842-4045-a022-8e51f4043f84 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-147603312" status: 204 len: 0 microversion: 2.2 time: 0.035243 Sep 08 10:29:48.692767 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1724/3642] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Sep 8 10:29:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-147603312 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:48.700437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.701587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:48.708963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e862489-e3db-4c05-927a-e268e5789af8 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f23506efb80>, body: {"keypair": {"name": "tempest-keypair-994755121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKud/LjQgeKDp5GsWfTY2oKjMYkJMejcFtNxPStTM5YVehrQD+4MOrtntoJ8kK8rtDXZnB8XuPLKdHDVJHJjqS/yUmfjzFoSg1LPqt8Xman7a3RLnZvK3ELFMaDQ8eBpaQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:48.720305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.721191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.721492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.722190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.722816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.723407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.733143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-1e862489-e3db-4c05-927a-e268e5789af8 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:48.739429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-1e862489-e3db-4c05-927a-e268e5789af8 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:48.767568 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e862489-e3db-4c05-927a-e268e5789af8 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.063724 Sep 08 10:29:48.769288 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1725/3643] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 08 10:29:48.775210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:48.775974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:48.782650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.783148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.783618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:48.784538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:48.784993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:48.787741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.036266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:49.071086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:49.086922 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b01732e4-d3a9-4466-a38d-b23b54b38f28 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1510 microversion: 2.1 time: 0.404827 Sep 08 10:29:49.089016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:49.090228 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1919/3644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:49.095508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:49.098923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-679bb771-bb1e-4f10-8ef5-9bbd2a16e5a3 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f2350501670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:49.100211 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-518b7f3c-9f56-4b01-b477-76d1dff4b90e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1744 microversion: 2.20 time: 0.329699 Sep 08 10:29:49.101302 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1726/3645] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:48 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1744 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:49.120553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:49.121335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:49.127626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:49.128769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:49.129409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.130735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:49.131306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:49.132428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.143320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-679bb771-bb1e-4f10-8ef5-9bbd2a16e5a3 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994755121" status: 204 len: 0 microversion: 2.2 time: 0.050512 Sep 08 10:29:49.144042 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1920/3646] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Sep 8 10:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994755121 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:49.157064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:49.172371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:49.178986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:49.179504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:49.179937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.180686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:49.181178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:49.181599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.562664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:49.577566 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5196a661-0a39-48b0-a882-9b584b5d8a31 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.468485 Sep 08 10:29:49.580372 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1727/3647] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:49 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:49.583551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:49.593451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a64e030-d3f9-462f-bd43-caa556fc34dd tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f235540f790>, body: {"keypair": {"name": "tempest-keypair-163260769", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:49.606931 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-370f0a18-18e7-4a75-94c4-4023190b4f29 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1515 microversion: 2.1 time: 0.453717 Sep 08 10:29:49.608489 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1921/3648] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:49 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1515 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:49.613371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:49.618191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:49.643315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3a64e030-d3f9-462f-bd43-caa556fc34dd tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:49.659349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3a64e030-d3f9-462f-bd43-caa556fc34dd tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:49.668577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:49.669168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:49.670080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.670981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:49.671633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:49.672240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:49.716156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a64e030-d3f9-462f-bd43-caa556fc34dd tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.133919 Sep 08 10:29:49.717631 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1728/3649] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:49 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:29:49.730270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2db81c1c-b249-4722-9302-dc29dc785241 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23554bca60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:49.774579 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2db81c1c-b249-4722-9302-dc29dc785241 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163260769" status: 204 len: 0 microversion: 2.2 time: 0.050430 Sep 08 10:29:49.776812 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1729/3650] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Sep 8 10:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163260769 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:29:49.796414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16248076-8533-4248-b538-1d6e4a8468e5 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f23506bf160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1335500588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpTRXkvXW2oVN8jjd/Kr1bzg8t143OE5c2UweJYg1JJySGCsMoBzBw+2lNE+s7pvdiiENM5UT11KkoOIv38VhWWqgx2ps7NZubQNFZBELVIGX4MJa0I21pDPXeFRISQNQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:49.860718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-16248076-8533-4248-b538-1d6e4a8468e5 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:49.876385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-16248076-8533-4248-b538-1d6e4a8468e5 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:49.959124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16248076-8533-4248-b538-1d6e4a8468e5 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.174193 Sep 08 10:29:49.965733 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1730/3651] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:49 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:29:49.976664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a43fc10-f47e-4d29-9b29-d1265a86e620 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f23506bfc10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2138591996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC57fdBPEfYJ8el+7uwv/mQZmj+rJqDtg90pWt7kQB1fqS5runjVkkNi/ufxic//temB63V9xN8/4YLgiNFAcszne4Iv/YqolU+gc0S4QdzcKBLZ7MulemW/YU1ybY+mvw=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:50.027080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0a43fc10-f47e-4d29-9b29-d1265a86e620 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:50.038096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0a43fc10-f47e-4d29-9b29-d1265a86e620 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:50.084033 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a43fc10-f47e-4d29-9b29-d1265a86e620 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.111269 Sep 08 10:29:50.085930 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1731/3652] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:49 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:29:50.103913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-865e5f3e-cbac-49d8-ae7b-0246bdeebe1c tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f2350bd0af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-753822029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD89VLRmPYfQCBWG3mpaWRntmWvIqPzI/8kAAydqbqkmzRNo6q3qpbpfQ7e1nGEFcn3bwRkeocM8H6gLbMdq7bgPm8X8fp1xmRAHn3JY0Wq9G6f82Wp5go8z2pDMbQZGpg=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:50.126595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-865e5f3e-cbac-49d8-ae7b-0246bdeebe1c tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:50.139653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-865e5f3e-cbac-49d8-ae7b-0246bdeebe1c tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:50.173332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-865e5f3e-cbac-49d8-ae7b-0246bdeebe1c tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.077461 Sep 08 10:29:50.181755 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1732/3653] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:50 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:29:50.186908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:50.187746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:50.218230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:50.218732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:50.219165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:50.224976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:50.225502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:50.225990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:50.502046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:50.510925 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5fc1e893-2833-4922-8c3a-5caa53038b57 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 0.901108 Sep 08 10:29:50.515725 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1922/3654] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:49 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:50.523343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:50.526494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:50.533862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:50.534742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:50.535413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:50.536483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:50.537126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:50.537560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:50.952321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:50.972942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:50.976281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:50.994603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65fffc58-f2be-4c9e-a7db-662620727d29 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1744 microversion: 2.20 time: 0.460914 Sep 08 10:29:50.996152 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1923/3655] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:50 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1744 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:51.008124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e85ac24-ccdb-4ffa-abd7-21da7787ef3f tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23504d9d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.018915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:51.023318 n-d-833090-19 devstack@n-api.service[122457]: WARNING oslo_db.sqlalchemy.utils [None req-9e85ac24-ccdb-4ffa-abd7-21da7787ef3f tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:29:51.029660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b470bec3-6a08-4691-837f-aa89f4ba1674 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1510 microversion: 2.1 time: 0.851562 Sep 08 10:29:51.036113 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1733/3656] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:50 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1510 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:51.043435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.044666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:51.052608 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e85ac24-ccdb-4ffa-abd7-21da7787ef3f tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.055101 Sep 08 10:29:51.056769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:51.057108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:51.057550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:51.058167 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1924/3657] 10.222.0.59 () {60 vars in 1177 bytes} [Thu Sep 8 10:29:50 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:51.058290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:51.069073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:51.071374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1a504da-0529-46a0-8623-5775f5c02959 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23504e80d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.080443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:51.123612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1a504da-0529-46a0-8623-5775f5c02959 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-753822029" status: 204 len: 0 microversion: 2.2 time: 0.058320 Sep 08 10:29:51.124575 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1925/3658] 10.222.0.59 () {60 vars in 1318 bytes} [Thu Sep 8 10:29:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-753822029 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:29:51.132744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e48571d4-cde9-4901-bc6d-b093ff3e815e tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23504e8e50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.179733 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e48571d4-cde9-4901-bc6d-b093ff3e815e tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2138591996" status: 204 len: 0 microversion: 2.2 time: 0.050691 Sep 08 10:29:51.180593 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1926/3659] 10.222.0.59 () {60 vars in 1321 bytes} [Thu Sep 8 10:29:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2138591996 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:51.188865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-520efa07-24de-4447-97e5-4712d24e1da4 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23504b5dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.231482 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-520efa07-24de-4447-97e5-4712d24e1da4 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1335500588" status: 204 len: 0 microversion: 2.2 time: 0.046286 Sep 08 10:29:51.232506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1927/3660] 10.222.0.59 () {60 vars in 1321 bytes} [Thu Sep 8 10:29:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1335500588 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:29:51.246948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-63b5137f-c89c-4cb3-892d-bab63e8e988b tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f23504bd670>, body: {"keypair": {"name": "tempest-keypair-786567306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVBxIkxFpc+cq3as8EmNILtIUNe7ehVOXTVSxbdKx1IHlqotBWVfVMiQJu6K0zCNmGE/ojT4soaMEZjvKsXY2ga+ScIrrmnFUG1Nm4iNWa8ZWtcBN6tGBUt5iyLOd2NLQ=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:51.309005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-63b5137f-c89c-4cb3-892d-bab63e8e988b tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:51.330192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-63b5137f-c89c-4cb3-892d-bab63e8e988b tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:51.390102 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63b5137f-c89c-4cb3-892d-bab63e8e988b tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.142876 Sep 08 10:29:51.392253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1928/3661] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Sep 8 10:29:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:29:51.417957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a98ea7c-5f21-4ceb-a1af-6b81a19174d6 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23504dc4c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.435100 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a98ea7c-5f21-4ceb-a1af-6b81a19174d6 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-786567306" status: 200 len: 512 microversion: 2.2 time: 0.031338 Sep 08 10:29:51.439006 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1929/3662] 10.222.0.59 () {60 vars in 1255 bytes} [Thu Sep 8 10:29:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-786567306 => generated 512 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:51.455308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-36dcc02e-751d-412b-a6df-259f933aba31 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f2350563160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.468768 n-d-833090-19 devstack@n-api.service[122457]: WARNING oslo_db.sqlalchemy.utils [None req-36dcc02e-751d-412b-a6df-259f933aba31 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:29:51.489935 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-36dcc02e-751d-412b-a6df-259f933aba31 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.043019 Sep 08 10:29:51.491079 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1930/3663] 10.222.0.59 () {60 vars in 1177 bytes} [Thu Sep 8 10:29:51 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:29:51.503283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10582a51-8b05-426b-93f0-a04d2c061d03 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f235050a790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.533995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10582a51-8b05-426b-93f0-a04d2c061d03 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786567306" status: 204 len: 0 microversion: 2.2 time: 0.035287 Sep 08 10:29:51.535183 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1931/3664] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Sep 8 10:29:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786567306 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:29:51.557218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:51.563654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:51.582701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:51.583613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:51.584947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:51.588525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:51.589237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:51.589892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:51.845944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:51.884581 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd678b21-8a82-4bdf-b2ab-b6bb71c678b1 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.846452 Sep 08 10:29:51.886291 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1734/3665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:51 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:51.893689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Action: 'create', calling method: .version_select at 0x7f23516a0d30>, body: {"keypair": {"name": "tempest-keypair-1386633529", "type": "x509"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:51.943514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:51.974991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:52.045443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.processutils [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpe209cw82/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpe209cw82/temp.key -subj /CN=800c289e7a3d41bca02ab544bfd8364c -extensions v3_req_client {{(pid=122456) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 08 10:29:52.182961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:52.207368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5069c8a8-c3e2-4aec-b2a2-e972d7dbe2d4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 0.651793 Sep 08 10:29:52.209352 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1932/3666] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:51 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:29:52.233404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a1e134fb-9f68-4b14-813b-ae12e26356af req-ec3fe9cd-8402-4fa1-9d10-b4b90e8dcef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e5b4d9-a3e3-47bd-b2e3-c336e146d113", "name": "network-vif-deleted", "tag": "832bec86-bc53-426a-81cf-6cc206c63e0d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:52.263006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a1e134fb-9f68-4b14-813b-ae12e26356af req-ec3fe9cd-8402-4fa1-9d10-b4b90e8dcef1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:52.265805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a1e134fb-9f68-4b14-813b-ae12e26356af req-ec3fe9cd-8402-4fa1-9d10-b4b90e8dcef1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:52.266314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a1e134fb-9f68-4b14-813b-ae12e26356af req-ec3fe9cd-8402-4fa1-9d10-b4b90e8dcef1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:52.315828 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a1e134fb-9f68-4b14-813b-ae12e26356af req-ec3fe9cd-8402-4fa1-9d10-b4b90e8dcef1 service nova] Creating event network-vif-deleted:832bec86-bc53-426a-81cf-6cc206c63e0d for instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 on n-h1-833090-19 Sep 08 10:29:52.329854 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a1e134fb-9f68-4b14-813b-ae12e26356af req-ec3fe9cd-8402-4fa1-9d10-b4b90e8dcef1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115753 Sep 08 10:29:52.330481 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1933/3667] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:52.345415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:52.346115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:52.379792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:52.384646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:52.390830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:52.392761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:52.393597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:52.394273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:52.437565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.processutils [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpe209cw82/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpe209cw82/temp.key -subj /CN=800c289e7a3d41bca02ab544bfd8364c -extensions v3_req_client" returned: 0 in 0.392s {{(pid=122456) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 08 10:29:52.440120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.processutils [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpe209cw82/temp.key -password pass: {{(pid=122456) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 08 10:29:52.526564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.processutils [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpe209cw82/temp.key -password pass:" returned: 0 in 0.086s {{(pid=122456) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 08 10:29:52.630668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:29:52.632600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:52.654188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Getting quotas for user 800c289e7a3d41bca02ab544bfd8364c and project 49a2f93009f8496d9a5ce1e175e3f8a4. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:29:52.724642 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e0c0b59-85a0-472b-8553-1097998fe55d tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.836069 Sep 08 10:29:52.732778 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1735/3668] 10.222.0.59 () {62 vars in 1198 bytes} [Thu Sep 8 10:29:51 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 845 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:52.749381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:52.750125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:52.769382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:52.769945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:52.770389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:52.772331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:52.772801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:52.773236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:52.857011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:52.857510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:52.857953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:52.858653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lazy-loading 'fault' on Instance uuid 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:53.406384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:53.416214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:53.429447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:53.431030 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5f0f279-e11f-463c-aab6-d5eeb3165404 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 1.099442 Sep 08 10:29:53.448002 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1934/3669] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:52 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:53.456163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:53.458811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:53.466029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:53.466758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:53.467371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:53.468275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:53.468895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:53.469532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:53.503066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'flavor' on Instance uuid ed661293-2de7-4a28-8de8-d4b538451e23 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:29:53.527298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69552444b08f405489f39ac149739240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72acb15b9873499e806c576dbc4807be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:53.537967 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a96a26d9-8a32-4683-a773-1f3b84eec1c3 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 200 len: 1306 microversion: 2.1 time: 0.803348 Sep 08 10:29:53.540928 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1736/3670] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:52 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 1306 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:53.566304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32850909-698c-4734-9f59-4aeb2ee8d007 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23506bf700>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:53.586538 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32850909-698c-4734-9f59-4aeb2ee8d007 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs/tempest-keypair-1386633529" status: 200 len: 1534 microversion: 2.2 time: 0.037909 Sep 08 10:29:53.597889 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1737/3671] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Sep 8 10:29:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1386633529 => generated 1534 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:53.604441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:53.605395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:53.611908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:53.612650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:53.613259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:53.614197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:53.614828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:53.615484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:53.672605 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9584577-5c5a-46eb-9df8-c9ae061da038 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action" status: 200 len: 32 microversion: 2.1 time: 0.214000 Sep 08 10:29:53.686308 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1935/3672] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:29:53 2022] POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:29:53.695251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:53.696482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:53.704445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:53.705855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:53.706503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:53.707447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:53.708139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:53.708776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:53.714601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:54.329867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:54.343973 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0cb01974-b9ee-4db6-9c0a-2454cc34bf13 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 0.744601 Sep 08 10:29:54.359417 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1738/3673] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:53 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:54.364427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1c741c7f-769c-43fb-9116-7eccad87a1db req-59843dc8-05e8-4e65-959f-5b410c8863e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337703bb-dc79-4187-8fab-37fa4188823a", "tag": "02f9688e-98f0-4abb-80bd-8e16ba849e86"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:54.389238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1c741c7f-769c-43fb-9116-7eccad87a1db req-59843dc8-05e8-4e65-959f-5b410c8863e1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:54.390031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1c741c7f-769c-43fb-9116-7eccad87a1db req-59843dc8-05e8-4e65-959f-5b410c8863e1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:54.390672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1c741c7f-769c-43fb-9116-7eccad87a1db req-59843dc8-05e8-4e65-959f-5b410c8863e1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:54.426614 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1c741c7f-769c-43fb-9116-7eccad87a1db req-59843dc8-05e8-4e65-959f-5b410c8863e1 service nova] Creating event network-changed:02f9688e-98f0-4abb-80bd-8e16ba849e86 for instance 337703bb-dc79-4187-8fab-37fa4188823a on n-h1-833090-19 Sep 08 10:29:54.432576 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1c741c7f-769c-43fb-9116-7eccad87a1db req-59843dc8-05e8-4e65-959f-5b410c8863e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071800 Sep 08 10:29:54.433795 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1739/3674] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:29:54.448449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24bcd4bd-5775-4f53-90fc-6a107d05c7ec tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f23506bf9d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:54.452981 n-d-833090-19 devstack@n-api.service[122456]: WARNING oslo_db.sqlalchemy.utils [None req-24bcd4bd-5775-4f53-90fc-6a107d05c7ec tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:29:54.467316 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24bcd4bd-5775-4f53-90fc-6a107d05c7ec tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.032106 Sep 08 10:29:54.468469 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1740/3675] 10.222.0.59 () {60 vars in 1177 bytes} [Thu Sep 8 10:29:54 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:54.482670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:54.483805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:54.498752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:54.499534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:54.501711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:54.505311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:54.506160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:54.506786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:54.528729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:54.537577 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b23bd9ce-ec8f-474c-b07d-71403c06171f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 0.848680 Sep 08 10:29:54.556414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1936/3676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:53 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:54.580211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:54.598910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:54.614197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:54.624113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:54.624835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:54.626030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:54.630605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:54.633679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.085394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:55.106271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:55.108923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:55.110458 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10dc7d46-7c4e-4fb3-bca3-46a117974895 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.552671 Sep 08 10:29:55.112337 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1937/3677] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:54 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:55.121167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0bef088-44f5-4353-94ea-0cab135574c6 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] Calling method '.version_select at 0x7f2350563280>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:55.150625 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0bef088-44f5-4353-94ea-0cab135574c6 tempest-KeyPairsV22TestJSON-1157192770 tempest-KeyPairsV22TestJSON-1157192770-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386633529" status: 204 len: 0 microversion: 2.2 time: 0.036873 Sep 08 10:29:55.151947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1938/3678] 10.222.0.59 () {60 vars in 1261 bytes} [Thu Sep 8 10:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386633529 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:29:55.157082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:55.158611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:55.165962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.166842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.167595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.168692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.169385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.170701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.187626 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 HTTP/1.1 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '24e5b4d9-a3e3-47bd-b2e3-c336e146d113'} Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.189856 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.194359 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.196435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.198157 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83c4f4ee-0d79-4381-97f0-4e426d4577f6 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 404 len: 111 microversion: 2.1 time: 0.044690 Sep 08 10:29:55.203497 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1939/3679] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:55 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:55.209788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:55.213680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:55.229032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1527554731", "metadata": {"image_type": "test"}}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:55.234225 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3b279eb9-4ce9-4431-a2cb-50b1d88846d5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.762740 Sep 08 10:29:55.235161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1741/3680] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:54 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:55.235766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:55.257633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.258579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.260166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.261326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.265918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.266815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.297779 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113/action HTTP/1.1 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 112 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1527554731", "metadata": {"image_type": "test"}}} Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '24e5b4d9-a3e3-47bd-b2e3-c336e146d113', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1527554731', 'metadata': {'image_type': 'test'}}}} Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:29:55.299493 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e0980062-16b0-496b-b97a-66869c16b834 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "POST /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113/action" status: 404 len: 111 microversion: 2.1 time: 0.096060 Sep 08 10:29:55.304822 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1940/3681] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Sep 8 10:29:55 2022] POST /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:55.316046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0c82f6d-4090-42f2-b803-b55a0a653883 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-464367294", "metadata": {"image_type": "test"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:55.319641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0c82f6d-4090-42f2-b803-b55a0a653883 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Failed to fetch instance by id tempest-invalid-1692091349 {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:29:55.320222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d0c82f6d-4090-42f2-b803-b55a0a653883 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance tempest-invalid-1692091349 could not be found. Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0c82f6d-4090-42f2-b803-b55a0a653883 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/tempest-invalid-1692091349/action HTTP/1.1 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 111 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-464367294", "metadata": {"image_type": "test"}}} Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance tempest-invalid-1692091349 could not be found. Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'tempest-invalid-1692091349', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-464367294', 'metadata': {'image_type': 'test'}}}} Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1692091349 could not be found. Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.322361 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1692091349 could not be found. Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1692091349 could not be found. Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0c82f6d-4090-42f2-b803-b55a0a653883 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance tempest-invalid-1692091349 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.329012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0c82f6d-4090-42f2-b803-b55a0a653883 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "POST /compute/v2.1/servers/tempest-invalid-1692091349/action" status: 404 len: 101 microversion: 2.1 time: 0.014679 Sep 08 10:29:55.330221 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1742/3682] 10.222.0.59 () {60 vars in 1249 bytes} [Thu Sep 8 10:29:55 2022] POST /compute/v2.1/servers/tempest-invalid-1692091349/action => generated 101 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:55.333831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c91f0ba5-83a1-4b4f-aa6c-75bdfb972eac tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-513507230"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:55.337929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c91f0ba5-83a1-4b4f-aa6c-75bdfb972eac tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:29:55.338934 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c91f0ba5-83a1-4b4f-aa6c-75bdfb972eac tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c91f0ba5-83a1-4b4f-aa6c-75bdfb972eac tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 56 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: {"createImage": {"name": "tempest-test-snap-513507230"}} Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-513507230'}}} Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.341254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.346364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.354595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c91f0ba5-83a1-4b4f-aa6c-75bdfb972eac tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.355442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c91f0ba5-83a1-4b4f-aa6c-75bdfb972eac tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025578 Sep 08 10:29:55.356241 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1941/3683] 10.222.0.59 () {60 vars in 1275 bytes} [Thu Sep 8 10:29:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:29:55.369883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:29:55.393981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d4b2d316-eff8-476e-a18c-5a886f261488 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1070763025"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:29:55.408281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:55.412879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d4b2d316-eff8-476e-a18c-5a886f261488 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:29:55.415232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:55.420292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d4b2d316-eff8-476e-a18c-5a886f261488 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d4b2d316-eff8-476e-a18c-5a886f261488 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 57 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: {"createImage": {"name": "tempest-test-snap-1070763025"}} Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1070763025'}}} Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.423715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.438532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d4b2d316-eff8-476e-a18c-5a886f261488 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.443988 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d4b2d316-eff8-476e-a18c-5a886f261488 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.078197 Sep 08 10:29:55.448625 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1743/3684] 10.222.0.59 () {60 vars in 1281 bytes} [Thu Sep 8 10:29:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:55.455620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.456436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.457124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.458562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:55.459166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:55.464335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.464945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.465618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.474675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.475819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.476661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.477685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.479929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.485645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.534423 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 HTTP/1.1 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '24e5b4d9-a3e3-47bd-b2e3-c336e146d113'} Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.536066 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.541813 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.544304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.549519 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d9a586e-013a-438f-a82c-b9f4fa891b53 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "DELETE /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 404 len: 111 microversion: 2.1 time: 0.095321 Sep 08 10:29:55.550357 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1744/3685] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:29:55 2022] DELETE /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:29:55.564176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:55.566471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] [instance: 24e5b4d9-a3e3-47bd-b2e3-c336e146d113] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:55.580171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.591965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.592655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.593579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.594139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.594669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.635863 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] HTTP exception thrown: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Request method failure captured: Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 HTTP/1.1 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQKGUwvbq_29rgxHWrHSz7IflnjIglmAHzyVSYizPALt6BBvKj98t2nT-ndIqJ2SAqi-Q91j6HHkkSrlDkTiruBEgQBecc5L1v3UssO9I-EHJKapSQmrzDel2d68drq7IXXUYKya4ei7s6FlyyY_jZyOja4e12qrJ3v9DFR6l3P60Y Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72acb15b9873499e806c576dbc4807be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72acb15b9873499e806c576dbc4807be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72acb15b9873499e806c576dbc4807be", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 72acb15b9873499e806c576dbc4807be Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-939558011 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 69552444b08f405489f39ac149739240 Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ImagesNegativeTestJSON-939558011-project Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '24e5b4d9-a3e3-47bd-b2e3-c336e146d113'} Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:29:55.646050 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:29:55.652148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] Returning 404 to user: Instance 24e5b4d9-a3e3-47bd-b2e3-c336e146d113 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:29:55.653758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffe051b6-9115-4dcf-b8d6-07d90c1a75e2 tempest-ImagesNegativeTestJSON-939558011 tempest-ImagesNegativeTestJSON-939558011-project] 10.222.0.59 "GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113" status: 404 len: 111 microversion: 2.1 time: 0.097660 Sep 08 10:29:55.654595 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1745/3686] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:55 2022] GET /compute/v2.1/servers/24e5b4d9-a3e3-47bd-b2e3-c336e146d113 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:29:55.662727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:55.666776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:55.680221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.682829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.683597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:55.685810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:55.687560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:55.688242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:56.206013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:56.220632 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea9a003d-230e-455c-8463-f5066bc91012 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 0.564620 Sep 08 10:29:56.229196 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1746/3687] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:55 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:56.240312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:56.241230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:56.256808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:56.257623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:56.258688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:56.260364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:56.261031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:56.261618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:56.472068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:56.484509 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2966fc38-dad5-4ebc-9304-0530f2762a4b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1505 microversion: 2.1 time: 1.099811 Sep 08 10:29:56.488011 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1942/3688] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:55 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1505 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:56.514670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:56.519706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:56.533123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:56.533892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:56.536016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:56.536987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:56.537626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:56.541706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:57.913115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:57.955785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:57.961984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:57.976910 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-12470b4e-8dd7-48f1-afc3-b6b4f03d9106 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 1.745541 Sep 08 10:29:57.986795 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1747/3689] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:56 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:29:58.001360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:58.002410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:58.016456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:58.017236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:58.020450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:58.022467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:58.022949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:58.024281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:58.080540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:58.093617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63de52d9-0607-4c36-884c-877f549122a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 1.592176 Sep 08 10:29:58.107885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1943/3690] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:56 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:58.116201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:58.116823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:58.158436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:58.162719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:58.166032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:58.168747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:58.171858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:58.176217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:59.164397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:59.178904 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10a07b22-7710-4a32-a7e4-b9eea594f400 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1485 microversion: 2.1 time: 1.077593 Sep 08 10:29:59.180467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:29:59.181505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1944/3691] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:58 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1485 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:59.192585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:59.197476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:59.202844 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d32a49cd-6bac-4157-97a4-0f618bc84dc0 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 1.204389 Sep 08 10:29:59.205236 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1748/3692] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:57 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:29:59.240048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:59.243163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:29:59.258031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:59.259977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:29:59.261607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:59.264669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:59.265161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:59.276264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:59.298328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:59.301108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:59.302615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:29:59.303405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:29:59.303905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:29:59.304339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:00.077588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:00.086184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:00.095217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:00.096497 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56cbcd38-23a7-4b2e-b842-3d1d68d4dd8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.909942 Sep 08 10:30:00.097068 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1945/3693] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:29:59 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:00.120563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-916499003", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:00.205291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] validate_networks() for [('e11d9c72-d8ba-4c51-b31a-0ad86ec288cb', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:30:00.684588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:00.699094 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-709ba110-458b-408b-acf4-90feddaedd30 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 1.490645 Sep 08 10:30:00.700542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1749/3694] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:29:59 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:00.717342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:00.718375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:00.739119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:00.740134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:00.742146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:00.744315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:00.747815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:00.749679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:01.341361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:02.195977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:02.210084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b175a13a-fbc4-433e-94ba-5878a8da30d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 1.505667 Sep 08 10:30:02.213785 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1750/3695] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:00 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:02.233248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:02.234245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:02.259598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.261187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.266773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:02.271903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.273251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.277867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:02.407477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:30:02.408744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:30:02.409506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:30:02.410473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:30:02.411147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:30:02.428091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.434439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.435203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:02.436246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.439389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.440118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:02.489933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Getting quotas for project 8c8cca3886ea40b1b3f7c8792ecdd289. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:30:02.506197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Getting quotas for user cb4b005426b049e7b96829b732f8f8a8 and project 8c8cca3886ea40b1b3f7c8792ecdd289. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:30:02.556867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:30:02.561879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:30:02.640979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:02.680947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=34 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:02.690793 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22cffcf1-8a26-44d8-8360-78b789915c5d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.578057 Sep 08 10:30:02.695334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1946/3696] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:30:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:30:02.711091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a0f03a94-dd32-4a74-8f28-b90c1887b5c6 req-e262c7b1-3a31-4daf-aac0-d54cf021034a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337703bb-dc79-4187-8fab-37fa4188823a", "name": "network-vif-plugged", "status": "completed", "tag": "02f9688e-98f0-4abb-80bd-8e16ba849e86"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:02.734606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a0f03a94-dd32-4a74-8f28-b90c1887b5c6 req-e262c7b1-3a31-4daf-aac0-d54cf021034a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.735370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a0f03a94-dd32-4a74-8f28-b90c1887b5c6 req-e262c7b1-3a31-4daf-aac0-d54cf021034a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.740171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a0f03a94-dd32-4a74-8f28-b90c1887b5c6 req-e262c7b1-3a31-4daf-aac0-d54cf021034a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:02.783168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a0f03a94-dd32-4a74-8f28-b90c1887b5c6 req-e262c7b1-3a31-4daf-aac0-d54cf021034a service nova] Creating event network-vif-plugged:02f9688e-98f0-4abb-80bd-8e16ba849e86 for instance 337703bb-dc79-4187-8fab-37fa4188823a on n-h1-833090-19 Sep 08 10:30:02.794041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a0f03a94-dd32-4a74-8f28-b90c1887b5c6 req-e262c7b1-3a31-4daf-aac0-d54cf021034a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097112 Sep 08 10:30:02.797130 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1947/3697] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:02.812390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:02.812967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:02.824519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.825019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.825464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:02.826178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:02.826638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:02.827077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:03.200654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:03.226701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:03.233786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:03.262593 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef72e91a-0e13-4c68-9aec-25819b41a8ff tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 1.042453 Sep 08 10:30:03.266609 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1751/3698] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:02 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:03.284085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-464449f9-e8ea-47b9-944a-a0ac71a6f987 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:03.287297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-464449f9-e8ea-47b9-944a-a0ac71a6f987 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:04.096592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-464449f9-e8ea-47b9-944a-a0ac71a6f987 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:04.117405 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-464449f9-e8ea-47b9-944a-a0ac71a6f987 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1213 microversion: 2.1 time: 0.846027 Sep 08 10:30:04.142737 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1752/3699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:03 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1213 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:04.154369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:04.159015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:04.182349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:04.187648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:04.188410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:04.189600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:04.191796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:04.192524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:04.472437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:04.493320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f73493a9-f750-468b-b0ad-38b01694fbb8 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 1.689414 Sep 08 10:30:04.493910 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1948/3700] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:02 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:04.515337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:04.517154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:04.536211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:04.536747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:04.537208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:04.539988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:04.541311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:04.541765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:05.091583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:05.104742 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0aaaf5e8-9ccd-47cb-ac0b-4ea945ce18b2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1364 microversion: 2.1 time: 0.959743 Sep 08 10:30:05.107779 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1753/3701] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:04 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1364 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:05.147078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:05.148689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:05.160687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:05.164845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:05.168477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:05.170364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:05.176463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:05.178282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:05.180712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:05.190004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:05.191479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:05.203818 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46d7cfdc-f0e5-4804-9a1b-bf53e8d8c0a1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.705451 Sep 08 10:30:05.213048 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1949/3702] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:04 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:05.389754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:05.399409 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0dc4053-28b6-445f-9eaf-32d9eb7b76ce tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1273 microversion: 2.1 time: 0.256084 Sep 08 10:30:05.421263 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1754/3703] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:05 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:05.522574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:05.523646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:05.539942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:05.542394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:05.544008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:05.545169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:05.548446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:05.549296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:05.561292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-250269215", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e52de432-f74f-4626-b441-5b8606b4763f"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:05.700878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] validate_networks() for [('e52de432-f74f-4626-b441-5b8606b4763f', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:30:06.235807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:06.248253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b17e3a7e-9da0-4356-aacf-ef375284a003 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.725920 Sep 08 10:30:06.264034 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1755/3704] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:05 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:06.272020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:06.273190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:06.283553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:06.284762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:06.285515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:06.286585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:06.287310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:06.288040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:07.373124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:07.396346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd2cdd23-ba8f-457d-8a1f-d0348bccabf5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1551 microversion: 2.1 time: 1.130774 Sep 08 10:30:07.399505 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1756/3705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:06 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1551 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:07.405665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:07.409159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:07.435266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:07.436375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:07.437159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:07.438361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:07.439049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:07.439668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:07.954984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:30:07.956173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:30:07.956925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:30:07.957849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:30:07.958640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:30:07.983907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:07.984398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:07.989660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:07.999240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:08.000266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:08.003426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:08.086511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Getting quotas for project b9dbeeab57494b40bb5793f7e8943339. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:30:08.111382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Getting quotas for user 8a4b68d4d9d04f9abe1c6f0f93a798b6 and project b9dbeeab57494b40bb5793f7e8943339. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:30:08.163825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:30:08.175879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:30:08.215129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:08.228738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:08.234444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:08.240381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e796a2d4-86e6-4a34-a479-19245ac046d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.837151 Sep 08 10:30:08.243025 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1757/3706] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:07 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:08.258821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:08.261288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:08.285208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:08.288250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:08.288764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:08.292951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:08.294850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:08.297836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:08.340181 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87898433-9fb7-4d0c-935b-9fd99ff3bb5b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.124703 Sep 08 10:30:08.351825 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1950/3707] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:30:08.369581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:08.378992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:08.404617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:08.405101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:08.406622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:08.410213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:08.412522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:08.414059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:08.996171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:09.005430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46f17afa-360f-4ef4-8dc6-a75964f96d16 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1271 microversion: 2.1 time: 0.760453 Sep 08 10:30:09.010038 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1758/3708] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:08 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1271 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:09.344342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82ded65f-2a3a-4b7f-8338-769ea6519792 tempest-ListImagesTestJSON-1565910263 tempest-ListImagesTestJSON-1565910263-project] Calling method '.version_select at 0x7f235165adc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:09.496078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82ded65f-2a3a-4b7f-8338-769ea6519792 tempest-ListImagesTestJSON-1565910263 tempest-ListImagesTestJSON-1565910263-project] 10.222.0.59 "GET /compute/v2.1/images/fe14f6a4-d144-40d8-8fee-904fb43a30eb" status: 200 len: 784 microversion: 2.1 time: 0.484796 Sep 08 10:30:09.496646 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1759/3709] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Sep 8 10:30:09 2022] GET /compute/v2.1/images/fe14f6a4-d144-40d8-8fee-904fb43a30eb => generated 784 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:09.515090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:09.520018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:09.533560 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4c5ce99-82ee-48b0-bc4d-6da928b6f59e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 1.176891 Sep 08 10:30:09.538242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:09.540807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1951/3710] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:08 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:09.553422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:09.554230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:09.561085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:09.562591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:09.564995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:09.566616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:09.568065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:09.570467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:09.590253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:09.590771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:09.591217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:09.593412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:09.593884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:09.594310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:09.750395 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d457146-045d-4e15-a207-0c58c90c580c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239262 Sep 08 10:30:09.760376 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1760/3711] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:30:09 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:09.765884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:09.766743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:09.783440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:09.786585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:09.787271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:09.788675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:09.796596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:09.797345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:09.988987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:10.021848 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f18dfb70-f412-4bac-bb13-e81d91e27f6f tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1219 microversion: 2.1 time: 0.476478 Sep 08 10:30:10.022966 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1952/3712] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:09 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1219 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:10.058278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d306abe8-bed8-4bd5-8c19-e3342204cb15 tempest-ListImagesTestJSON-1565910263 tempest-ListImagesTestJSON-1565910263-project] Calling method '.version_select at 0x7f23504bd670>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:10.205980 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d306abe8-bed8-4bd5-8c19-e3342204cb15 tempest-ListImagesTestJSON-1565910263 tempest-ListImagesTestJSON-1565910263-project] 10.222.0.59 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.176647 Sep 08 10:30:10.207362 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1953/3713] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Sep 8 10:30:10 2022] GET /compute/v2.1/images => generated 445 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:10.220831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:10.233760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:10.268255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:10.272792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:10.273529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:10.275989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:10.280187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:10.282779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:10.719059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:10.742267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:10.744902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:10.751928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97bd76eb-5cc6-478f-9b26-960f27c21a6b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.989912 Sep 08 10:30:10.752474 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1761/3714] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:09 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:10.802445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-37cb194f-0832-4403-9990-2885961b098b tempest-ListImagesTestJSON-1565910263 tempest-ListImagesTestJSON-1565910263-project] Calling method '.version_select at 0x7f23506ef670>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:10.903028 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-37cb194f-0832-4403-9990-2885961b098b tempest-ListImagesTestJSON-1565910263 tempest-ListImagesTestJSON-1565910263-project] 10.222.0.59 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.127087 Sep 08 10:30:10.936145 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1762/3715] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:30:10 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:10.952206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:10.952863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:10.971685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:10.973813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:10.976045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:10.978442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:10.979132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:10.982568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:11.716331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:11.738416 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83848d87-b734-4ac1-b1b7-ea7c12dd4b3e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 1.529467 Sep 08 10:30:11.744825 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1954/3716] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:10 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:11.770896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:11.772695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:11.816460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:11.817962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:11.819828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:11.821005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:11.823873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:11.824948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:12.230278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:12.242186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc55ca9e-f46d-427a-9119-7d3546d10ba6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1273 microversion: 2.1 time: 0.495714 Sep 08 10:30:12.261654 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1955/3717] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:11 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1273 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:12.268992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:12.276459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:12.289113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:12.292623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:12.294752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:12.297266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:12.307678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:12.308740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:12.608522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:12.622520 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b11858a4-18ca-46d7-8506-073771097707 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 1.684853 Sep 08 10:30:12.630062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1763/3718] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:10 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:13.023566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-566990551", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:13.129941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:13.147164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:30:13.159856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:13.162399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:13.165999 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c29c06c5-5e30-4c94-a988-7528e6c823e7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.903033 Sep 08 10:30:13.167194 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1956/3719] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:12 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:13.172771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:13.173933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:13.186444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:13.187492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:13.188185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:13.189244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:13.190085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:13.190771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:14.164059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:14.460669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:14.473835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8469c7cd-5d3a-4261-9180-1f75ad192a23 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 1.305313 Sep 08 10:30:14.474456 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1957/3720] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:13 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:14.484213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:14.484831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:14.511710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:14.516822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:14.517367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:14.518539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:14.518657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:14.519062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:14.942548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:14.951582 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba8ce49e-38ab-4f90-b7c2-cfe671d3524d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1273 microversion: 2.1 time: 0.471011 Sep 08 10:30:14.952435 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1958/3721] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:14 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1273 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:14.957362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:14.958196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:14.971089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:14.972950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:14.974896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:14.978602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:14.979405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:14.981386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:14.988093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:15.362023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:15.401636 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb26606e-d4a6-4ac1-a805-a7f3f3155806 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.447885 Sep 08 10:30:15.451852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1959/3722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:14 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:15.480174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:15.485277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:15.513915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:15.518132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:15.525876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:15.530813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:15.531618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:15.534774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:15.706866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:30:15.707390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:30:15.708122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:30:15.708279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:30:15.708631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:30:15.760005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:15.760504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:15.764808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:15.771541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:15.772331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:15.772963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:15.836160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:30:15.852435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:30:15.939490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:30:15.960377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:30:16.130493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e25516ac-0c08-4be4-b9f9-ac1438917d6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.495279 Sep 08 10:30:16.142670 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1764/3723] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:30:16.152406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7a61890d-7a06-4dc0-8ca1-55c930778eb6 req-ad9e402f-a7e2-4863-8362-4c8d13608db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337703bb-dc79-4187-8fab-37fa4188823a", "tag": "02f9688e-98f0-4abb-80bd-8e16ba849e86"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:16.192547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7a61890d-7a06-4dc0-8ca1-55c930778eb6 req-ad9e402f-a7e2-4863-8362-4c8d13608db0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:16.201000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7a61890d-7a06-4dc0-8ca1-55c930778eb6 req-ad9e402f-a7e2-4863-8362-4c8d13608db0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:16.220197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7a61890d-7a06-4dc0-8ca1-55c930778eb6 req-ad9e402f-a7e2-4863-8362-4c8d13608db0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:16.227931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7a61890d-7a06-4dc0-8ca1-55c930778eb6 req-ad9e402f-a7e2-4863-8362-4c8d13608db0 service nova] Creating event network-changed:02f9688e-98f0-4abb-80bd-8e16ba849e86 for instance 337703bb-dc79-4187-8fab-37fa4188823a on n-h1-833090-19 Sep 08 10:30:16.244222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7a61890d-7a06-4dc0-8ca1-55c930778eb6 req-ad9e402f-a7e2-4863-8362-4c8d13608db0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097509 Sep 08 10:30:16.251077 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1765/3724] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:16.274219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:16.275509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:16.287127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:16.291132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:16.291894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:16.294373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:16.296584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:16.297463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:16.347008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:16.368763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:16.380960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:16.382395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:16.390232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-66d73e99-a125-409f-9b77-7fb686e994fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1739 microversion: 2.20 time: 0.928411 Sep 08 10:30:16.392037 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1960/3725] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:15 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1739 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:16.407372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ef17efc7-b764-4393-881f-dc1ef5f2297b req-9512b59b-d79a-44a8-a5f2-f759bd4b0c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7597c060-2466-49e8-8ab1-929408de8442", "tag": "2c6aa126-2279-4ded-be77-090058c531be"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:16.429552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ef17efc7-b764-4393-881f-dc1ef5f2297b req-9512b59b-d79a-44a8-a5f2-f759bd4b0c8d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:16.430284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ef17efc7-b764-4393-881f-dc1ef5f2297b req-9512b59b-d79a-44a8-a5f2-f759bd4b0c8d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:16.431131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ef17efc7-b764-4393-881f-dc1ef5f2297b req-9512b59b-d79a-44a8-a5f2-f759bd4b0c8d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:16.452118 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ef17efc7-b764-4393-881f-dc1ef5f2297b req-9512b59b-d79a-44a8-a5f2-f759bd4b0c8d service nova] Creating event network-changed:2c6aa126-2279-4ded-be77-090058c531be for instance 7597c060-2466-49e8-8ab1-929408de8442 on n-h1-833090-19 Sep 08 10:30:16.460983 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ef17efc7-b764-4393-881f-dc1ef5f2297b req-9512b59b-d79a-44a8-a5f2-f759bd4b0c8d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058324 Sep 08 10:30:16.463751 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1961/3726] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:16.470690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:16.472762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:16.483776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:16.485979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:16.486666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:16.487649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:16.488287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:16.488972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.037222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:17.060534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6f2a58b-7903-4441-9f65-a9b0755046c9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 0.806226 Sep 08 10:30:17.061749 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1766/3727] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:16 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:17.082734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:17.085224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:17.113132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:17.113919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:17.114531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.115664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:17.116355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:17.116946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.229342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:17.243986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-13249795-53f1-4623-8701-b75845391749 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.773649 Sep 08 10:30:17.244645 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1962/3728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:16 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:17.266825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:17.267773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:17.274298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:17.275155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:17.275801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.276696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:17.277319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:17.277916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.314083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:17.326345 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-768df3b2-0ba7-4c8b-944c-0fc9ba1abfa8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1218 microversion: 2.1 time: 0.263195 Sep 08 10:30:17.327403 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1767/3729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:17 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1218 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:17.437068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:17.437690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:17.449564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:17.450627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:17.451264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.452447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:17.453263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:17.453947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:17.985506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.004276 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a326b7ff-2f97-42d9-b6bf-da4369d2a75f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.742430 Sep 08 10:30:18.005844 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1963/3730] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:17 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:18.086045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:18.086692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:18.088789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:18.094428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:18.094900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:18.095343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:18.096080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:18.096536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:18.096961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:18.141607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:18.302156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.311922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.313560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.314796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a86e10ea-6a24-4b7d-bd1e-d5912495cc6a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1721 microversion: 2.20 time: 0.892848 Sep 08 10:30:18.315329 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1768/3731] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:17 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1721 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:18.320256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:18.321045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:18.327815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:18.328506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:18.329106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:18.329990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:18.330603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:18.331381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:18.687703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.704523 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb2cc606-eeb5-4d85-af39-bdc89d6c858e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 0.622495 Sep 08 10:30:18.705128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1964/3732] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:18 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:18.726830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:18.727818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:18.735092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:18.735786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:18.736528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:18.737567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:18.738098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:18.739787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:18.867750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.877298 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc14b4e1-956b-402a-8746-1957c2c21ae6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1266 microversion: 2.1 time: 0.156459 Sep 08 10:30:18.883229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:18.886847 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1965/3733] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:18 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:18.893492 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f96e2f3-1b4c-4284-8212-7f23cfffe38e tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.576717 Sep 08 10:30:18.894702 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1769/3734] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:18 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:19.032396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:19.033197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:19.082234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.082743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.083248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:19.086516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.087953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.113795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:19.344488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:19.349988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:19.366321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.374451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.374916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:19.378535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.380106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.380545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:19.926411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:19.937802 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-230abb1e-1553-43be-ab1e-80393f52a515 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.910550 Sep 08 10:30:19.939142 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1966/3735] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:19 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:19.944443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4cf8fe08-216c-41ed-acae-78874c03acf4 req-725eedda-9065-4a87-8e27-ea1f1e6209d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642ccf38-90ef-4d1b-8b32-f170ff7ea7c6", "tag": "31cf445e-04ed-4140-9a19-a57ea7d7c9fb"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:19.958588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4cf8fe08-216c-41ed-acae-78874c03acf4 req-725eedda-9065-4a87-8e27-ea1f1e6209d1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.959244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4cf8fe08-216c-41ed-acae-78874c03acf4 req-725eedda-9065-4a87-8e27-ea1f1e6209d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.960050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4cf8fe08-216c-41ed-acae-78874c03acf4 req-725eedda-9065-4a87-8e27-ea1f1e6209d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:19.974929 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4cf8fe08-216c-41ed-acae-78874c03acf4 req-725eedda-9065-4a87-8e27-ea1f1e6209d1 service nova] Creating event network-changed:31cf445e-04ed-4140-9a19-a57ea7d7c9fb for instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 on n-h2-833090-19 Sep 08 10:30:19.981021 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4cf8fe08-216c-41ed-acae-78874c03acf4 req-725eedda-9065-4a87-8e27-ea1f1e6209d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040416 Sep 08 10:30:19.981936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1967/3736] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:19.987426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:19.988271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:19.995794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.996687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.997241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:19.998222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:19.998964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:19.999512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.010547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:20.019177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:20.020954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:20.022422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-080e98c3-bd32-4d29-8f2a-1a5c57200229 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1721 microversion: 2.20 time: 0.683031 Sep 08 10:30:20.039937 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1770/3737] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:19 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1721 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:20.050199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:20.051232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:20.060284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.061062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.061920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.062911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.063651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.064341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.544391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:20.551180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:20.555986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbb79bde-bbc5-4470-820a-0d60e0d7a8d8 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 0.572714 Sep 08 10:30:20.557827 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1968/3738] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:19 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:20.570529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:20.571444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:20.578731 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aca06c4a-43ca-493c-9827-c9d9dd2c4dcf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1272 microversion: 2.1 time: 0.536524 Sep 08 10:30:20.582643 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1771/3739] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:20 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1272 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:20.604425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.608135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.612337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.614523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.615072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.619916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.726470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a1abd266-6105-4df7-b17e-4e98ed60e727 req-42bdea8a-c332-4180-ae5e-0dfa54e55aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "name": "network-vif-unplugged", "status": "completed", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:20.752401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a1abd266-6105-4df7-b17e-4e98ed60e727 req-42bdea8a-c332-4180-ae5e-0dfa54e55aa6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.756252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a1abd266-6105-4df7-b17e-4e98ed60e727 req-42bdea8a-c332-4180-ae5e-0dfa54e55aa6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.756840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a1abd266-6105-4df7-b17e-4e98ed60e727 req-42bdea8a-c332-4180-ae5e-0dfa54e55aa6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.779676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a1abd266-6105-4df7-b17e-4e98ed60e727 req-42bdea8a-c332-4180-ae5e-0dfa54e55aa6 service nova] Creating event network-vif-unplugged:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:30:20.785979 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a1abd266-6105-4df7-b17e-4e98ed60e727 req-42bdea8a-c332-4180-ae5e-0dfa54e55aa6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089310 Sep 08 10:30:20.787176 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1772/3740] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:30:20.969633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:20.970605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:20.977562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.978918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.979685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:20.980625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:20.981292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:20.981936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.222414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:21.237421 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a31af4dc-42e0-4131-aa8c-c6d1e7d52ab9 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.676763 Sep 08 10:30:21.239411 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1969/3741] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:20 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:21.246864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:21.247863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:21.258809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:21.260171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:21.260776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.261672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:21.262286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:21.262957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.478653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:21.489697 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f08de571-015e-463b-aa79-b9cfd7d1d105 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.528488 Sep 08 10:30:21.491241 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1773/3742] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:20 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:21.584318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:21.585793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:21.592344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:21.592983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:21.593524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.594334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:21.595037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:21.595654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.633449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:21.643987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:21.646202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:21.647819 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b97f1d72-7389-4d67-acd1-156ef9ea3e1c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1721 microversion: 2.20 time: 0.406051 Sep 08 10:30:21.648806 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1970/3743] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:21 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1721 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:21.654260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:21.655155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:21.662558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:21.663299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:21.663959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.664873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:21.665565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:21.666164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:21.803929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:21.814084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8fac67d0-7141-4d91-b468-83c2359312a0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1272 microversion: 2.1 time: 0.163662 Sep 08 10:30:21.814938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1971/3744] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:21 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:22.069215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:22.078208 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ab4d4c67-855a-4416-9323-5cdffa54db0b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 0.497784 Sep 08 10:30:22.078830 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1774/3745] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:21 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:22.261708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:22.262837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:22.270890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:22.271711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:22.272391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:22.273509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:22.274335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:22.275032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:22.520047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:22.521348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:22.531320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:22.532765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:22.533871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:22.534985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:22.536318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:22.536318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:22.851287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:22.859706 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-84fe37aa-ff92-402d-9ff4-326d3a9b6e37 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.602369 Sep 08 10:30:22.860296 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1972/3746] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:22 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:22.864946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:22.865543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:22.873104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:22.873588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:22.874026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:22.874724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:22.875499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:22.875626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.069200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:23.078134 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc787518-b88b-48d3-a5b9-2f63289e2020 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1501 microversion: 2.1 time: 0.563292 Sep 08 10:30:23.079190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1775/3747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:22 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1501 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:23.084054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-46ca6a1e-ee29-4422-90b0-017e30b57a32 req-56fed09d-83f0-4d4b-999b-38576836a8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7597c060-2466-49e8-8ab1-929408de8442", "name": "network-vif-plugged", "status": "completed", "tag": "2c6aa126-2279-4ded-be77-090058c531be"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:23.090871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:23.097986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-46ca6a1e-ee29-4422-90b0-017e30b57a32 req-56fed09d-83f0-4d4b-999b-38576836a8ff service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.098473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-46ca6a1e-ee29-4422-90b0-017e30b57a32 req-56fed09d-83f0-4d4b-999b-38576836a8ff service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.098911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-46ca6a1e-ee29-4422-90b0-017e30b57a32 req-56fed09d-83f0-4d4b-999b-38576836a8ff service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.111056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-46ca6a1e-ee29-4422-90b0-017e30b57a32 req-56fed09d-83f0-4d4b-999b-38576836a8ff service nova] Creating event network-vif-plugged:2c6aa126-2279-4ded-be77-090058c531be for instance 7597c060-2466-49e8-8ab1-929408de8442 on n-h1-833090-19 Sep 08 10:30:23.115937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-46ca6a1e-ee29-4422-90b0-017e30b57a32 req-56fed09d-83f0-4d4b-999b-38576836a8ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035328 Sep 08 10:30:23.116576 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1776/3748] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:23.123286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:23.123550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:23.130558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.131046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.131737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.132665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.133203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.133635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.633261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:23.641970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:23.643417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:23.644612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1935a79c-8a4a-4c89-a2eb-3fce95443736 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1664 microversion: 2.20 time: 0.783399 Sep 08 10:30:23.645185 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1973/3749] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:22 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1664 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:23.650382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd50ad17-83bc-4e6f-96a2-f3650a145f3e"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:23.652804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:23.659349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.659872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.660321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.661272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.661904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.662491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.689206 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Cannot 'attach_volume' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state rescued Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/os-volume_attachments HTTP/1.1 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 74 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: {"volumeAttachment": {"volumeId": "dd50ad17-83bc-4e6f-96a2-f3650a145f3e"}} Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot 'attach_volume' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state rescued Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': 'ed661293-2de7-4a28-8de8-d4b538451e23', 'body': {'volumeAttachment': {'volumeId': 'dd50ad17-83bc-4e6f-96a2-f3650a145f3e'}}} Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed661293-2de7-4a28-8de8-d4b538451e23 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 10:30:23.691504 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state rescued Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state rescued Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 409 to user: Cannot 'attach_volume' instance ed661293-2de7-4a28-8de8-d4b538451e23 while it is in vm_state rescued {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ecf3eaa-90b9-4636-b43e-d0e15ff4965a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046790 Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1974/3750] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:30:23 2022] POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:23.701323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:23.705210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.705729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.706172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.706875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.707334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.707789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.834137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:23.842153 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1bbf2acb-fb84-4502-b221-fda94d605a8d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.723952 Sep 08 10:30:23.842743 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1777/3751] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:23 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:23.864199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98a5b1b1-10b9-41c8-982a-598c6da6afa7"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:23.866808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:23.873467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.874046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.874322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:23.875023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:23.875695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:23.876118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.047758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:24.057964 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c229b986-68d0-497c-8e77-d979e719cbf3 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1313 microversion: 2.1 time: 0.363240 Sep 08 10:30:24.058712 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1975/3752] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:23 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:24.070740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:24.070740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:24.078260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.078856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.079208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.079930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.080725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.081226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.144062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:24.171159 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fcc86a40-429c-423c-868d-9ecbda451931 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action" status: 202 len: 0 microversion: 2.1 time: 0.110034 Sep 08 10:30:24.172265 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1976/3753] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:30:24 2022] POST /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:30:24.177630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:24.178263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:24.187335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.187874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.188368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.189080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.189606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.190025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.224612 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e2e0eea-b525-444c-bb07-e8a72e5a09f6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366006 Sep 08 10:30:24.225440 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1778/3754] 10.222.0.59 () {62 vars in 1364 bytes} [Thu Sep 8 10:30:23 2022] POST /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 188 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:30:24.254533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:24.255851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:24.265604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.266564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.267317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.268618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.270469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.271203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.593830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:24.604651 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7e4f9700-5a7f-40da-995b-c4eb2e0e75fb tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.431147 Sep 08 10:30:24.605935 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1977/3755] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:24 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:24.611586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:24.612439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:24.619572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.620277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.621011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.622564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.623208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.624276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.662490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:24.674602 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2f744a9e-e0f0-4b4f-b4a8-18694ce68490 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1509 microversion: 2.1 time: 0.447546 Sep 08 10:30:24.693006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1779/3756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:24 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:24.737546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122457) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:30:24.845401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfaf54b2-2fc1-4301-ad07-962650790224 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/action" status: 202 len: 0 microversion: 2.20 time: 0.238038 Sep 08 10:30:24.847161 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1978/3757] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:30:24 2022] POST /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:30:24.858292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:24.861036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:24.865812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:24.866667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:24.874409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.875336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.875763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.876368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.876503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.877529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.878454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.878687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.879238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:24.880163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:24.887590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:24.888519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.404312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:25.428328 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ffc31b23-4c8d-486a-a5cd-a67db6871ed1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.566318 Sep 08 10:30:25.443530 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1979/3758] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:24 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:25.443530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-67071e0b-2919-4bb0-bab6-800239ba9978 req-99a505b4-3152-443b-b4f4-ab7c4fbf10f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86438198-bffb-477f-8aa7-ed6ea338b3a4", "tag": "ab92ae64-52f8-4539-99d5-cedac37b1774"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:25.454591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-67071e0b-2919-4bb0-bab6-800239ba9978 req-99a505b4-3152-443b-b4f4-ab7c4fbf10f8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.455250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-67071e0b-2919-4bb0-bab6-800239ba9978 req-99a505b4-3152-443b-b4f4-ab7c4fbf10f8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.455631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:25.456101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-67071e0b-2919-4bb0-bab6-800239ba9978 req-99a505b4-3152-443b-b4f4-ab7c4fbf10f8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.465486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:25.466917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:25.468135 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-22f1bd1c-338d-4e2b-bba2-65733cb710b0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1750 microversion: 2.20 time: 0.615371 Sep 08 10:30:25.472197 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-67071e0b-2919-4bb0-bab6-800239ba9978 req-99a505b4-3152-443b-b4f4-ab7c4fbf10f8 service nova] Creating event network-changed:ab92ae64-52f8-4539-99d5-cedac37b1774 for instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 on n-h1-833090-19 Sep 08 10:30:25.476873 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1780/3759] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:24 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1750 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:30:25.481942 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-67071e0b-2919-4bb0-bab6-800239ba9978 req-99a505b4-3152-443b-b4f4-ab7c4fbf10f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049321 Sep 08 10:30:25.483104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1980/3760] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:25.486023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:25.488342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:25.495497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.495990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.496428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.497338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.498035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.498799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.628974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:25.630244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:25.637052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.637941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.638605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.639582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.640920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.641551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.813306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:25.876345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:25.880361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:25.890633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cd7b119d-215a-4698-b359-2025bebdef5e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1499 microversion: 2.1 time: 0.412558 Sep 08 10:30:25.913406 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1781/3761] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:25 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1499 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:25.919540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:25.920483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:25.928724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:25.934054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.934663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.935289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:25.943361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:25.943893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:25.944437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:26.000597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:26.011574 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f6079ba-733b-43cd-88d4-14b23c5aca61 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.387010 Sep 08 10:30:26.012545 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1981/3762] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:25 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:26.019042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:26.022607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:26.033032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:26.033536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:26.033977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:26.034688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:26.035158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:26.035606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:26.078726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lazy-loading 'flavor' on Instance uuid 7597c060-2466-49e8-8ab1-929408de8442 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:30:26.192316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e90404c-faa1-42d9-8693-e555ae654e0d tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "POST /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442/action" status: 200 len: 32 microversion: 2.1 time: 0.177794 Sep 08 10:30:26.193521 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1982/3763] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:30:26 2022] POST /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:30:26.206244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:26.207031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:26.215891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:26.216464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:26.217633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:26.218282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:26.218752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:26.219194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:26.737722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:26.746808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5455319a-4831-4a87-9728-edf28e5aa01a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1509 microversion: 2.1 time: 0.831924 Sep 08 10:30:26.760968 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1782/3764] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:25 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1509 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:26.779683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:26.780410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:26.794224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:26.800838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:26.801845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:26.802838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:26.803540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:26.806387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:27.389234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:27.398574 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-06532ab2-787d-48f7-aa6d-82996a74b146 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 1.197954 Sep 08 10:30:27.405330 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1983/3765] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:26 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:27.419984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:27.421230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:27.432493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:27.433326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:27.444253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:27.445428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:27.446138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:27.446897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:27.634390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:27.645569 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-428c6f36-0ab9-45ee-9843-d1627143d624 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.883393 Sep 08 10:30:27.646492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1783/3766] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:26 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:27.653057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:27.654060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:27.662919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:27.663720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:27.664213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:27.664979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:27.666084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:27.666513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.122649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:28.137099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:28.137867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a32f9905-de87-458d-953e-5d8760884df3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.489504 Sep 08 10:30:28.146265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:28.147819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1784/3767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:27 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:28.157792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:28.161000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:28.163231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:28.164442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f1c8a16-dd0d-41d9-9a4c-3367d1f6278c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1752 microversion: 2.20 time: 0.755556 Sep 08 10:30:28.165847 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1984/3768] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:27 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1752 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:28.172507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:28.173217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:28.173825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.174736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:28.175386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:28.176816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.430694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:28.434078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:28.454364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:28.455203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:28.456087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.457537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:28.458416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:28.459638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.591453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:28.609101 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5538b505-c38d-44a7-b01f-dd980bf9a4da tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1515 microversion: 2.1 time: 0.459860 Sep 08 10:30:28.630306 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1785/3769] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:28 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:28.695421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:28.696339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:28.708594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:28.709094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:28.710104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.712651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:28.713566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:28.716989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:28.882454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:28.899663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18857061-e831-481c-836e-694b4300f8bc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.471043 Sep 08 10:30:28.918353 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1985/3770] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:28 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:29.167382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:29.168036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:29.180804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:29.181938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:29.182560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:29.183611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:29.190864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:29.192946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:29.411233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:29.449203 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a7073169-8411-40a7-a10e-03a1256fdf41 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.779344 Sep 08 10:30:29.454948 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1786/3771] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:28 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:29.473497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:29.479174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:29.501819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:29.504359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:29.506249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:29.507390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:29.510140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:29.510770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:29.960379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:29.971742 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e2d1a3cb-8a8c-41b8-907b-f45ee7a15ac7 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.809668 Sep 08 10:30:29.974249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1986/3772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:29 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:29.984786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-04de2a16-8d54-4742-8102-8beb1b3fcb37 req-9c0db7ca-a453-489c-9129-c9b293057e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642ccf38-90ef-4d1b-8b32-f170ff7ea7c6", "name": "network-vif-plugged", "status": "completed", "tag": "31cf445e-04ed-4140-9a19-a57ea7d7c9fb"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:30.020108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-04de2a16-8d54-4742-8102-8beb1b3fcb37 req-9c0db7ca-a453-489c-9129-c9b293057e2d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:30.027810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-04de2a16-8d54-4742-8102-8beb1b3fcb37 req-9c0db7ca-a453-489c-9129-c9b293057e2d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:30.029928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-04de2a16-8d54-4742-8102-8beb1b3fcb37 req-9c0db7ca-a453-489c-9129-c9b293057e2d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:30.059090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:30.070855 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-04de2a16-8d54-4742-8102-8beb1b3fcb37 req-9c0db7ca-a453-489c-9129-c9b293057e2d service nova] Creating event network-vif-plugged:31cf445e-04ed-4140-9a19-a57ea7d7c9fb for instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 on n-h2-833090-19 Sep 08 10:30:30.076723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:30.078824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:30.083796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-60f507c7-f190-4e6e-a55a-1ee679c8c61d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1752 microversion: 2.20 time: 0.626418 Sep 08 10:30:30.084622 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1787/3773] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:29 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1752 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:30.095449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:30.098110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:30.106547 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-04de2a16-8d54-4742-8102-8beb1b3fcb37 req-9c0db7ca-a453-489c-9129-c9b293057e2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129089 Sep 08 10:30:30.115885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1987/3774] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:30.134616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:30.137289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:30.142320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:30.149809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:30.152836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:30.153672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:30.479849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:30.483204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:30.499189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:30.503171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:30.505489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:30.506148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:30.507141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:30.507881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:30.508518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:30.997255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:31.010080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6255740f-5edb-4e0e-ad6f-c818f4595123 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.921494 Sep 08 10:30:31.028305 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1788/3775] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:30 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:31.034128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:31.034997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:31.050579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:31.051079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:31.051761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:31.052673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:31.054604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:31.057451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:31.057993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:31.072156 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b13cc71-f1a1-4391-a7b2-001066c30c15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.596260 Sep 08 10:30:31.072764 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1988/3776] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:30 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:31.110267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:31.110967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:31.120808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:31.124224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:31.124884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:31.125798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:31.126440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:31.129288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:31.801852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:31.811706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a5f85e1-5208-4ec1-9e92-e3f963d761ec tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1315 microversion: 2.1 time: 0.781905 Sep 08 10:30:31.813718 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1789/3777] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:31 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:31.818703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dd50f39-5a01-4cea-ad63-f2070ba5a8e5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'create', calling method: .version_select at 0x7f235063d8b0>, body: {"keypair": {"name": "tempest-keypair-2094183046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqNMpE2tv1xlyK6UtJexG03eMA7eYqlF22XpEl4ofeVzSHuXpaCkg0Se5jGEMBiN8ltXk4nvnjYBOXz/s0kUSbyYGOvgwUbNZZcE2dvdXIfT6dsT0dpZXzuAhYIpKHIKQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:31.827392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:31.843311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:31.847877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:31.853282 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e8ab16c-2b96-4c9b-bf50-d48312b5d02e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1752 microversion: 2.20 time: 0.745915 Sep 08 10:30:31.854178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1989/3778] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:31 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1752 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:31.876947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-1dd50f39-5a01-4cea-ad63-f2070ba5a8e5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for project 41785319e3f242ca9cd86981db6e1789. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:30:31.901783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-1dd50f39-5a01-4cea-ad63-f2070ba5a8e5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for user 3cc1615daf5e4df5900068455d7109ee and project 41785319e3f242ca9cd86981db6e1789. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:30:31.955630 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dd50f39-5a01-4cea-ad63-f2070ba5a8e5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135172 Sep 08 10:30:31.956629 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1790/3779] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:30:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:32.038482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:32.040443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:32.048355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:32.049246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:32.050006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:32.054267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:32.056473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:32.057341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:32.068395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Calling method '.version_select at 0x7f23504a0940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:32.120740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:30:32.121839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Neutron security group 8380f6c1-39c0-4b30-add8-5427c454bb37 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:30:32.122377 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] HTTP exception thrown: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.122377 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Request method failure captured: Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/8380f6c1-39c0-4b30-add8-5427c454bb37 HTTP/1.1 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRHMhUWMUyezF5RvPQLXtjQZSDDMGstLEApUxCwXZT3el1K0gN7lpRSLSKw6wfwv6mnuISimLEyQbzwwIgr-T50R5-UwoY-ug8V34_RmCR2J5RjAkKchIRL9nQZ2VeLbN5aGR6eMXpV78rCxB9079IxgBfmXpXZnEV1iSjDHXEia3U Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61a4ae1fc40f405fa8a7954508d77a5d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 6aeb9349352c4e9b9faa8350c1242830 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8380f6c1-39c0-4b30-add8-5427c454bb37'} Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:30:32.124498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] Sep 08 10:30:32.129931 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:32.136471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Returning 404 to user: Security group 8380f6c1-39c0-4b30-add8-5427c454bb37 does not exist Sep 08 10:30:32.136471 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-f83674aa-be84-43ab-9fe6-e68061036960'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:32.137752 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a2d334d2-4400-4630-b830-16f39c3442b2 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/8380f6c1-39c0-4b30-add8-5427c454bb37" status: 404 len: 194 microversion: 2.1 time: 0.146061 Sep 08 10:30:32.138874 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1990/3780] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:30:31 2022] DELETE /compute/v2.1/os-security-groups/8380f6c1-39c0-4b30-add8-5427c454bb37 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:30:32.146585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:32.147517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:32.156393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:32.157086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:32.157717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:32.158436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:32.158899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:32.159374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:32.509969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:32.522392 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-499684f8-2ee1-4ac7-b584-24ac1c88f742 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.488521 Sep 08 10:30:32.536942 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1791/3781] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:32 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:32.572452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5b7d951-57f5-4e9f-8c7b-d2e9266236ba tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.029255 Sep 08 10:30:32.575928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:32.576823 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1792/3782] 10.222.0.59 () {58 vars in 1164 bytes} [Thu Sep 8 10:30:32 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:30:32.588460 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1fc16a85-fc78-4fc6-8ab9-78731210fec0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.448079 Sep 08 10:30:32.589402 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1991/3783] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:32 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:32.595066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c28ce8c-caf8-4c55-ba98-89ee1fd2a827 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Calling method '.version_select at 0x7f2350b62d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:32.815897 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c28ce8c-caf8-4c55-ba98-89ee1fd2a827 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.234024 Sep 08 10:30:32.825137 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1793/3784] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 10:30:32 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:32.830419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dac75205-6ae2-4092-923e-cbf591571d91 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Calling method '.version_select at 0x7f23504a05e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:32.839562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:32.840768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:32.864320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:32.866004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:32.866851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:32.870321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:32.871060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:32.874051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.192886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:33.210951 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48106113-6aa7-411d-a6f2-abe56f1b63e3 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1503 microversion: 2.1 time: 0.376374 Sep 08 10:30:33.215566 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1794/3785] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:32 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:33.220598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-dac75205-6ae2-4092-923e-cbf591571d91 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:30:33.221950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-dac75205-6ae2-4092-923e-cbf591571d91 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 08 10:30:33.221950 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dac75205-6ae2-4092-923e-cbf591571d91 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Request method failure captured: Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-security-groups/2234e3bb-ab64-44e3-81ec-f8b7c3eeb1df HTTP/1.1 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRHMhUWMUyezF5RvPQLXtjQZSDDMGstLEApUxCwXZT3el1K0gN7lpRSLSKw6wfwv6mnuISimLEyQbzwwIgr-T50R5-UwoY-ug8V34_RmCR2J5RjAkKchIRL9nQZ2VeLbN5aGR6eMXpV78rCxB9079IxgBfmXpXZnEV1iSjDHXEia3U Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61a4ae1fc40f405fa8a7954508d77a5d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 6aeb9349352c4e9b9faa8350c1242830 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: exception: Insufficient rights for removing default security group. Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '2234e3bb-ab64-44e3-81ec-f8b7c3eeb1df'} Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:30:33.224765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] Sep 08 10:30:33.231379 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.240657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dac75205-6ae2-4092-923e-cbf591571d91 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 08 10:30:33.240657 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-9ee913d2-4a6b-4d96-bc72-70de9875e3cc'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:33.240657 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dac75205-6ae2-4092-923e-cbf591571d91 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] 10.222.0.59 "DELETE /compute/v2.1/os-security-groups/2234e3bb-ab64-44e3-81ec-f8b7c3eeb1df" status: 400 len: 182 microversion: 2.1 time: 0.412793 Sep 08 10:30:33.249197 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1992/3786] 10.222.0.59 () {58 vars in 1272 bytes} [Thu Sep 8 10:30:32 2022] DELETE /compute/v2.1/os-security-groups/2234e3bb-ab64-44e3-81ec-f8b7c3eeb1df => generated 182 bytes in 423 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:30:33.260246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:33.260784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:33.261757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:33.262726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:33.270296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.271115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.271798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.272741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.273391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.274005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.293418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.294997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.297597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.298553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.301251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.301836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.331688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:33.449724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df11e191-25da-495d-9ed7-9ed6a0ef3cd6 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "DELETE /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.199085 Sep 08 10:30:33.453761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1993/3787] 10.222.0.59 () {58 vars in 1296 bytes} [Thu Sep 8 10:30:33 2022] DELETE /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6/os-server-password => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:30:33.466810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Calling method '.version_select at 0x7f235045e820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:33.553619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:30:33.554220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Neutron security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:30:33.554802 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] HTTP exception thrown: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.554802 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Request method failure captured: Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-security-groups/cb9f1d81-78fb-46ba-9f18-66432bbe71d2 HTTP/1.1 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRHMhUWMUyezF5RvPQLXtjQZSDDMGstLEApUxCwXZT3el1K0gN7lpRSLSKw6wfwv6mnuISimLEyQbzwwIgr-T50R5-UwoY-ug8V34_RmCR2J5RjAkKchIRL9nQZ2VeLbN5aGR6eMXpV78rCxB9079IxgBfmXpXZnEV1iSjDHXEia3U Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61a4ae1fc40f405fa8a7954508d77a5d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 6aeb9349352c4e9b9faa8350c1242830 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'cb9f1d81-78fb-46ba-9f18-66432bbe71d2'} Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:30:33.557876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Returning 404 to user: Security group cb9f1d81-78fb-46ba-9f18-66432bbe71d2 does not exist Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-15ec3ccd-e3cc-4007-8928-bedf657a48f5'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1249aae-5401-45ab-8a42-5a5332613f48 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] 10.222.0.59 "GET /compute/v2.1/os-security-groups/cb9f1d81-78fb-46ba-9f18-66432bbe71d2" status: 404 len: 194 microversion: 2.1 time: 0.104247 Sep 08 10:30:33.562259 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1994/3788] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:30:33 2022] GET /compute/v2.1/os-security-groups/cb9f1d81-78fb-46ba-9f18-66432bbe71d2 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:30:33.571957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:33.574291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:33.582239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:33.583954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:33.584799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:33.585408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d684f49d-0c95-443b-be6b-407f15019783 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1752 microversion: 2.20 time: 0.367290 Sep 08 10:30:33.586442 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1795/3789] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:33 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1752 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:33.593026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:33.593647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:33.604527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.605033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.605404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.605543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.606009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.606185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.606652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.606782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.608987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.609350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.611121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.612299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.659525 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b2499c9-f4f7-4ee1-ab16-16b3400f9e0b tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.097768 Sep 08 10:30:33.661618 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1995/3790] 10.222.0.59 () {58 vars in 1293 bytes} [Thu Sep 8 10:30:33 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6/os-server-password => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:30:33.668930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Action: 'update', calling method: .version_select at 0x7f2350409dc0>, body: {"security_group": {"name": "tempest-sg-1575633533", "description": "tempest-description-1241923586"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:33.706442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG neutronclient.v2_0.client [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist", "detail": ""}} {{(pid=122457) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 10:30:33.707169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Neutron security group 0c04999a-b6d6-406b-8523-5cf4726dd704 not found {{(pid=122457) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 10:30:33.707835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] HTTP exception thrown: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.707835 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Request method failure captured: Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/os-security-groups/0c04999a-b6d6-406b-8523-5cf4726dd704 HTTP/1.1 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 102 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRHMhUWMUyezF5RvPQLXtjQZSDDMGstLEApUxCwXZT3el1K0gN7lpRSLSKw6wfwv6mnuISimLEyQbzwwIgr-T50R5-UwoY-ug8V34_RmCR2J5RjAkKchIRL9nQZ2VeLbN5aGR6eMXpV78rCxB9079IxgBfmXpXZnEV1iSjDHXEia3U Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61a4ae1fc40f405fa8a7954508d77a5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61a4ae1fc40f405fa8a7954508d77a5d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 61a4ae1fc40f405fa8a7954508d77a5d Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-216796104 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 6aeb9349352c4e9b9faa8350c1242830 Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-216796104-project Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: {"security_group": {"name": "tempest-sg-1575633533", "description": "tempest-description-1241923586"}} Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: exception: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0c04999a-b6d6-406b-8523-5cf4726dd704', 'body': {'security_group': {'name': 'tempest-sg-1575633533', 'description': 'tempest-description-1241923586'}}} Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 10:30:33.710317 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] Returning 404 to user: Security group 0c04999a-b6d6-406b-8523-5cf4726dd704 does not exist Sep 08 10:30:33.716341 n-d-833090-19 devstack@n-api.service[122457]: Neutron server returns request_ids: ['req-10a7ea34-ebbe-48a6-9558-ff3415441a6b'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:33.728973 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ccbba329-0872-48f3-ad80-7b153eb932c4 tempest-SecurityGroupsNegativeTestJSON-216796104 tempest-SecurityGroupsNegativeTestJSON-216796104-project] 10.222.0.59 "PUT /compute/v2.1/os-security-groups/0c04999a-b6d6-406b-8523-5cf4726dd704" status: 404 len: 194 microversion: 2.1 time: 0.054906 Sep 08 10:30:33.728973 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1996/3791] 10.222.0.59 () {60 vars in 1290 bytes} [Thu Sep 8 10:30:33 2022] PUT /compute/v2.1/os-security-groups/0c04999a-b6d6-406b-8523-5cf4726dd704 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:30:33.740998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:33.740998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:33.759233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.759233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.768900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:33.770225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:33.770911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:33.771519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:34.274422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:34.288436 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d16c47e4-fea6-40df-a4ab-76724904a2c4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.699440 Sep 08 10:30:34.292972 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1796/3792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:33 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:34.318178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-19f13e29-b0cc-4e15-b3bb-67aab4451649 req-d13af5a1-8d2e-4439-af6b-fceeff84aee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86438198-bffb-477f-8aa7-ed6ea338b3a4", "name": "network-vif-plugged", "status": "completed", "tag": "ab92ae64-52f8-4539-99d5-cedac37b1774"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:34.335702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-19f13e29-b0cc-4e15-b3bb-67aab4451649 req-d13af5a1-8d2e-4439-af6b-fceeff84aee0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:34.336241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-19f13e29-b0cc-4e15-b3bb-67aab4451649 req-d13af5a1-8d2e-4439-af6b-fceeff84aee0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:34.336682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-19f13e29-b0cc-4e15-b3bb-67aab4451649 req-d13af5a1-8d2e-4439-af6b-fceeff84aee0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:34.354294 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-19f13e29-b0cc-4e15-b3bb-67aab4451649 req-d13af5a1-8d2e-4439-af6b-fceeff84aee0 service nova] Creating event network-vif-plugged:ab92ae64-52f8-4539-99d5-cedac37b1774 for instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 on n-h1-833090-19 Sep 08 10:30:34.361033 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-19f13e29-b0cc-4e15-b3bb-67aab4451649 req-d13af5a1-8d2e-4439-af6b-fceeff84aee0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066178 Sep 08 10:30:34.364305 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1797/3793] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:34.370108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:34.378110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e218e96b-f9cd-4da4-9e92-73b6c4295491 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.657511 Sep 08 10:30:34.378558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1997/3794] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:33 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:34.386052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:34.386649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:34.394107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-485849349", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c418c27-a2cd-44f8-b76b-f5c1929bd451"}], "security_groups": [{"name": "tempest-securitygroup--236932046"}], "key_name": "tempest-keypair-2094183046", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:34.404345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:34.404972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:34.407807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:34.408843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:34.409327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:34.409765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:34.495167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:30:34.669765 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c3307caf-fcce-4093-bf9e-796ca216234d tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "DELETE /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 204 len: 0 microversion: 2.1 time: 0.303895 Sep 08 10:30:34.670672 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1798/3795] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:30:34 2022] DELETE /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:30:34.680237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:34.681732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:34.691760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:34.698759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:34.700821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:34.701894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:34.702537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:34.703194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:34.765488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] validate_networks() for [('5c418c27-a2cd-44f8-b76b-f5c1929bd451', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:30:35.049353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:35.076244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:35.080818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:35.087977 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08ccf5ff-cd17-4f0b-868c-baa90dec6acc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1752 microversion: 2.20 time: 0.415041 Sep 08 10:30:35.088571 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1799/3796] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:34 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1752 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:35.097593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:35.098214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:35.117933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.117933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.118297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.119861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.120557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.121293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.149246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:35.527386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:35.538000 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07ab8d11-b984-465d-b959-547fef2d19a4 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1509 microversion: 2.1 time: 0.447913 Sep 08 10:30:35.539502 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1800/3797] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:35 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:35.556471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:35.557016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:35.564331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.564826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.565266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.565974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.566429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.566858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.915779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:30:35.916265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:30:35.917379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:30:35.918610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:30:35.919912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:30:35.939516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.940116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.940906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.943414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.945687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.946175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.950974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:35.970666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-79812994-1a62-4f4a-b829-f9254a759a2b tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.429882 Sep 08 10:30:35.971565 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1801/3798] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:35 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:35.976621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:35.977232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:35.984159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.985440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.986898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:35.995985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:35.997329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:35.997329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:36.005379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for project 41785319e3f242ca9cd86981db6e1789. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:30:36.012624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Getting quotas for user 3cc1615daf5e4df5900068455d7109ee and project 41785319e3f242ca9cd86981db6e1789. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:30:36.049745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:30:36.054130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:30:36.125270 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-052805ee-f11c-40c8-a10e-fbdf2753ad2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.745852 Sep 08 10:30:36.126388 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1998/3799] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:30:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:30:36.143619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:36.144642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:36.154950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:36.155584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:36.156033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:36.157826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:36.158503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:36.158944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:36.651433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:36.664841 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a84d329-6f00-4975-9f57-dc30f3169e98 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1314 microversion: 2.1 time: 0.691924 Sep 08 10:30:36.666711 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1802/3800] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:35 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:36.689372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8e492f4-6273-40e1-ba55-1082a0616c78 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:36.692245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8e492f4-6273-40e1-ba55-1082a0616c78 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:36.866121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d8e492f4-6273-40e1-ba55-1082a0616c78 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:36.879794 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8e492f4-6273-40e1-ba55-1082a0616c78 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1245 microversion: 2.1 time: 0.211471 Sep 08 10:30:36.896407 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1803/3801] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:36 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1245 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:36.904927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:36.907754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:36.908747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:36.918860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:36.922265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:36.923552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:36.924540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:36.927791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:36.929064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-389a0bdd-08af-49c9-ab27-1f4a4ece80c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1752 microversion: 2.20 time: 0.801467 Sep 08 10:30:36.932906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 1999/3802] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:36 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1752 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:36.941405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:36.942149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:36.942604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:36.997951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:36.998858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:37.005829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:37.007520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:37.007941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:37.008648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:37.009135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:37.009564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:37.419261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:37.429386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-73fccbe6-e007-428e-b7e6-a5c636fa0726 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1509 microversion: 2.1 time: 0.531256 Sep 08 10:30:37.431091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1804/3803] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:36 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1509 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:37.694292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:37.695697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:37.706139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:37.707037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:37.707713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:37.709355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:37.710255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:37.711531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:37.875106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:37.884845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9452ce80-b9aa-459f-be6f-d2d5ef84cd04 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.891443 Sep 08 10:30:37.885425 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2000/3804] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:36 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:37.908646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:37.909177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:37.915485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:37.916227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:37.917153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:37.917872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:37.920403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:37.920968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.106533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:38.131960 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2d7f58aa-2c92-40e1-861e-dfbed04565c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1297 microversion: 2.1 time: 0.225821 Sep 08 10:30:38.132922 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2001/3805] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:37 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:38.160087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:38.160735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:38.178621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.179374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.180083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.181901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.184276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.184948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.370435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:38.386187 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63e90975-e01c-4b06-b663-d293c180b832 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1501 microversion: 2.1 time: 0.698396 Sep 08 10:30:38.386799 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1805/3806] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:37 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1501 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:38.410276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:38.411035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:38.419724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.420462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.421360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.422258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.422880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.423537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.463767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:30:38.597504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-800612f1-404e-490e-8d10-e704600f7302 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 204 len: 0 microversion: 2.1 time: 0.190387 Sep 08 10:30:38.605326 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1806/3807] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:30:38 2022] DELETE /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:30:38.626594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:38.627912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:38.642507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.646645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.646645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.648508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.651678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.652654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.662084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:38.689473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:38.690952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:38.693267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7e7f9dc4-a36f-45c9-894b-682cc2d063eb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.549637 Sep 08 10:30:38.695014 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2002/3808] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:38 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:38.703736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:38.704918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:38.721792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.722595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.723209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.724331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:38.724967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:38.725806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:38.957727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:38.971380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-356faedb-30fb-42a0-a1e5-5ab31a15cc1a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1467 microversion: 2.1 time: 0.362745 Sep 08 10:30:38.974606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1807/3809] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:38 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1467 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:38.989443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:38.990695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:39.009882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.010654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.011306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:39.012341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.013755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.014379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:39.323193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:39.355527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ecb08b7-620a-44aa-a960-0ca13b39b475 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1507 microversion: 2.1 time: 0.655206 Sep 08 10:30:39.363585 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2003/3810] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:38 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1507 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:39.376755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-cd0ef23d-c13f-4cdd-9dbb-3392fff32895 req-a16db6e1-72db-4c9a-be7f-7923c4764c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642ccf38-90ef-4d1b-8b32-f170ff7ea7c6", "name": "network-vif-deleted", "tag": "31cf445e-04ed-4140-9a19-a57ea7d7c9fb"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:39.404753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd0ef23d-c13f-4cdd-9dbb-3392fff32895 req-a16db6e1-72db-4c9a-be7f-7923c4764c22 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.405493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd0ef23d-c13f-4cdd-9dbb-3392fff32895 req-a16db6e1-72db-4c9a-be7f-7923c4764c22 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.406165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd0ef23d-c13f-4cdd-9dbb-3392fff32895 req-a16db6e1-72db-4c9a-be7f-7923c4764c22 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:39.442803 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-cd0ef23d-c13f-4cdd-9dbb-3392fff32895 req-a16db6e1-72db-4c9a-be7f-7923c4764c22 service nova] Creating event network-vif-deleted:31cf445e-04ed-4140-9a19-a57ea7d7c9fb for instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 on n-h2-833090-19 Sep 08 10:30:39.449573 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-cd0ef23d-c13f-4cdd-9dbb-3392fff32895 req-a16db6e1-72db-4c9a-be7f-7923c4764c22 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089228 Sep 08 10:30:39.450542 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2004/3811] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:39.456426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:39.457576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:39.465873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.466712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.467398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:39.468477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.469178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.469948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:39.500269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:39.516500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e6de870-386a-42d8-8ba5-de051ab00da5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.540611 Sep 08 10:30:39.530084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1808/3812] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:38 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:39.743810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:39.744962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:39.769283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.770052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.771031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:39.772065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:39.773159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:39.773915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.164784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:40.189535 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ed2d96e-726b-4637-90ea-bc2b6a23d93a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.737374 Sep 08 10:30:40.190144 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2005/3813] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:39 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:40.230088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:40.232390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:40.278887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.280590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.284164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.291022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.293107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.293976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.328196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:40.346270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:40.352362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:40.354955 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5dc35e33-1260-43d9-8de5-3e16ee9a3772 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.635839 Sep 08 10:30:40.358177 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1809/3814] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:39 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:40.390318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:40.391181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:40.411972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.412478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.412921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.420021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.423564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.426470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.450658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.456616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.458201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.463178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lazy-loading 'fault' on Instance uuid 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:30:40.690816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b68d4d9d04f9abe1c6f0f93a798b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9dbeeab57494b40bb5793f7e8943339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:40.700380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-443e2af5-de90-4319-89c6-8a5647a74470 tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 200 len: 1305 microversion: 2.1 time: 0.489695 Sep 08 10:30:40.704311 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2006/3815] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:40 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 1305 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:40.714916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:40.717837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:40.731785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.732751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.738048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:40.739338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:40.740456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:40.741831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:41.126233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:41.143591 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-734bf162-4e24-4104-9ce8-566981b05df4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1507 microversion: 2.1 time: 0.756847 Sep 08 10:30:41.144525 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1810/3816] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:40 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1507 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:41.256933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:41.258043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:41.266380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:41.268878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:41.269623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:41.270623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:41.271568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:41.272260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:41.638661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:41.648385 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1cf117dc-a17c-499e-96de-a0d4ecfdfac5 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.942673 Sep 08 10:30:41.652185 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2007/3817] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:40 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:41.670508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:41.671501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:41.691753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:41.692504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:41.693131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:41.693911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:41.694583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:41.695145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:41.903067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:41.920526 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cd54e604-01dc-4b7f-a7ff-2caffe7a92a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.705538 Sep 08 10:30:41.950896 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1811/3818] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:41 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:41.966851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-459de60a-f4e4-4a76-8103-27b6ba285b71 req-0dec934e-0d88-46eb-975a-57480df3a4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ae1c59-e738-4c93-891f-f3fd33f5568c", "tag": "02d0433b-b496-410d-b46c-603c4e47b66d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:42.002589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-459de60a-f4e4-4a76-8103-27b6ba285b71 req-0dec934e-0d88-46eb-975a-57480df3a4db service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.016772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-459de60a-f4e4-4a76-8103-27b6ba285b71 req-0dec934e-0d88-46eb-975a-57480df3a4db service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.017881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-459de60a-f4e4-4a76-8103-27b6ba285b71 req-0dec934e-0d88-46eb-975a-57480df3a4db service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.067781 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-459de60a-f4e4-4a76-8103-27b6ba285b71 req-0dec934e-0d88-46eb-975a-57480df3a4db service nova] Creating event network-changed:02d0433b-b496-410d-b46c-603c4e47b66d for instance 48ae1c59-e738-4c93-891f-f3fd33f5568c on n-h2-833090-19 Sep 08 10:30:42.083599 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-459de60a-f4e4-4a76-8103-27b6ba285b71 req-0dec934e-0d88-46eb-975a-57480df3a4db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127342 Sep 08 10:30:42.091379 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1812/3819] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:42.093468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:42.105131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:42.106883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] [instance: 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:42.108566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:42.114945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.116447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.117119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.118865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:42.119360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.120043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.121134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.129333 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f28c5d8-4a51-4bdb-8d63-1a78a1f4b066 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.475692 Sep 08 10:30:42.136278 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2008/3820] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:41 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:42.177511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:42.178212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:42.188313 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] HTTP exception thrown: Instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 could not be found. Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Request method failure captured: Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 HTTP/1.1 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQsdeZoKXrpV5tBoIMw7Ujsy2WzuU5CInLdCeFWp5YtLG6FF3fc6T4il8YvjpcrWhvidY6Otfxj8z6Cc1trFG3I2a4kWMwsPukScRFIpANLdzQtbUvgdxyKSgzyTZZHhNX6xS26c-REfhcYXVylg2cjUitPtqv4ircOt_t_ZdkTGgE Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: b9dbeeab57494b40bb5793f7e8943339 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerPasswordTestJSON-2022444866 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b9dbeeab57494b40bb5793f7e8943339"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b9dbeeab57494b40bb5793f7e8943339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b9dbeeab57494b40bb5793f7e8943339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b9dbeeab57494b40bb5793f7e8943339", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerPasswordTestJSON-2022444866 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: b9dbeeab57494b40bb5793f7e8943339 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2022444866 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerPasswordTestJSON-2022444866-project Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 8a4b68d4d9d04f9abe1c6f0f93a798b6 Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerPasswordTestJSON-2022444866-project Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 could not be found. Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '642ccf38-90ef-4d1b-8b32-f170ff7ea7c6'} Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 could not be found. Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 could not be found. Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:42.190308 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 could not be found. Sep 08 10:30:42.195057 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:30:42.199827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] Returning 404 to user: Instance 642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:42.200941 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1858de7f-dfdb-49a6-b4a0-33bad872b99a tempest-ServerPasswordTestJSON-2022444866 tempest-ServerPasswordTestJSON-2022444866-project] 10.222.0.59 "GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6" status: 404 len: 111 microversion: 2.1 time: 0.104812 Sep 08 10:30:42.203058 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1813/3821] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:42 2022] GET /compute/v2.1/servers/642ccf38-90ef-4d1b-8b32-f170ff7ea7c6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:30:42.203672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.204173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.206751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.207710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.208281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.212483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.370026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:42.386752 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc583d97-ba6a-4e85-9184-5a16033ee16c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 200 len: 1465 microversion: 2.1 time: 0.218532 Sep 08 10:30:42.390113 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2009/3822] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:42 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:42.676653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:42.677533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:42.721630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.722158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.722655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.729260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:42.729747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:42.730190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:42.951674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:42.952303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:43.007144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:43.008100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:43.009449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:43.010379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:43.011014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:43.011948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:43.536011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:43.544844 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67843992-714a-46ea-a384-c59a0eb2e35f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.872534 Sep 08 10:30:43.566049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1814/3823] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:42 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:43.579285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:43.580196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:43.593122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:43.593923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:43.594545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:43.604866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:43.605725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:43.606346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:43.693715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:43.717741 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-109507cc-5cfc-443f-8457-44c1880fe8fb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.769682 Sep 08 10:30:43.719710 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2010/3824] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:42 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:43.737193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:43.738094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:43.752396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:43.755090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:43.755599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:43.756344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:43.756803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:43.760379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:43.788042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 HTTP/1.1 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '86438198-bffb-477f-8aa7-ed6ea338b3a4'} Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:30:43.789733 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:30:43.796989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:30:43.798418 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c51d4328-51b1-4476-b904-c37561480b28 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 404 len: 111 microversion: 2.1 time: 0.076106 Sep 08 10:30:43.815729 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2011/3825] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:43 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:30:43.992042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-343989595", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:44.057055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:30:44.371540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:44.389657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:44.392432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:44.393949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8335835a-56be-4492-859c-16f1f9fb86d6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.826521 Sep 08 10:30:44.394903 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1815/3826] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:43 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:44.401689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b708fa32-65b3-42dc-bf5d-879508a8b071 req-2962fff5-ccfc-4851-b64e-cb9138a37337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86438198-bffb-477f-8aa7-ed6ea338b3a4", "name": "network-vif-deleted", "tag": "ab92ae64-52f8-4539-99d5-cedac37b1774"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:44.419720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:44.435169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b708fa32-65b3-42dc-bf5d-879508a8b071 req-2962fff5-ccfc-4851-b64e-cb9138a37337 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:44.437346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b708fa32-65b3-42dc-bf5d-879508a8b071 req-2962fff5-ccfc-4851-b64e-cb9138a37337 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:44.437947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b708fa32-65b3-42dc-bf5d-879508a8b071 req-2962fff5-ccfc-4851-b64e-cb9138a37337 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:44.481481 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b708fa32-65b3-42dc-bf5d-879508a8b071 req-2962fff5-ccfc-4851-b64e-cb9138a37337 service nova] Creating event network-vif-deleted:ab92ae64-52f8-4539-99d5-cedac37b1774 for instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 on n-h1-833090-19 Sep 08 10:30:44.503627 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b708fa32-65b3-42dc-bf5d-879508a8b071 req-2962fff5-ccfc-4851-b64e-cb9138a37337 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098728 Sep 08 10:30:44.508199 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1816/3827] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:44.575495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:44.575495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:44.584408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:44.585585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:44.586132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:44.587860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:44.588517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:44.589166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:44.981135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:44.995657 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d4916b8-d749-4392-b240-77087acb0fd9 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.426596 Sep 08 10:30:44.996344 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1817/3828] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:44 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:45.001235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:45.001921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:45.008103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:45.009552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:45.010227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:45.012345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:45.013610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:45.014230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:45.034356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:45.057223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:30:45.059288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:30:45.060090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:30:45.060581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:30:45.061101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:30:45.080682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:45.081355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:45.081812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:45.082777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:45.083317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:45.084308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:45.107956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:30:45.114916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:30:45.133105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:30:45.136095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:30:45.196804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4de72d9f-ebf1-414a-9db0-190268726ec1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208575 Sep 08 10:30:45.201214 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2012/3829] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:30:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:30:45.216694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35588a6c-09f2-4093-9a02-ee85176603d7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:45.217315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35588a6c-09f2-4093-9a02-ee85176603d7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:45.300232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35588a6c-09f2-4093-9a02-ee85176603d7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:45.308892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35588a6c-09f2-4093-9a02-ee85176603d7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1214 microversion: 2.1 time: 0.099352 Sep 08 10:30:45.310115 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2013/3830] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:45 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:45.365159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:45.374127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39e42239-ad94-4d9c-805f-1f41314fc674 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.376195 Sep 08 10:30:45.387492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1818/3831] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:44 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:45.426180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:45.428394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:45.435942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:45.436323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:45.436937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:45.438048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:45.439718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:45.440167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:45.465326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:45.657624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:45.674616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:45.677362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:45.678876 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28cdac1e-22e4-485b-a958-dcb63385cc93 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.258496 Sep 08 10:30:45.680118 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2014/3832] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:45 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:46.019661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:46.020409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:46.028996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.029990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.030681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.031659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.032369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.033021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.219877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:46.229507 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffc9379e-ce61-48e6-bb4f-8431cd0a2943 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.213070 Sep 08 10:30:46.244063 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1819/3833] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:46 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:46.332985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:46.333723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:46.351730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.352741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.353199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.353996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.354484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.354970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.401455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:46.402101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:46.409212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.409785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.410235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.411126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.411627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.412063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.465969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:46.474995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea7b71d0-baeb-4480-bc52-6bfdbd3abe06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1266 microversion: 2.1 time: 0.146108 Sep 08 10:30:46.497590 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2015/3834] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:46 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:46.508548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:46.509091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:46.518771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.523887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.525577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.526547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.527516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.528141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.563341 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39a7f023-4b7e-4983-b49f-79adc081e7cf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/ips" status: 200 len: 146 microversion: 2.1 time: 0.063297 Sep 08 10:30:46.569137 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2016/3835] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:30:46 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:46.738575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:46.749842 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c11169f2-5867-4e85-9dc4-1f0157064833 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.352238 Sep 08 10:30:46.770630 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1820/3836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:46 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:46.780770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:46.795875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:46.809823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.810324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.810768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.811505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.812069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.822754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.824663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:46.826368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.829917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.831558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.832638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:46.835523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:46.838511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:46.883693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:46.927140 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e36fd0c2-52dc-4b86-bf38-29e08f42dad7 tempest-AZV2TestJSON-2060670847 tempest-AZV2TestJSON-2060670847-project] 10.222.0.59 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.361787 Sep 08 10:30:46.933555 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2017/3837] 10.222.0.59 () {58 vars in 1164 bytes} [Thu Sep 8 10:30:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:30:47.266335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:47.270096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:47.271227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:47.284799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:47.290154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:47.293036 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-babad508-f870-40a3-8f0c-a0864adc24d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.521134 Sep 08 10:30:47.293946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:47.296120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:47.297476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:47.298970 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1821/3838] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:46 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:47.300942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:47.301701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:47.305432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:47.513563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:47.514183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:47.528077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:47.529089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:47.529575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:47.530306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:47.530862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:47.531299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:47.675695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:47.690292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd51688e-7104-4dfd-97d8-7bd473396d25 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1272 microversion: 2.1 time: 0.181202 Sep 08 10:30:47.694957 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1822/3839] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:47 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:47.750911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:47.762256 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f82ef13-96c2-4188-9738-c30a1389e6d7 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.511812 Sep 08 10:30:47.763522 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2018/3840] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:47 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:47.786554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:47.787141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:47.805295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:47.806347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:47.810038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:47.810898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:47.811386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:47.811857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:48.152172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:48.170053 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f12d5a4b-a82d-4472-8f6d-2c0becbfd2c4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.387733 Sep 08 10:30:48.172294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1823/3841] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:47 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:30:48.325494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:48.326167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:48.345569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:48.347291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:48.347835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:48.350513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:48.351077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:48.352087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:48.832750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:48.868779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:48.870516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:48.874443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a6c31a1-a5b0-4a9a-b980-ffc3b89ed9fa tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.550754 Sep 08 10:30:48.879231 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2019/3842] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:48 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:48.901441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:48.902057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:48.929982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:48.930475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:48.930995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:48.937578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:48.940339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:48.941375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.110910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:49.111507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:49.127084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:49.135610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:49.136322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.137093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:49.137567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:49.137995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.253150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:30:49.518990 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2501a0e6-c296-444d-a623-d63ed739892a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 204 len: 0 microversion: 2.42 time: 1.012290 Sep 08 10:30:49.521200 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1824/3843] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:30:48 2022] DELETE /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:30:49.548427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:49.553248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:49.556253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:49.563249 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6fe60e3e-537e-4a52-a445-82e34adcc659 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1314 microversion: 2.1 time: 0.682756 Sep 08 10:30:49.566557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2020/3844] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:48 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:49.574523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:49.576875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:49.578780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.583154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:49.583989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:49.585915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.587498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:49.588350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:49.601210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:49.614393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:49.614897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.617872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:49.618399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:49.618856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:49.979414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:49.988542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:49.998078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-72bf3441-27f6-48c6-9967-3eef771a7508 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.475214 Sep 08 10:30:49.999057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1825/3845] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:49 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:50.004128 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec11f59a-4ea0-43c5-8a93-79d8e6dc7f63 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.436086 Sep 08 10:30:50.004624 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2021/3846] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:49 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:50.015677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:50.021057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:50.029728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:50.030320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:50.036554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.040982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.041655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.044421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.044944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.045950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.047019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.047647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.069261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.072976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.073546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.073987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.612345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.627185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.638741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.640825 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4479aab8-a1d2-482f-8d3e-c11c8d0788fb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.634934 Sep 08 10:30:50.641424 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2022/3847] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:50 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:50.646609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:50.647226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:50.654500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.655279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.656196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.657210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.657842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.658542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.682478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.699011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.702961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.711623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6e8e5b4-91ab-43aa-bfe5-598b421748b8 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.711037 Sep 08 10:30:50.712810 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1826/3848] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:49 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:50.871845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:50.883374 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3dc99a00-aead-4420-8880-dfefc4408735 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1314 microversion: 2.1 time: 0.240020 Sep 08 10:30:50.884778 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2023/3849] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:50 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:50.918615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-115d1029-cfd4-4a37-be72-65b81946a4cd req-751a4506-acca-49be-a472-13ae097b2b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae77cab-a3f8-42bf-ade8-a0705608902b", "tag": "b7fc800c-b096-4dee-8643-7c139c7b49d6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:50.937977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-115d1029-cfd4-4a37-be72-65b81946a4cd req-751a4506-acca-49be-a472-13ae097b2b81 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:50.938458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-115d1029-cfd4-4a37-be72-65b81946a4cd req-751a4506-acca-49be-a472-13ae097b2b81 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:50.938889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-115d1029-cfd4-4a37-be72-65b81946a4cd req-751a4506-acca-49be-a472-13ae097b2b81 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:50.963833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-115d1029-cfd4-4a37-be72-65b81946a4cd req-751a4506-acca-49be-a472-13ae097b2b81 service nova] Creating event network-changed:b7fc800c-b096-4dee-8643-7c139c7b49d6 for instance bae77cab-a3f8-42bf-ade8-a0705608902b on n-h1-833090-19 Sep 08 10:30:50.970410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-115d1029-cfd4-4a37-be72-65b81946a4cd req-751a4506-acca-49be-a472-13ae097b2b81 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055247 Sep 08 10:30:50.972594 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1827/3850] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:51.021758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:51.022418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:51.029131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:51.031058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.031759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.032617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.033568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.034217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.034823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.038343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:51.039048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:51.053093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.053592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.054031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.054771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.055227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.062572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.304502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:51.310049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:51.316901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94620d7f-427d-4c94-9eee-79e1d5acc7b7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.283136 Sep 08 10:30:51.317775 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1828/3851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:51 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:51.319248 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61f907f0-0e33-462e-a56c-31f6cd899e56 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.299973 Sep 08 10:30:51.323508 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2024/3852] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:51 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:51.451772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14d6a9a9-9896-4f3e-b5b2-af8cfb73bf71"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:51.455828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:51.464133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.465164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.465164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.465980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.466561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.467055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.671008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:51.672083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:51.680821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.681848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.683146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:51.684320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:51.685964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:51.686649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:52.412838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:52.438980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:52.440911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:52.445717 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1a7f36c-2703-40df-9057-460dd2ff0e69 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.777524 Sep 08 10:30:52.447101 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2025/3853] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:51 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:52.467591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:52.468595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:52.482858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:52.484556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:52.485063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:52.485842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:52.488949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:52.489403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:52.987129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:53.012677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:53.019038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:53.024483 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b953b73-e8d9-4b90-943a-fe9363233b95 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.573071 Sep 08 10:30:53.064406 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74b8a7ba-e334-4fc6-a33d-f7d919ec4b24 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.611508 Sep 08 10:30:53.065731 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1829/3854] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:30:51 2022] POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-volume_attachments => generated 194 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:30:53.074772 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2026/3855] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:52 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:53.084602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:53.085919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:53.086416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:53.089224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:53.097850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.098820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.099791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.100917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.101621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.102735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.114361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.120984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.121597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.122569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.123184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.123662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.741191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:53.752770 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8749cdae-aed8-49ba-a121-1f33cf270799 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1314 microversion: 2.1 time: 0.684342 Sep 08 10:30:53.759525 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1830/3856] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:53 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:53.775447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:53.777727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:53.785715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.787563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.788247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.789205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.789880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.791860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.834787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:53.845923 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4149aa37-b388-413d-b656-13c1299cec2d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.768943 Sep 08 10:30:53.852148 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2027/3857] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:53 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:53.862110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-cf7c1afb-163f-45f1-ab64-5868bcfad98a req-3279b1d0-53eb-49cf-bcdf-cd78c23cc23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ae1c59-e738-4c93-891f-f3fd33f5568c", "name": "network-vif-plugged", "status": "completed", "tag": "02d0433b-b496-410d-b46c-603c4e47b66d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:53.889580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cf7c1afb-163f-45f1-ab64-5868bcfad98a req-3279b1d0-53eb-49cf-bcdf-cd78c23cc23e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.890450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cf7c1afb-163f-45f1-ab64-5868bcfad98a req-3279b1d0-53eb-49cf-bcdf-cd78c23cc23e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.891085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cf7c1afb-163f-45f1-ab64-5868bcfad98a req-3279b1d0-53eb-49cf-bcdf-cd78c23cc23e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.916662 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-cf7c1afb-163f-45f1-ab64-5868bcfad98a req-3279b1d0-53eb-49cf-bcdf-cd78c23cc23e service nova] Creating event network-vif-plugged:02d0433b-b496-410d-b46c-603c4e47b66d for instance 48ae1c59-e738-4c93-891f-f3fd33f5568c on n-h2-833090-19 Sep 08 10:30:53.935386 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-cf7c1afb-163f-45f1-ab64-5868bcfad98a req-3279b1d0-53eb-49cf-bcdf-cd78c23cc23e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071388 Sep 08 10:30:53.936392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2028/3858] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:53.942407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:53.943119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:53.957422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.957928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.963524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:53.964369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:53.964853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:53.965511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:54.251117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.263274 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-501ee770-0473-4978-8f27-8b09c226e96e tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.502240 Sep 08 10:30:54.276019 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1831/3859] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:53 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:54.290292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:54.298707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:54.335841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:54.339763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:54.343543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:54.346283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:54.348657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:54.349812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:54.570519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.582055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.583637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.608180 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a2cdbda4-c989-47b0-8ea4-d649883e884e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.647429 Sep 08 10:30:54.631220 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2029/3860] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:53 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:54.695608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.699804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:54.716070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.717568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:54.718872 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bbe79dbe-7dba-41d8-af5b-0d2844cf5abb tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.440771 Sep 08 10:30:54.719481 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1832/3861] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:54 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:54.784381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:54.785803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:54.796948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:54.797519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:54.797980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:54.799232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:54.799793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:54.800237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:54.880448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:54.881470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:54.896608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:54.897459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:54.898135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:54.903607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:54.907637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:54.908460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.260400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:55.273725 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-251f1555-db49-493f-ad21-0d437e1f2b4a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1314 microversion: 2.1 time: 0.494658 Sep 08 10:30:55.275864 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2030/3862] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:54 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:55.300669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:55.303090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:55.316781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:55.336276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:55.337904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:55.339804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.343658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:55.344441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:55.345445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.383353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:55.402751 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-632aa2a6-0e75-4787-8c11-fd4f47da1364 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.527974 Sep 08 10:30:55.403348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1833/3863] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:54 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:55.639477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:55.640217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:55.653009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:55.656075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:55.659253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.661788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:55.662529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:55.664360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.768882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:55.797280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad2835f0-7bc4-44ec-8502-b79922be5db6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.501302 Sep 08 10:30:55.802065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2031/3864] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:55 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:55.807001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:55.813804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:55.830840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:55.841433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:55.842190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.843026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:55.844944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:55.845575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:55.985340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:56.004265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:56.008044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:56.012893 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0fb58ea-0495-47c4-ae3f-425eaad3c9bd tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.377736 Sep 08 10:30:56.016127 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1834/3865] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:55 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:56.078517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-94183661-b55d-432e-aa24-3a7e4f872e89 req-5c5bc68f-12de-4471-8b01-f5a91c0e9406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae77cab-a3f8-42bf-ade8-a0705608902b", "name": "network-vif-plugged", "status": "completed", "tag": "b7fc800c-b096-4dee-8643-7c139c7b49d6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:56.104043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-94183661-b55d-432e-aa24-3a7e4f872e89 req-5c5bc68f-12de-4471-8b01-f5a91c0e9406 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:56.111520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-94183661-b55d-432e-aa24-3a7e4f872e89 req-5c5bc68f-12de-4471-8b01-f5a91c0e9406 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:56.113128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-94183661-b55d-432e-aa24-3a7e4f872e89 req-5c5bc68f-12de-4471-8b01-f5a91c0e9406 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:56.149078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-94183661-b55d-432e-aa24-3a7e4f872e89 req-5c5bc68f-12de-4471-8b01-f5a91c0e9406 service nova] Creating event network-vif-plugged:b7fc800c-b096-4dee-8643-7c139c7b49d6 for instance bae77cab-a3f8-42bf-ade8-a0705608902b on n-h1-833090-19 Sep 08 10:30:56.160650 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-94183661-b55d-432e-aa24-3a7e4f872e89 req-5c5bc68f-12de-4471-8b01-f5a91c0e9406 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087117 Sep 08 10:30:56.162641 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1835/3866] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:30:56.303924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:56.304741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:56.394204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:56.396209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:56.396989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:56.398134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:56.398774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:56.399444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:56.525426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:56.529031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:56.568411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:56.573343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:56.574696 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07c8d2a8-64a5-41aa-b8da-9bcbff47a3d6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.771513 Sep 08 10:30:56.599067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2032/3867] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:55 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:56.605327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:56.613711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:56.629871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:56.633646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:56.634862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:56.637712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:56.640443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:56.641156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:56.860881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:30:57.018899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:57.030660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-514acb80-264a-45cc-808e-25d8a76aadd3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1314 microversion: 2.1 time: 0.731800 Sep 08 10:30:57.039643 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1836/3868] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:56 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:57.052030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:57.053507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:57.061142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:57.061927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:57.062745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:57.063695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:57.064386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:57.065417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:57.068416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:57.081085 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0eb59b8e-ae38-4504-a9c9-29baea7e436d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.478488 Sep 08 10:30:57.081702 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2033/3869] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:56 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:57.092283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:57.092913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:57.109331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:57.109832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:57.110276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:57.111000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:57.111469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:57.111903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:57.553099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:57.561721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c36989f2-b1df-4c18-854b-7742598d7082 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.518374 Sep 08 10:30:57.567855 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1837/3870] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:57 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:57.603326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:57.603979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:57.618912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:57.620331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:57.621218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:57.626660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:57.627005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:57.627514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:57.627956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:57.633826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:57.638227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:57.645843 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55eec8c1-4378-4f4e-9b6c-1f436fa70a9b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.556362 Sep 08 10:30:57.668710 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2034/3871] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:57 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:58.059954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:58.078492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:58.100222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.106745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.109722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.121554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.123712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.124761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.155044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:58.165838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:58.167817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:58.169237 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd082415-1add-4c31-a6bf-611ea07bef72 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.570527 Sep 08 10:30:58.170920 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1838/3872] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:57 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:30:58.192130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:58.192952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:58.206891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.207778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.208407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.209285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.209905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.210593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.520095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:58.534924 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f1a2ac3-d53c-4f6b-968e-3a3b234ac08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1314 microversion: 2.1 time: 0.480852 Sep 08 10:30:58.541657 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2035/3873] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:58 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:58.563651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:58.573643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3cf04cbe-aba5-457b-8a44-9811b888b801 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.401080 Sep 08 10:30:58.586699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:58.588218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:58.589042 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1839/3874] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:58 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:58.597327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.597990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.598443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.599179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.599668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.600334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.675438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:58.676084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:58.690095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.694162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.695454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:58.700561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:58.703655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:58.706131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.018516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.028197 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d87d0046-8216-4d45-bfc6-4b4b37188b30 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.446762 Sep 08 10:30:59.032570 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2036/3875] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:58 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:30:59.047068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2a5f6e22-9be5-4b50-b1f8-3338f3fa19c7 req-16a506c9-4029-465f-9e51-deff328dfc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "476853c2-0179-4c3b-bd7b-48ae101e3282"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:30:59.072154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2a5f6e22-9be5-4b50-b1f8-3338f3fa19c7 req-16a506c9-4029-465f-9e51-deff328dfc17 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.072989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2a5f6e22-9be5-4b50-b1f8-3338f3fa19c7 req-16a506c9-4029-465f-9e51-deff328dfc17 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.073696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2a5f6e22-9be5-4b50-b1f8-3338f3fa19c7 req-16a506c9-4029-465f-9e51-deff328dfc17 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.098380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2a5f6e22-9be5-4b50-b1f8-3338f3fa19c7 req-16a506c9-4029-465f-9e51-deff328dfc17 service nova] Creating event network-vif-unplugged:476853c2-0179-4c3b-bd7b-48ae101e3282 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:30:59.103401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.113718 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2a5f6e22-9be5-4b50-b1f8-3338f3fa19c7 req-16a506c9-4029-465f-9e51-deff328dfc17 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079566 Sep 08 10:30:59.114547 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2037/3876] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:30:59.123601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.125052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.126491 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91520562-c278-4f93-be2f-87e0cee98cc2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.456218 Sep 08 10:30:59.127072 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1840/3877] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:58 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:59.210552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:59.211975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:59.220652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.221522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.222198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.223895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.224674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.225341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.553265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.565456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:59.566099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.567107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:59.567892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:30:59.569382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80d6f533-dd7b-4eca-8d62-eb51ca90a3ca tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.374774 Sep 08 10:30:59.578015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.578775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.579427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.580361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.581810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.584262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.585205 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2038/3878] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:30:59 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:30:59.600271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:30:59.600944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:30:59.626028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.629015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.629508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:30:59.630341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:30:59.630747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:30:59.631191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:00.001396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:00.011804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e9bdc88-56d9-4696-8d41-c2cd1fb4ce2d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1501 microversion: 2.1 time: 0.450714 Sep 08 10:31:00.013607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1841/3879] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:59 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1501 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:00.062397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:00.064504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:00.071839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:00.074943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:00.075211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:00.076270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:00.077262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:00.077955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:00.098072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:00.119009 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bdc01416-f0ce-47a3-a0d8-e121362b034c tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.521774 Sep 08 10:31:00.121852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2039/3880] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:30:59 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:00.154262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:00.155315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:00.161894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:00.162672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:00.163275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:00.164521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:00.165329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:00.165922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:00.588162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:00.598266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:00.608258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:00.608954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:00.619135 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f70130ab-8dd6-451d-9ea8-87781791a925 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.467870 Sep 08 10:31:00.628043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e697438-e2de-4f7e-b6de-abea12eedc8a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.570768 Sep 08 10:31:00.629415 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1842/3881] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:00 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:00.629820 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2040/3882] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:00 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:00.648577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:00.655143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:00.662747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:00.665093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:00.666294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:00.667747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:00.668528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:00.676244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.114763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:01.132750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:01.134728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:01.140342 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7db753fb-c4bf-4252-9605-3d17f235244a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 0.509381 Sep 08 10:31:01.141914 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2041/3883] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:00 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:01.151627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:01.166012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:01.189933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "ed356a2e-ef5c-4059-a100-4db728c7c7b5"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "084f648d-df8a-4900-8878-d6f4ecfd7b59"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "be64d2f2-5a29-40cc-bdb5-522ee1650ba5"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "6c5df8e6-4c14-418d-a246-db3fd7c9961a"}, {"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "7ff24e51-954c-4345-b488-9f054da2ef8d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:01.190425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.191185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.193089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.209959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.211493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.212846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.221298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.221780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.222557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.258350 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Creating event network-vif-unplugged:ed356a2e-ef5c-4059-a100-4db728c7c7b5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:01.261494 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Creating event network-vif-unplugged:084f648d-df8a-4900-8878-d6f4ecfd7b59 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:01.263315 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Creating event network-vif-unplugged:be64d2f2-5a29-40cc-bdb5-522ee1650ba5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:01.275927 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Creating event network-vif-unplugged:6c5df8e6-4c14-418d-a246-db3fd7c9961a for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:01.284384 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] Creating event network-vif-unplugged:7ff24e51-954c-4345-b488-9f054da2ef8d for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:01.297329 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-14351d35-30e4-4d8e-94d7-d3e08084c54b req-5475a748-32ba-4bb4-9fc3-50429f633ce2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.110855 Sep 08 10:31:01.306855 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2042/3884] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:01.434079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:01.442883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-facae210-a4fa-44d8-8517-aba6dd38eccc tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1370 microversion: 2.1 time: 0.296377 Sep 08 10:31:01.443500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1843/3885] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:01 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:01.652624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:01.654195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:01.657386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:01.658572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:01.669207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.670863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.671322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.674132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.678792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.679676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.693181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.693709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.701932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:01.708575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:01.709093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:01.709541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:02.103080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:02.117644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:02.131009 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ddab61b4-6eef-4c15-9402-21b9b1907536 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1485 microversion: 2.1 time: 0.478305 Sep 08 10:31:02.145028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:02.147007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:02.156682 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1844/3886] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:01 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1485 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:02.161836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38218a23-aace-45d3-9450-6751a884e029 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.516070 Sep 08 10:31:02.175725 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2043/3887] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:01 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:02.175929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:02.270559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:02.271690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:02.282938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:02.285927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:02.287387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:02.289756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:02.294469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:02.295187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:02.312999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d17761f7-1fcb-4bde-b190-96e3469ad015 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "POST /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442/action" status: 202 len: 0 microversion: 2.1 time: 0.154914 Sep 08 10:31:02.316522 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1845/3888] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:31:02 2022] POST /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:31:02.322780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:02.327010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:02.343016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:02.343554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:02.343998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:02.344760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:02.345216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:02.345642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.245237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.257095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d87c4f69-c503-416d-a174-91f472a18959 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1493 microversion: 2.1 time: 0.939111 Sep 08 10:31:03.271444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.272176 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1846/3889] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:02 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1493 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:03.279625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:03.280843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:03.285163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.286608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.288885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.289748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.292048 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-437516e9-b3cf-4334-8628-f4994c4042e5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 1.026753 Sep 08 10:31:03.292048 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2044/3890] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:02 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:03.293494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.295038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.295831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.296718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.308394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f19dcf95-9b4b-42e6-bae0-e8a469771457"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:03.311177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:03.331109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.331644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.332084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.332795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.333243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.336191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.523870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.540070 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b23d6bb-1774-4a5e-a055-81a9e41c1241 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1563 microversion: 2.1 time: 0.266481 Sep 08 10:31:03.541520 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1847/3891] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:03 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:03.547810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:03.548716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:03.568372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.573103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.574152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.575253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.576027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.576785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.746796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-feb8e2d9-0cd1-401e-a068-0c7131a07f7a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451528 Sep 08 10:31:03.748103 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2045/3892] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:31:03 2022] POST /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:03.766291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9926cfb7-7d71-4705-8f7c-dfb7e623eec2 req-a3107048-f5c5-4e35-ba76-75858346ffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-unplugged", "status": "completed", "tag": "17fde0e0-1318-48b1-8837-bc941c736cff"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:03.795832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9926cfb7-7d71-4705-8f7c-dfb7e623eec2 req-a3107048-f5c5-4e35-ba76-75858346ffb5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.796645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9926cfb7-7d71-4705-8f7c-dfb7e623eec2 req-a3107048-f5c5-4e35-ba76-75858346ffb5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.797497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9926cfb7-7d71-4705-8f7c-dfb7e623eec2 req-a3107048-f5c5-4e35-ba76-75858346ffb5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.826013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9926cfb7-7d71-4705-8f7c-dfb7e623eec2 req-a3107048-f5c5-4e35-ba76-75858346ffb5 service nova] Creating event network-vif-unplugged:17fde0e0-1318-48b1-8837-bc941c736cff for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:03.841198 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9926cfb7-7d71-4705-8f7c-dfb7e623eec2 req-a3107048-f5c5-4e35-ba76-75858346ffb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090849 Sep 08 10:31:03.846376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2046/3893] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:03.856903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:03.857998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:03.865162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.866208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.866893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.867887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:03.868647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:03.869316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:03.879185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.903210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.904993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:03.906607 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-696e05fb-1f74-47e1-b879-e7be7dec1c75 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.363900 Sep 08 10:31:03.907730 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1848/3894] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:03 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:04.027325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f39bddb1-6202-438a-90b5-a14cbb281259 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179330 Sep 08 10:31:04.027966 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2047/3895] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:31:03 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:04.284195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:04.284814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:04.300084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:04.308264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:04.308966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:04.310842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:04.311512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:04.325922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:04.327452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:04.330645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:04.356745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:04.357468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:04.359520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:04.360677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:04.363387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:04.366190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:04.430750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:05.366949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:05.380162 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d92458e-4999-4ab7-8aca-48041de40695 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1493 microversion: 2.1 time: 1.100652 Sep 08 10:31:05.380759 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1849/3896] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:04 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1493 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:05.394399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:05.395299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:05.409489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:05.410258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:05.410900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:05.411842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:05.412470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:05.413070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:05.451244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:05.470208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:05.472012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:05.473510 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0b4984a-e162-414f-b436-bcc74c2e1634 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2962 microversion: 2.42 time: 1.155211 Sep 08 10:31:05.489108 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2048/3897] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:04 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2962 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:06.018348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:06.043828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:06.049650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:06.058886 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cce21148-20c5-4052-9e8f-0e03b7d807b7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.674159 Sep 08 10:31:06.068315 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1850/3898] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:05 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:06.413428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:06.414041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:06.430433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:06.430916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:06.431357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:06.432180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:06.432630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:06.433558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:06.523800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:06.524957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:06.544006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:06.560366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:06.564502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:06.567975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:06.568660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:06.571520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:07.420124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.432864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.437945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.439350 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e2a64e49-c160-4c3b-bd30-536c980071cc tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2941 microversion: 2.42 time: 0.920967 Sep 08 10:31:07.449432 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1851/3899] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:06 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2941 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:07.454551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:07.455429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:07.467329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:07.472206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:07.472935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:07.473845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:07.474856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:07.475486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:07.584753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.595794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4bd40b14-24d3-4715-8f14-cbf0acb1848f tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1493 microversion: 2.1 time: 1.189473 Sep 08 10:31:07.597392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2049/3900] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:06 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1493 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:07.603570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e6788c85-3051-4cc6-b3ab-006e107db8a1 req-c207f09e-a4ff-44f8-becc-e8184a863575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ae1c59-e738-4c93-891f-f3fd33f5568c", "tag": "02d0433b-b496-410d-b46c-603c4e47b66d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:07.615678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e6788c85-3051-4cc6-b3ab-006e107db8a1 req-c207f09e-a4ff-44f8-becc-e8184a863575 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:07.616716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e6788c85-3051-4cc6-b3ab-006e107db8a1 req-c207f09e-a4ff-44f8-becc-e8184a863575 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:07.617878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e6788c85-3051-4cc6-b3ab-006e107db8a1 req-c207f09e-a4ff-44f8-becc-e8184a863575 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:07.637184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e6788c85-3051-4cc6-b3ab-006e107db8a1 req-c207f09e-a4ff-44f8-becc-e8184a863575 service nova] Creating event network-changed:02d0433b-b496-410d-b46c-603c4e47b66d for instance 48ae1c59-e738-4c93-891f-f3fd33f5568c on n-h2-833090-19 Sep 08 10:31:07.646591 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e6788c85-3051-4cc6-b3ab-006e107db8a1 req-c207f09e-a4ff-44f8-becc-e8184a863575 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047269 Sep 08 10:31:07.649430 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2050/3901] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:07.907819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.918118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.919579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:07.920770 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45f44f80-ee90-43ec-9949-7172fafba109 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.470250 Sep 08 10:31:07.934819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1852/3902] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:07 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:08.315785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64783e87-de46-487e-a708-7362cce8ff14 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Action: 'create', calling method: .version_select at 0x7f23517f9e50>, body: {"keypair": {"name": "tempest-keypair-370513525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIz864j4rSN+swYHAd0yWLTprwwrTMr4ibiv6EzOufA2oO0MS8XwMviZJLa9OPaSeP4vwZ2PHrgCA9DHFcAK857bfWFjWlxOIN+Ut8sEDq03XuanonEF4DBzhP04fx3qg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:08.359377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-64783e87-de46-487e-a708-7362cce8ff14 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Getting quotas for project 5b87c6f7be904e8da5a4e65f60ae8c9d. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:08.390063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-64783e87-de46-487e-a708-7362cce8ff14 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Getting quotas for user 089da7972e3d46a88e8e9403346e1c3a and project 5b87c6f7be904e8da5a4e65f60ae8c9d. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:08.464885 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64783e87-de46-487e-a708-7362cce8ff14 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.458463 Sep 08 10:31:08.470497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:08.471622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:08.473578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2051/3903] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:31:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:08.486105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:08.487355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:08.488463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:08.493728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:08.494444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:08.495057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:08.628775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:08.630861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:08.663661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:08.666040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:08.682769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:08.684801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:08.690852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:08.691910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:08.756095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:09.757867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:09.775056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:09.776771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:09.778234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17832a85-22db-4daf-b1a1-0640f49ccf7a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2920 microversion: 2.42 time: 1.311655 Sep 08 10:31:09.786044 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1853/3904] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:08 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2920 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:31:09.791072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:09.801802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:09.820716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:09.821783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:09.828288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:09.831261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:09.835679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:09.838621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:09.839174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:09.852202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-30683108-5d84-4772-a92f-1120d37a98c6 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1499 microversion: 2.1 time: 1.231355 Sep 08 10:31:09.854365 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2052/3905] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:08 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1499 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:09.900548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-784ff313-17f4-462f-979d-ee7c78113347 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:09.909775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784ff313-17f4-462f-979d-ee7c78113347 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:09.910621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784ff313-17f4-462f-979d-ee7c78113347 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:09.911343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-784ff313-17f4-462f-979d-ee7c78113347 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.010009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-784ff313-17f4-462f-979d-ee7c78113347 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Going to try to stop instance {{(pid=122457) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:31:10.126874 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-784ff313-17f4-462f-979d-ee7c78113347 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action" status: 202 len: 0 microversion: 2.1 time: 0.252630 Sep 08 10:31:10.127559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2053/3906] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:31:09 2022] POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:31:10.140439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:10.141489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:10.156512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:10.158889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:10.159571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.162043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:10.162698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:10.164015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.238514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:10.355261 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba4d7944-d3b1-46f7-8993-b592926f979a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 204 len: 0 microversion: 2.1 time: 0.225527 Sep 08 10:31:10.369985 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2054/3907] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:10 2022] DELETE /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:31:10.383147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:10.384941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:10.392028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:10.392950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:10.393614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.394642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:10.395409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:10.396176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.527097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:10.543731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:10.546965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:10.550136 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98dd34ff-b8c6-4d2b-9042-e00e9d98031f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.762543 Sep 08 10:31:10.551597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1854/3908] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:09 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:10.565592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:10.568851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:10.592634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:10.593134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:10.593759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.594885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:10.595352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:10.595852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:10.981804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:10.995442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df50b9c9-0661-4eec-9cda-6c2624c361a1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.621526 Sep 08 10:31:10.997360 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2055/3909] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:10 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:11.090177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1773774772", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:11.130622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:11.141163 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c545ba4e-6b10-4374-b403-ace3c6681fc4 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.581713 Sep 08 10:31:11.159884 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1855/3910] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:10 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:11.167446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:11.168157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:11.180020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:11.181352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:11.182169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:11.189334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:11.194800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:11.195717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:11.196960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:11.749075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:11.773128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:11.780888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:11.782574 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98091d8e-2926-4b83-8e83-bd0aad6211a2 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2873 microversion: 2.42 time: 0.621068 Sep 08 10:31:11.783171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1856/3911] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:11 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2873 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:11.796697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-da0e0a98-4ef8-4333-8cab-64d878cb7c76 req-d01a7413-fd45-4eed-8a21-77712f67bdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-deleted", "tag": "be64d2f2-5a29-40cc-bdb5-522ee1650ba5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:11.820168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da0e0a98-4ef8-4333-8cab-64d878cb7c76 req-d01a7413-fd45-4eed-8a21-77712f67bdfe service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:11.821847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da0e0a98-4ef8-4333-8cab-64d878cb7c76 req-d01a7413-fd45-4eed-8a21-77712f67bdfe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:11.822548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da0e0a98-4ef8-4333-8cab-64d878cb7c76 req-d01a7413-fd45-4eed-8a21-77712f67bdfe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:11.858470 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-da0e0a98-4ef8-4333-8cab-64d878cb7c76 req-d01a7413-fd45-4eed-8a21-77712f67bdfe service nova] Creating event network-vif-deleted:be64d2f2-5a29-40cc-bdb5-522ee1650ba5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:11.869804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-da0e0a98-4ef8-4333-8cab-64d878cb7c76 req-d01a7413-fd45-4eed-8a21-77712f67bdfe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084671 Sep 08 10:31:11.874561 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1857/3912] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:11.886344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:11.887245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:11.898632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:11.899606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:11.900308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:11.901892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:11.903603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:11.904368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:12.645407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:12.660501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:12.663587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:12.665806 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc7d0c22-13df-4df2-a1dd-20c0e7e0f861 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.789036 Sep 08 10:31:12.666964 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1858/3913] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:11 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:12.675060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:12.677103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:12.682114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:12.682690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:12.683486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:12.684006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:12.684955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:12.686114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:12.686946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:12.687601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:12.688569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:12.689200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:12.690124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:12.708499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:12.708991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:12.709428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:12.710192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:12.710644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:12.711067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:12.742825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:12.750900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:12.778745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:12.794161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:12.870581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9929e7f-14f2-493f-8a75-d2a61ddba999 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872064 Sep 08 10:31:12.877773 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2056/3914] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:12.882848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:12.884096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:12.896674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:12.897109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:12.897559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:12.898286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:12.898873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:12.901562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:13.118403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:13.129678 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8019d21-7f16-4670-ae8e-e69f1fccc5d9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.460887 Sep 08 10:31:13.148446 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1859/3915] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:12 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:13.159895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:13.161125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:13.168408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:13.169089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:13.169633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:13.170474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:13.171609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:13.172813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:13.526922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:13.541137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08f015ae-5c79-4170-a2cf-7d3a1671cc18 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1505 microversion: 2.1 time: 0.661584 Sep 08 10:31:13.541819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2057/3916] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:12 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:13.546307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78a71419-f702-46f6-90bc-b4106c4cf95c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:13.546910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78a71419-f702-46f6-90bc-b4106c4cf95c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:13.563072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:13.650306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78a71419-f702-46f6-90bc-b4106c4cf95c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:13.659113 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78a71419-f702-46f6-90bc-b4106c4cf95c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1193 microversion: 2.1 time: 0.116312 Sep 08 10:31:13.663532 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2058/3917] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:13 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1193 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:13.712792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:13.716447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:13.721807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:13.733331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:13.734013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:13.734624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:13.734799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:13.735808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:13.736168 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-65df4d72-4bbd-4e49-a33f-39a8715b9699 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2712 microversion: 2.42 time: 0.582233 Sep 08 10:31:13.737013 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1860/3918] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:13 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2712 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:13.737614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:13.740046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:13.740598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:13.929950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-97f044b3-b2f2-4e7f-8c8e-371e2df7b9da req-64417342-bc27-4198-aba4-84e1705b1eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-deleted", "tag": "084f648d-df8a-4900-8878-d6f4ecfd7b59"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:13.946707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-97f044b3-b2f2-4e7f-8c8e-371e2df7b9da req-64417342-bc27-4198-aba4-84e1705b1eb8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:13.955497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-97f044b3-b2f2-4e7f-8c8e-371e2df7b9da req-64417342-bc27-4198-aba4-84e1705b1eb8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:13.956339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-97f044b3-b2f2-4e7f-8c8e-371e2df7b9da req-64417342-bc27-4198-aba4-84e1705b1eb8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:13.976996 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-97f044b3-b2f2-4e7f-8c8e-371e2df7b9da req-64417342-bc27-4198-aba4-84e1705b1eb8 service nova] Creating event network-vif-deleted:084f648d-df8a-4900-8878-d6f4ecfd7b59 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:13.982871 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-97f044b3-b2f2-4e7f-8c8e-371e2df7b9da req-64417342-bc27-4198-aba4-84e1705b1eb8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056638 Sep 08 10:31:13.984022 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1861/3919] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:14.162196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:14.162898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:14.175663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.176393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.178244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.178996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.179499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.181546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.538317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:14.553282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:14.554748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:14.556578 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfbc59cd-67af-4f01-b7e2-04e06e83b77a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.863386 Sep 08 10:31:14.579661 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2059/3920] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:13 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:14.596454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b0698515-a2f0-4c48-9f7e-e32807d1a529 req-7c2153a6-920f-4034-934d-f2bd6681a635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7597c060-2466-49e8-8ab1-929408de8442", "name": "network-vif-deleted", "tag": "2c6aa126-2279-4ded-be77-090058c531be"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:14.613115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0698515-a2f0-4c48-9f7e-e32807d1a529 req-7c2153a6-920f-4034-934d-f2bd6681a635 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.613970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0698515-a2f0-4c48-9f7e-e32807d1a529 req-7c2153a6-920f-4034-934d-f2bd6681a635 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.614901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0698515-a2f0-4c48-9f7e-e32807d1a529 req-7c2153a6-920f-4034-934d-f2bd6681a635 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.629561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b0698515-a2f0-4c48-9f7e-e32807d1a529 req-7c2153a6-920f-4034-934d-f2bd6681a635 service nova] Creating event network-vif-deleted:2c6aa126-2279-4ded-be77-090058c531be for instance 7597c060-2466-49e8-8ab1-929408de8442 on n-h1-833090-19 Sep 08 10:31:14.636880 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b0698515-a2f0-4c48-9f7e-e32807d1a529 req-7c2153a6-920f-4034-934d-f2bd6681a635 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054980 Sep 08 10:31:14.644387 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2060/3921] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:14.652986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:14.654099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:14.665716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.666557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.667222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.675877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.676965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.677726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.741475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.742134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.743859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.744773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lazy-loading 'fault' on Instance uuid 7597c060-2466-49e8-8ab1-929408de8442 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:31:14.817793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:14.833438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cfbbb142-2f05-42ab-930c-d88e586d2bde tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.675402 Sep 08 10:31:14.836609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:14.848837 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1862/3922] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:14 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:14.853502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0afb54b9-7d3f-45a1-8554-f880c2ca20ec tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 200 len: 1303 microversion: 2.1 time: 0.201490 Sep 08 10:31:14.855294 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2061/3923] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:14 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 1303 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:14.857339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-107003942", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7b44c38f-17e7-4067-b7f4-3381eface34d"}], "security_groups": [{"name": "tempest-securitygroup--1611374237"}], "key_name": "tempest-keypair-370513525", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:14.867208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:14.868281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:14.875729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.890540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.891105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.894403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:14.895172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:14.899945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:14.906575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:15.110208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:15.124606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-440d7f13-4f6a-4fd0-97b8-5b6e602e25b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1253 microversion: 2.1 time: 0.266233 Sep 08 10:31:15.131960 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2062/3924] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:14 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1253 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:15.138466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:15.140868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:15.168171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:15.171782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:15.172866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:15.184074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] validate_networks() for [('7b44c38f-17e7-4067-b7f4-3381eface34d', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:15.185043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:15.185658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:15.186217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:15.753722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:15.766567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:15.776909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:15.778559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e410e522-f94b-4e7e-a043-f8314feae49b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2551 microversion: 2.42 time: 0.645283 Sep 08 10:31:15.779525 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2063/3925] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:15 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2551 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:15.786213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-df0f0d2c-55db-467e-9146-bad5c3d3af6f req-c1c52a70-2dc8-4a2f-99e6-e54d08551b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "name": "network-vif-plugged", "status": "completed", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:15.809793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df0f0d2c-55db-467e-9146-bad5c3d3af6f req-c1c52a70-2dc8-4a2f-99e6-e54d08551b3b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:15.811888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df0f0d2c-55db-467e-9146-bad5c3d3af6f req-c1c52a70-2dc8-4a2f-99e6-e54d08551b3b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:15.813234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df0f0d2c-55db-467e-9146-bad5c3d3af6f req-c1c52a70-2dc8-4a2f-99e6-e54d08551b3b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:15.843293 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-df0f0d2c-55db-467e-9146-bad5c3d3af6f req-c1c52a70-2dc8-4a2f-99e6-e54d08551b3b service nova] Creating event network-vif-plugged:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:31:15.858269 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-df0f0d2c-55db-467e-9146-bad5c3d3af6f req-c1c52a70-2dc8-4a2f-99e6-e54d08551b3b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074489 Sep 08 10:31:15.860699 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2064/3926] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:15.867759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:15.868620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:15.875617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:15.876207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:15.876746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:15.877565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:15.878102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:15.878603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.589238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:16.602926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:16.606212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Getting quotas for project 5b87c6f7be904e8da5a4e65f60ae8c9d. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:16.610221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:16.612507 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65bc0d68-7540-412c-b9e8-1f42d4ff1032 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.748779 Sep 08 10:31:16.613826 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2065/3927] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:15 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:16.615103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Getting quotas for user 089da7972e3d46a88e8e9403346e1c3a and project 5b87c6f7be904e8da5a4e65f60ae8c9d. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:16.622027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:16.623148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:16.631777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.633329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.635022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.636951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.637699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.639983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.651833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:16.652254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:16.652724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:16.653126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:16.653536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:16.662415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.663157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.663791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.664696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.665867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.666473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.690608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Getting quotas for project 5b87c6f7be904e8da5a4e65f60ae8c9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:16.697311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Getting quotas for user 089da7972e3d46a88e8e9403346e1c3a and project 5b87c6f7be904e8da5a4e65f60ae8c9d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:16.720188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:16.723632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:16.785706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39186ea0-2330-4871-888f-6c4ba4813692 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.935094 Sep 08 10:31:16.787094 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1863/3928] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:14 2022] POST /compute/v2.1/servers => generated 407 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:16.794508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:16.795526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: 7597c060-2466-49e8-8ab1-929408de8442] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:16.803037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.806088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.807152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.808155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.808846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.809540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.833033 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] HTTP exception thrown: Instance 7597c060-2466-49e8-8ab1-929408de8442 could not be found. Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Request method failure captured: Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 HTTP/1.1 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPm4AoyeMtB_X_1HIHr-xqaoCOYVPecQddY9jvNNkhx1s1yKCcYdRpwYg0oKSA6aoaRONjuH6AQaoMkZInPMs62YRAXSchyf1pAMxPEXMKE-AbvQ9BzptGSRSMTIrKR3Mxw8gQ6jHRz2EVLZ0bqvXMJN7TliMIbGG3m23TpsqvOKFc Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 8c8cca3886ea40b1b3f7c8792ecdd289 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerRescueTestJSON-2018628554 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8c8cca3886ea40b1b3f7c8792ecdd289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8c8cca3886ea40b1b3f7c8792ecdd289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8c8cca3886ea40b1b3f7c8792ecdd289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8c8cca3886ea40b1b3f7c8792ecdd289", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerRescueTestJSON-2018628554 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 8c8cca3886ea40b1b3f7c8792ecdd289 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerRescueTestJSON-2018628554 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerRescueTestJSON-2018628554-project Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: cb4b005426b049e7b96829b732f8f8a8 Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerRescueTestJSON-2018628554-project Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 7597c060-2466-49e8-8ab1-929408de8442 could not be found. Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7597c060-2466-49e8-8ab1-929408de8442'} Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7597c060-2466-49e8-8ab1-929408de8442 could not be found. Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7597c060-2466-49e8-8ab1-929408de8442 could not be found. Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:16.835893 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7597c060-2466-49e8-8ab1-929408de8442 could not be found. Sep 08 10:31:16.844597 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:16.846185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Returning 404 to user: Instance 7597c060-2466-49e8-8ab1-929408de8442 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:16.846185 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c1b09ae-db24-4051-8f3f-6dafaad93a49 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442" status: 404 len: 111 microversion: 2.1 time: 0.057495 Sep 08 10:31:16.847216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1864/3929] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:16 2022] GET /compute/v2.1/servers/7597c060-2466-49e8-8ab1-929408de8442 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:16.854650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:16.855279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:16.862888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.864060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.864992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.866002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.866784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.867448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:16.940750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:16.960445 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60e300da-0edb-4fd8-8004-897f333ecfbc tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.343857 Sep 08 10:31:16.961031 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2066/3930] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:16 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:16.975784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-866abb9f-3783-4566-9df7-a35d38c73a81 req-798c93ab-2674-41fa-973e-e43fc7fc1545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-deleted", "tag": "7ff24e51-954c-4345-b488-9f054da2ef8d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:16.984824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-866abb9f-3783-4566-9df7-a35d38c73a81 req-798c93ab-2674-41fa-973e-e43fc7fc1545 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:16.985476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-866abb9f-3783-4566-9df7-a35d38c73a81 req-798c93ab-2674-41fa-973e-e43fc7fc1545 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:16.995711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-866abb9f-3783-4566-9df7-a35d38c73a81 req-798c93ab-2674-41fa-973e-e43fc7fc1545 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.008085 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-866abb9f-3783-4566-9df7-a35d38c73a81 req-798c93ab-2674-41fa-973e-e43fc7fc1545 service nova] Creating event network-vif-deleted:7ff24e51-954c-4345-b488-9f054da2ef8d for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:17.018502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-866abb9f-3783-4566-9df7-a35d38c73a81 req-798c93ab-2674-41fa-973e-e43fc7fc1545 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056265 Sep 08 10:31:17.019266 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2067/3931] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:17.025220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b65d0ba-7957-4d26-b82c-3647ceae5a10 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:17.025931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b65d0ba-7957-4d26-b82c-3647ceae5a10 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:17.144625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b65d0ba-7957-4d26-b82c-3647ceae5a10 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.152492 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b65d0ba-7957-4d26-b82c-3647ceae5a10 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1268 microversion: 2.1 time: 0.131719 Sep 08 10:31:17.153160 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2068/3932] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:17 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:17.158024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:17.158937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:17.165814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.166552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.167218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.168199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.168886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.169562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.354134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.364845 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd8761f8-e596-4135-ab7a-39f86e900c11 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.516265 Sep 08 10:31:17.365434 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1865/3933] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:16 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:17.372552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:17.373404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:17.386026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.387087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.387788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.389544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.390767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.391207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.429216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:17.470703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.489850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.492854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.495523 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa878e75-b1c0-490a-88b1-605e2a904022 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2347 microversion: 2.42 time: 0.341137 Sep 08 10:31:17.498741 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2069/3934] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:17 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2347 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:17.504206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-df1fc7c4-1494-4d62-bfb5-319364920f22 req-be2ce9b8-a328-4776-bab8-359093ea2379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c96259-d5ca-4900-b512-a20d2cf6dda2", "tag": "61f90d63-3ebd-48a3-96d7-1b7080f3cd65"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:17.508174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:17.514407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df1fc7c4-1494-4d62-bfb5-319364920f22 req-be2ce9b8-a328-4776-bab8-359093ea2379 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.515199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df1fc7c4-1494-4d62-bfb5-319364920f22 req-be2ce9b8-a328-4776-bab8-359093ea2379 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.516261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-df1fc7c4-1494-4d62-bfb5-319364920f22 req-be2ce9b8-a328-4776-bab8-359093ea2379 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.532188 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-df1fc7c4-1494-4d62-bfb5-319364920f22 req-be2ce9b8-a328-4776-bab8-359093ea2379 service nova] Creating event network-changed:61f90d63-3ebd-48a3-96d7-1b7080f3cd65 for instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 on n-h2-833090-19 Sep 08 10:31:17.541690 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-df1fc7c4-1494-4d62-bfb5-319364920f22 req-be2ce9b8-a328-4776-bab8-359093ea2379 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041378 Sep 08 10:31:17.542314 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2070/3935] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:17.564053 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da6a935d-e7a3-44b1-b2dd-de9f0eb279dc tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 204 len: 0 microversion: 2.1 time: 0.196763 Sep 08 10:31:17.573555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:17.574638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:17.577267 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1866/3936] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:17 2022] DELETE /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:31:17.582280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.583000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.583961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.584698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.585161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.585604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.590193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:17.645311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:17.646014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:17.653225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.653898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.654534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.655525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.656236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.656723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.801138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.812227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-435cd1f9-c478-4fc7-adab-9b8c7d252348 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1491 microversion: 2.1 time: 0.243238 Sep 08 10:31:17.812810 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2071/3937] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:17 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1491 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:17.857023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.872068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.873526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:17.874722 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81c1f25f-7d17-4a8a-908c-4f3b69fccc74 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.233895 Sep 08 10:31:17.875286 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1867/3938] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:17 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:17.985313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:17.985885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:17.991870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.992362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.992805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:17.993582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:17.994043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:17.994626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.172107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:18.184749 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-186e17fc-2127-427f-b584-531899efc71c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.203158 Sep 08 10:31:18.199506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2072/3939] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:17 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:18.199755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:18.199755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:18.205513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.205513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.207502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.209138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.209675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.210241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.308652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:18.319851 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2789fb8d-a217-4b32-a6e0-6f87c77ddc4e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1338 microversion: 2.1 time: 0.141360 Sep 08 10:31:18.322679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1868/3940] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:18 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:18.391703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:18.392328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:18.398793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.399985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.400431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.401142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.402349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.402791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.527982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:18.528704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:18.538979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.540095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.540724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.541962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.542639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.543062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.544003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:18.565836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38b1aaa8-6280-4ca4-8b9f-b70f76ad5948 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.178584 Sep 08 10:31:18.579963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2073/3941] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:18 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:18.704773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:18.716675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:18.718382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:18.719873 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9340ff97-bc29-4f36-964b-b1bc90f8c525 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2347 microversion: 2.42 time: 0.197023 Sep 08 10:31:18.720448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1869/3942] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:18 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2347 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:18.835740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:18.836383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:18.843934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.844885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.845501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.846722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.847194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.847671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.900829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:18.901538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:18.910995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.911497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.911949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:18.912809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:18.913189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:18.913632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.159862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.169607 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1375dbcc-d965-4610-b348-e0360a336d5a tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1491 microversion: 2.1 time: 0.338119 Sep 08 10:31:19.170208 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2074/3943] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:18 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1491 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:19.184102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2dc94d00-34c9-478f-9885-8890d3dee275 req-a9d883f2-358a-4c96-88a7-435e4bc04e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-deleted", "tag": "ed356a2e-ef5c-4059-a100-4db728c7c7b5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:19.197304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2dc94d00-34c9-478f-9885-8890d3dee275 req-a9d883f2-358a-4c96-88a7-435e4bc04e76 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.198205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2dc94d00-34c9-478f-9885-8890d3dee275 req-a9d883f2-358a-4c96-88a7-435e4bc04e76 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.198910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2dc94d00-34c9-478f-9885-8890d3dee275 req-a9d883f2-358a-4c96-88a7-435e4bc04e76 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.211016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.214501 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2dc94d00-34c9-478f-9885-8890d3dee275 req-a9d883f2-358a-4c96-88a7-435e4bc04e76 service nova] Creating event network-vif-deleted:ed356a2e-ef5c-4059-a100-4db728c7c7b5 for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:19.220191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2dc94d00-34c9-478f-9885-8890d3dee275 req-a9d883f2-358a-4c96-88a7-435e4bc04e76 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048569 Sep 08 10:31:19.221155 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2075/3944] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:19.227129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.228031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:19.228710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.228871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:19.230098 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5509b34e-6cd9-4b20-869f-97992a569f6e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.333951 Sep 08 10:31:19.235507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1870/3945] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:18 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:19.235692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.235939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.236380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.237082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.237537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.237964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.349605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:19.350518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:19.357048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.358053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.358726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.360312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.361017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.361679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.387888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.399357 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8cc73871-40a6-4ec1-8461-5f043306bff3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.176528 Sep 08 10:31:19.400472 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2076/3946] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:19 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:19.473252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:19.473762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:19.480352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.481074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.481720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.482616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.483078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.483722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.512036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.514304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:19.521195 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-56361850-e005-4e97-b26d-63c025e5393d tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1394 microversion: 2.1 time: 0.175568 Sep 08 10:31:19.537095 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1871/3947] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:19 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1394 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:19.590131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:19.590855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:19.597177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.597665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.598100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.598805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.599268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.599816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.632322 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cceb23ba-4446-43a0-ba86-1fd7bb79587e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 204 len: 0 microversion: 2.1 time: 0.162610 Sep 08 10:31:19.633284 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2077/3948] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:19 2022] DELETE /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:31:19.642828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:19.643832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:19.652122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.652777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.653218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.653925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.654409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.654860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.799767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.809421 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03d65e14-62ad-454e-af7f-18777b4f487a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.223102 Sep 08 10:31:19.810293 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1872/3949] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:19 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:19.814923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:19.815781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:19.822153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.822976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.823948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.825232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.825913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.826340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.840783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.850491 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8723c3e5-1786-4b2a-a362-b2420211d313 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1553 microversion: 2.1 time: 0.213051 Sep 08 10:31:19.851076 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2078/3950] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:19 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:19.857546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d60b9cbf-fcda-401d-8005-9f87b0956098 req-8e2c7715-790e-4fc2-be36-19fbc232439d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a600b74-6a49-4a29-874a-10b7e802b122", "tag": "53d02017-9557-49d2-8fe6-2bff76dce083"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:19.868534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d60b9cbf-fcda-401d-8005-9f87b0956098 req-8e2c7715-790e-4fc2-be36-19fbc232439d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:19.869354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d60b9cbf-fcda-401d-8005-9f87b0956098 req-8e2c7715-790e-4fc2-be36-19fbc232439d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:19.869992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d60b9cbf-fcda-401d-8005-9f87b0956098 req-8e2c7715-790e-4fc2-be36-19fbc232439d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:19.884759 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d60b9cbf-fcda-401d-8005-9f87b0956098 req-8e2c7715-790e-4fc2-be36-19fbc232439d service nova] Creating event network-changed:53d02017-9557-49d2-8fe6-2bff76dce083 for instance 9a600b74-6a49-4a29-874a-10b7e802b122 on n-h1-833090-19 Sep 08 10:31:19.889833 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d60b9cbf-fcda-401d-8005-9f87b0956098 req-8e2c7715-790e-4fc2-be36-19fbc232439d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037350 Sep 08 10:31:19.890443 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2079/3951] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:19.974996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.985400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.986866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:19.988124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0692b0cc-5581-4a5e-a9b5-bf3cc19ae4c6 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 2347 microversion: 2.42 time: 0.177169 Sep 08 10:31:19.988724 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1873/3952] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:19 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 2347 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:20.193864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:20.194558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:20.211146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:20.212196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:20.212639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:20.213344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:20.213794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:20.214218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:20.258492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:20.259802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:20.272525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:20.273302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:20.273965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:20.275427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:20.276068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:20.276662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:20.938631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:20.960572 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9d41e3b5-d6d1-464f-a9ad-ce7225187e50 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1491 microversion: 2.1 time: 0.770828 Sep 08 10:31:20.961486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2080/3953] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:20 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1491 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:20.966977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:20.967856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:20.983852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:20.984618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:20.985065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:20.985785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:20.986240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:20.986672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:21.043245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:21.063751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:21.065236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:21.075257 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc93dd7c-8d1a-4403-aba3-d9aa1b6a0bd2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1808 microversion: 2.20 time: 0.820399 Sep 08 10:31:21.089959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1874/3954] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:20 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1808 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:21.104396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:21.105279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:21.111764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:21.112488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:21.113169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:21.114067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:21.114699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:21.115301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:21.725567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:21.737621 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec62bab1-d7d8-4077-bd76-332a88723c94 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.774281 Sep 08 10:31:21.738798 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2081/3955] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:20 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:21.760981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:21.762024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:21.769135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:21.769278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:21.769881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:21.770786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:21.771228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:21.771862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:21.800844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:21.813103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1082b6ae-7be2-43cf-9496-d2cdb69a196e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1394 microversion: 2.1 time: 0.721390 Sep 08 10:31:21.814275 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1875/3956] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:21 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1394 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:21.829638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:21.831211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:21.839761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:21.840381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:21.840932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:21.841839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:21.842396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:21.842926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.265085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.272845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c5cb70e-78d4-45fb-aa8a-89491984a1ca tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.519536 Sep 08 10:31:22.273420 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2082/3957] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:21 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:22.278657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:22.279478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:22.286577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.287323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.287881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.288726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.292498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.296498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.296953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.302160 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-669d3eaa-c348-46a8-9ab1-eb84805b0823 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1553 microversion: 2.1 time: 0.479915 Sep 08 10:31:22.302754 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1876/3958] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:21 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:22.312092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-38959649-0d84-4419-8e1c-02f5247137ff req-e9a2a4de-c233-40aa-8bdb-6b17922bd427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecbee39-cbcc-45e7-9838-ea881b7b6225", "name": "network-vif-deleted", "tag": "6c5df8e6-4c14-418d-a246-db3fd7c9961a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:22.326532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-38959649-0d84-4419-8e1c-02f5247137ff req-e9a2a4de-c233-40aa-8bdb-6b17922bd427 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.327382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-38959649-0d84-4419-8e1c-02f5247137ff req-e9a2a4de-c233-40aa-8bdb-6b17922bd427 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.327781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-38959649-0d84-4419-8e1c-02f5247137ff req-e9a2a4de-c233-40aa-8bdb-6b17922bd427 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.341910 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-38959649-0d84-4419-8e1c-02f5247137ff req-e9a2a4de-c233-40aa-8bdb-6b17922bd427 service nova] Creating event network-vif-deleted:6c5df8e6-4c14-418d-a246-db3fd7c9961a for instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 on n-h2-833090-19 Sep 08 10:31:22.347441 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-38959649-0d84-4419-8e1c-02f5247137ff req-e9a2a4de-c233-40aa-8bdb-6b17922bd427 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038996 Sep 08 10:31:22.348077 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1877/3959] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:22.353898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:22.354602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:22.360858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.361342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.361787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.362489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.363117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.363795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.442278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.452248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.453703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.454955 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6f9a87a-fc08-4c70-b25b-66a1d7424e81 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1987 microversion: 2.42 time: 0.179919 Sep 08 10:31:22.455555 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2083/3960] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:22 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1987 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:22.460380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:22.462147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:22.468073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.468711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.469158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.469875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.470330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.470761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.492631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.500998 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10cc2542-881b-479a-893b-0d16187a8e51 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1449 microversion: 2.1 time: 0.151575 Sep 08 10:31:22.501723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1878/3961] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:22 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:22.701997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.712425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.714141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.716001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14e3ee26-ef12-4093-adad-d3abc8c04adc tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1795 microversion: 2.20 time: 0.259479 Sep 08 10:31:22.716579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2084/3962] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:22 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1795 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:22.766296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:22.766933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:22.773585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.774074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.775103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.775868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.776322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.776746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.838098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:22.838718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:22.840957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:22.846718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.847213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.847681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.848612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:22.849238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:22.849686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:22.975044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:22.985623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7203536e-0860-492c-8bc5-6baba5ee87b1 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.222548 Sep 08 10:31:22.986364 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1879/3963] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:22 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:23.021415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.029431 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-502203a6-a385-4094-84ef-a77d763def06 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1394 microversion: 2.1 time: 0.195806 Sep 08 10:31:23.030018 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2085/3964] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:22 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1394 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:23.296296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:23.297003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:23.303718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.304567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.305770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.306518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.307081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.307673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.326215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:23.326977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:23.336363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.340025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.340704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.341521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.342091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.342628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.449360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.476622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-952990f9-2622-47c5-bf14-45021ca80095 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1345 microversion: 2.1 time: 0.153754 Sep 08 10:31:23.478140 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2086/3965] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:23 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:23.483840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:23.484887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:23.493454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.494371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.495218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.496203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.496892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.498121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.503028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.511780 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02fb5383-ddc0-479f-9501-d76e7a040f01 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.219114 Sep 08 10:31:23.512758 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1880/3966] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:23 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:23.524028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:23.525008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:23.531735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.531964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:23.532623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.533236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.534118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:23.534728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:23.535342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:23.601214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.612120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.613836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.615318 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-618c4d13-f57d-4d68-a280-38db940339a9 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1987 microversion: 2.42 time: 0.135791 Sep 08 10:31:23.621298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b005426b049e7b96829b732f8f8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8cca3886ea40b1b3f7c8792ecdd289', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:23.624562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2087/3967] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:23 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1987 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:23.630707 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8b07661-e408-4210-bcbf-183dab6ead73 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 200 len: 1449 microversion: 2.1 time: 0.110317 Sep 08 10:31:23.631497 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1881/3968] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:23 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 1449 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:24.012675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:24.015235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:24.026226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.027253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.028406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.029597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.030500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.031791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.056188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:24.056914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:24.072663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.073627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.074293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.075263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.076051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.076702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.348419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.355896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.364616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2224a7ad-3ff4-450c-8fa0-b9676d7c6bb6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.357265 Sep 08 10:31:24.365139 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17a9a406-beb0-49bd-8e84-39a6dbd1e59c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1394 microversion: 2.1 time: 0.316341 Sep 08 10:31:24.366125 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1882/3969] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:24 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1394 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:24.383960 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2088/3970] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:24 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:24.386503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df528d15-892b-4880-a5d9-c5bf4f33e60b", "name": "network-vif-deleted", "tag": "35461c57-49b0-4c75-a9d2-efea812bf8d6"}, {"server_uuid": "bae77cab-a3f8-42bf-ade8-a0705608902b", "name": "network-vif-deleted", "tag": "b7fc800c-b096-4dee-8643-7c139c7b49d6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:24.406532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.407025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.407695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.421166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] Creating event network-vif-deleted:35461c57-49b0-4c75-a9d2-efea812bf8d6 for instance df528d15-892b-4880-a5d9-c5bf4f33e60b on n-h2-833090-19 Sep 08 10:31:24.421963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] Creating event network-vif-deleted:b7fc800c-b096-4dee-8643-7c139c7b49d6 for instance bae77cab-a3f8-42bf-ade8-a0705608902b on n-h1-833090-19 Sep 08 10:31:24.430857 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1ae94f5d-53bc-4528-8210-c8138f66b8d0 req-68c33b04-bdcf-4d58-a019-bc73dfdcfd79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052588 Sep 08 10:31:24.431487 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1883/3971] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:24.503214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:24.504424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:24.514221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.515116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.515824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.526873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.529625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.530271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.540480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:24.541514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:24.552625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.553496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.555255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.556855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.557588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.558402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.722111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.731062 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dfcf1a23-cb45-4a66-85ba-5123d05409d1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1345 microversion: 2.1 time: 0.231943 Sep 08 10:31:24.732075 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2089/3972] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:24 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:24.737327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:24.738179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:24.745526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.746274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.746952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.747692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.748146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.748768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.837560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.852807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.855676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.858688 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-725dfc41-66dc-4131-b5d9-a4a81889ea3d tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.125018 Sep 08 10:31:24.859530 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2090/3973] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:24 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:24.866020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:24.867494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] [instance: df528d15-892b-4880-a5d9-c5bf4f33e60b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:24.880495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.881704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.882716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.884732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:24.885768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:24.886761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:24.906179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:24.914346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:24.915615 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] HTTP exception thrown: Instance df528d15-892b-4880-a5d9-c5bf4f33e60b could not be found. Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Request method failure captured: Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b HTTP/1.1 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPm4AoyeMtB_X_1HIHr-xqaoCOYVPecQddY9jvNNkhx1s1yKCcYdRpwYg0oKSA6aoaRONjuH6AQaoMkZInPMs62YRAXSchyf1pAMxPEXMKE-AbvQ9BzptGSRSMTIrKR3Mxw8gQ6jHRz2EVLZ0bqvXMJN7TliMIbGG3m23TpsqvOKFc Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 8c8cca3886ea40b1b3f7c8792ecdd289 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueTestJSON-2018628554 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8c8cca3886ea40b1b3f7c8792ecdd289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8c8cca3886ea40b1b3f7c8792ecdd289"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8c8cca3886ea40b1b3f7c8792ecdd289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8c8cca3886ea40b1b3f7c8792ecdd289", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueTestJSON-2018628554 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 8c8cca3886ea40b1b3f7c8792ecdd289 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueTestJSON-2018628554 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueTestJSON-2018628554-project Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: cb4b005426b049e7b96829b732f8f8a8 Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueTestJSON-2018628554-project Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance df528d15-892b-4880-a5d9-c5bf4f33e60b could not be found. Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'df528d15-892b-4880-a5d9-c5bf4f33e60b'} Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df528d15-892b-4880-a5d9-c5bf4f33e60b could not be found. Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df528d15-892b-4880-a5d9-c5bf4f33e60b could not be found. Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:24.919109 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df528d15-892b-4880-a5d9-c5bf4f33e60b could not be found. Sep 08 10:31:24.929358 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:24.933568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] Returning 404 to user: Instance df528d15-892b-4880-a5d9-c5bf4f33e60b could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:24.935374 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dff1e591-d726-46cb-86c9-87cc0c5a8f02 tempest-ServerRescueTestJSON-2018628554 tempest-ServerRescueTestJSON-2018628554-project] 10.222.0.59 "GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b" status: 404 len: 111 microversion: 2.1 time: 0.074338 Sep 08 10:31:24.937046 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2091/3974] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:24 2022] GET /compute/v2.1/servers/df528d15-892b-4880-a5d9-c5bf4f33e60b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:24.961124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fedea5bd-fb8f-4e89-9a3d-756c0beb834d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.429376 Sep 08 10:31:24.971499 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1884/3975] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:24 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:25.392927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:25.394812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:25.406690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:25.408087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:25.412833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.415121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.416267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.416637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.417368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.418041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.419007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.419255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.420005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.420750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.421086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.421709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.648587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:25.657952 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d044cf5-5f21-4013-bfcd-922810038f33 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.256233 Sep 08 10:31:25.661645 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1885/3976] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:25 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:25.674014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c98a7e1b-8b31-4896-97e8-71144a736e41 req-61201255-753e-45f6-bcc0-5669498b7244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a600b74-6a49-4a29-874a-10b7e802b122", "name": "network-vif-plugged", "status": "completed", "tag": "53d02017-9557-49d2-8fe6-2bff76dce083"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:25.689196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:25.696497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c98a7e1b-8b31-4896-97e8-71144a736e41 req-61201255-753e-45f6-bcc0-5669498b7244 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.697306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c98a7e1b-8b31-4896-97e8-71144a736e41 req-61201255-753e-45f6-bcc0-5669498b7244 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.697982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c98a7e1b-8b31-4896-97e8-71144a736e41 req-61201255-753e-45f6-bcc0-5669498b7244 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.699338 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d2032fe-169c-453e-aa76-8cc746aa9cc0 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1394 microversion: 2.1 time: 0.312268 Sep 08 10:31:25.699983 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2092/3977] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:25 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1394 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:25.717600 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c98a7e1b-8b31-4896-97e8-71144a736e41 req-61201255-753e-45f6-bcc0-5669498b7244 service nova] Creating event network-vif-plugged:53d02017-9557-49d2-8fe6-2bff76dce083 for instance 9a600b74-6a49-4a29-874a-10b7e802b122 on n-h1-833090-19 Sep 08 10:31:25.723240 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c98a7e1b-8b31-4896-97e8-71144a736e41 req-61201255-753e-45f6-bcc0-5669498b7244 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061573 Sep 08 10:31:25.723994 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1886/3978] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:25.759967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:25.760674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:25.769892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.770607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.771240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.771966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.772576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.773186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.866798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:25.880243 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fd389dca-0799-47ef-b61b-fd410f88c7b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1345 microversion: 2.1 time: 0.129165 Sep 08 10:31:25.888139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:25.889607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:25.896204 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2093/3979] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:25 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:25.898668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.900001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.901019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.901979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.902660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.903586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:25.987283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:25.988350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:25.995095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:25.998006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:25.998758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:25.999378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.000306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.000947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.001842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.013020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:26.015109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:26.016888 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9baa66fa-f411-4137-9d25-a01f75c4328e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.134890 Sep 08 10:31:26.017792 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1887/3980] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:25 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:26.171712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:26.180576 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab42392e-f362-4511-ac93-d26ca9ea318e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.198063 Sep 08 10:31:26.183192 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2094/3981] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:25 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:26.682722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:26.683938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:26.687430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:26.693912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.694716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.695347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.696759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.697395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.698236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.715084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:26.722454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:26.723721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:26.731069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.731877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.732495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.733380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.733998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.734601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.905987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:26.921887 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b14f6f8-b189-4ba1-af97-78f99c4b340f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.239860 Sep 08 10:31:26.924167 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1888/3982] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:26 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:26.931826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:26.932929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:26.940759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.942530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.943287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.944438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:26.946964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:26.948255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:26.953092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:26.961958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-982a24d2-8d01-4864-bf45-0924fd10e27b tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1394 microversion: 2.1 time: 0.243489 Sep 08 10:31:26.962751 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2095/3983] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:26 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1394 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:27.020281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:27.029786 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4783ab42-c028-418d-ac12-c4795f4b4476 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 200 len: 1345 microversion: 2.1 time: 0.104297 Sep 08 10:31:27.030650 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1889/3984] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:26 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:27.044979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:27.045886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:27.053031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.054798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.054798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.054798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.056073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.056849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.126132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:27.135834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:27.137278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:27.138487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03ac1c18-a9fc-4f93-a1bd-5bdf71f39487 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.098615 Sep 08 10:31:27.139250 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2096/3985] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:27 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:27.206729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:27.207367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:27.217900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.218704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.219687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.220945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.221781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.222530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.577471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:27.590764 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3b78de48-ba24-4f37-8d09-c19be36affac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.390941 Sep 08 10:31:27.608675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1890/3986] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:27 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:27.743950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8a827d91-1962-49a5-915d-6fb91c922d3c req-50744b60-2146-485b-8988-e3599497b473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c96259-d5ca-4900-b512-a20d2cf6dda2", "name": "network-vif-plugged", "status": "completed", "tag": "61f90d63-3ebd-48a3-96d7-1b7080f3cd65"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:27.764539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:27.773664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8a827d91-1962-49a5-915d-6fb91c922d3c req-50744b60-2146-485b-8988-e3599497b473 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.775161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8a827d91-1962-49a5-915d-6fb91c922d3c req-50744b60-2146-485b-8988-e3599497b473 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.776756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8a827d91-1962-49a5-915d-6fb91c922d3c req-50744b60-2146-485b-8988-e3599497b473 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.798448 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8a827d91-1962-49a5-915d-6fb91c922d3c req-50744b60-2146-485b-8988-e3599497b473 service nova] Creating event network-vif-plugged:61f90d63-3ebd-48a3-96d7-1b7080f3cd65 for instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 on n-h2-833090-19 Sep 08 10:31:27.806055 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8a827d91-1962-49a5-915d-6fb91c922d3c req-50744b60-2146-485b-8988-e3599497b473 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067950 Sep 08 10:31:27.813389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2097/3987] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:27.946203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:27.946905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:27.953916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.954702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.955495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.956432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:27.957086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:27.957710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:27.986646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:27.987917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:28.000592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.001220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.001755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.002857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.011197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.011728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.706709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:28.716928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d78ac98e-bf21-4cd3-916e-29bdfd02ca23 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.774542 Sep 08 10:31:28.722308 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1891/3988] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:27 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:28.729905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:28.730323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:28.737093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.737554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.738201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.739093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.739761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.740367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.741297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:28.750553 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4f38688-72d1-4577-9cc2-88152d43c9b9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1575 microversion: 2.1 time: 0.769424 Sep 08 10:31:28.756588 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2098/3989] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:27 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1575 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:28.756990 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b HTTP/1.1 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'bae77cab-a3f8-42bf-ade8-a0705608902b'} Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:28.759319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11439fe1-0133-4268-9e90-7b16c92eae42 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 404 len: 111 microversion: 2.1 time: 0.037309 Sep 08 10:31:28.764681 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1892/3990] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:28 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:28.766212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:28.766829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:28.779421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.779973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.780408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.781115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.781679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.781983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.784924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:28.785553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:28.801638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.802427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.803031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:28.803947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:28.804584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:28.807311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:29.000146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:29.012024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:29.013648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:29.014920 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c51000bc-d882-4682-b208-5d4cffbee435 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.256788 Sep 08 10:31:29.019841 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2099/3991] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:28 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:29.027116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:29.028116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:29.035997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:29.037042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:29.037744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:29.038764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:29.039500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:29.040783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:29.166136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:29.177639 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46c9a600-93d0-4314-a56a-9dc84e8c71e0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1293 microversion: 2.1 time: 0.415102 Sep 08 10:31:29.178241 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1893/3992] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:28 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:29.188201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:29.195751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:29.209875 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8b97a4a6-396a-4166-9a0e-e7deadf3be45 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188872 Sep 08 10:31:29.210480 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2100/3993] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:31:29 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:29.212524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:29.213193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:29.213803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:29.214866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:29.215509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:29.216091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:29.264142 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b/os-volume_attachments HTTP/1.1 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': 'bae77cab-a3f8-42bf-ade8-a0705608902b'} Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:29.265993 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:31:29.271301 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:29.273216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:29.274795 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c054cfc-cac7-402d-bb7c-32a83761510a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.094683 Sep 08 10:31:29.281842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1894/3994] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:31:29 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b/os-volume_attachments => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:29.512672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-243133327", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:29.607031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:29.752131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:29.753177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:29.762044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:29.763515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:29.764877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:29.766134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:29.766825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:29.768301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.152159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:30.163485 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f8e7ccd1-9823-4a5c-a9b6-15292f7d3997 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.418044 Sep 08 10:31:30.182990 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1895/3995] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:29 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:30.189243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:30.190165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:30.202789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:30.204568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:30.205526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.206442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:30.207074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:30.208246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.393264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:30.404783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:30.407784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:30.409721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63a669f9-543e-46bd-9e2c-acfe0b8f576b tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.224894 Sep 08 10:31:30.411233 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1896/3996] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:30 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:30.422421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:30.425007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:30.433095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:30.434582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:30.435087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.436229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:30.437760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:30.438356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.755403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:30.756561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:30.757336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:30.757969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:30.759094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:30.773928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:30.775197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:30.775961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.777065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:30.777857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:30.778523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:30.805891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:30.812267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:30.812538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:30.819360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:30.834530 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-00784ff0-b85d-453e-81bb-58a443fe6fb5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1474 microversion: 2.1 time: 0.420584 Sep 08 10:31:30.838845 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1897/3997] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:30 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:30.841671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:30.845956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:30.960139 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35c42a12-8ff7-433a-a586-ae845e2ceb04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450044 Sep 08 10:31:30.968013 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2101/3998] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:30.975637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-127ae419-fb30-4376-9c3b-9e038ad4a216 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:30.976383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-127ae419-fb30-4376-9c3b-9e038ad4a216 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:30.989527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:31.056230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-49977301", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:31.168113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-127ae419-fb30-4376-9c3b-9e038ad4a216 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:31.182716 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-127ae419-fb30-4376-9c3b-9e038ad4a216 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 200 len: 1214 microversion: 2.1 time: 0.208074 Sep 08 10:31:31.183535 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1898/3999] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:30 2022] GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:31.201500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:31.209721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:31.210395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:31.244201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:31.247586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:31.249002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:31.250447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:31.253481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:31.254162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.252467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:32.266116 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-483c5728-dbe0-4fc7-b128-4cabc7fa3123 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 1.076910 Sep 08 10:31:32.266764 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1899/4000] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:31 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:32.301807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:32.302627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:32.318864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.321946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.322400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.335898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.336409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.336898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.390371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:32.508156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bbce852c-6425-4b7b-b2a9-f8f21bbb86c1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 204 len: 0 microversion: 2.1 time: 0.220123 Sep 08 10:31:32.509479 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1900/4001] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:32 2022] DELETE /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:31:32.518154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:32.519403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:32.525817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:32.526320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:32.526767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:32.527180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:32.527623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:32.529358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.530041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.530666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.531573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.532211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.532815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.541400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.541727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.542171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.542911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.543410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.543863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.579367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:32.589550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:32.609191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:32.616308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 668e1e1c-98e6-47a7-97e7-f10fe36ed11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:32.692716 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-518df4d2-bd7e-4127-980c-5cf507565d3d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641297 Sep 08 10:31:32.701112 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2102/4002] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:31:32.701350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:32.707754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:32.708581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:32.716297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.717044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.717658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.718560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.719310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.719946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.720419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:32.723033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:32.724335 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-57605594-658d-42f8-87c7-fd0f3fc089b1 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.212961 Sep 08 10:31:32.724912 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1901/4003] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:32 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:32.747685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a4bb8a81-d768-41bd-8dcc-69da1d6fd78f req-c6db86a1-612d-45a5-816a-2086f8175fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a600b74-6a49-4a29-874a-10b7e802b122", "tag": "53d02017-9557-49d2-8fe6-2bff76dce083"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:32.780420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a4bb8a81-d768-41bd-8dcc-69da1d6fd78f req-c6db86a1-612d-45a5-816a-2086f8175fd7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.783057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a4bb8a81-d768-41bd-8dcc-69da1d6fd78f req-c6db86a1-612d-45a5-816a-2086f8175fd7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.783528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a4bb8a81-d768-41bd-8dcc-69da1d6fd78f req-c6db86a1-612d-45a5-816a-2086f8175fd7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.817075 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a4bb8a81-d768-41bd-8dcc-69da1d6fd78f req-c6db86a1-612d-45a5-816a-2086f8175fd7 service nova] Creating event network-changed:53d02017-9557-49d2-8fe6-2bff76dce083 for instance 9a600b74-6a49-4a29-874a-10b7e802b122 on n-h1-833090-19 Sep 08 10:31:32.831372 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a4bb8a81-d768-41bd-8dcc-69da1d6fd78f req-c6db86a1-612d-45a5-816a-2086f8175fd7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105211 Sep 08 10:31:32.832229 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1902/4004] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:32.875529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:32.882223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:32.901510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.902994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.904590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.905953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:32.908303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:32.908862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:32.943054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:33.096192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:33.112621 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ba6bdd3-fbdb-463f-a179-04ac8631de1c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 200 len: 1216 microversion: 2.1 time: 0.249352 Sep 08 10:31:33.115883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1903/4005] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:32 2022] GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:33.134947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ce306de-6bb4-4f7a-a47e-ab179b78912e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:33.135474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ce306de-6bb4-4f7a-a47e-ab179b78912e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 668e1e1c-98e6-47a7-97e7-f10fe36ed11a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:33.206321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:33.212787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ce306de-6bb4-4f7a-a47e-ab179b78912e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 668e1e1c-98e6-47a7-97e7-f10fe36ed11a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:33.215633 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ef02540-c298-4b07-ad39-77eb310936ff tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1575 microversion: 2.1 time: 0.512944 Sep 08 10:31:33.216233 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2103/4006] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:32 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1575 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:33.292560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:33.293093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:33.304476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:33.304986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:33.307714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:33.308481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:33.308955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:33.309398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:33.573048 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.scheduler.client.report [None req-5ce306de-6bb4-4f7a-a47e-ab179b78912e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Deleted allocations for instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a Sep 08 10:31:33.604509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ce306de-6bb4-4f7a-a47e-ab179b78912e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a" status: 204 len: 0 microversion: 2.1 time: 0.486210 Sep 08 10:31:33.606140 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1904/4007] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:33 2022] DELETE /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:31:33.618804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:33.619896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 668e1e1c-98e6-47a7-97e7-f10fe36ed11a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:33.626743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:33.627537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:33.628151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:33.630032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:33.630816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:33.631424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:33.647596 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a HTTP/1.1 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '668e1e1c-98e6-47a7-97e7-f10fe36ed11a'} Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:33.650367 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:31:33.657190 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:33.658972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:33.660437 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3f082b4-4dad-419c-ad4c-9085fefabbe2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a" status: 404 len: 111 microversion: 2.1 time: 0.049824 Sep 08 10:31:33.661542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1905/4008] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:33 2022] GET /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:33.720100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:33.735900 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2610519e-a72d-43f1-91f3-b5b81e1918fb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.447456 Sep 08 10:31:33.736963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2104/4009] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:33 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:33.759248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:33.761353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:33.772477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:33.773412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:33.781448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:33.782641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:33.783564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:33.784595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:33.893740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1616947496", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:33.946972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:33.961389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:33.962900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:33.965881 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9486bf93-c4a8-4030-beb1-947a40f583fe tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.215508 Sep 08 10:31:33.968989 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1906/4010] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:33 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:31:34.005403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:34.137098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:34.137723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:34.165929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:34.166445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:34.166881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:34.167635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:34.168137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:34.168572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:34.265540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:34.275128 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3bbe5df3-19ec-4e79-86c0-b8159bc7ecd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 200 len: 1216 microversion: 2.1 time: 0.142321 Sep 08 10:31:34.275764 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1907/4011] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:34 2022] GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:34.543900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:34.544842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:34.545674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:34.546307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:34.547151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:34.558861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:34.561318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:34.562122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:34.563171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:34.563931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:34.564628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:34.585653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:34.594600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:34.610453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:34.613135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:34.669467 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed0b3b7e-416a-4b82-a113-1f2b765bee41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781160 Sep 08 10:31:34.671998 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2105/4012] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:34.685922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5e7b86d-ddfe-4b5d-9ad8-60294f3994c8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:34.687089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5e7b86d-ddfe-4b5d-9ad8-60294f3994c8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:34.766410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:34.767201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:34.778895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5e7b86d-ddfe-4b5d-9ad8-60294f3994c8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:34.786999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5e7b86d-ddfe-4b5d-9ad8-60294f3994c8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1221 microversion: 2.1 time: 0.107301 Sep 08 10:31:34.790895 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1908/4013] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:34 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:34.794924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:34.795739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:34.796526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:34.797427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:34.798494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:34.799103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:34.974470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:34.985369 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2c3bd12c-8ab6-4d0e-b928-aca9a5cd9004 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.225062 Sep 08 10:31:34.997183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:34.998274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:35.003483 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2106/4014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:34 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:35.006100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:35.008848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:35.009583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:35.010594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:35.012095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:35.017464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:35.150419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:35.167027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:35.168893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:35.170644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b86290f9-f334-44c4-9979-fee005718af7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.178122 Sep 08 10:31:35.172157 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1909/4015] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:34 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:31:35.302317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:35.303102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:35.313282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:35.313887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:35.314395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:35.315446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:35.316038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:35.317248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:35.338015 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 HTTP/1.1 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ca22e520-0eda-42dd-af19-913fa4991b90'} Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:35.340593 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:31:35.345821 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:35.347676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:35.349097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ee0bd96-063e-4244-a636-eb6acf9553d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 404 len: 111 microversion: 2.1 time: 0.054531 Sep 08 10:31:35.362318 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2107/4016] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:35 2022] GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:35.477992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1334055459", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:35.561323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:35.815707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:35.817016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:35.828524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:35.829526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:35.830244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:35.831162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:35.831999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:35.832835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:35.867362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:35.941604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:35.953194 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cdc398ed-0f2d-488f-8e42-de7886b22c2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1273 microversion: 2.1 time: 0.142150 Sep 08 10:31:35.955288 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2108/4017] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:35 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:36.011265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:36.012364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:36.026641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:36.028339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:36.030590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:36.031515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:36.033691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:36.034414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:36.166388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:36.167025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:36.167788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:36.168275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:36.169000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:36.179802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:36.180514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:36.180939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:36.181871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:36.182417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:36.182846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:36.209434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:36.216888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:36.232390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:36.236272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:36.240844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:36.244213 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f2d2eae-f549-448b-8cce-2f23dd1e646f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1725 microversion: 2.1 time: 0.237264 Sep 08 10:31:36.245265 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2109/4018] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:36 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:36.250237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:36.250877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:36.257714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:36.258851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:36.259294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:36.260179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:36.260755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:36.261349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:36.314692 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ff127ca-3637-4226-887a-7a9356f05ad9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841368 Sep 08 10:31:36.315161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1910/4019] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:36.327273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35303daf-1d8d-4015-94a9-fdc59ff5abd7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:36.327958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35303daf-1d8d-4015-94a9-fdc59ff5abd7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:36.363909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:36.384600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:36.388703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:36.397726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-09cd75bf-8208-4727-8558-ad0b24cff2e4 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.150810 Sep 08 10:31:36.413059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2110/4020] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:36 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:36.436668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35303daf-1d8d-4015-94a9-fdc59ff5abd7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:36.449895 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35303daf-1d8d-4015-94a9-fdc59ff5abd7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1215 microversion: 2.1 time: 0.126826 Sep 08 10:31:36.459051 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1911/4021] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:36 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:36.984918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:36.986408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:36.999941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.000742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.001361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.002456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.003095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.003732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.153490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:37.161760 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a6877453-6ce1-4277-afab-9507e7bfb1dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1279 microversion: 2.1 time: 0.181637 Sep 08 10:31:37.163030 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2111/4022] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:36 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:37.276349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:37.279507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:37.296495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.296994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.297440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.308024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.309794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.310180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.430681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:37.431338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:37.447230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.452974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.453457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.458793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.460709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.461333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.714695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:37.729372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:37.732347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:37.734006 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d996259d-b852-4d56-ab77-57d35d64212c tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.309080 Sep 08 10:31:37.735182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2112/4023] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:37 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:31:37.740643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:37.741615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:37.751157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.752124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.753361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.754847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.755578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.756238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.801330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:37.815346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fdf180e6-01bf-4688-a847-8692ea4cf810 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1702 microversion: 2.1 time: 0.546631 Sep 08 10:31:37.819716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1912/4024] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:37 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1702 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:37.846062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fc1fb618-d9bb-4875-9348-9fe5021fa28b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:37.854763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc1fb618-d9bb-4875-9348-9fe5021fa28b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:37.856058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc1fb618-d9bb-4875-9348-9fe5021fa28b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:37.857639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc1fb618-d9bb-4875-9348-9fe5021fa28b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:37.877761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:37.894441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-460f28e5-5b87-44fb-a6c9-8d891136948a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1267 microversion: 2.1 time: 0.156555 Sep 08 10:31:37.895591 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2113/4025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:37 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:37.915523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fc1fb618-d9bb-4875-9348-9fe5021fa28b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Going to try to start instance {{(pid=122456) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:31:37.974452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fc1fb618-d9bb-4875-9348-9fe5021fa28b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action" status: 202 len: 0 microversion: 2.1 time: 0.132382 Sep 08 10:31:37.975447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1913/4026] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:31:37 2022] POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:31:37.989945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:37.991452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:38.003327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.005573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.006122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.007112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.007884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.010812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.189469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:38.190006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:38.201182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.201676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.202594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.202832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.203285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.203760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.489959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:38.503669 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee800055-226e-4e97-95fb-ee1b545d168b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1711 microversion: 2.1 time: 0.523596 Sep 08 10:31:38.504566 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2114/4027] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:37 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1711 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:38.550585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-bf12c1c9-10ab-4edd-96b5-3baca491f94e req-81183ef2-f22d-4e26-8b04-ea0b32aa19e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76119686-ee23-4963-b8c0-31ab04408821", "tag": "96d68dcf-454c-4f34-b0a3-71f23bc81cfc"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:38.565751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bf12c1c9-10ab-4edd-96b5-3baca491f94e req-81183ef2-f22d-4e26-8b04-ea0b32aa19e7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.566612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bf12c1c9-10ab-4edd-96b5-3baca491f94e req-81183ef2-f22d-4e26-8b04-ea0b32aa19e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.567271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bf12c1c9-10ab-4edd-96b5-3baca491f94e req-81183ef2-f22d-4e26-8b04-ea0b32aa19e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.584174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-bf12c1c9-10ab-4edd-96b5-3baca491f94e req-81183ef2-f22d-4e26-8b04-ea0b32aa19e7 service nova] Creating event network-changed:96d68dcf-454c-4f34-b0a3-71f23bc81cfc for instance 76119686-ee23-4963-b8c0-31ab04408821 on n-h1-833090-19 Sep 08 10:31:38.593120 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-bf12c1c9-10ab-4edd-96b5-3baca491f94e req-81183ef2-f22d-4e26-8b04-ea0b32aa19e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047884 Sep 08 10:31:38.594509 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2115/4028] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:38.749454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:38.766551 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f59a7918-d800-4ba4-8699-62ef78db6c60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1321 microversion: 2.1 time: 0.580713 Sep 08 10:31:38.767297 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1914/4029] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:38 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:38.773195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:38.774101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:38.802002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.803005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.803005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.806389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.808988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.808988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.918713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:38.919335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:38.932799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.937056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.937793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.940397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:38.940861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:38.941467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:38.986424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:39.005479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:39.011202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:39.012838 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a2f11e4-1bef-4587-b8e2-44fc23271603 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.244715 Sep 08 10:31:39.023515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2116/4030] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:38 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:31:39.167762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:39.181902 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a663cac4-d413-4998-b3fa-36f8e82aee18 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1273 microversion: 2.1 time: 0.268014 Sep 08 10:31:39.183434 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1915/4031] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:38 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:39.532011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:39.532910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:39.552374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:39.553176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:39.556416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:39.562167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:39.562876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:39.563404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:39.801720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:39.802946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:39.821509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:39.822006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:39.822448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:39.823154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:39.823641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:39.824408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:39.890420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:39.902132 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b1f1e1c-afb2-4326-8d73-ebad88552521 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1711 microversion: 2.1 time: 0.376950 Sep 08 10:31:39.904760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2117/4032] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:39 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1711 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:40.043766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:40.044464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:40.058886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:40.059547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:40.059992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:40.062295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:40.062796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:40.063229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:40.312141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:40.325090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:40.327559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:40.329273 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a33ce313-760e-447d-a4b1-c61980522e02 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.290756 Sep 08 10:31:40.330015 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2118/4033] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:40 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:31:40.338459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:40.339327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:40.359113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:40.359973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:40.362323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:40.363826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:40.364471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:40.365170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:40.377218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:40.390302 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e44f9f35-c0a1-4da6-8586-e61181bf5964 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1321 microversion: 2.1 time: 0.592897 Sep 08 10:31:40.411540 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1916/4034] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:39 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:40.722412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:40.730892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-50cc04ad-a07d-4d21-babb-9b9cc634316d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.399457 Sep 08 10:31:40.731525 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2119/4035] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:40 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:40.933471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:40.934973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:40.947219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:40.948157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:40.949671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:40.951676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:40.952691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:40.954476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:41.360435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:41.361594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:41.362919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:41.372255 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ae69b8b9-8fd9-43eb-9a22-a94662d2a1ec tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1711 microversion: 2.1 time: 0.444093 Sep 08 10:31:41.385853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:41.388193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:41.392273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:41.393267 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1917/4036] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:40 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1711 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:41.393901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:41.394391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:41.394832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:41.414158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:41.415161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:41.425892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:41.432410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:41.433883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:41.435479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:41.436405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:41.437485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:41.630008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:41.650616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:41.656326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:41.664607 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54a6ac52-eac6-425b-b3bf-a94e972795c5 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.308892 Sep 08 10:31:41.665884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2120/4037] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:41 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:41.757345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:41.758050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:41.774379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:41.775477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:41.776107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:41.777685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:41.778694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:41.779328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:42.202238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:42.220713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-897b641b-c89a-4802-92a5-94019a2bf844 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1321 microversion: 2.1 time: 0.809238 Sep 08 10:31:42.235784 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1918/4038] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:41 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1321 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:42.355150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:42.368823 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-375b9ec4-1273-46fd-ba37-ba3b34b7245d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.615343 Sep 08 10:31:42.371791 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2121/4039] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:41 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:42.403024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:42.404073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:42.419007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:42.420560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:42.421896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:42.424671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:42.425400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:42.427009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:42.621975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6d8a7070-7483-4f6f-9969-4cee60ac736d req-817fdd0b-2ab3-4f4f-9b65-f2e382b0558b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c572bf-23a4-4d57-ade4-6e1823b9a5ef", "tag": "74c5fcd5-55b6-4530-a9fb-a84fab1a36d7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:42.639807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6d8a7070-7483-4f6f-9969-4cee60ac736d req-817fdd0b-2ab3-4f4f-9b65-f2e382b0558b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:42.640298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6d8a7070-7483-4f6f-9969-4cee60ac736d req-817fdd0b-2ab3-4f4f-9b65-f2e382b0558b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:42.640722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6d8a7070-7483-4f6f-9969-4cee60ac736d req-817fdd0b-2ab3-4f4f-9b65-f2e382b0558b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:42.671487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6d8a7070-7483-4f6f-9969-4cee60ac736d req-817fdd0b-2ab3-4f4f-9b65-f2e382b0558b service nova] Creating event network-changed:74c5fcd5-55b6-4530-a9fb-a84fab1a36d7 for instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef on n-h2-833090-19 Sep 08 10:31:42.681234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:42.690517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6d8a7070-7483-4f6f-9969-4cee60ac736d req-817fdd0b-2ab3-4f4f-9b65-f2e382b0558b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071148 Sep 08 10:31:42.691500 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2122/4040] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:42.702723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:42.703018 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3b0187b5-3c23-43fc-aa52-eabec67788d8 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1715 microversion: 2.1 time: 0.304368 Sep 08 10:31:42.704235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1919/4041] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:42 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1715 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:42.706038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:42.713175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:42.713662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:42.714291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:42.715177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:42.715843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:42.716448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:42.846345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:42.858299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:42.862092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:42.863811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-defe0d44-6705-42d2-a3b4-9b30aae99d5a tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.166862 Sep 08 10:31:42.865157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2123/4042] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:42 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:43.243117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:43.244282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:43.251676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.252323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.252769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.253476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.254154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.254588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.395783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:43.397167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:43.406750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.407529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.408743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.409617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.410298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.411023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.432379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:43.455327 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f8748eb-66cc-46ea-89fa-2362815ed9d6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1321 microversion: 2.1 time: 0.216885 Sep 08 10:31:43.455957 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1920/4043] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:43 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:43.548378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-e78ce94d-4a0b-4017-a6a4-b222de102efa req-db16eacc-5f9f-4eda-8119-33f0cb2540d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76119686-ee23-4963-b8c0-31ab04408821", "name": "network-vif-plugged", "status": "completed", "tag": "96d68dcf-454c-4f34-b0a3-71f23bc81cfc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:43.559600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e78ce94d-4a0b-4017-a6a4-b222de102efa req-db16eacc-5f9f-4eda-8119-33f0cb2540d8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.560344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e78ce94d-4a0b-4017-a6a4-b222de102efa req-db16eacc-5f9f-4eda-8119-33f0cb2540d8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.561277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e78ce94d-4a0b-4017-a6a4-b222de102efa req-db16eacc-5f9f-4eda-8119-33f0cb2540d8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.576726 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-e78ce94d-4a0b-4017-a6a4-b222de102efa req-db16eacc-5f9f-4eda-8119-33f0cb2540d8 service nova] Creating event network-vif-plugged:96d68dcf-454c-4f34-b0a3-71f23bc81cfc for instance 76119686-ee23-4963-b8c0-31ab04408821 on n-h1-833090-19 Sep 08 10:31:43.582455 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-e78ce94d-4a0b-4017-a6a4-b222de102efa req-db16eacc-5f9f-4eda-8119-33f0cb2540d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038206 Sep 08 10:31:43.584021 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1921/4044] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:43.628585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:43.641677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a73394f0-1cec-43c3-b95e-c7bf96345069 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.251234 Sep 08 10:31:43.675631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2124/4045] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:43 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:43.897582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:43.898190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:43.905161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.905647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.906085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.906799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:43.907233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:43.907680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:43.975623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:43.986253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:43.987928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:43.989321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac33ce52-c4ba-4b0a-8bb4-88142497f531 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.096182 Sep 08 10:31:43.990144 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1922/4046] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:43 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:44.479785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:44.480408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:44.487501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:44.488003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:44.488442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:44.489214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:44.489801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:44.490208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:44.576503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:44.604890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=18 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:44.644770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:44.662508 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7800dfe5-61ad-4730-bcb4-991bb09dc458 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1321 microversion: 2.1 time: 0.184608 Sep 08 10:31:44.679827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:44.682126 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2125/4047] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:44 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:44.684787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:44.697189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:44.698087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:44.698896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:44.700353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:44.701458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:44.702628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:44.872229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:44.880246 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac73a2de-8324-4f79-98c1-07e72bc0c222 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.211571 Sep 08 10:31:44.880844 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1923/4048] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:44 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:45.016691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:45.017805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:45.025021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.026381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.027295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.028101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.028624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.029050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.049932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:45.104055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:45.113621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:45.115053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:45.116259 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9fdcc5d-c373-4b52-b6dd-4d8ea2e0413f tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1604 microversion: 2.42 time: 0.104729 Sep 08 10:31:45.116945 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2126/4049] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:45 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:45.723935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:45.724745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:45.734058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.734418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.735084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.735999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.736460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.736880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.739894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:45.884085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:45.893506 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4fa128a7-6715-4180-a367-96e9558dc628 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1502 microversion: 2.1 time: 0.174666 Sep 08 10:31:45.893506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1924/4050] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:45 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:45.902850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:45.903658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:45.910652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.911136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.911601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.912300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.912749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.913168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.926678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:45.928021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:45.942209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.943515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.944378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:45.945405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:45.946196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:45.946671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.192940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:46.265288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:46.272741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:46.275077 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-183c241a-b819-422b-85b1-8eae93839fe5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1502 microversion: 2.1 time: 0.357050 Sep 08 10:31:46.275926 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1925/4051] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:45 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1502 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:46.282598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:46.283923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:46.284149 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3268785b-cb73-4e7d-a060-cf2179a4750b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.385085 Sep 08 10:31:46.284739 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2127/4052] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:45 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:46.293169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.293932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.295047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.296156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.296963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.297774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.303998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:46.305441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:46.321231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.322016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.322697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.323648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.324346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.324983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.345276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.345776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.346219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.346680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lazy-loading 'fault' on Instance uuid 8ecbee39-cbcc-45e7-9838-ea881b7b6225 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:31:46.355608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:46.412839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:46.432218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:46.433682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:46.434896 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62bedebf-5b48-438f-8b37-58ccddcec0d3 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1609 microversion: 2.42 time: 0.157770 Sep 08 10:31:46.445700 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1926/4053] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:46 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1609 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:46.465591 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd3d0b5f-0ca4-4145-96c4-9da54351e02b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 204 len: 0 microversion: 2.1 time: 0.169546 Sep 08 10:31:46.466253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2128/4054] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:46 2022] DELETE /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:31:46.474312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:46.474925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:46.479419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:46.481456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:46.487279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.488167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.488811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.489590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:46.490132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:46.490561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:46.752212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:46.765972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89477e02-36e6-4ae0-a285-c159c7146e0b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1508 microversion: 2.1 time: 0.295414 Sep 08 10:31:46.766634 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1927/4055] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:46 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:47.312191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:47.312900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:47.316918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:47.326938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.327436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.327908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:47.328623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.329078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.329709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:47.473983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:47.474605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:47.478435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:47.481266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.481907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.482695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:47.483732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.484482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.485221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:47.486769 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e4bf0a5-77b3-4369-b78d-c1bb2ef2814a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.180168 Sep 08 10:31:47.487646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2129/4056] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:47 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:47.529708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.530202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.530637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:47.531088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lazy-loading 'fault' on Instance uuid 8ecbee39-cbcc-45e7-9838-ea881b7b6225 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:31:47.584797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:47.592964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:47.594410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19623b43fee044eeb1adf3aad9c87dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5302ed717cdd423aabd3d0a282fb1ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:47.595666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34cb769a-705b-4c20-93b0-afd2b42c58c7 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 200 len: 1371 microversion: 2.42 time: 0.126397 Sep 08 10:31:47.611658 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1928/4057] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:47 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:31:47.791022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:47.791942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:47.799619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.800324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.800943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:47.801829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:47.802307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:47.802934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.011921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:48.020409 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16fb0e63-7f50-4498-bc9b-03fa6acc15f9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1508 microversion: 2.1 time: 0.234571 Sep 08 10:31:48.036114 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2130/4058] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:47 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:48.521424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:48.522204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:48.539192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:48.540864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:48.542193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.544475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:48.545972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:48.546527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.552594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d6757a58-cd0c-42a0-9158-906866157e13 req-be452b42-96b2-471c-99e7-34af89021f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76119686-ee23-4963-b8c0-31ab04408821", "name": "network-vif-deleted", "tag": "96d68dcf-454c-4f34-b0a3-71f23bc81cfc"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:48.580841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d6757a58-cd0c-42a0-9158-906866157e13 req-be452b42-96b2-471c-99e7-34af89021f4b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:48.581330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d6757a58-cd0c-42a0-9158-906866157e13 req-be452b42-96b2-471c-99e7-34af89021f4b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:48.582372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d6757a58-cd0c-42a0-9158-906866157e13 req-be452b42-96b2-471c-99e7-34af89021f4b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.597539 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d6757a58-cd0c-42a0-9158-906866157e13 req-be452b42-96b2-471c-99e7-34af89021f4b service nova] Creating event network-vif-deleted:96d68dcf-454c-4f34-b0a3-71f23bc81cfc for instance 76119686-ee23-4963-b8c0-31ab04408821 on n-h1-833090-19 Sep 08 10:31:48.604603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d6757a58-cd0c-42a0-9158-906866157e13 req-be452b42-96b2-471c-99e7-34af89021f4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057028 Sep 08 10:31:48.605867 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2131/4059] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:48.635862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:48.641082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:48.656865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:48.658994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:48.663154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.664256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:48.666728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:48.667570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.694949 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] HTTP exception thrown: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Request method failure captured: Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 HTTP/1.1 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcLOl-lEriZnFGLr9NohiGDBxVRqBcyodCeMSROH3lad4SRgT5N8_LLQUUC6pUUTksUTmlUYTBYUkwu9r-imZiOmgM7wbMVDH96g2cLLPDA-_O8iywe77rbI3dbQK6b5yVvvRaIhzF7Qex-tlfsNyL3ijh2WNp1mpRcRiZcCwbOf4KE Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5302ed717cdd423aabd3d0a282fb1ced Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5302ed717cdd423aabd3d0a282fb1ced", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5302ed717cdd423aabd3d0a282fb1ced Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TaggedBootDevicesTest_v242-1635289162-project Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 19623b43fee044eeb1adf3aad9c87dac Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1635289162-project Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8ecbee39-cbcc-45e7-9838-ea881b7b6225'} Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:48.701268 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:48.707734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:48.712002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Returning 404 to user: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:48.713300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e5d5de0-8df7-4a52-9e84-daaec6387347 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 404 len: 111 microversion: 2.42 time: 0.087208 Sep 08 10:31:48.722971 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2132/4060] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:48 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:31:48.730665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82c00c95-c871-4c14-a26e-a1118b8849ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '.version_select at 0x7f235066bd30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:48.783584 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82c00c95-c871-4c14-a26e-a1118b8849ad tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298455185" status: 204 len: 0 microversion: 2.42 time: 0.037726 Sep 08 10:31:48.794336 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2133/4061] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298455185 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:31:48.869426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8b21123e-09d4-4e8d-a04e-a3c94f5d89f4 req-e8c2317e-2e69-4149-ad4e-9119ce1b3200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c572bf-23a4-4d57-ade4-6e1823b9a5ef", "name": "network-vif-plugged", "status": "completed", "tag": "74c5fcd5-55b6-4530-a9fb-a84fab1a36d7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:48.890481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b21123e-09d4-4e8d-a04e-a3c94f5d89f4 req-e8c2317e-2e69-4149-ad4e-9119ce1b3200 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:48.894070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b21123e-09d4-4e8d-a04e-a3c94f5d89f4 req-e8c2317e-2e69-4149-ad4e-9119ce1b3200 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:48.895553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b21123e-09d4-4e8d-a04e-a3c94f5d89f4 req-e8c2317e-2e69-4149-ad4e-9119ce1b3200 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:48.919447 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8b21123e-09d4-4e8d-a04e-a3c94f5d89f4 req-e8c2317e-2e69-4149-ad4e-9119ce1b3200 service nova] Creating event network-vif-plugged:74c5fcd5-55b6-4530-a9fb-a84fab1a36d7 for instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef on n-h2-833090-19 Sep 08 10:31:48.927817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:48.928293 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8b21123e-09d4-4e8d-a04e-a3c94f5d89f4 req-e8c2317e-2e69-4149-ad4e-9119ce1b3200 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062824 Sep 08 10:31:48.929164 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2134/4062] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:48.953301 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c48d2273-cdd4-44a6-ab02-ec4a15c213f7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.445024 Sep 08 10:31:48.955808 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1929/4063] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:48 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:49.053229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:49.054768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:49.067964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:49.068762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:49.069378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:49.070275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:49.070938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:49.071558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:49.105691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:49.106512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:49.107195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:49.107867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid 76119686-ee23-4963-b8c0-31ab04408821 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:31:49.187167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:49.196167 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5517512b-59e8-4ba1-8877-b98b556c88af tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 200 len: 1311 microversion: 2.1 time: 0.153409 Sep 08 10:31:49.196742 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2135/4064] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:49 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:49.991516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:49.995029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:50.007128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:50.011283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:50.012113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:50.013482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:50.014080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:50.014715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:50.181890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:50.193311 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2cf99c2-d555-4c25-b25d-47b12ba25452 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1315 microversion: 2.1 time: 0.212692 Sep 08 10:31:50.194086 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1930/4065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:49 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:50.221361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:50.222215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:50.231673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:50.232178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:50.232625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:50.233345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:50.233803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:50.234439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:50.248814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 HTTP/1.1 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '76119686-ee23-4963-b8c0-31ab04408821'} Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:50.250633 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3280e2d1-c244-4fdc-9d05-d11200915eb0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 404 len: 111 microversion: 2.1 time: 0.037253 Sep 08 10:31:50.256216 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2136/4066] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:50 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:50.266344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6cbc6d8-93b3-4954-ba65-e938c0a4132c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: .version_select at 0x7f23506bf430>, body: {"keypair": {"name": "tempest-key-656747715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORruRfycb6/N9l+CtP+qJlT6Vi0WQjwyLCEgejq3Hr56/g5vtAuDVQiR/gb07DtkwQK069NggF06BLhYMW6wkM/I5C+EI0/RDe1yPT2spMHmwda2BSAafTI0xkH1NV0jg=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:50.283907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f6cbc6d8-93b3-4954-ba65-e938c0a4132c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:50.290613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f6cbc6d8-93b3-4954-ba65-e938c0a4132c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:50.316251 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6cbc6d8-93b3-4954-ba65-e938c0a4132c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.054198 Sep 08 10:31:50.317278 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1931/4067] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:31:50 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:50.333946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05729ada-a6e2-4856-bd88-aa5e66668369 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '.version_select at 0x7f23506935e0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:50.342717 n-d-833090-19 devstack@n-api.service[122457]: WARNING oslo_db.sqlalchemy.utils [None req-05729ada-a6e2-4856-bd88-aa5e66668369 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 10:31:50.363977 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05729ada-a6e2-4856-bd88-aa5e66668369 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.039555 Sep 08 10:31:50.367510 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2137/4068] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:31:50 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:31:50.530388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-740995077", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-key-656747715", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:50.609769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:51.217222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:51.218316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:51.230870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.231541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.247297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.248700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.248913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.249352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.641308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:51.641763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:51.642274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:51.642683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:51.643041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:51.655679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.656747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.657485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.660920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.662826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.663685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.694446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:51.696595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:51.706604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7853070b-84e5-42f9-b96f-5b6281a598c9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1503 microversion: 2.1 time: 0.493220 Sep 08 10:31:51.707114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:51.707602 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2138/4069] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:51 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1503 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:51.733656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:51.734112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:51.747431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.748816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.748816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.749298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.749995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.750608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.794002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:51.798984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:51.896661 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63034d58-5638-44d8-a028-4d928c06a4c3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361393 Sep 08 10:31:51.919892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1932/4070] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:51.922421 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-36a84726-0e20-412a-a0e3-fbd9c3bfe808 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef/action" status: 202 len: 0 microversion: 2.1 time: 0.191781 Sep 08 10:31:51.924458 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2139/4071] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:31:51 2022] POST /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:31:51.932493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0fd10dca-730a-47d0-b570-9e86b6a54d9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:51.933427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0fd10dca-730a-47d0-b570-9e86b6a54d9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:51.957850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:51.958856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:51.973219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.974097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.975427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:51.976623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:51.977900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:51.978578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:52.062114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0fd10dca-730a-47d0-b570-9e86b6a54d9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:52.075270 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0fd10dca-730a-47d0-b570-9e86b6a54d9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1227 microversion: 2.1 time: 0.153417 Sep 08 10:31:52.076309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1933/4072] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:51 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:52.374084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:52.434358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2255f380-e9c7-4358-80d1-fbb54ced3153 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1508 microversion: 2.1 time: 0.483625 Sep 08 10:31:52.435045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2140/4073] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:51 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:52.933830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:52.934327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:52.941393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:52.941890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:52.942329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:52.943059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:52.943548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:52.943976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:52.964791 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] HTTP exception thrown: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Request method failure captured: Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 HTTP/1.1 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcLOl-lEriZnFGLr9NohiGDBxVRqBcyodCeMSROH3lad4SRgT5N8_LLQUUC6pUUTksUTmlUYTBYUkwu9r-imZiOmgM7wbMVDH96g2cLLPDA-_O8iywe77rbI3dbQK6b5yVvvRaIhzF7Qex-tlfsNyL3ijh2WNp1mpRcRiZcCwbOf4KE Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5302ed717cdd423aabd3d0a282fb1ced Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5302ed717cdd423aabd3d0a282fb1ced", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5302ed717cdd423aabd3d0a282fb1ced Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TaggedBootDevicesTest_v242-1635289162-project Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 19623b43fee044eeb1adf3aad9c87dac Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1635289162-project Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '8ecbee39-cbcc-45e7-9838-ea881b7b6225'} Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:52.966514 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Returning 404 to user: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38ed3b14-50cf-4021-b1ad-7c979df40248 tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 404 len: 111 microversion: 2.42 time: 0.038522 Sep 08 10:31:52.971220 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1934/4074] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:31:52 2022] DELETE /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:31:52.977233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:52.977862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] [instance: 8ecbee39-cbcc-45e7-9838-ea881b7b6225] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:52.988287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:52.988857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:52.989363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:52.990049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:52.990519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:52.990953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.007442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] HTTP exception thrown: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Request method failure captured: Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 HTTP/1.1 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcLOl-lEriZnFGLr9NohiGDBxVRqBcyodCeMSROH3lad4SRgT5N8_LLQUUC6pUUTksUTmlUYTBYUkwu9r-imZiOmgM7wbMVDH96g2cLLPDA-_O8iywe77rbI3dbQK6b5yVvvRaIhzF7Qex-tlfsNyL3ijh2WNp1mpRcRiZcCwbOf4KE Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5302ed717cdd423aabd3d0a282fb1ced Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5302ed717cdd423aabd3d0a282fb1ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5302ed717cdd423aabd3d0a282fb1ced", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5302ed717cdd423aabd3d0a282fb1ced Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1635289162 Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TaggedBootDevicesTest_v242-1635289162-project Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 19623b43fee044eeb1adf3aad9c87dac Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1635289162-project Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8ecbee39-cbcc-45e7-9838-ea881b7b6225'} Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:53.009875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] Returning 404 to user: Instance 8ecbee39-cbcc-45e7-9838-ea881b7b6225 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39a5e717-7879-4154-81df-9237d19a7f0e tempest-TaggedBootDevicesTest_v242-1635289162 tempest-TaggedBootDevicesTest_v242-1635289162-project] 10.222.0.59 "GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225" status: 404 len: 111 microversion: 2.42 time: 0.038617 Sep 08 10:31:53.061364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2141/4075] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:31:52 2022] GET /compute/v2.1/servers/8ecbee39-cbcc-45e7-9838-ea881b7b6225 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:31:53.101438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:53.101438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:53.129053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.129713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.130149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.130940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.131628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.132049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.219841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:53.229620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-53e695ed-a65e-4284-84b7-c4d30b29ef9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1279 microversion: 2.1 time: 0.132318 Sep 08 10:31:53.230597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1935/4076] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:53 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:53.463843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:53.464453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:53.471418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.472011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.472436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.473129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.473575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.473997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.652129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:53.667395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98acd1f1-95a6-4aee-9ef1-6eac4645d224 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1488 microversion: 2.1 time: 0.207834 Sep 08 10:31:53.668045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2142/4077] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:53 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:53.693204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:53.694260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:53.710588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.713979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.715121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.717852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.719009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.720677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.781901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:31:53.890533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7eae341-898c-46d3-bb8b-d09ab6317e59 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 204 len: 0 microversion: 2.1 time: 0.201931 Sep 08 10:31:53.891304 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1936/4078] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:31:53 2022] DELETE /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:31:53.901811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:53.902740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:53.911578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.912429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.913075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:53.915050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:53.915902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:53.917114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:54.151602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:54.161074 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-716dd348-f0b9-4163-a348-3a2eb02dbd3e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1494 microversion: 2.1 time: 0.265588 Sep 08 10:31:54.162363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2143/4079] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:53 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:54.254126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:54.254830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:54.262890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:54.263684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:54.264412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:54.265319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:54.265971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:54.266653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:54.377220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:54.386651 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe3141fb-ff7c-476a-aad1-165e25d5f3d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1285 microversion: 2.1 time: 0.135453 Sep 08 10:31:54.395993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1937/4080] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:54 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:55.190732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:55.191494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:55.201286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:55.202052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:55.202790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:55.203683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:55.204276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:55.204909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:55.409507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:55.410159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:55.417595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:55.418100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:55.418748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:55.419714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:55.420363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:55.420813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:55.467506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:55.477344 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-53882771-cb86-4591-9e0a-e3cd0a1caec7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1494 microversion: 2.1 time: 0.295128 Sep 08 10:31:55.478672 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2144/4081] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:55 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1494 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:55.674571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:55.684183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c06db11c-5f3b-44f9-aec3-8f971f1133b6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1327 microversion: 2.1 time: 0.278799 Sep 08 10:31:55.710671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a2480be3-6f59-4aa2-a3a9-645bb37ae72c req-86ea5e5b-7a75-49bd-93f6-9d6834bd1d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdfe335c-1c4c-41d4-983b-19732d20d69b", "tag": "207e0abb-1169-4d73-80cb-4e6e4109055d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:55.728777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2480be3-6f59-4aa2-a3a9-645bb37ae72c req-86ea5e5b-7a75-49bd-93f6-9d6834bd1d15 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:55.729013 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1938/4082] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:55 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1327 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:55.732354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2480be3-6f59-4aa2-a3a9-645bb37ae72c req-86ea5e5b-7a75-49bd-93f6-9d6834bd1d15 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:55.733288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2480be3-6f59-4aa2-a3a9-645bb37ae72c req-86ea5e5b-7a75-49bd-93f6-9d6834bd1d15 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:55.755566 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a2480be3-6f59-4aa2-a3a9-645bb37ae72c req-86ea5e5b-7a75-49bd-93f6-9d6834bd1d15 service nova] Creating event network-changed:207e0abb-1169-4d73-80cb-4e6e4109055d for instance bdfe335c-1c4c-41d4-983b-19732d20d69b on n-h1-833090-19 Sep 08 10:31:55.770368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a2480be3-6f59-4aa2-a3a9-645bb37ae72c req-86ea5e5b-7a75-49bd-93f6-9d6834bd1d15 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065713 Sep 08 10:31:55.771156 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2145/4083] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:56.503742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:56.505672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:56.529664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:56.532990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:56.536302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:56.540118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:56.542055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:56.542505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:56.712100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:56.718631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:56.719290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:56.733774 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6eb31cf9-58e9-4d04-81ca-05ced44b8513 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1452 microversion: 2.1 time: 0.236600 Sep 08 10:31:56.734371 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1939/4084] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:56 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1452 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:56.749980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:56.751421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:56.757344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:56.759369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:56.759884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:56.760327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:56.774649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:57.083737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:57.097836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5922908-0d08-44df-88e5-27eccf538344 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1327 microversion: 2.1 time: 0.390094 Sep 08 10:31:57.098814 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2146/4085] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:56 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1327 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:57.765000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:57.766663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:57.782333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:57.783063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:57.783703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:57.784592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:57.787254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:57.791356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:57.800273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-fc21754d-7a32-40b1-8888-b59d6228655d req-c3ffa080-afd5-4a86-9989-291a209e9b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c572bf-23a4-4d57-ade4-6e1823b9a5ef", "name": "network-vif-deleted", "tag": "74c5fcd5-55b6-4530-a9fb-a84fab1a36d7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:57.828601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fc21754d-7a32-40b1-8888-b59d6228655d req-c3ffa080-afd5-4a86-9989-291a209e9b53 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:57.829152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fc21754d-7a32-40b1-8888-b59d6228655d req-c3ffa080-afd5-4a86-9989-291a209e9b53 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:57.829577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fc21754d-7a32-40b1-8888-b59d6228655d req-c3ffa080-afd5-4a86-9989-291a209e9b53 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:57.871899 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-fc21754d-7a32-40b1-8888-b59d6228655d req-c3ffa080-afd5-4a86-9989-291a209e9b53 service nova] Creating event network-vif-deleted:74c5fcd5-55b6-4530-a9fb-a84fab1a36d7 for instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef on n-h2-833090-19 Sep 08 10:31:57.884609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:57.885420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:57.886144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:57.886607 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-fc21754d-7a32-40b1-8888-b59d6228655d req-c3ffa080-afd5-4a86-9989-291a209e9b53 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090952 Sep 08 10:31:57.887078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lazy-loading 'fault' on Instance uuid b0c572bf-23a4-4d57-ade4-6e1823b9a5ef {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:31:57.888832 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2147/4086] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:31:57.956003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:57.965576 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ebbe713f-7f59-4153-88cd-2946e92547b9 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 200 len: 1305 microversion: 2.1 time: 0.206095 Sep 08 10:31:57.967616 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1940/4087] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:57 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 1305 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:58.126289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:58.126999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:58.135897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:58.136385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:58.137052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:58.137967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:58.138769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:58.139611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:58.339252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:58.347583 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c55dfe2-59fa-40ce-8552-d8a1a2ca0906 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1327 microversion: 2.1 time: 0.226911 Sep 08 10:31:58.348174 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2148/4088] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:58 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1327 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:31:58.993708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:58.994326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:59.001663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:59.002361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:59.002788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:59.003525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:59.003987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:59.004413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:59.020488 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef HTTP/1.1 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b0c572bf-23a4-4d57-ade4-6e1823b9a5ef'} Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:31:59.022268 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f318ac44-c914-46d6-b318-ad89a7836103 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 404 len: 111 microversion: 2.1 time: 0.034611 Sep 08 10:31:59.026211 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1941/4089] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:58 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:31:59.161068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-963282117", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:31:59.217564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:31:59.371126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:59.371753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:31:59.380128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:59.380626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:59.381062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:59.381769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:59.382221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:59.382647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:59.387092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:31:59.747600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:31:59.765700 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68e18f9c-1820-44c7-a552-2f13e5827e39 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1327 microversion: 2.1 time: 0.399364 Sep 08 10:31:59.766617 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1942/4090] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:59 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1327 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:31:59.784138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:31:59.784598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:31:59.785082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:31:59.785913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:31:59.786375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:31:59.800150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:59.800711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:59.801306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:59.802296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:31:59.802821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:31:59.803535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:31:59.846491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:31:59.856624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:31:59.875231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:31:59.878693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:31:59.940594 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aa4686c1-097e-4b56-a9ef-32a735a697a8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782519 Sep 08 10:31:59.941260 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2149/4091] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:31:59.953650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd579d68-a6db-4472-9bb3-799809a12bd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:31:59.954272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd579d68-a6db-4472-9bb3-799809a12bd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:00.031651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd579d68-a6db-4472-9bb3-799809a12bd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:00.039624 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd579d68-a6db-4472-9bb3-799809a12bd4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1214 microversion: 2.1 time: 0.090789 Sep 08 10:32:00.040204 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1943/4092] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:31:59 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:00.792540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:00.793156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:00.800884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:00.801748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:00.802749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:00.803805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:00.804463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:00.805622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:01.064507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:01.065129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:01.073059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:01.073561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:01.074009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:01.074724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:01.075189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:01.081476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:01.098344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:01.109615 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9bde892e-d3e5-4f3c-b538-4acb84f95c56 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1327 microversion: 2.1 time: 0.321717 Sep 08 10:32:01.110887 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2150/4093] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:00 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1327 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:01.162480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:01.171302 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-400866d3-6e31-4322-8a93-6f21b19d6f19 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1266 microversion: 2.1 time: 0.110969 Sep 08 10:32:01.183663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1944/4094] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:01 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:01.618591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3677f12b-b3d0-465f-8b54-13f5c5dfa8d5 req-709d0f9a-5a71-460d-a3c7-376d042aeb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfe335c-1c4c-41d4-983b-19732d20d69b", "name": "network-vif-plugged", "status": "completed", "tag": "207e0abb-1169-4d73-80cb-4e6e4109055d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:01.650740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3677f12b-b3d0-465f-8b54-13f5c5dfa8d5 req-709d0f9a-5a71-460d-a3c7-376d042aeb2e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:01.651242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3677f12b-b3d0-465f-8b54-13f5c5dfa8d5 req-709d0f9a-5a71-460d-a3c7-376d042aeb2e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:01.651854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3677f12b-b3d0-465f-8b54-13f5c5dfa8d5 req-709d0f9a-5a71-460d-a3c7-376d042aeb2e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:01.665918 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3677f12b-b3d0-465f-8b54-13f5c5dfa8d5 req-709d0f9a-5a71-460d-a3c7-376d042aeb2e service nova] Creating event network-vif-plugged:207e0abb-1169-4d73-80cb-4e6e4109055d for instance bdfe335c-1c4c-41d4-983b-19732d20d69b on n-h1-833090-19 Sep 08 10:32:01.672078 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3677f12b-b3d0-465f-8b54-13f5c5dfa8d5 req-709d0f9a-5a71-460d-a3c7-376d042aeb2e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059396 Sep 08 10:32:01.673297 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2151/4095] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:02.130156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:02.135761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:02.136382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:02.143103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:02.144728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:02.145412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:02.147069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:02.147721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:02.148154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:02.197548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:02.198996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:02.209653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:02.210738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:02.211351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:02.212296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:02.212970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:02.213443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:02.311194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:02.325211 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e816fe19-db4c-4b18-b5f8-0fe537aa42c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1272 microversion: 2.1 time: 0.132759 Sep 08 10:32:02.326422 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2152/4096] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:02 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:02.464158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:02.474769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-43fed69b-ec4b-4093-ba7e-570a12be988e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1327 microversion: 2.1 time: 0.344633 Sep 08 10:32:02.475840 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1945/4097] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:02 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1327 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:03.355394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:03.356062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:03.363009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.363527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.363980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.364702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.365159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.365590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.506047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:03.507397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:03.528480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.532618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.535869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.538709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.539591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.540295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.599024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:03.616573 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2993d2f1-766e-4f85-b8ab-581308746332 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.265846 Sep 08 10:32:03.618178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2153/4098] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:03 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:03.789883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:03.806132 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a70be599-4c5e-42af-8a1b-d2453adc214a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1507 microversion: 2.1 time: 0.305051 Sep 08 10:32:03.824915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1946/4099] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:03 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:03.832699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:03.833348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:03.840950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.842094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.842994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.844150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.845156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.845822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.857431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cc562cb7-f2f7-419a-8a1f-07f49d53e30b req-db2764c2-6a75-407b-964e-1d312cdc38f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c428be4-d1e0-4c04-a3f9-50d787654006", "tag": "3a280d5b-ebf7-420d-bf18-1edae29fc63c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:03.878606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cc562cb7-f2f7-419a-8a1f-07f49d53e30b req-db2764c2-6a75-407b-964e-1d312cdc38f3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:03.879123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cc562cb7-f2f7-419a-8a1f-07f49d53e30b req-db2764c2-6a75-407b-964e-1d312cdc38f3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:03.879647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cc562cb7-f2f7-419a-8a1f-07f49d53e30b req-db2764c2-6a75-407b-964e-1d312cdc38f3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:03.907248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cc562cb7-f2f7-419a-8a1f-07f49d53e30b req-db2764c2-6a75-407b-964e-1d312cdc38f3 service nova] Creating event network-changed:3a280d5b-ebf7-420d-bf18-1edae29fc63c for instance 8c428be4-d1e0-4c04-a3f9-50d787654006 on n-h2-833090-19 Sep 08 10:32:03.918309 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cc562cb7-f2f7-419a-8a1f-07f49d53e30b req-db2764c2-6a75-407b-964e-1d312cdc38f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066605 Sep 08 10:32:03.919390 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1947/4100] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:04.138052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:04.148187 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2caece1c-9148-46ec-bde2-492f401a1ebf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1507 microversion: 2.1 time: 0.319905 Sep 08 10:32:04.148894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2154/4101] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:03 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:04.172852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:04.173716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:04.183669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:04.184890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:04.185690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:04.186877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:04.187869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:04.188716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:04.231518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:32:04.330196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5aeb8df-8114-42e2-9926-27b9fd3c44b9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 204 len: 0 microversion: 2.1 time: 0.161340 Sep 08 10:32:04.335309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1948/4102] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:32:04 2022] DELETE /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:32:04.340267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:04.340934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:04.352185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:04.352692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:04.353135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:04.353859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:04.354315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:04.354745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:04.635417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:04.641209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:04.641975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:04.647518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17c7ddd6-163f-49aa-99f9-4f428b6c1ac5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1513 microversion: 2.1 time: 0.311314 Sep 08 10:32:04.648768 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2155/4103] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:04 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:04.667423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:04.668278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:04.668951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:04.669962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:04.670737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:04.671419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:04.860736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:04.870060 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d68ed65-fd4c-4936-9906-5d5b5fc8b2c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.233250 Sep 08 10:32:04.871436 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1949/4104] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:04 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:05.670769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:05.671416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:05.682922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:05.684151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:05.684746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:05.687317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:05.687949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:05.688693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:05.896049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:05.897966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:05.899666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:05.914438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:05.915634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:05.917276 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf96e561-ee37-4b0f-90b0-20c88302872d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1513 microversion: 2.1 time: 0.250279 Sep 08 10:32:05.917846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:05.917978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2156/4105] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:05 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:05.918863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:05.919728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:05.925515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.030612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:06.037774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:06.039017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Searching by: {'deleted': False, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:06.046979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.047780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.048760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.049688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.050281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.050838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.108961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:06.146630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b62d40c3-9310-4a9f-b006-347d30327b2e tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.120721 Sep 08 10:32:06.147653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2157/4106] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:32:06 2022] GET /compute/v2.1/servers => generated 333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:06.161556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:06.167629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:06.168592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Searching by: {'deleted': False, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:06.174616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.175086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.175683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.176744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.177332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.178681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.211875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:06.245429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:06.255054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-958a6e43-2400-4d9d-9f7d-712beef5af5f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.361242 Sep 08 10:32:06.256220 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1950/4107] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:05 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:06.262141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:06.273422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.274786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.275432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.473715 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2810b765-ad60-40ff-b10e-cbf1cfe6f11c tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.315729 Sep 08 10:32:06.475020 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2158/4108] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:32:06 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:06.503192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a71485db-98ea-4b3d-a63a-4d819e3064dc tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:06.512473 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a71485db-98ea-4b3d-a63a-4d819e3064dc tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015307 Sep 08 10:32:06.513859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1951/4109] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:32:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:06.701168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0d200d85-800d-4311-b021-f37c29a3e3f9 req-3dec4536-b206-4624-ba51-5eddda2268c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfe335c-1c4c-41d4-983b-19732d20d69b", "name": "network-vif-deleted", "tag": "207e0abb-1169-4d73-80cb-4e6e4109055d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:06.724370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0d200d85-800d-4311-b021-f37c29a3e3f9 req-3dec4536-b206-4624-ba51-5eddda2268c5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.725171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0d200d85-800d-4311-b021-f37c29a3e3f9 req-3dec4536-b206-4624-ba51-5eddda2268c5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.726718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0d200d85-800d-4311-b021-f37c29a3e3f9 req-3dec4536-b206-4624-ba51-5eddda2268c5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.744627 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0d200d85-800d-4311-b021-f37c29a3e3f9 req-3dec4536-b206-4624-ba51-5eddda2268c5 service nova] Creating event network-vif-deleted:207e0abb-1169-4d73-80cb-4e6e4109055d for instance bdfe335c-1c4c-41d4-983b-19732d20d69b on n-h1-833090-19 Sep 08 10:32:06.750080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0d200d85-800d-4311-b021-f37c29a3e3f9 req-3dec4536-b206-4624-ba51-5eddda2268c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053874 Sep 08 10:32:06.751022 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2159/4110] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:06.881157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:06.882915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:06.899258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.901068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.901951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.904934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.905717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.907745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.944691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:06.946221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:06.959418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.962388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.963025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.968128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:06.968658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:06.969337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:06.980076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:32:07.036105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:07.037008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:07.038222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:07.038887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid bdfe335c-1c4c-41d4-983b-19732d20d69b {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:32:07.136261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:07.141425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b3bffd52-8161-41b0-a48d-a8386ff76c7a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 204 len: 0 microversion: 2.1 time: 0.264365 Sep 08 10:32:07.142846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1952/4111] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:32:06 2022] DELETE /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:32:07.150407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:07.155123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:07.156194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:07.162359 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f168e75-fef2-4b9d-a61a-4782f23f6229 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1317 microversion: 2.1 time: 0.223969 Sep 08 10:32:07.163200 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2160/4112] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:06 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:07.164113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:07.164796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:07.165342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:07.166384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:07.166957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:07.167564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:07.278294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:07.279126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:07.286207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:07.286699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:07.287297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:07.288308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:07.288975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:07.289642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:07.551772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:07.566078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c59d9a72-ca22-4896-b251-af840b0c58ee tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1699 microversion: 2.1 time: 0.417224 Sep 08 10:32:07.566859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1953/4113] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:07 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1699 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:07.620534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:07.629121 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf49a9e6-cfae-48aa-94b4-57356c428efe tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.354628 Sep 08 10:32:07.629809 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2161/4114] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:07 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:08.192701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:08.193514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:08.209723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.210230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.210890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:08.211855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.212483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.213287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:08.289542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.290405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.291196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:08.292061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid bdfe335c-1c4c-41d4-983b-19732d20d69b {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:32:08.349169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:08.361538 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d324f92-d22c-480b-9999-204c6cb5e368 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 200 len: 1317 microversion: 2.1 time: 0.174453 Sep 08 10:32:08.362403 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1954/4115] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:08 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:08.593366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:08.594006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:08.615542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.621944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.622500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:08.625715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.626122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.627765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:08.658443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:08.659951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:08.684393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.685990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.686718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:08.691798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:08.693305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:08.697917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:09.119915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:09.131925 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19279912-b8db-42b6-9619-330e2599a5b7 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1699 microversion: 2.1 time: 0.542442 Sep 08 10:32:09.135983 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2162/4116] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:08 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1699 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:09.162204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:09.174156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-824d2a95-01f1-4003-aa2d-c81b6bc25851 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.524032 Sep 08 10:32:09.174755 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1955/4117] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:08 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:09.386156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:09.386776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:09.393777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:09.394507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:09.395193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:09.395945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:09.397077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:09.397527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:09.415977 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b HTTP/1.1 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bdfe335c-1c4c-41d4-983b-19732d20d69b'} Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:32:09.419437 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:32:09.424115 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d77f573-bcd5-4981-b0ee-fdd847d7be19 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 404 len: 111 microversion: 2.1 time: 0.040472 Sep 08 10:32:09.426747 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2163/4118] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:09 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:32:09.431981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f46b5ce4-9759-4361-8131-789875f3f917 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '.version_select at 0x7f2350bd0820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:09.470598 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f46b5ce4-9759-4361-8131-789875f3f917 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-key-656747715" status: 202 len: 0 microversion: 2.1 time: 0.042452 Sep 08 10:32:09.472229 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1956/4119] 10.222.0.59 () {58 vars in 1206 bytes} [Thu Sep 8 10:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-656747715 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:32:09.594395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1477330548", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:09.677939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-894fb864-3188-46f7-bf44-19186eb08f44 req-cae67cde-3557-4729-a368-5075955baa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a600b74-6a49-4a29-874a-10b7e802b122", "name": "network-vif-unplugged", "status": "completed", "tag": "53d02017-9557-49d2-8fe6-2bff76dce083"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:09.688712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-894fb864-3188-46f7-bf44-19186eb08f44 req-cae67cde-3557-4729-a368-5075955baa72 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:09.689573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-894fb864-3188-46f7-bf44-19186eb08f44 req-cae67cde-3557-4729-a368-5075955baa72 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:09.690278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-894fb864-3188-46f7-bf44-19186eb08f44 req-cae67cde-3557-4729-a368-5075955baa72 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:09.694150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:32:09.706219 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-894fb864-3188-46f7-bf44-19186eb08f44 req-cae67cde-3557-4729-a368-5075955baa72 service nova] Creating event network-vif-unplugged:53d02017-9557-49d2-8fe6-2bff76dce083 for instance 9a600b74-6a49-4a29-874a-10b7e802b122 on n-h1-833090-19 Sep 08 10:32:09.714387 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-894fb864-3188-46f7-bf44-19186eb08f44 req-cae67cde-3557-4729-a368-5075955baa72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044482 Sep 08 10:32:09.715624 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1957/4120] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:10.161816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:10.166641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:10.167346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:10.174428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:10.175290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:10.175986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:10.176918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:10.177575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:10.178201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:10.612453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:10.621253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b1a4bdd-df00-432d-96e2-95c495db9e0a tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1699 microversion: 2.1 time: 0.460297 Sep 08 10:32:10.622020 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1958/4121] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:10 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1699 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:10.626947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:10.627907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:10.634738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:10.635324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:10.635800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:10.636535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:10.636968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:10.637397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:10.654013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:11.024443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:32:11.024968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:32:11.025274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:32:11.025748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:32:11.026353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:32:11.035943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:11.037607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:11.038407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:11.039783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:11.040696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:11.041337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:11.076483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:11.078845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:11.085154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:11.088430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:11.107574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:32:11.111682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:32:11.119647 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50f93898-7c95-4b39-a28b-e205b24eab3f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.496304 Sep 08 10:32:11.120507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1959/4122] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:10 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:11.166278 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d9f6960f-2de2-41e3-ad9c-90af9160d508 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575473 Sep 08 10:32:11.167299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2164/4123] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:32:11.179309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c65fdca-b74c-4b60-b1fc-dafc30713d2a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:11.180497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c65fdca-b74c-4b60-b1fc-dafc30713d2a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:11.267861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8c65fdca-b74c-4b60-b1fc-dafc30713d2a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:11.282509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c65fdca-b74c-4b60-b1fc-dafc30713d2a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1209 microversion: 2.1 time: 0.107847 Sep 08 10:32:11.288956 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1960/4124] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:11 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:11.646360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:11.646984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:11.661453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:11.663688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:11.667722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:11.668710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:11.669815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:11.670239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:11.695802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:11.714641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-655f0236-645a-41fc-b17a-3f2b6930b437 req-5e7555a9-97ce-4b89-9ec4-fc068c6825f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a600b74-6a49-4a29-874a-10b7e802b122", "name": "network-vif-deleted", "tag": "53d02017-9557-49d2-8fe6-2bff76dce083"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:11.740505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-655f0236-645a-41fc-b17a-3f2b6930b437 req-5e7555a9-97ce-4b89-9ec4-fc068c6825f1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:11.744326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-655f0236-645a-41fc-b17a-3f2b6930b437 req-5e7555a9-97ce-4b89-9ec4-fc068c6825f1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:11.744976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-655f0236-645a-41fc-b17a-3f2b6930b437 req-5e7555a9-97ce-4b89-9ec4-fc068c6825f1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:11.766640 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-655f0236-645a-41fc-b17a-3f2b6930b437 req-5e7555a9-97ce-4b89-9ec4-fc068c6825f1 service nova] Creating event network-vif-deleted:53d02017-9557-49d2-8fe6-2bff76dce083 for instance 9a600b74-6a49-4a29-874a-10b7e802b122 on n-h1-833090-19 Sep 08 10:32:11.803447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-655f0236-645a-41fc-b17a-3f2b6930b437 req-5e7555a9-97ce-4b89-9ec4-fc068c6825f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090926 Sep 08 10:32:11.804141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1961/4125] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:11.818227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-bc5cb05e-454c-42db-8558-fa34d8a1c809 req-f18d2c71-ffcf-43b8-be74-e885185ec21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c428be4-d1e0-4c04-a3f9-50d787654006", "name": "network-vif-plugged", "status": "completed", "tag": "3a280d5b-ebf7-420d-bf18-1edae29fc63c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:11.837653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089da7972e3d46a88e8e9403346e1c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b87c6f7be904e8da5a4e65f60ae8c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:11.849894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bc5cb05e-454c-42db-8558-fa34d8a1c809 req-f18d2c71-ffcf-43b8-be74-e885185ec21a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:11.850979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bc5cb05e-454c-42db-8558-fa34d8a1c809 req-f18d2c71-ffcf-43b8-be74-e885185ec21a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:11.853207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bc5cb05e-454c-42db-8558-fa34d8a1c809 req-f18d2c71-ffcf-43b8-be74-e885185ec21a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:11.853976 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-851f630f-7880-4339-9ddb-2cd1fb3580c4 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 200 len: 1631 microversion: 2.1 time: 0.211725 Sep 08 10:32:11.868172 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2165/4126] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:11 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 1631 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:11.908452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-bc5cb05e-454c-42db-8558-fa34d8a1c809 req-f18d2c71-ffcf-43b8-be74-e885185ec21a service nova] Creating event network-vif-plugged:3a280d5b-ebf7-420d-bf18-1edae29fc63c for instance 8c428be4-d1e0-4c04-a3f9-50d787654006 on n-h2-833090-19 Sep 08 10:32:11.926317 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-bc5cb05e-454c-42db-8558-fa34d8a1c809 req-f18d2c71-ffcf-43b8-be74-e885185ec21a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118899 Sep 08 10:32:11.927430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1962/4127] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:12.147194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:12.149657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:12.167757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:12.168403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:12.168870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:12.171308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:12.171994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:12.172442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:12.316262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:12.316924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:12.324560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:12.325062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:12.325506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:12.326232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:12.326695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:12.327124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:12.885296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:12.894159 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63d30fbf-4881-4782-a8a5-b31effe5abd4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1205 microversion: 2.1 time: 0.582285 Sep 08 10:32:12.894950 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1963/4128] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:12 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1205 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:12.910752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:12.911689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] [instance: 9a600b74-6a49-4a29-874a-10b7e802b122] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:12.919610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:12.920443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:12.921071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:12.921986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:12.922621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:12.923228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:12.943686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] HTTP exception thrown: Instance 9a600b74-6a49-4a29-874a-10b7e802b122 could not be found. Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Request method failure captured: Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 HTTP/1.1 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRrLvG210sWYBndZh7cq1w44ytUbf3ZN7ljpicPHNJuNtDRV28yu8TZnin29cBeFBrjS4n-y17qF66VLsWy1FfpP3eQzBCTP2ZIsJ9SyRhRTPN7zTwP5WgPxng5nzYrCnAuXRkQvlpowf5gi4YqMHmwODmSZFN1zpJQCuajgShZMI4 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5b87c6f7be904e8da5a4e65f60ae8c9d Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1157965047 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b87c6f7be904e8da5a4e65f60ae8c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5b87c6f7be904e8da5a4e65f60ae8c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5b87c6f7be904e8da5a4e65f60ae8c9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5b87c6f7be904e8da5a4e65f60ae8c9d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1157965047 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5b87c6f7be904e8da5a4e65f60ae8c9d Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1157965047 Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1157965047-project Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 089da7972e3d46a88e8e9403346e1c3a Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1157965047-project Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9a600b74-6a49-4a29-874a-10b7e802b122 could not be found. Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9a600b74-6a49-4a29-874a-10b7e802b122'} Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a600b74-6a49-4a29-874a-10b7e802b122 could not be found. Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a600b74-6a49-4a29-874a-10b7e802b122 could not be found. Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:32:12.945656 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a600b74-6a49-4a29-874a-10b7e802b122 could not be found. Sep 08 10:32:12.948928 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:32:12.950618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Returning 404 to user: Instance 9a600b74-6a49-4a29-874a-10b7e802b122 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:32:12.951702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dc06222f-360a-4497-8d23-8989182b7955 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122" status: 404 len: 111 microversion: 2.1 time: 0.055985 Sep 08 10:32:12.952766 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1964/4129] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:12 2022] GET /compute/v2.1/servers/9a600b74-6a49-4a29-874a-10b7e802b122 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:32:12.961344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86ee1e00-ca66-4d55-8952-157e51d945d9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] Calling method '.version_select at 0x7f23505e3160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:12.993530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:12.998190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86ee1e00-ca66-4d55-8952-157e51d945d9 tempest-ServersTestJSON-1157965047 tempest-ServersTestJSON-1157965047-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-370513525" status: 202 len: 0 microversion: 2.1 time: 0.040791 Sep 08 10:32:12.999094 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1965/4130] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:32:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-370513525 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:32:13.005218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-940bf3ae-e6ab-4727-8079-814a469eaeea tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.863025 Sep 08 10:32:13.006210 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2166/4131] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:12 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:13.918110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:13.919171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:13.938269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:13.939189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:13.940760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:13.941520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:13.944213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:13.944699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:14.030548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:14.032299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:14.066851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:14.067499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:14.071736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:14.072667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:14.075165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:14.079895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:14.125302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:14.137304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-64662fd6-d7de-4905-8203-2a5c49086c1d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1267 microversion: 2.1 time: 0.223798 Sep 08 10:32:14.138057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1966/4132] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:13 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:14.601231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:14.611427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-953f1122-af01-41c0-8fd5-25adb23b160d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1314 microversion: 2.1 time: 0.586469 Sep 08 10:32:14.612568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2167/4133] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:14 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:15.166585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:15.167861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:15.190052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:15.190762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:15.201524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:15.202931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:15.203711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:15.204322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:15.505703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:15.506195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:15.517289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:15.517768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:15.521657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:15.524903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:15.525661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:15.526247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:15.647994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:15.658267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db753b72-9c80-42af-a174-9b0e1d78af79 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.496127 Sep 08 10:32:15.658861 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1967/4134] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:15 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:15.672136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:15.672816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:15.692363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:15.692852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:15.694246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:15.695064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:15.695642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:15.696135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:15.713158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lazy-loading 'services' on Instance uuid 337703bb-dc79-4187-8fab-37fa4188823a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:32:15.836597 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79344f84-9d3f-4c5e-9b5e-8916367a471c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-volume_attachments/14d6a9a9-9896-4f3e-b5b2-af8cfb73bf71" status: 202 len: 0 microversion: 2.1 time: 0.334099 Sep 08 10:32:15.838765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2168/4135] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:32:15 2022] DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-volume_attachments/14d6a9a9-9896-4f3e-b5b2-af8cfb73bf71 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:32:16.194954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:16.213035 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f417212-8b74-4311-be4e-24babac42450 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1502 microversion: 2.1 time: 0.549501 Sep 08 10:32:16.213811 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1968/4136] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:15 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1502 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:16.238291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:16.239234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:16.247955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:16.248848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:16.249541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:16.250809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:16.251647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:16.252327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:16.288182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lazy-loading 'flavor' on Instance uuid 8c428be4-d1e0-4c04-a3f9-50d787654006 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:32:16.575700 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-feeea2c8-1647-4573-bdce-73a15e267d1a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006/action" status: 202 len: 0 microversion: 2.1 time: 0.341927 Sep 08 10:32:16.580327 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2169/4137] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:32:16 2022] POST /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:32:16.591192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:16.594171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:16.604862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:16.608596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:16.609501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:16.611272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:16.612191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:16.613131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:16.690032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:16.691082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:16.713575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:16.715419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:16.716269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:16.717319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:16.717933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:16.718462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:17.544307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:17.555360 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e76b66c-e19c-4113-a376-477e2fdeb988 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.970685 Sep 08 10:32:17.561497 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1969/4138] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:16 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:17.676174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:17.683101 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93c160b2-2c51-4954-a6e3-61138560daf7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 1.000143 Sep 08 10:32:17.684304 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2170/4139] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:16 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:17.869568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4f32ef26-9109-424d-8322-b54ae684607b req-e16d138e-0399-4b9b-9113-3b51c4d32643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5706297-ee53-472b-b105-a94832c371a7", "tag": "97a1016f-4ed4-4384-8f0e-7537f303067d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:17.932356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4f32ef26-9109-424d-8322-b54ae684607b req-e16d138e-0399-4b9b-9113-3b51c4d32643 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:17.933290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4f32ef26-9109-424d-8322-b54ae684607b req-e16d138e-0399-4b9b-9113-3b51c4d32643 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:17.936731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4f32ef26-9109-424d-8322-b54ae684607b req-e16d138e-0399-4b9b-9113-3b51c4d32643 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:17.968975 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4f32ef26-9109-424d-8322-b54ae684607b req-e16d138e-0399-4b9b-9113-3b51c4d32643 service nova] Creating event network-changed:97a1016f-4ed4-4384-8f0e-7537f303067d for instance e5706297-ee53-472b-b105-a94832c371a7 on n-h1-833090-19 Sep 08 10:32:17.976150 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4f32ef26-9109-424d-8322-b54ae684607b req-e16d138e-0399-4b9b-9113-3b51c4d32643 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112641 Sep 08 10:32:17.978121 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1970/4140] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:18.583135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:18.584745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:18.604962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:18.606539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:18.609696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:18.611982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:18.612717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:18.615581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:18.708186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:18.708931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:18.720559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:18.721119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:18.721899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:18.734999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:18.740727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:18.743625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:19.092550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:19.120114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b13b2f70-62a1-4960-b6bd-6947f1a66da3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.526597 Sep 08 10:32:19.122831 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2171/4141] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:18 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:19.210419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:19.234616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f9957763-bc84-4d6d-99e4-cda79cdc2d23 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.531917 Sep 08 10:32:19.245915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1971/4142] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:18 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:20.148758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:20.150182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:20.163364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:20.164795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:20.168076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:20.169503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:20.170906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:20.172424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:20.265816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:20.266785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:20.285134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:20.285673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:20.286200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:20.287788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:20.291793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:20.297632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:20.762309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:20.771437 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29f1bad4-b340-4179-b9e9-afceaf89fb05 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.628124 Sep 08 10:32:20.776475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2172/4143] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:20 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:21.077584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:21.090087 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-752f3252-2e3c-4d50-b885-b76d2186b94e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.828392 Sep 08 10:32:21.094862 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1972/4144] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:20 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:21.805139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:21.806482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:21.829121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:21.831060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:21.841093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:21.841754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:21.842295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:21.843135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:21.843853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:21.844278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:22.136686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:22.137883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:22.154264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:22.158436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:22.162516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:22.163917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:22.176428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:22.177627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:22.178253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:22.218248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:22.226448 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dcde2acd-ec2a-40d7-a5a3-d135d52a1f69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.428515 Sep 08 10:32:22.231301 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2173/4145] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:21 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:22.585170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:22.595855 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3fec3fc-17af-438c-ac13-5922a8f414d3 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.476351 Sep 08 10:32:22.608618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1973/4146] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:22 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:23.254202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:23.254855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:23.267967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:23.268895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:23.269925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:23.272459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:23.273674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:23.275488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:23.477723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2136727769", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "ea609200-903a-480c-8327-63bf38291252"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:23.489914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:23.505902 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c872c83-2ae5-4c55-8031-3248da42ca20 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.255608 Sep 08 10:32:23.510589 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1974/4147] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:23 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:23.569654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] validate_networks() for [('ea609200-903a-480c-8327-63bf38291252', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:32:23.621526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:23.622224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:23.633060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:23.636162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:23.636803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:23.637727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:23.638407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:23.639336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:23.954946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:23.974909 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1a60b7cd-c892-4cfe-a93c-1dfd204924bf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.356720 Sep 08 10:32:23.976334 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1975/4148] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:23 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:23.986126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb1f489a-22d8-4ab3-9cfc-489a3ed36515 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:24.000118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb1f489a-22d8-4ab3-9cfc-489a3ed36515 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:24.001391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb1f489a-22d8-4ab3-9cfc-489a3ed36515 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:24.002168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb1f489a-22d8-4ab3-9cfc-489a3ed36515 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:24.063975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb1f489a-22d8-4ab3-9cfc-489a3ed36515 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:32:24.162097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb1f489a-22d8-4ab3-9cfc-489a3ed36515 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action" status: 202 len: 0 microversion: 2.1 time: 0.183665 Sep 08 10:32:24.163093 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1976/4149] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:32:23 2022] POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:32:24.177599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:24.182048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:24.198048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:24.198937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:24.199770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:24.201043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:24.201871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:24.204040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:24.920043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:24.931180 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c8b0fc0-9045-4f9a-bbf3-893d434e166f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1679 microversion: 2.1 time: 0.762537 Sep 08 10:32:24.931997 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1977/4150] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:24 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1679 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:24.937215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:24.937894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:24.953058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:24.953635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:24.954284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:24.956044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:24.956590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:24.957242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:25.002469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:32:25.003038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:32:25.003601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:32:25.004018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:32:25.004577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:32:25.022270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:25.025129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:25.025575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:25.026353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:25.026800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:25.027228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:25.077802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Getting quotas for project beaeeece01104ca08b7362293f061037. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:25.084715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Getting quotas for user 02e6fae0553d463b9c7d029bda48989f and project beaeeece01104ca08b7362293f061037. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:25.100368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:32:25.103250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:32:25.160082 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98f0ce79-e5a1-4cab-9f70-04d87e9f45aa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069395 Sep 08 10:32:25.161294 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2174/4151] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:32:25.166271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:25.167109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:25.174696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:25.176537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:25.177206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:25.178316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:25.179128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:25.179835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:25.204701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:25.221915 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca6fd0b3-5b80-4a73-a1cf-6ec8b620e749 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.288565 Sep 08 10:32:25.222550 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1978/4152] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:24 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:25.281077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1815504729", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "ea609200-903a-480c-8327-63bf38291252"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:25.371208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] validate_networks() for [('ea609200-903a-480c-8327-63bf38291252', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:32:25.636139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:25.652462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4d4ddcb-7a86-40ce-9d87-fd7525bafd9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.487097 Sep 08 10:32:25.655667 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2175/4153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:25 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:25.957357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:25.957981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:25.972382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:25.972820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:25.973281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:25.973988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:25.975133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:25.975600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.512478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:32:26.512948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:32:26.513497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:32:26.513967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:32:26.514469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:32:26.551752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.552465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.553069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.554155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.555092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.555779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.584150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Getting quotas for project beaeeece01104ca08b7362293f061037. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:26.602625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Getting quotas for user 02e6fae0553d463b9c7d029bda48989f and project beaeeece01104ca08b7362293f061037. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:26.624051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:32:26.626660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:32:26.687251 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-71a2db68-77f5-48c3-8e2f-fcf4874541b5 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410221 Sep 08 10:32:26.688562 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1979/4154] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:32:26.695969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1aaf30cb-7281-4878-b9b1-a67e4411ecb8 req-a7e84871-2497-4884-a03d-a4c71a89208a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5706297-ee53-472b-b105-a94832c371a7", "name": "network-vif-plugged", "status": "completed", "tag": "97a1016f-4ed4-4384-8f0e-7537f303067d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:26.713655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1aaf30cb-7281-4878-b9b1-a67e4411ecb8 req-a7e84871-2497-4884-a03d-a4c71a89208a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.714941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1aaf30cb-7281-4878-b9b1-a67e4411ecb8 req-a7e84871-2497-4884-a03d-a4c71a89208a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.717541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1aaf30cb-7281-4878-b9b1-a67e4411ecb8 req-a7e84871-2497-4884-a03d-a4c71a89208a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.732550 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1aaf30cb-7281-4878-b9b1-a67e4411ecb8 req-a7e84871-2497-4884-a03d-a4c71a89208a service nova] Creating event network-vif-plugged:97a1016f-4ed4-4384-8f0e-7537f303067d for instance e5706297-ee53-472b-b105-a94832c371a7 on n-h1-833090-19 Sep 08 10:32:26.740676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1aaf30cb-7281-4878-b9b1-a67e4411ecb8 req-a7e84871-2497-4884-a03d-a4c71a89208a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050639 Sep 08 10:32:26.742831 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1980/4155] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:26.749296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:26.751210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:26.759437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.760465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.761166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.762113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.762797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.763752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.767688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:26.888855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:26.902583 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-84aa71a2-d5c3-4a01-85a9-9fd230d66adf tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1679 microversion: 2.1 time: 0.948980 Sep 08 10:32:26.903552 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2176/4156] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:25 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1679 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:26.915763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:26.916392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:26.930332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.932803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.933445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:26.935431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:26.937789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:26.938433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:27.520735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:27.534649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-232519ff-9f5c-4314-abe6-e2b4014be537 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.790285 Sep 08 10:32:27.536657 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1981/4157] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:26 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:27.556132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-725410600", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "451", "networks": [{"uuid": "ea609200-903a-480c-8327-63bf38291252"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:27.605817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:27.626701 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d22629f7-b6d9-4125-8bdd-450b4e8fa17d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1309 microversion: 2.1 time: 0.721712 Sep 08 10:32:27.632561 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2177/4158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:26 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1309 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:27.645247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] validate_networks() for [('ea609200-903a-480c-8327-63bf38291252', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:32:27.931052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:27.931709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:27.944501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:27.944920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:27.945914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:27.946641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:27.960659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:27.961630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:28.768553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:28.783555 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44a7d72d-1cff-4b0a-abec-366e7ab8c2f3 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1679 microversion: 2.1 time: 0.856117 Sep 08 10:32:28.784444 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2178/4159] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:27 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1679 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:28.816525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:28.817437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:28.865406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:28.866185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:28.869115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:28.870148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:28.871644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:28.873455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:29.835255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:32:29.836241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:32:29.836880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:32:29.837454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:32:29.838045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:32:29.852824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:29.853317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:29.856090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:29.856874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:29.860935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:29.861636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:29.904139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Getting quotas for project beaeeece01104ca08b7362293f061037. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:29.910529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Getting quotas for user 02e6fae0553d463b9c7d029bda48989f and project beaeeece01104ca08b7362293f061037. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:29.925912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:32:29.931488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:32:29.939477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:29.950469 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-158316eb-5648-4b94-add2-fc6f352cd3be tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 1.162573 Sep 08 10:32:29.951431 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2179/4160] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:28 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:29.957563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:29.958613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:29.966432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:29.967242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:29.967899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:29.968796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:29.969405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:29.970215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:29.989894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:30.017308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2720505-c461-4735-b4bb-d372a2600a0d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.476846 Sep 08 10:32:30.018191 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1982/4161] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:32:30.023632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-036256b2-94be-4036-a274-196a36f464ad req-01f82786-1b57-440d-b103-81a985c9b49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3668eaf7-daff-402c-b428-bb6d6188bc08", "tag": "5e094197-7caf-4cde-b31c-ec217cf6ef6d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:30.035589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:30.038483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-036256b2-94be-4036-a274-196a36f464ad req-01f82786-1b57-440d-b103-81a985c9b49a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:30.039239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-036256b2-94be-4036-a274-196a36f464ad req-01f82786-1b57-440d-b103-81a985c9b49a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:30.039845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-036256b2-94be-4036-a274-196a36f464ad req-01f82786-1b57-440d-b103-81a985c9b49a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:30.071952 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-036256b2-94be-4036-a274-196a36f464ad req-01f82786-1b57-440d-b103-81a985c9b49a service nova] Creating event network-changed:5e094197-7caf-4cde-b31c-ec217cf6ef6d for instance 3668eaf7-daff-402c-b428-bb6d6188bc08 on n-h1-833090-19 Sep 08 10:32:30.077154 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-036256b2-94be-4036-a274-196a36f464ad req-01f82786-1b57-440d-b103-81a985c9b49a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057461 Sep 08 10:32:30.078206 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1983/4162] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:30.085864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:30.086953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:30.093964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:30.094695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:30.095279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:30.096170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:30.096894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:30.097461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:30.864724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:30.877367 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b61e2d07-e793-4658-88c3-3257f70acd80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1490 microversion: 2.1 time: 0.924547 Sep 08 10:32:30.878113 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2180/4163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:29 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1490 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:30.883625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:30.884403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:30.890749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:30.891430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:30.892059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:30.892914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:30.893652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:30.894227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:30.953834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:30.964841 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-71716c15-36f0-4132-a7e9-ee392e7d695b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1679 microversion: 2.1 time: 0.885262 Sep 08 10:32:30.965760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1984/4164] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:30 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1679 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:30.989599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:30.990471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:30.998695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:30.999300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:30.999847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:31.001346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:31.001891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:31.002404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:31.041165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:31.056451 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6064dd84-124c-465e-93a0-8f74d794db6f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1224 microversion: 2.1 time: 0.177146 Sep 08 10:32:31.057315 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2181/4165] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:30 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1224 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:31.079440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1477330548", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:31.136265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:32:31.575134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:31.584274 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d2b909a-0255-4da5-85f6-e0c901bcba67 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.612617 Sep 08 10:32:31.584884 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1985/4166] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:30 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:31.999153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:32.001514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:32.010804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:32.012065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:32.014132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:32.015105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:32.015770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:32.017414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.024448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:32:33.025788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:33.029437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:32:33.033170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:32:33.051719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:32:33.052397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:32:33.091006 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f4c4061-05f1-4960-ab91-644a9d9cff4d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1679 microversion: 2.1 time: 1.099118 Sep 08 10:32:33.095256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.095511 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1986/4167] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:31 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1679 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:33.100809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.104742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.106476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:33.107529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.108166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.110694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:33.111226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.127583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.131451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.133630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.134742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.137639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.138301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.173787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:33.186621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:33.207400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:32:33.210281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:32:33.281514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da550083-69d7-455c-aa09-bea3c95e51ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.203503 Sep 08 10:32:33.290220 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2182/4168] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:32:33.296945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:33.298152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:33.306183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.306750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.307305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.308165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.308821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.309924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.350880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:33.369430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ed40a7a1-2ef7-47ae-bb72-41b1258dad22 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1278 microversion: 2.1 time: 0.272553 Sep 08 10:32:33.370048 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1987/4169] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:33 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:33.389750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0767b0bf-154d-4202-95f8-1ca0f4d900e8"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:33.399968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:33.416155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.416955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.417565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.418491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:33.419108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:33.420501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:33.719643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:33.731415 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5556fd27-edd5-47d2-9083-d395ab5770af tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.439172 Sep 08 10:32:33.734927 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2183/4170] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:33 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:33.747770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b39e41b-5848-49ce-8bd4-2a43a30dcf68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:33.748769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b39e41b-5848-49ce-8bd4-2a43a30dcf68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:33.959529 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d6d490c-95bd-4d66-bf72-c25d2932265a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578951 Sep 08 10:32:33.972237 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1988/4171] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:32:33 2022] POST /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:33.992529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b39e41b-5848-49ce-8bd4-2a43a30dcf68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:34.008857 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b39e41b-5848-49ce-8bd4-2a43a30dcf68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1209 microversion: 2.1 time: 0.272642 Sep 08 10:32:34.017231 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2184/4172] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:33 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1209 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:34.116174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:34.118123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:34.133631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:34.134704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:34.135295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:34.138346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:34.138861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:34.139304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:34.394256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:34.395482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:34.412254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:34.414475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:34.415423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:34.425044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:34.425716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:34.428373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:34.512260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:34.533920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-961cb7c6-c2c7-4786-8e5a-072ed737cec4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1679 microversion: 2.1 time: 0.422730 Sep 08 10:32:34.540429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1989/4173] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:34 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1679 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:34.587624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:34.603163 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f35ae454-513b-4c36-8fe5-d8fb9af0ace0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1278 microversion: 2.1 time: 0.213642 Sep 08 10:32:34.604505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2185/4174] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:34 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:34.760890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:34.761730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:34.777784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:34.782453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:34.783185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:34.784397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:34.785146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:34.786189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.037011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:35.037900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:35.054860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.056881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.058346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.061137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.061872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.063947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.309577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:35.319364 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c76403c1-8623-4f97-8a36-1e96968a96a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1261 microversion: 2.1 time: 0.286306 Sep 08 10:32:35.324922 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2186/4175] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:35 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1261 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:35.441188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:35.450298 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d497c5f3-fb42-4088-8cab-360630425b0c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.695662 Sep 08 10:32:35.456438 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1990/4176] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:34 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:35.570516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:35.571243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:35.598758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-25c2f378-5442-48a0-aa54-c17cd8102802 req-e1e193c1-e4bb-45f4-93b0-6039d99e261e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e724ec35-a517-469c-9395-3f0318a2024c", "tag": "c2781840-fb6e-4c56-9cc2-b29bb282e65b"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:35.621728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-25c2f378-5442-48a0-aa54-c17cd8102802 req-e1e193c1-e4bb-45f4-93b0-6039d99e261e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.626570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-25c2f378-5442-48a0-aa54-c17cd8102802 req-e1e193c1-e4bb-45f4-93b0-6039d99e261e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.628096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.628671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-25c2f378-5442-48a0-aa54-c17cd8102802 req-e1e193c1-e4bb-45f4-93b0-6039d99e261e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.628876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.643887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.645682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-25c2f378-5442-48a0-aa54-c17cd8102802 req-e1e193c1-e4bb-45f4-93b0-6039d99e261e service nova] Creating event network-changed:c2781840-fb6e-4c56-9cc2-b29bb282e65b for instance e724ec35-a517-469c-9395-3f0318a2024c on n-h2-833090-19 Sep 08 10:32:35.647048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.650659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.651178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.653155 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-25c2f378-5442-48a0-aa54-c17cd8102802 req-e1e193c1-e4bb-45f4-93b0-6039d99e261e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062306 Sep 08 10:32:35.654481 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1991/4177] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:32:35.662155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:35.663190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:35.671444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.672365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.673045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:35.673985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:35.674926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:35.675854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.257083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:36.268680 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c62dd05-e174-4ede-9e3a-0c960f07b349 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1656 microversion: 2.1 time: 0.706167 Sep 08 10:32:36.269203 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2187/4178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:35 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1656 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:36.295414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d000da0f-df1b-4b5d-ad1d-a1853eb446e6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:36.310077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d000da0f-df1b-4b5d-ad1d-a1853eb446e6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.310584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d000da0f-df1b-4b5d-ad1d-a1853eb446e6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.311128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d000da0f-df1b-4b5d-ad1d-a1853eb446e6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.373323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d000da0f-df1b-4b5d-ad1d-a1853eb446e6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Going to try to start instance {{(pid=122457) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:32:36.495432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:36.496685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d000da0f-df1b-4b5d-ad1d-a1853eb446e6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action" status: 202 len: 0 microversion: 2.1 time: 0.204199 Sep 08 10:32:36.516538 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2188/4179] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:32:36 2022] POST /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:32:36.535832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:36.536997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:36.544828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.546286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.546631 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3bb5c4b4-0faf-490e-b99c-5cb26c9ef267 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.886683 Sep 08 10:32:36.547320 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1992/4180] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:35 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:36.576182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:36.576815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:36.585823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.590510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.591929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.594704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.594838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.595336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.597161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.598086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.599235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.602386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.809484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:36.819811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d95a393-9133-4adb-8e6e-e9372e788585 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1267 microversion: 2.1 time: 0.300940 Sep 08 10:32:36.827600 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2189/4181] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:36 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:36.850116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:36.850803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:36.867650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.868163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.870868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:36.871655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:36.874905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:36.875387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:37.202890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:37.211084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c602606-5cca-4e8a-8e40-846244989157 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1665 microversion: 2.1 time: 0.381928 Sep 08 10:32:37.226668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:37.227378 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2190/4182] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:36 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1665 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:37.251768 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e35baeb2-af87-4165-bc62-a39dba76ca15 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.700906 Sep 08 10:32:37.252380 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1993/4183] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:36 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:37.574508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:37.575125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:37.589951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:37.592164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:37.592622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:37.593366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:37.593833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:37.594261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:37.833351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9f8a6b36-6e8f-4510-a9e3-457fd6013de4 req-6218ffc2-ee38-4c4d-8b01-3f6c9fd310fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3668eaf7-daff-402c-b428-bb6d6188bc08", "name": "network-vif-plugged", "status": "completed", "tag": "5e094197-7caf-4cde-b31c-ec217cf6ef6d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:37.851981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9f8a6b36-6e8f-4510-a9e3-457fd6013de4 req-6218ffc2-ee38-4c4d-8b01-3f6c9fd310fb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:37.852475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9f8a6b36-6e8f-4510-a9e3-457fd6013de4 req-6218ffc2-ee38-4c4d-8b01-3f6c9fd310fb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:37.860432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9f8a6b36-6e8f-4510-a9e3-457fd6013de4 req-6218ffc2-ee38-4c4d-8b01-3f6c9fd310fb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:37.878259 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9f8a6b36-6e8f-4510-a9e3-457fd6013de4 req-6218ffc2-ee38-4c4d-8b01-3f6c9fd310fb service nova] Creating event network-vif-plugged:5e094197-7caf-4cde-b31c-ec217cf6ef6d for instance 3668eaf7-daff-402c-b428-bb6d6188bc08 on n-h1-833090-19 Sep 08 10:32:37.898066 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9f8a6b36-6e8f-4510-a9e3-457fd6013de4 req-6218ffc2-ee38-4c4d-8b01-3f6c9fd310fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068980 Sep 08 10:32:37.899286 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1994/4184] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:32:37.906426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:37.919426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:37.927231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:37.928586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:37.929252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:37.940299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:37.941026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:37.941728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:37.961631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:37.975262 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d632fdfa-bf62-470a-ab28-3b3fcd05d7a7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.406272 Sep 08 10:32:37.976586 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2191/4185] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:37 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:38.252569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:38.254156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:38.271235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:38.273701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:38.274355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:38.275290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:38.275993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:38.276631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:38.448204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:38.461442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63d0e184-972d-4e7d-956a-001119e93a2f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1267 microversion: 2.1 time: 0.560164 Sep 08 10:32:38.464775 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1995/4186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:37 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1267 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:38.485557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:38.486188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:38.506839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:38.508424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:38.509063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:38.510153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:38.510755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:38.511330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:38.779495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:38.800401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc5902db-90ac-4a49-b314-3b054de19fd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1665 microversion: 2.1 time: 0.552467 Sep 08 10:32:38.802731 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2192/4187] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:38 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1665 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:38.944117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-26c50359-4bb3-4b3d-9db4-f33bd97318e4 req-2f93bf5a-2a33-44bc-9474-3f445e006e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a240bd1a-088d-4f3e-8bf0-db0a4cfa53df", "tag": "c8a794fe-d40f-4ea0-9bf3-1143b70ffb85"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:38.955544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:39.000618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7f138b1-2e9a-4214-87df-12666cf8e175 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.532209 Sep 08 10:32:39.004424 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1996/4188] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:38 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:39.019273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:39.021843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:39.027233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-26c50359-4bb3-4b3d-9db4-f33bd97318e4 req-2f93bf5a-2a33-44bc-9474-3f445e006e90 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.027755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-26c50359-4bb3-4b3d-9db4-f33bd97318e4 req-2f93bf5a-2a33-44bc-9474-3f445e006e90 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.028186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-26c50359-4bb3-4b3d-9db4-f33bd97318e4 req-2f93bf5a-2a33-44bc-9474-3f445e006e90 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.032772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.034305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.035130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.036635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.037651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.038450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.058472 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-26c50359-4bb3-4b3d-9db4-f33bd97318e4 req-2f93bf5a-2a33-44bc-9474-3f445e006e90 service nova] Creating event network-changed:c8a794fe-d40f-4ea0-9bf3-1143b70ffb85 for instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df on n-h1-833090-19 Sep 08 10:32:39.076473 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-26c50359-4bb3-4b3d-9db4-f33bd97318e4 req-2f93bf5a-2a33-44bc-9474-3f445e006e90 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139466 Sep 08 10:32:39.078869 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2193/4189] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:39.254608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:39.263682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a3aca74f-413f-43c4-a4a0-e1a46fe8f186 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.257721 Sep 08 10:32:39.264606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1997/4190] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:39 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:39.491073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:39.492259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:39.501871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.502384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.502827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.503568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.504029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.504457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.729215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:39.744571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-970d9e98-78b6-403e-8df5-9b6db749aa08 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.258130 Sep 08 10:32:39.745190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1998/4191] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:39 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:39.826845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:39.828051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:39.839156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.840179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.840772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.841639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.843598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.844195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.856909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:39.857523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:39.857703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:39.872312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.872824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.873269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.874002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:39.876083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:39.876690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:39.883093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:39.935299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:39.957845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67fbc986-a65e-486e-950e-cdf1446a0f62 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments/98a5b1b1-10b9-41c8-982a-598c6da6afa7" status: 200 len: 194 microversion: 2.20 time: 0.513567 Sep 08 10:32:39.964578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2194/4192] 10.222.0.59 () {60 vars in 1454 bytes} [Thu Sep 8 10:32:39 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments/98a5b1b1-10b9-41c8-982a-598c6da6afa7 => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:32:40.032840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:40.033457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:40.054011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:40.054894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:40.066486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:40.068320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:40.068973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:40.069566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:40.446657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:40.462403 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-37f7ff1d-a2ec-45ad-87ee-d59a2cf67c86 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1665 microversion: 2.1 time: 0.639349 Sep 08 10:32:40.463011 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 1999/4193] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:39 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1665 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:40.480548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:40.481059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:40.516325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:40.517053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:40.517504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:40.518429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:40.519036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:40.519803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:40.660432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:40.677639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-43ac8805-f981-453d-9359-f2397593ac9a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.648657 Sep 08 10:32:40.678404 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2195/4194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:40 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:40.702062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:40.702996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:40.706441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:40.714216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:40.715051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:40.715795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:40.716932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:40.718304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:40.719090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:40.814843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lazy-loading 'services' on Instance uuid f9caece1-c0d1-4b20-bb15-9156d669bcd8 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:32:41.022154 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-190b77c9-c692-418f-a415-f9f5e21c060d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments/98a5b1b1-10b9-41c8-982a-598c6da6afa7" status: 202 len: 0 microversion: 2.20 time: 0.557358 Sep 08 10:32:41.026933 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2000/4195] 10.222.0.59 () {60 vars in 1457 bytes} [Thu Sep 8 10:32:40 2022] DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments/98a5b1b1-10b9-41c8-982a-598c6da6afa7 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:32:41.036428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:41.040259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:41.061283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.061793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.064945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.065914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.066411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.069004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.540969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:41.559739 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35bee6da-6e78-49b2-a8a6-5d38b31b4dcd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.525144 Sep 08 10:32:41.560598 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2001/4196] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:41 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:41.582018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:41.584851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:41.601769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.602353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.602875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.603811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.616119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.616777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.668994 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5323d44-7e07-4b4c-9f36-58e268463186 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091098 Sep 08 10:32:41.673158 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2002/4197] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:41 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:32:41.678428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:41.679089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:41.686974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.687491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.687930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.689293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.689853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.690391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.718311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:41.727695 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f2961065-4090-46e2-bd69-762417b46ea8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 1.031566 Sep 08 10:32:41.728216 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2196/4198] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:40 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:41.743512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:41.744752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:41.765357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.765861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.766301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:41.767018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:41.767535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:41.767927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.260865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:42.276262 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-64868ad8-c3b4-476f-9d57-351bf70fc248 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1669 microversion: 2.1 time: 0.601083 Sep 08 10:32:42.313200 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2003/4199] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:41 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1669 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:42.383360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:42.395348 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5918bc08-e9f8-4edc-9609-f5c70f567bcd tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.666070 Sep 08 10:32:42.400071 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2197/4200] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:41 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:42.587702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:42.589378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:42.606129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.610303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.611118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.619623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.620599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.621260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.677616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e0d3f8f1-4814-4c9d-8e57-222000db85f9 req-af946d83-e364-4da6-a23d-3056e98a23df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820014b3-4ed2-4cc3-bb9a-b3266dcf3060", "tag": "328dad21-1f27-4a96-ae9a-f4c3998563ee"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:42.738436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e0d3f8f1-4814-4c9d-8e57-222000db85f9 req-af946d83-e364-4da6-a23d-3056e98a23df service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.739065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e0d3f8f1-4814-4c9d-8e57-222000db85f9 req-af946d83-e364-4da6-a23d-3056e98a23df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.739356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e0d3f8f1-4814-4c9d-8e57-222000db85f9 req-af946d83-e364-4da6-a23d-3056e98a23df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.745324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:42.756870 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e0d3f8f1-4814-4c9d-8e57-222000db85f9 req-af946d83-e364-4da6-a23d-3056e98a23df service nova] Creating event network-changed:328dad21-1f27-4a96-ae9a-f4c3998563ee for instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 on n-h1-833090-19 Sep 08 10:32:42.763397 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e0d3f8f1-4814-4c9d-8e57-222000db85f9 req-af946d83-e364-4da6-a23d-3056e98a23df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090220 Sep 08 10:32:42.765516 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2198/4201] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:42.789410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:42.795793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:42.816113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.816854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.820547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.821482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.822111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.822701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.870513 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf50e759-14e1-4924-89ae-89ec9d05b096 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103503 Sep 08 10:32:42.871721 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2199/4202] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:42 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:32:42.877778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:42.878607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:42.887383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.888851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.889519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:42.890718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:42.892183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:42.893118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:43.141355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:43.434195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:43.452314 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a45ed678-7dcb-4976-862d-17397eeb5bbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.873022 Sep 08 10:32:43.453094 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2004/4203] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:42 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:43.458193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:43.459103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:43.475696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:43.476797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:43.477598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:43.478627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:43.479315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:43.479955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:43.529319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:43.540445 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c274cf0-0975-4a27-a967-433dcd01770f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.667379 Sep 08 10:32:43.546193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2200/4204] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:42 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:43.789253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8fd54d45-4785-4d6c-9dc5-516cbdfaaebc req-cceb66ac-4c65-41a2-ab51-6efb39097960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e724ec35-a517-469c-9395-3f0318a2024c", "name": "network-vif-plugged", "status": "completed", "tag": "c2781840-fb6e-4c56-9cc2-b29bb282e65b"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:43.814129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8fd54d45-4785-4d6c-9dc5-516cbdfaaebc req-cceb66ac-4c65-41a2-ab51-6efb39097960 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:43.821351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8fd54d45-4785-4d6c-9dc5-516cbdfaaebc req-cceb66ac-4c65-41a2-ab51-6efb39097960 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:43.822096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8fd54d45-4785-4d6c-9dc5-516cbdfaaebc req-cceb66ac-4c65-41a2-ab51-6efb39097960 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:43.857417 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8fd54d45-4785-4d6c-9dc5-516cbdfaaebc req-cceb66ac-4c65-41a2-ab51-6efb39097960 service nova] Creating event network-vif-plugged:c2781840-fb6e-4c56-9cc2-b29bb282e65b for instance e724ec35-a517-469c-9395-3f0318a2024c on n-h2-833090-19 Sep 08 10:32:43.873788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8fd54d45-4785-4d6c-9dc5-516cbdfaaebc req-cceb66ac-4c65-41a2-ab51-6efb39097960 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090736 Sep 08 10:32:43.879588 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2201/4205] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:32:43.885464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:43.901593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:43.909178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:43.909721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:43.910292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:43.920650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:43.921557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:43.922171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:43.951492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:43.960149 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-47ee064a-c08d-42c2-ba23-fda5374a43c5 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.505660 Sep 08 10:32:43.970410 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2005/4206] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:43 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:44.004698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:44.016661 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-958cebdb-a761-46a6-8c2b-83b714abc0d3 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.131362 Sep 08 10:32:44.017957 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2202/4207] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:43 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:32:44.477866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:44.479072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:44.495606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:44.496191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:44.496571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:44.497303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:44.497768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:44.498195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:44.571891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:44.573175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:44.605839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:44.606516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:44.606982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:44.614225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:44.614671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:44.616028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:44.845526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:44.862178 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc3578e2-3b56-4c6f-8759-090011ea91fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.390313 Sep 08 10:32:44.864004 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2006/4208] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:44 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:44.887271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:44.899376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7cbb96ab-be7c-4bff-b4d6-3694d8c7c50a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.332660 Sep 08 10:32:44.917894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2203/4209] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:44 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:44.999125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:44.999870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:45.010176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.010758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.011263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.023108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.023808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.024328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.030953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:45.033616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:45.053000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.053496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.055920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.058323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.059963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.060425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.141561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0539ae1-84f6-44f5-8fe9-8e87131e9a60 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115388 Sep 08 10:32:45.142483 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2204/4210] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:45 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:32:45.264713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:45.282609 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0b697a90-24c7-4291-9e3d-7d3d52c96ee0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.286922 Sep 08 10:32:45.283300 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2007/4211] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:44 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:45.900386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:45.901586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:45.911132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.911942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.912796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.914832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.916176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.917261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.927401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:45.928312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:45.941530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.942119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.942629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:45.944072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:45.944623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:45.948110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:46.166790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:46.178641 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72323feb-e151-4f2b-a275-0e2d3c2bfb61 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.290097 Sep 08 10:32:46.182247 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2205/4212] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:45 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:46.194127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:46.197648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:46.217172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:46.217956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:46.218836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:46.222139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:46.222139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:46.222642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:46.246514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:46.256190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81162d9f-459f-4c33-b32f-91100b68ecbe tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.334073 Sep 08 10:32:46.258168 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2008/4213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:45 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:46.287868 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bca6787b-a251-4565-8f78-a1e2ee468e52 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103642 Sep 08 10:32:46.289214 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2206/4214] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:46 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:32:46.311351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:46.312289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:46.320221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:46.320957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:46.321562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:46.322472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:46.323064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:46.324032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:46.578076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:46.590374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cefbe1b-d80f-420e-9b1e-a6c8fe83a16e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.284529 Sep 08 10:32:46.605289 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2009/4215] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:46 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:46.629694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-167929218", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "90d9be0f-29d7-48af-b21f-4aa5d2cdf86d"}, {"uuid": "18444f53-d9ae-411b-88fb-1754db2713f6"}, {"uuid": "90d9be0f-29d7-48af-b21f-4aa5d2cdf86d"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:46.789534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] validate_networks() for [('90d9be0f-29d7-48af-b21f-4aa5d2cdf86d', None, None, None, None, None), ('18444f53-d9ae-411b-88fb-1754db2713f6', None, None, None, None, None), ('90d9be0f-29d7-48af-b21f-4aa5d2cdf86d', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:32:47.209230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:47.210494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:47.227543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:47.231249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:47.234754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:47.236363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:47.238985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:47.243563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:47.660210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:47.669487 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7737a78a-a35e-4bfe-b532-e81d22e5e7f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.465380 Sep 08 10:32:47.670097 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2010/4216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:47 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:47.685170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:47.685796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:47.712403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:47.712926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:47.713375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:47.720474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:47.722566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:47.723274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:48.003204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:48.011979 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c4ff535-fc86-4cae-81a0-a0214ee2f967 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.335977 Sep 08 10:32:48.017937 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2011/4217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:47 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:48.025269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:48.040965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:48.057906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:48.058372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:48.067784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:48.069395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:48.069522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:48.069993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:48.113873 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c46c0ae1-82b7-4ce6-8704-739a59ef31d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091615 Sep 08 10:32:48.115078 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2012/4218] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:48 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:32:48.121391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:48.123442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:48.131741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:48.133814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:48.135264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:48.136178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:48.136797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:48.137453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:48.500955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:48.510487 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe0d7b65-b16e-46fa-b022-2f9f55d77dbc tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1508 microversion: 2.1 time: 0.394047 Sep 08 10:32:48.513504 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2013/4219] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:48 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:48.692744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:48.693407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:48.708376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:48.718225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:48.719444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:48.725481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:48.726755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:48.727735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.036914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:49.051115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1939d0a9-bfdc-4c33-bc35-8dae06f80d00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.362389 Sep 08 10:32:49.051760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2014/4220] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:48 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:49.067412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f797b4d1-ea58-496d-bf59-9211376df6fb req-c0d0edbf-4d3a-4b95-a0bf-9ad8116b47d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a240bd1a-088d-4f3e-8bf0-db0a4cfa53df", "name": "network-vif-plugged", "status": "completed", "tag": "c8a794fe-d40f-4ea0-9bf3-1143b70ffb85"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:49.076375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f797b4d1-ea58-496d-bf59-9211376df6fb req-c0d0edbf-4d3a-4b95-a0bf-9ad8116b47d1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.076881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f797b4d1-ea58-496d-bf59-9211376df6fb req-c0d0edbf-4d3a-4b95-a0bf-9ad8116b47d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.077325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f797b4d1-ea58-496d-bf59-9211376df6fb req-c0d0edbf-4d3a-4b95-a0bf-9ad8116b47d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.082750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:49.095566 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f797b4d1-ea58-496d-bf59-9211376df6fb req-c0d0edbf-4d3a-4b95-a0bf-9ad8116b47d1 service nova] Creating event network-vif-plugged:c8a794fe-d40f-4ea0-9bf3-1143b70ffb85 for instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df on n-h1-833090-19 Sep 08 10:32:49.101721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f797b4d1-ea58-496d-bf59-9211376df6fb req-c0d0edbf-4d3a-4b95-a0bf-9ad8116b47d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047971 Sep 08 10:32:49.102493 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2015/4221] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:49.108480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:49.109222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:49.125982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.126643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.127157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.128804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.129281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.129716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.177718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:32:49.178179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:32:49.179015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:32:49.179478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:32:49.179912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:32:49.200621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.202020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.209652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.211198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.211853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.212432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.259653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Getting quotas for project 74ba3f7102ee4a859110d905535409c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:49.265387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Getting quotas for user 23f41725e5014fa0b415fefeb73352e6 and project 74ba3f7102ee4a859110d905535409c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:49.279257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:32:49.281875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:32:49.318238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:49.328644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0f5e1e3-0bb4-4c16-a8db-569be926d8f4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.224922 Sep 08 10:32:49.329900 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2016/4222] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:49 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:49.335012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:49.337779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:49.345225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.345925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.346516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.348240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.348702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.349302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.393423 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56773909-461e-462e-a0cc-7efe9affb184 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.767659 Sep 08 10:32:49.395536 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e746f37f-661a-432f-904a-a3424f30c5ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064388 Sep 08 10:32:49.397571 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2017/4223] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:32:49 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:49.398668 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2207/4224] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:32:49.426892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cf92b2ea-da94-44bc-9510-2b419ba839b2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:49.428304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cf92b2ea-da94-44bc-9510-2b419ba839b2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:49.497097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cf92b2ea-da94-44bc-9510-2b419ba839b2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:49.505130 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cf92b2ea-da94-44bc-9510-2b419ba839b2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1212 microversion: 2.1 time: 0.090586 Sep 08 10:32:49.507004 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2018/4225] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:49 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:49.529813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:49.530636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:49.539931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:49.540673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:49.557380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.560590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.561608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.563100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.563912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.565492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.581734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.582388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.582845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:49.585836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:49.586311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.596505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:49.683560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:32:49.994534 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29abe19e-6f73-4955-adb8-a43ec6cbdf73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 204 len: 0 microversion: 2.20 time: 0.468799 Sep 08 10:32:50.013164 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2208/4226] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:32:49 2022] DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:32:50.024179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:50.039139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:50.073890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.074066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.074497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.075232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.075727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.076160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.106094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:50.120711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'flavor' on Instance uuid 48ae1c59-e738-4c93-891f-f3fd33f5568c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:32:50.121887 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad773f51-f660-4d97-a818-483f3a538c33 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1529 microversion: 2.1 time: 0.587266 Sep 08 10:32:50.122505 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2019/4227] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:49 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1529 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:50.140572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:50.141509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:50.156737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.157245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.161313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.166742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.171618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.174626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.430565 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-de96e58d-8388-4761-8d9e-db5fbd3a4820 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/action" status: 200 len: 32 microversion: 2.1 time: 0.415389 Sep 08 10:32:50.432927 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2209/4228] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:32:50 2022] POST /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:32:50.453428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:50.454874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:50.458888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:50.471408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:50.474047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:50.476570 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c757812f-3ccd-41c5-a981-08da016591d8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.352978 Sep 08 10:32:50.477447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.477706 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2020/4229] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:32:50 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:32:50.479524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.480135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.482407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.482956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.483917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.484145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:50.484920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:50.492820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.493621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.494228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.495412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.496127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.496804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.812004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:50.824051 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7038abc-e13a-4f9c-b9d0-111b72f8f5c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1320 microversion: 2.1 time: 0.345007 Sep 08 10:32:50.824713 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2021/4230] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:50 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1320 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:50.861626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:50.877806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:50.878701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:50.883781 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18ba77e0-9ac7-4e08-be13-8a1aceee9c94 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.448063 Sep 08 10:32:50.884793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2210/4231] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:50 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:50.891230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.895772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.897609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.898392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.898863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.899296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.899995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:50.900648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:50.920733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.921227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.921705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:50.922420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:50.922870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:50.923294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.118094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:51.135499 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ede0a50a-dd1f-48a5-be08-2fcd2e77e096 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1216 microversion: 2.1 time: 0.244587 Sep 08 10:32:51.137147 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2211/4232] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:50 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:51.159013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:51.164128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:51.182786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.183571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.184287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.190770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.191324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.191758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.377041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:51.387899 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0219b1bc-aa29-4775-83ae-a4cddce68479 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.534309 Sep 08 10:32:51.389132 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2022/4233] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:50 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:51.496417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:51.505429 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f1df666-7fd0-4bd5-8fb2-fcf89f4c48b0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1529 microversion: 2.1 time: 0.357015 Sep 08 10:32:51.506321 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2212/4234] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:51 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1529 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:51.521270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:51.521886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:51.531225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.531761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.532200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.532910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.533363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.533868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.858136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:51.859929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:51.876759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.880245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.881349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.884313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:51.887849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.888531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.889153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.893088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:51.894854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:51.906743 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b2a69a0-0044-4ab8-9e9c-ed8d188ffb8e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.400355 Sep 08 10:32:51.908396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:51.916878 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2023/4235] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:32:51 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:32:51.937481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:51.946553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:51.967607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.971124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.974937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:51.976156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:51.979233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:51.980434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.318781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:52.329034 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0fdb7aaf-3d66-49a9-aef7-cba350ffc353 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.411054 Sep 08 10:32:52.330046 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2024/4236] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:51 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:52.346042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:52.356272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:52.365122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.365783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.366500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.367241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.368538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.368988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.427903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:52.441426 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-735b43df-6381-482d-82d8-60f3da5acd69 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1510 microversion: 2.1 time: 0.594203 Sep 08 10:32:52.442594 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2213/4237] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:51 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1510 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:52.452312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:52.453376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:52.463573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.467067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.471619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.472668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.473338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.473998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.488507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:52.502157 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f2976d5-34e7-4c02-8130-2b7169be6687 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1264 microversion: 2.1 time: 0.170489 Sep 08 10:32:52.503411 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2025/4238] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:52 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:52.509360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-729382f6-9eb1-4666-b0c3-6445bc679ab5 req-dd9682ad-7614-4ad8-9480-36822041612c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c428be4-d1e0-4c04-a3f9-50d787654006", "name": "network-vif-plugged", "status": "completed", "tag": "3a280d5b-ebf7-420d-bf18-1edae29fc63c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:52.529933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-729382f6-9eb1-4666-b0c3-6445bc679ab5 req-dd9682ad-7614-4ad8-9480-36822041612c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.530869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-729382f6-9eb1-4666-b0c3-6445bc679ab5 req-dd9682ad-7614-4ad8-9480-36822041612c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.531985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-729382f6-9eb1-4666-b0c3-6445bc679ab5 req-dd9682ad-7614-4ad8-9480-36822041612c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.550872 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-729382f6-9eb1-4666-b0c3-6445bc679ab5 req-dd9682ad-7614-4ad8-9480-36822041612c service nova] Creating event network-vif-plugged:3a280d5b-ebf7-420d-bf18-1edae29fc63c for instance 8c428be4-d1e0-4c04-a3f9-50d787654006 on n-h2-833090-19 Sep 08 10:32:52.557958 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-729382f6-9eb1-4666-b0c3-6445bc679ab5 req-dd9682ad-7614-4ad8-9480-36822041612c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052994 Sep 08 10:32:52.559975 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2026/4239] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:52.567180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:52.568086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:52.581385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.583088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.583801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.585150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.585830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.586580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.692025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:52.704296 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-921eebf0-6ac3-4c83-be6f-263137fc2e0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.260374 Sep 08 10:32:52.705251 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2214/4240] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:52 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:52.722051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:52.723000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:52.730433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.731233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.731789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.732711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.733376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.734072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.865725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:52.876035 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9bfb4f1e-98a2-42ec-9362-98897f59a94d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1512 microversion: 2.1 time: 0.314558 Sep 08 10:32:52.880077 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2027/4241] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:52 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:52.902538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:52.903377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:52.910917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.912240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.912852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:52.914867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:52.915510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:52.916127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:53.245507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:53.281493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5443da52-b0a0-457c-b378-ac4d55ea269e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1529 microversion: 2.1 time: 0.571423 Sep 08 10:32:53.301445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2215/4242] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:52 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1529 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:53.319377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:53.320951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:53.337130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:53.337872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:53.338469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:53.340578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:53.342747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:53.343455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:53.388101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:53.399207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ab7e5b8-c65f-4536-b999-b42fb4ec6445 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1511 microversion: 2.1 time: 0.501099 Sep 08 10:32:53.423368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2028/4243] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:52 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:53.434811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:53.437308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:53.444686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:53.446172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:53.446816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:53.447904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:53.448802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:53.449459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.016807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.026567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.028501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.030073 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63e07185-3290-4a53-ae23-e22916f1d1a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1723 microversion: 2.20 time: 0.727362 Sep 08 10:32:54.030578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2216/4244] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:32:53 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1723 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:32:54.035342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:54.045522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.048738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.050510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:54.066658 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23c8d3a3-006e-42ed-a14b-c81d0bea4db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.639263 Sep 08 10:32:54.067041 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2029/4245] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:53 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:54.072039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:54.072845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:54.079309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.080069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.080658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.081513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.082111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.082711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.084358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.084854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.085935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.096052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.096638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.097092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.180710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.190172 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-750378aa-ea27-47e7-9574-fa2cf0a5dad6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1270 microversion: 2.1 time: 0.121879 Sep 08 10:32:54.192105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2030/4246] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:54 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:54.202644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:54.203776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:54.215576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:54.222828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.222828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.223080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.223828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.224312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.224741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.321203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.328059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.329122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.330155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.619889 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97a8b040-c363-44e4-96bd-d28527d711d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.588064 Sep 08 10:32:54.621374 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2217/4247] 10.222.0.59 () {58 vars in 1167 bytes} [Thu Sep 8 10:32:54 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:54.629108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:54.629946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:54.641577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.643492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.644087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.646950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:54.648213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:54.649035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:54.973097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:54.982426 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7727237-bb82-4125-bbfe-1f9bc582aef1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.788929 Sep 08 10:32:54.983030 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2031/4248] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:54 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:54.987747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-bfe811dd-d143-480c-8430-e18073029549 req-75842194-095c-4b8c-b501-e97b3d294fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820014b3-4ed2-4cc3-bb9a-b3266dcf3060", "name": "network-vif-plugged", "status": "completed", "tag": "328dad21-1f27-4a96-ae9a-f4c3998563ee"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:55.002992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:55.005227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bfe811dd-d143-480c-8430-e18073029549 req-75842194-095c-4b8c-b501-e97b3d294fd0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.006765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bfe811dd-d143-480c-8430-e18073029549 req-75842194-095c-4b8c-b501-e97b3d294fd0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.007414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bfe811dd-d143-480c-8430-e18073029549 req-75842194-095c-4b8c-b501-e97b3d294fd0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.033149 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-bfe811dd-d143-480c-8430-e18073029549 req-75842194-095c-4b8c-b501-e97b3d294fd0 service nova] Creating event network-vif-plugged:328dad21-1f27-4a96-ae9a-f4c3998563ee for instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 on n-h1-833090-19 Sep 08 10:32:55.048943 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-bfe811dd-d143-480c-8430-e18073029549 req-75842194-095c-4b8c-b501-e97b3d294fd0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064415 Sep 08 10:32:55.050216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2032/4249] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:55.057658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:55.063887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.065055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2136727769', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:55.071271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.072075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.072674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.074008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.074638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.075802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.202671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.207255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:55.211373 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18a4c374-79b4-41b4-b1ad-a5349633ba06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1529 microversion: 2.1 time: 0.587751 Sep 08 10:32:55.215086 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2218/4250] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:54 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1529 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:55.226514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:55.232271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:55.239026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.239771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.240396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.242213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.243168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.244032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.347787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.357370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.359309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.360367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.361128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.367412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.368883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.375246 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5c94b629-4def-41a2-913f-53061bb63c9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 200 len: 1656 microversion: 2.20 time: 0.158320 Sep 08 10:32:55.378181 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2219/4251] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:32:55 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:32:55.387083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:55.387734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:55.417766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.420570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.421217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.422138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.425138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.425789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.583984 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ab0d8f02-26eb-4ac7-a0a4-3994c9233fdf tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2136727769" status: 200 len: 1515 microversion: 2.1 time: 0.531777 Sep 08 10:32:55.585755 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2033/4252] 10.222.0.59 () {58 vars in 1263 bytes} [Thu Sep 8 10:32:55 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2136727769 => generated 1515 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:55.595594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:55.602168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:55.623179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.624050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.624748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.626931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.627687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.630561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.640676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:55.798733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.809771 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ce8a5cf-3280-4af5-9fe5-3b4ce9d6032d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.428170 Sep 08 10:32:55.812509 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2220/4253] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:55 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:55.827371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-306a2810-483c-4e2f-a597-354c6248bee6 req-41c714b0-0de2-4c72-8d03-a01bd8dc3b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9caece1-c0d1-4b20-bb15-9156d669bcd8", "name": "network-vif-deleted", "tag": "a7b2a2b9-5d24-41ee-bbff-c85ff72593d2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:55.886765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-306a2810-483c-4e2f-a597-354c6248bee6 req-41c714b0-0de2-4c72-8d03-a01bd8dc3b61 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.887260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-306a2810-483c-4e2f-a597-354c6248bee6 req-41c714b0-0de2-4c72-8d03-a01bd8dc3b61 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.887751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-306a2810-483c-4e2f-a597-354c6248bee6 req-41c714b0-0de2-4c72-8d03-a01bd8dc3b61 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.936303 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-306a2810-483c-4e2f-a597-354c6248bee6 req-41c714b0-0de2-4c72-8d03-a01bd8dc3b61 service nova] Creating event network-vif-deleted:a7b2a2b9-5d24-41ee-bbff-c85ff72593d2 for instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 on n-h2-833090-19 Sep 08 10:32:55.949396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-306a2810-483c-4e2f-a597-354c6248bee6 req-41c714b0-0de2-4c72-8d03-a01bd8dc3b61 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132140 Sep 08 10:32:55.950403 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2221/4254] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:55.958365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:55.964328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:55.965735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:55.989530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.992308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.993188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:55.996669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:55.997432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:55.998073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.033998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:56.054511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ff81809-0ab9-4a07-9a88-e8b20c540a99 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1312 microversion: 2.1 time: 0.466306 Sep 08 10:32:56.083344 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2034/4255] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:55 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:56.101291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:56.107948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:56.137573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.138080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.138522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.139243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.139724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.149759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.200709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:56.294755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:56.303901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.304807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.305451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.575134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:56.608776 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e2231fa7-080a-4dd9-ad94-f93e17f48691 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.515265 Sep 08 10:32:56.636487 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2035/4256] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:56 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:56.651686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:56.652600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:56.669360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.672676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.674774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.679284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.679824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.680277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.734294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-acc8e5ee-0dd0-4ffe-8d87-b08530fb5d52 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.782368 Sep 08 10:32:56.735550 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2222/4257] 10.222.0.59 () {58 vars in 1173 bytes} [Thu Sep 8 10:32:55 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:56.742043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:56.743772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:56.785251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.785921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.793941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.795064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.795809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.796948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.843483 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] HTTP exception thrown: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Request method failure captured: Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 HTTP/1.1 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOELNILFdXXwetg1qLtNPYWapnbPiYgzKI5ouAU87UP18x6pqWOOgsZZ0DFkaORfznPB5jLTzY9pJgoI1uYWbpZR8RNRDFbeZtV8m0Msaz0bUBkWrp6kmglz69klmkc4353VxGe5fBPRlTvW45SIwzogvsBkVRr7Xpyvfv9f58tmPw Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3a73a158fede41208b272a3e9c4d6e47", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 98c97cd324034c9297200125111c3029 Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f9caece1-c0d1-4b20-bb15-9156d669bcd8'} Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:56.849013 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:32:56.853215 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:32:56.858849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Returning 404 to user: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:32:56.859985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd468c26-9ae6-4384-b7f0-6dbb10943067 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 404 len: 111 microversion: 2.20 time: 0.122968 Sep 08 10:32:56.860676 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2223/4258] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:32:56 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:32:56.868059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:56.876169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:56.876938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.servers [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Removing options 'limit' from query {{(pid=122457) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:32:56.877932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:56.885102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.885879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.886551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.887699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.888335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.888925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.959137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:56.972320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:56.981934 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e3f04a4-17ff-401c-ae59-f37f4bacced6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.343578 Sep 08 10:32:56.982535 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2036/4259] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:56 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:56.988256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:56.993011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:56.993931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:56.994437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:56.999378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:57.007892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.014018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.014480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.015226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.016270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.018090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.250043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7b5bebb-ec89-4c38-9e7a-c760cc741a25 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.387924 Sep 08 10:32:57.251500 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2224/4260] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 10:32:56 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:57.257564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-50ae66cb-48c3-4175-a2d3-1814179e0799 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '.version_select at 0x7f2350a63040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:57.298361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-50ae66cb-48c3-4175-a2d3-1814179e0799 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779031383" status: 204 len: 0 microversion: 2.20 time: 0.045795 Sep 08 10:32:57.302572 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2225/4261] 10.222.0.59 () {60 vars in 1262 bytes} [Thu Sep 8 10:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779031383 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:32:57.302709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:57.310297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:57.311062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:57.316992 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea9c2d3b-9603-4899-aea2-99b90bc1df8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1309 microversion: 2.1 time: 0.333134 Sep 08 10:32:57.317952 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2037/4262] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:56 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1309 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:57.326538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.329498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.330134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.334126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:57.335568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.336161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.344164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.351732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:57.353580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:57.370108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.373186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.374941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.398121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.399439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.400054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.549901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:57.648930 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e332b1e2-ae75-4e48-9e0e-762f1117eb86 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.328837 Sep 08 10:32:57.651003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:57.661898 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2038/4263] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:32:57 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:57.670972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:57.672379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:57.681295 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54b7dd86-7e7e-4545-8786-5926231cb51d tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1312 microversion: 2.1 time: 0.378072 Sep 08 10:32:57.681920 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2226/4264] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:57 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1312 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:57.690834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.691616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.692381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.693311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.693960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.695246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.708403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:57.732602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:57.733395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.servers [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Removing options 'limit' from query {{(pid=122457) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:32:57.734258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:57.745645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.751772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.752495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.753482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.754190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.754804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.811004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:57.902302 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c2a7b9a-fb8f-496b-ae65-487a4c3ac431 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.218673 Sep 08 10:32:57.912924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2227/4265] 10.222.0.59 () {58 vars in 1150 bytes} [Thu Sep 8 10:32:57 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:57.917898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:57.923914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:57.925169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:57.934004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.934860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.935716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.936671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:57.937282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:57.937867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:57.941654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:57.951834 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b09e519-a484-4755-9148-1c1575f056e7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.288409 Sep 08 10:32:57.954371 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2039/4266] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:57 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:57.985286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:58.009932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.011535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:58.018804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.019555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.020249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.021175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.021826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.022442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.034276 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac472a91-76a0-4577-9385-916c6f5fdfb8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.120085 Sep 08 10:32:58.044666 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2228/4267] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:32:57 2022] GET /compute/v2.1/servers => generated 1011 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:58.065282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.070846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:58.071540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:58.095603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.096085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.096526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.097252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.097706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.098131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.189603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:58.192592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:58.199524 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2e6c04a1-44a6-4d85-ab7b-4f8733c2ab4d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.194401 Sep 08 10:32:58.200632 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2040/4268] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:58.242502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:58.261639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b04be8cb-63cf-42ed-a7af-f6b32a763163 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.215779 Sep 08 10:32:58.262607 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2229/4269] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:58.274931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.284252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:58.284753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.servers [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Removing options 'limit' from query {{(pid=122456) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:32:58.285467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:58.302129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.302620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.303061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.304360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.304841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.305262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.344881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.348202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:58.358963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:32:58.360725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.366999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.367939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.368784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.370813 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39afcf8a-d2d0-4459-bbf7-50e7b64a8fc7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.099703 Sep 08 10:32:58.371897 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2041/4270] 10.222.0.59 () {58 vars in 1140 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:32:58.380547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.381156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.385218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.390189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:58.390869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2136727769', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:32:58.409510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.410012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.410453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.411183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.411670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.422508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.585522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:58.594416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:32:58.594724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01155477-6e7b-40c7-8f85-50a6a9773048 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1490 microversion: 2.1 time: 0.254835 Sep 08 10:32:58.597707 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2230/4271] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1490 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:32:58.627693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.628503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:58.635581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.636382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.637077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.638037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.638495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.638921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.684897 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7f8bcc64-16a7-4d43-b644-9d9205ea3ffa tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2136727769" status: 200 len: 346 microversion: 2.1 time: 0.304141 Sep 08 10:32:58.686152 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2042/4272] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2136727769 => generated 346 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:32:58.706332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2977bde6-114e-430a-bd67-382a7561f753 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:58.716594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2977bde6-114e-430a-bd67-382a7561f753 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.717430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2977bde6-114e-430a-bd67-382a7561f753 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.718049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2977bde6-114e-430a-bd67-382a7561f753 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.750849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2977bde6-114e-430a-bd67-382a7561f753 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:32:58.850226 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2977bde6-114e-430a-bd67-382a7561f753 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "POST /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08/action" status: 202 len: 0 microversion: 2.1 time: 0.155114 Sep 08 10:32:58.851620 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2043/4273] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:32:58 2022] POST /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:32:58.863631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:58.864166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.864546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:58.879215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.879770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.880318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.881044 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67498656-6d21-4a55-ba1f-4e04953d39d9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1490 microversion: 2.1 time: 0.259809 Sep 08 10:32:58.881187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.881644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.882647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.889693 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2231/4274] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1490 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:58.902632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:58.904242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:58.919170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.920089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.920843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:58.922101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:58.922942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:58.923605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.163771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:59.180527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b378dd13-ea39-47ca-ab23-9a099c99d5d2 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1333 microversion: 2.1 time: 0.327318 Sep 08 10:32:59.183122 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2044/4275] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1333 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:59.188821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:59.189683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:59.196713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.197438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.198028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.209331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.212637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.213740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.249038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:59.260701 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b5dd6a2-eeed-40cb-b8ec-1033b1842161 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1522 microversion: 2.1 time: 0.369442 Sep 08 10:32:59.261392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2232/4276] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:58 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:59.287891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:59.290143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:59.300325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.301112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.301645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.302846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.303582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.308427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.510910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:59.527343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-00d366ab-a4e1-4a2d-8a14-349006891e55 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1490 microversion: 2.1 time: 0.342507 Sep 08 10:32:59.528417 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2045/4277] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:59 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1490 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:59.537389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:59.537931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:59.544195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.544687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.545251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.545919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.546381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.546807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.607868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:59.630216 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef2e7d83-2b42-437e-a1ac-be99d9260f0b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.348663 Sep 08 10:32:59.639495 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2233/4278] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:59 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:59.639495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:59.639495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:59.651618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.652116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.652547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.653263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.653716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.654614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.700703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:32:59.765618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:32:59.775922 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-33f75470-adc0-4afc-b78a-7ab38bea5b69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.245517 Sep 08 10:32:59.777146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2046/4279] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:59 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:32:59.785504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea2e1782-ee30-48ef-b6df-05f482944e1f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'create', calling method: .version_select at 0x7f2351a8a670>, body: {"keypair": {"name": "tempest-keypair-640598117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4f/bfJZ2s6vsNVcgD9NqMOCuudgsI17b4sTJ30YpDTPzVH9NUekwdo7LsQr1oKferFrItSM6NnqXaEfxyPrB+XhaX/+LsAv1H+JU3sq25ch9zk0ckjLn2BxR4NU8Qkrw=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:32:59.806783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ea2e1782-ee30-48ef-b6df-05f482944e1f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:32:59.813815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ea2e1782-ee30-48ef-b6df-05f482944e1f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for user 98c97cd324034c9297200125111c3029 and project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:32:59.857190 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a09502f-88c8-4426-9906-b3fe5578e6ef tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 204 len: 0 microversion: 2.1 time: 0.224959 Sep 08 10:32:59.864340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2234/4280] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:32:59 2022] DELETE /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:32:59.872837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:32:59.873081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:32:59.874883 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea2e1782-ee30-48ef-b6df-05f482944e1f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.095591 Sep 08 10:32:59.876055 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2047/4281] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:32:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:32:59.889090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.889771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.890564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:32:59.891434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:32:59.895416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:32:59.896092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.118697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:00.146084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b183de3f-a287-407e-97b5-3665aca3dd21 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1496 microversion: 2.1 time: 0.263546 Sep 08 10:33:00.146084 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2235/4282] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:32:59 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1496 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:00.206789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:00.208715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:00.227643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.228452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.229119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.230061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.231657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.232452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.286956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:00.288221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:00.297340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.298275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.299193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.300756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.301396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.302155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.534607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:00.543402 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ae3dcb8-d1dc-4516-804d-d35b7324cccf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1333 microversion: 2.1 time: 0.341660 Sep 08 10:33:00.556575 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2048/4283] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:00 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1333 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:00.602160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:00.611778 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7eb11ba8-7822-4afa-a838-196f8e9c4ce2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1522 microversion: 2.1 time: 0.330106 Sep 08 10:33:00.613871 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2236/4284] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:00 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:00.661884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:00.662907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:00.671645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.672942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.673665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.675439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.676382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.677170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.807128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:00.807773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:00.821819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.822483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.823597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:00.824413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:00.824811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:00.825229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:01.128778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:01.144827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0267874e-f624-455c-9515-4c6b194c5e16 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.490601 Sep 08 10:33:01.161124 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2049/4285] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:00 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:01.161124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:01.161124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:01.172923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:01.173903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:01.175002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:01.175921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:01.176532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:01.177111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:01.233679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:01.245041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8eb58f86-821d-4c02-acce-9200347630c4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.443453 Sep 08 10:33:01.249838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:01.263841 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2237/4286] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:00 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:01.589498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:01.590123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:01.610604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:01.611115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:01.611595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:01.636225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:01.636225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:01.636225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:01.933038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:01.945082 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-899b5534-4c2d-4fe4-aa19-ad969d934500 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1496 microversion: 2.1 time: 0.795001 Sep 08 10:33:01.945959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2050/4287] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:01 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1496 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:01.953926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:01.960921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:01.974056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:01.974684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:01.975201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:01.976560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:01.992068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:01.992574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:02.156734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:02.168319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6d6485fc-7c86-4244-9517-88c74604d04f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.598206 Sep 08 10:33:02.190439 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2238/4288] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:01 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:02.195908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:02.201086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:02.216225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:02.217055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:02.217946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:02.218859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:02.219495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:02.219936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:02.455654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:02.465433 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fbdf4295-ca35-4a89-8491-7eccccb41306 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1522 microversion: 2.1 time: 0.518056 Sep 08 10:33:02.471697 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2051/4289] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:01 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:02.479244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:02.480920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:02.493553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:02.494054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:02.494504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:02.495213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:02.495734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:02.496164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:02.598803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:02.612797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29b38f31-19d1-4111-8321-3cb09a634a38 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.420808 Sep 08 10:33:02.616793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2239/4290] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:02 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:02.771654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:02.780999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38dd5d05-94d1-4103-a952-07a80872b0f6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.307849 Sep 08 10:33:02.801747 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2052/4291] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:02 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:02.970459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:02.971097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:02.981352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:02.982220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:02.982881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:02.983897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:02.984577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:02.985216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.197940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:03.199217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:03.204186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:03.213351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.214137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.214806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.215938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.216589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.217259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.222541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60f55314-1b08-48c1-a3cf-1869219b34f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1454 microversion: 2.1 time: 0.254073 Sep 08 10:33:03.236798 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2240/4292] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:02 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:03.307086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-65e151ea-7586-4eb4-bc84-734f80dc62f0 req-8d2436a6-34ff-4907-97f6-9788b13afeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820014b3-4ed2-4cc3-bb9a-b3266dcf3060", "name": "network-vif-deleted", "tag": "328dad21-1f27-4a96-ae9a-f4c3998563ee"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:03.342694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-65e151ea-7586-4eb4-bc84-734f80dc62f0 req-8d2436a6-34ff-4907-97f6-9788b13afeb8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.344836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-65e151ea-7586-4eb4-bc84-734f80dc62f0 req-8d2436a6-34ff-4907-97f6-9788b13afeb8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.345297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-65e151ea-7586-4eb4-bc84-734f80dc62f0 req-8d2436a6-34ff-4907-97f6-9788b13afeb8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.393340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-65e151ea-7586-4eb4-bc84-734f80dc62f0 req-8d2436a6-34ff-4907-97f6-9788b13afeb8 service nova] Creating event network-vif-deleted:328dad21-1f27-4a96-ae9a-f4c3998563ee for instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 on n-h1-833090-19 Sep 08 10:33:03.410581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-65e151ea-7586-4eb4-bc84-734f80dc62f0 req-8d2436a6-34ff-4907-97f6-9788b13afeb8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108238 Sep 08 10:33:03.411412 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2241/4293] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:03.503624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:03.505132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:03.518678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.520390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.522004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.524721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.525255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.525698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.753370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:03.773884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d05e964-a668-4ae0-9f9b-b2a753d9c725 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.579909 Sep 08 10:33:03.778130 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2053/4294] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:03 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:03.799130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:03.801912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:03.829378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.830131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.830795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.831732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.832462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.833077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.919403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:03.930365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a4e30a3-e134-4fb6-a769-f87c270814d3 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1522 microversion: 2.1 time: 0.434104 Sep 08 10:33:03.936762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2242/4295] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:03 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:03.953576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:03.954606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:03.965336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.968043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.968618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:03.969805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:03.973855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:03.974458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:04.315768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:04.324515 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e091c8d2-664f-4816-9687-3f5b96643d53 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.386180 Sep 08 10:33:04.328200 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2243/4296] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:03 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:04.339411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:04.340305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:04.348384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:04.348602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:04.350133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:04.351340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:04.352298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:04.352954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:04.353719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:04.360204 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2fda3a3d-7914-479d-989e-00fb89b895b2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.577984 Sep 08 10:33:04.363472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2054/4297] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:03 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:04.433008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:04.433616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:04.434065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:04.435686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:04.478348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1940910646", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2f851e4-04e3-4e98-8d14-1721acd59a0a"}], "security_groups": [{"name": "tempest-securitygroup--311435718"}], "key_name": "tempest-keypair-640598117", "user_data": "}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:04.516719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:04.530144 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e24384e-8873-4827-9a7d-9f173a911910 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 200 len: 1299 microversion: 2.1 time: 0.200676 Sep 08 10:33:04.531242 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2244/4298] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:04 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:04.639020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] validate_networks() for [('e2f851e4-04e3-4e98-8d14-1721acd59a0a', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:33:04.804466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:04.806187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:04.817474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:04.818286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:04.818844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:04.819849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:04.820530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:04.821233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:04.828741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:05.142808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:05.168353 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57a86c81-dd87-4530-ac89-92cd94804b70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.368695 Sep 08 10:33:05.171136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2245/4299] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:04 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:05.176231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:05.184281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:05.195434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:05.196257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:05.198299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:05.199176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:05.200687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:05.201278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.054304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:33:06.055351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:33:06.056007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:33:06.057167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:33:06.057605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:33:06.077742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.078619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.079312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.080686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.081369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.081993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.089002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:06.097314 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e19cdd63-1199-4502-a6db-efa4e60ee9f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1499 microversion: 2.1 time: 0.924940 Sep 08 10:33:06.098685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2246/4300] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:05 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1499 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:06.106248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:06.107150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:06.114233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.115071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.115784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.116738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.117402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.118036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.127200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:06.160831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Getting quotas for user 98c97cd324034c9297200125111c3029 and project 3a73a158fede41208b272a3e9c4d6e47. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:06.175510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:33:06.178078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:33:06.235555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df8c8d8e-a0bc-4b46-8069-626141dfbe5b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.763849 Sep 08 10:33:06.236760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2055/4301] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:33:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 10:33:06.242817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:06.244545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:06.252429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.253416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.254135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.255000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.255737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.256316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.520254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:06.533688 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-769796d8-1366-4bab-ab4f-30e227cbf367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.433250 Sep 08 10:33:06.557322 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2247/4302] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:06 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:06.571117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "tag": "c931ed7a-54a5-4304-9ed2-f20056135a20"}, {"name": "network-changed", "server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "tag": "75aab739-a5a3-48b5-b5a7-065dd5afdf52"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:06.592860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.593681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.596337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.630875 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] Creating event network-changed:c931ed7a-54a5-4304-9ed2-f20056135a20 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:06.636072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] Creating event network-changed:75aab739-a5a3-48b5-b5a7-065dd5afdf52 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:06.653043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-57cc2c81-2ecb-4e8e-9cd7-59cff5717535 req-d431c638-44a2-4119-bdc4-14df4e6ca360 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089109 Sep 08 10:33:06.654167 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2248/4303] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:06.664744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:06.667494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:06.678343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.680588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.681277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.682231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.683780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.684418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.708613 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 HTTP/1.1 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '820014b3-4ed2-4cc3-bb9a-b3266dcf3060'} Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:06.711242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc79f0b7-35ff-47df-86dc-b61e633c0dbf tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 404 len: 111 microversion: 2.1 time: 0.057630 Sep 08 10:33:06.718514 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2249/4304] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:06 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:06.722457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:06.730638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:06.731841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:06.738839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.739439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.740002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.741012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.742512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.743396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.794920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:06.848089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-994fdf07-6839-4791-a9ed-d55d18ff892f tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.132101 Sep 08 10:33:06.856232 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2250/4305] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Sep 8 10:33:06 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:06.868530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:06.869550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:06.890452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.891354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.892885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.900968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:06.903292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:06.905699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:06.956396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:06.995921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:07.014320 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-efc407ce-262b-49bc-8c09-d07596189ca6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.776278 Sep 08 10:33:07.014914 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2056/4306] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:06 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:07.019653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:07.020478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:07.039353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.040233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.040824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.041697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.042524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.043110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.216139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:07.227034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:07.228800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:07.232608 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf99f90a-8a8e-4f83-b447-1dbd237f3457 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1285 microversion: 2.20 time: 0.215478 Sep 08 10:33:07.253369 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2057/4307] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:07 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:07.258909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:07.259670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:07.268631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:07.279766 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff58998c-103c-459e-9044-6f58fb91c39c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.422997 Sep 08 10:33:07.280356 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2251/4308] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:06 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:07.296783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d6264a32-83cf-40e9-b9e1-2b717e88b9dc tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:07.303809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6264a32-83cf-40e9-b9e1-2b717e88b9dc tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.308197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6264a32-83cf-40e9-b9e1-2b717e88b9dc tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.308650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6264a32-83cf-40e9-b9e1-2b717e88b9dc tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.309747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.310249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.310697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.311670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.312137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.316476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.363514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d6264a32-83cf-40e9-b9e1-2b717e88b9dc tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Going to try to start instance {{(pid=122457) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:33:07.391921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:07.469441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d6264a32-83cf-40e9-b9e1-2b717e88b9dc tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "POST /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08/action" status: 202 len: 0 microversion: 2.1 time: 0.174981 Sep 08 10:33:07.476406 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2252/4309] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:33:07 2022] POST /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:33:07.489242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:07.492013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:07.500607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.501124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.501871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.502724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.503172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.503690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.607703 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a714540-35de-404d-861e-d3d65f0b30a8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 204 len: 0 microversion: 2.1 time: 0.352537 Sep 08 10:33:07.609187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2058/4310] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:07 2022] DELETE /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:07.616525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:07.617487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:07.643883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.644404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.644857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.645589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.646049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.649891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.938841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:07.947153 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6faf8138-207b-4565-9575-f3d50f44c721 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1508 microversion: 2.1 time: 0.469293 Sep 08 10:33:07.947762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2253/4311] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:07 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:07.958114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:07.963952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:07.979874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.980658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.981281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:07.982005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:07.982455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:07.983015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.119392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.133015 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-963a5e20-8fad-4ef5-865a-a92f98ba7485 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.522120 Sep 08 10:33:08.144206 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2059/4312] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:07 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:08.155794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:08.156790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:08.163248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.164339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.165026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.192403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.193778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.197511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.362456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.386950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99b832aa-467d-4130-ac76-1087a4f1dc9a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1496 microversion: 2.1 time: 0.436704 Sep 08 10:33:08.392505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2254/4313] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:07 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1496 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:08.401575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:08.403047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:08.415552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.416436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.417163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.418132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.418748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.419904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.582844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.592579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.594035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.595583 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3edff86f-bf06-40ed-91cb-0a632a187a77 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1341 microversion: 2.20 time: 0.200637 Sep 08 10:33:08.607487 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2255/4314] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:08 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:08.607721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.617964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:08.617964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:08.625886 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c30f8f42-c6f4-446a-9346-da40a7158ac0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.480132 Sep 08 10:33:08.632053 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2060/4315] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:08 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:08.634911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.635647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.636232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.637487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.638597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.638597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.696464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-44aa682a-fdd0-47fa-964e-285c334dbe70 req-b5f3906f-e4e8-4c52-90fe-408e7ee79557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "tag": "dcea6251-f94d-4749-908b-578984c45236"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:08.710407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-44aa682a-fdd0-47fa-964e-285c334dbe70 req-b5f3906f-e4e8-4c52-90fe-408e7ee79557 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.711244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-44aa682a-fdd0-47fa-964e-285c334dbe70 req-b5f3906f-e4e8-4c52-90fe-408e7ee79557 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.711794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-44aa682a-fdd0-47fa-964e-285c334dbe70 req-b5f3906f-e4e8-4c52-90fe-408e7ee79557 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.729315 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-44aa682a-fdd0-47fa-964e-285c334dbe70 req-b5f3906f-e4e8-4c52-90fe-408e7ee79557 service nova] Creating event network-changed:dcea6251-f94d-4749-908b-578984c45236 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:08.736187 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-44aa682a-fdd0-47fa-964e-285c334dbe70 req-b5f3906f-e4e8-4c52-90fe-408e7ee79557 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046968 Sep 08 10:33:08.737348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2061/4316] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:33:08.924034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:08.935761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3011dfb-fcce-47d5-bc92-8d63c846cede tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.338291 Sep 08 10:33:08.938737 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2256/4317] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:08 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:08.976958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:08.982157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:08.990013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.993024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.993883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:08.995323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:08.996397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:08.997050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:09.160432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:09.161227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:09.175973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:09.176621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:09.177159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:09.177990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:09.178570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:09.179529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:09.440060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:09.455247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-637c82bc-69b8-49e2-8817-cff43ad7a71b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.297598 Sep 08 10:33:09.456323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2257/4318] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:09 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:09.469539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:09.474713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:09.488633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:09.489494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:09.492542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:09.493502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:09.497039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:09.497729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:09.535136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:09.545708 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a159e17-9998-43df-bc9f-ae79a0465d8e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1508 microversion: 2.1 time: 0.575636 Sep 08 10:33:09.566049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2062/4319] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:08 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1508 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:09.636188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:09.640417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:09.662605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:09.666478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:09.667034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:09.668182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:09.668997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:09.670664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.182065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:10.201406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:10.203824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:10.207224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-259214f9-4ad5-426b-ac5a-443bb4cc326a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1341 microversion: 2.20 time: 0.585631 Sep 08 10:33:10.211231 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2063/4320] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:09 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1341 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:33:10.222345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:10.240685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:10.263288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.264107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.264711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.266619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.267245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.274644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.285171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:10.293436 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9ece07e-b2da-420b-8963-dfa396377ac6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1496 microversion: 2.1 time: 0.833109 Sep 08 10:33:10.294041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2258/4321] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:09 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1496 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:10.325558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:10.326194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:10.342743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.343585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.344229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.344992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.345530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.348499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.633913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:10.646630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d67d7219-7eae-4458-9936-cf9b1bbeceff tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.331232 Sep 08 10:33:10.650184 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2259/4322] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:10 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:10.654396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:10.674179 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec608dcd-8e1f-4f34-8aeb-ec1e3d3a3c91 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.461519 Sep 08 10:33:10.675211 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2064/4323] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:10 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:10.681055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:10.683184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:10.683931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:10.684394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:10.686743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:10.703672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.704669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.705399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.706490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.706836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.707773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.708291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.708813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.709021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:10.709910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:10.711963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:10.712425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.167065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.182268 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d6a9376f-0749-46c7-bb54-2770cd715c97 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.511916 Sep 08 10:33:11.183489 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2260/4324] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:10 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:11.188126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-88f82b38-efe0-44a9-89ab-d36d30a649d9 req-b8f09e66-3afb-4568-9bc9-5a2d92e7a878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5706297-ee53-472b-b105-a94832c371a7", "name": "network-vif-deleted", "tag": "97a1016f-4ed4-4384-8f0e-7537f303067d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:11.198796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88f82b38-efe0-44a9-89ab-d36d30a649d9 req-b8f09e66-3afb-4568-9bc9-5a2d92e7a878 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.199547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88f82b38-efe0-44a9-89ab-d36d30a649d9 req-b8f09e66-3afb-4568-9bc9-5a2d92e7a878 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.200196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88f82b38-efe0-44a9-89ab-d36d30a649d9 req-b8f09e66-3afb-4568-9bc9-5a2d92e7a878 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.213441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-88f82b38-efe0-44a9-89ab-d36d30a649d9 req-b8f09e66-3afb-4568-9bc9-5a2d92e7a878 service nova] Creating event network-vif-deleted:97a1016f-4ed4-4384-8f0e-7537f303067d for instance e5706297-ee53-472b-b105-a94832c371a7 on n-h1-833090-19 Sep 08 10:33:11.222644 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-88f82b38-efe0-44a9-89ab-d36d30a649d9 req-b8f09e66-3afb-4568-9bc9-5a2d92e7a878 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036679 Sep 08 10:33:11.223949 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2261/4325] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:11.238114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.248406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:11.248406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:11.252683 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02fb9c77-fa8a-4d34-b903-17da10aef30c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1512 microversion: 2.1 time: 0.576122 Sep 08 10:33:11.263519 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2065/4326] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:10 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:11.263737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.263737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.263737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.263737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.263737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.263737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.281252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:11.285411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:11.286593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.287305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.servers [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Removing options 'limit' from query {{(pid=122456) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 10:33:11.291047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:11.292539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.293261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.296013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.297055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.297789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.298436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.307986 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c1101f3b-b886-4a9d-886a-f99075f51d8a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029471 Sep 08 10:33:11.308840 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2066/4327] 10.222.0.59 () {58 vars in 1140 bytes} [Thu Sep 8 10:33:11 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:33:11.332861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:11.333925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:11.348184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.348672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.349106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.349815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.350253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.351230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.414134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.415123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.419891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.439757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.441483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid e5706297-ee53-472b-b105-a94832c371a7 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:11.447039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:11.449267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.459796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.463530 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59e19033-3014-4188-9e25-2e2077a97f9d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1341 microversion: 2.20 time: 0.223414 Sep 08 10:33:11.465047 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2262/4328] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:11 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:33:11.486302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:11.504807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:11.521586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.523123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.525505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.526349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.528020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.530809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.554556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:11.564909 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1feb0990-fbb3-4957-a595-12dc0bbdc929 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 200 len: 1299 microversion: 2.1 time: 0.247084 Sep 08 10:33:11.581394 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2067/4329] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:11 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 1299 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:11.674440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:11.675680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:11.682155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.691079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.693856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:11.695378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:11.696299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:11.696887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.060979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.073872 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64c7f0e9-18d1-4846-990f-3feec2cfbfb0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1512 microversion: 2.1 time: 0.597221 Sep 08 10:33:12.091487 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2263/4330] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:11 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:12.091487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:12.091487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:12.105303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.106002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.106549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.107361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.114724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.115328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.213082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.228065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d310690e-8ca7-4731-bfe5-effd780a4054 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.557484 Sep 08 10:33:12.230033 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2068/4331] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:11 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:12.237200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:12.239378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:12.247612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.249291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.250051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.250787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.251243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.251713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.417556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.428031 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afae942b-a9d8-4830-8b04-b313dd222e5a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.346802 Sep 08 10:33:12.445026 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2264/4332] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:12 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:12.452386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:12.453440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:12.462736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.463401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.464385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.465153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.465604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.466034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.618984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.629105 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b059ec82-7f11-43aa-a987-2a2b51519c00 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1511 microversion: 2.1 time: 0.396862 Sep 08 10:33:12.639553 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2069/4333] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:12 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:12.645162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:12.646208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:12.653778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.654755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.654877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.655735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.656283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.656842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.746220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.751346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.756603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.757996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:12.759515 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6890f1bc-2adb-4875-9f65-015d222d28ad tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1524 microversion: 2.1 time: 0.312080 Sep 08 10:33:12.759646 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-65b020cb-e298-496a-b0f8-e50521a67052 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1339 microversion: 2.20 time: 0.118437 Sep 08 10:33:12.760366 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2265/4334] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:12 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1524 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:12.765521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:12.765788 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2070/4335] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:12 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:12.766510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:12.773574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.774318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.774908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.775796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.776556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.777278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.778229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:12.780153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:12.787409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.788867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.789219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.790127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:12.790585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:12.791017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:12.799162 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 HTTP/1.1 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'e5706297-ee53-472b-b105-a94832c371a7'} Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:12.801292 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54af5f04-fe5f-4cb1-a675-c92d4ccd4e68 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 404 len: 111 microversion: 2.1 time: 0.041252 Sep 08 10:33:12.804719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2266/4336] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:12 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:12.954235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1929913223", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:13.016261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:33:13.050388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:13.062347 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-717927eb-7574-4fb8-a13e-217e36f3f62c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1510 microversion: 2.1 time: 0.295024 Sep 08 10:33:13.063447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2071/4337] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:12 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:13.086318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:13.092641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:13.093528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:13.230678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:13.231779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:13.234228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:13.235206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:13.235814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:13.236340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:13.348161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:13.419298 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49e61b14-816a-452a-8f03-f7be6b32116c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.338087 Sep 08 10:33:13.420489 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2072/4338] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Sep 8 10:33:13 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:13.425595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:13.428266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:13.437758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:13.438537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:13.439132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:13.440302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:13.440912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:13.441490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:13.879859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:13.895630 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d230056a-d7fd-4b86-b29a-af688d870078 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.473604 Sep 08 10:33:13.897749 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2073/4339] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:13 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:13.903797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:13.904764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:13.912336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:13.914777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:13.915447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:13.916410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:13.917244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:13.917902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.120236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:33:14.120721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:33:14.121330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:33:14.121755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:33:14.122174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:33:14.132675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.133122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.133734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.134643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.135921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.136511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.149984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=17 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:14.165890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:14.174188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:14.188991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:33:14.192821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:33:14.260338 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04b58ec0-25e7-4e33-9707-e455f42560dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310695 Sep 08 10:33:14.261225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2267/4340] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:33:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:33:14.266607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:14.267741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:14.277200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.277903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.278364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.279167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.279701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.280143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.348094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:14.357529 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0591dd34-56b6-4196-a4ce-23a9332f578b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1512 microversion: 2.1 time: 0.458122 Sep 08 10:33:14.358988 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2074/4341] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:13 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1512 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:14.376084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:14.376897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:14.384161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.385521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.386203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.387132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.387850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.388518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.806779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:14.821451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:14.838251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16c64b02-1832-437e-8854-7d029505c87d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.575108 Sep 08 10:33:14.839528 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2268/4342] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:14 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:14.845512 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cecbbc87-6025-4d2b-aa96-8d11546db07d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1506 microversion: 2.1 time: 0.482271 Sep 08 10:33:14.847609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:14.848503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:14.849244 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2075/4343] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:14 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:14.858088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:14.860254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:14.881621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.883981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:14.895842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.896286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.897201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.897935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.899543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.900287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.901233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:14.901958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.903322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:14.904280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:14.906494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.379216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:15.388602 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b08229a2-8ef4-4899-815a-4cc8e64a3f0c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1205 microversion: 2.1 time: 0.536960 Sep 08 10:33:15.404215 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2076/4344] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:14 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1205 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:15.411450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:15.412203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:15.419507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.420268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.420796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.421623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.422149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.422647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.558629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:15.569811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:15.572046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:15.573510 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67e29a90-dd3f-4d79-940d-8d863770d701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.731892 Sep 08 10:33:15.583501 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2269/4345] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:14 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:15.583501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4b5d2ff6-a0ae-406d-8cb0-d1db4e183ce0 req-5b668cd8-ccf9-4d93-a8f4-3fca0c0c4ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:15.608327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:15.611309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b5d2ff6-a0ae-406d-8cb0-d1db4e183ce0 req-5b668cd8-ccf9-4d93-a8f4-3fca0c0c4ec5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.613550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b5d2ff6-a0ae-406d-8cb0-d1db4e183ce0 req-5b668cd8-ccf9-4d93-a8f4-3fca0c0c4ec5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.614543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b5d2ff6-a0ae-406d-8cb0-d1db4e183ce0 req-5b668cd8-ccf9-4d93-a8f4-3fca0c0c4ec5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.617849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36530046-fbfe-45ab-8ec9-7ae741a2a9d0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1511 microversion: 2.1 time: 0.211478 Sep 08 10:33:15.620363 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2077/4346] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:15 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:15.639840 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4b5d2ff6-a0ae-406d-8cb0-d1db4e183ce0 req-5b668cd8-ccf9-4d93-a8f4-3fca0c0c4ec5 service nova] Creating event network-changed:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h2-833090-19 Sep 08 10:33:15.641507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:15.641507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:15.651988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4b5d2ff6-a0ae-406d-8cb0-d1db4e183ce0 req-5b668cd8-ccf9-4d93-a8f4-3fca0c0c4ec5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074232 Sep 08 10:33:15.652919 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2270/4347] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:15.653755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.654321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.654984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.656769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.657288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.657726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.659407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:15.660199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:15.667139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.667767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.668275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:15.669044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:15.669580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:15.670060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.025014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.034280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3bd3726d-34f8-4e0a-8012-45ede5e2871d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1510 microversion: 2.1 time: 0.379785 Sep 08 10:33:16.034618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.035767 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2271/4348] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:15 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:16.042384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:16.043313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:16.050430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.051500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.053120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.054482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.054642 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-780a4459-9730-4c61-8b55-6fffb4406775 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.427230 Sep 08 10:33:16.055280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2078/4349] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:15 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:16.055570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.056303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.070024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:16.070645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:16.079015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.079687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.080200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.080981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.081662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.082431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.170686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:16.360517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.369919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8bb72b73-1de2-4e10-9dcd-30b9a8131b09 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.332665 Sep 08 10:33:16.370869 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2272/4350] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:16 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:16.376317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:16.381568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.382642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:16.389358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.389824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.390368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.391394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.392138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.392380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.397041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.417198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45e4a620-96b1-4004-a956-7c384e852887 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1506 microversion: 2.1 time: 0.360784 Sep 08 10:33:16.418088 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2079/4351] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:16 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:16.423112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:16.424156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:16.431720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.433095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.433736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.434853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.435921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.436724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.446233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:16.488792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.497671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.498400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.498986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.521075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.530044 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48ebeec5-32ae-4142-bf4a-7a5553dbfaeb tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1267 microversion: 2.1 time: 0.110619 Sep 08 10:33:16.543728 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2080/4352] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:16 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:16.600298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:16.601555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:16.608963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.610878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.611323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.612076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:16.612876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:16.613477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:16.837516 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a65f131-d2d2-44da-b701-fe7c1410d1f7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.465220 Sep 08 10:33:16.838808 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2273/4353] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:33:16 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:16.869210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:16.875065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.875992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:16.878862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.888271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.889730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:16.890857 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4d7323e-1ada-4538-9059-6dcf8a8615d4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.294830 Sep 08 10:33:16.893185 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2081/4354] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:16 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:33:17.014130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.014619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.015050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.016015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.016462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.017046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.078185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:17.078782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:17.090341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.093120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.093811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.094694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.096596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.099743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.174126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:17.280681 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85d1d017-1296-4a08-9383-f1e200ed6de1 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.415358 Sep 08 10:33:17.281908 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2274/4355] 10.222.0.59 () {58 vars in 1150 bytes} [Thu Sep 8 10:33:16 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:17.287126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1e3391e3-de85-4a4d-8178-809dde01d392 req-d6eb6864-b2ee-425d-91e2-3a086ac779c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-plugged", "status": "completed", "tag": "c931ed7a-54a5-4304-9ed2-f20056135a20"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:17.299428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1e3391e3-de85-4a4d-8178-809dde01d392 req-d6eb6864-b2ee-425d-91e2-3a086ac779c0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.300499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1e3391e3-de85-4a4d-8178-809dde01d392 req-d6eb6864-b2ee-425d-91e2-3a086ac779c0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.301186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1e3391e3-de85-4a4d-8178-809dde01d392 req-d6eb6864-b2ee-425d-91e2-3a086ac779c0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.316923 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1e3391e3-de85-4a4d-8178-809dde01d392 req-d6eb6864-b2ee-425d-91e2-3a086ac779c0 service nova] Creating event network-vif-plugged:c931ed7a-54a5-4304-9ed2-f20056135a20 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:17.323490 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1e3391e3-de85-4a4d-8178-809dde01d392 req-d6eb6864-b2ee-425d-91e2-3a086ac779c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039719 Sep 08 10:33:17.324986 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2275/4356] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:17.331549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:17.338387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:17.339526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:17.346255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.346978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.348130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.350156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.352028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.352673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.455198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:17.467869 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b1495192-8f6f-4955-bc74-1d0efdb0a4af tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.393368 Sep 08 10:33:17.471731 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2082/4357] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:17 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:17.480623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:17.485849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:17.487044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:17.502931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.504363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.509369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.510332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.510962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.511583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.567756 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55010784-0e22-46ac-aabb-b59c0d5fe08a tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.240110 Sep 08 10:33:17.569527 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2276/4358] 10.222.0.59 () {58 vars in 1212 bytes} [Thu Sep 8 10:33:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:17.573549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:17.574342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:17.581005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.581593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.582099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.583535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:17.585152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:17.585654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:17.965196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:17.969923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:17.974921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:17.981187 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a96a4479-7a3b-4f17-ae35-e2fcbe6d75d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.507521 Sep 08 10:33:17.983525 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2083/4359] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:17 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:17.990356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:17.992802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:17.993968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35cc8d66-f6ee-4ef9-a4a6-58bc1ccba5bb tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1506 microversion: 2.1 time: 0.423971 Sep 08 10:33:18.002328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.003257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.003880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.004712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.005294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.005845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.012805 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2277/4360] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:17 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:18.017730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:18.024427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.025279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:18.030665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.031228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.032223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.033949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.034630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.035277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.140312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:18.204297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6c364e09-0fcf-4ea3-96bb-fe8b923436ed tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.190024 Sep 08 10:33:18.204697 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2278/4361] 10.222.0.59 () {58 vars in 1196 bytes} [Thu Sep 8 10:33:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:18.216863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:18.217743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:18.224933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.225900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.226344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.228012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.228012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.228339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.262899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.272149 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89a15d51-cfe2-4ce4-96c5-62953f84173f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.287184 Sep 08 10:33:18.273280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2084/4362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:17 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:18.278148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:18.283710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.284623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': '2136727769', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:18.292001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.292749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.293336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.294221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.294903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.295487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.452140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:18.530364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be546def-03d7-4595-ab43-ca8eae6f4756 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?name=2136727769" status: 200 len: 346 microversion: 2.1 time: 0.255785 Sep 08 10:33:18.531408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2085/4363] 10.222.0.59 () {58 vars in 1156 bytes} [Thu Sep 8 10:33:18 2022] GET /compute/v2.1/servers?name=2136727769 => generated 346 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:18.536696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:18.537316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:18.545120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.545956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.546885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.550427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.550427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.550427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.665562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.676399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.677928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.679140 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-26083736-9fa2-44c3-bec4-a26dabf79816 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.466636 Sep 08 10:33:18.680028 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2279/4364] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:18 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:18.685195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:18.692883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.692883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:18.698200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.698708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.699109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.699973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.700421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.702296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.809444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:18.838684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:18.907489 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4399bd4-db9a-4fa1-9042-afa040d6939c tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.226343 Sep 08 10:33:18.908606 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2280/4365] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Sep 8 10:33:18 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:18.920728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:18.926106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:18.926780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-213672776', 'deleted': False, 'project_id': 'beaeeece01104ca08b7362293f061037'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:33:18.932212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.932697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.933211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:18.933935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:18.934385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:18.934804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.029741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:33:19.122875 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-489fa3ff-6c0b-4d2c-bc9c-d03cbdb576c4 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-213672776" status: 200 len: 346 microversion: 2.1 time: 0.205752 Sep 08 10:33:19.123948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:19.132734 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2281/4366] 10.222.0.59 () {58 vars in 1228 bytes} [Thu Sep 8 10:33:18 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-213672776 => generated 346 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:33:19.140842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:19.141567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:19.145768 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ad09bdd-e204-4d50-94dd-5a1a675571fe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.612424 Sep 08 10:33:19.150119 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2086/4367] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:18 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:19.165881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:19.166505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:19.167317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.168100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.168947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.170445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.171180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.171984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.186342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.186841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.188056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.192767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.193765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.195696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.524454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:19.534504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a3cb8d2-3154-4f05-aff7-7b9085259f6a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1509 microversion: 2.1 time: 0.382979 Sep 08 10:33:19.535102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2087/4368] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:19 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:19.540982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:19.541668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:19.552088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.552814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.553974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.555037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.555523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.555958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.589722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:19.697110 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23ed15ab-2cf2-426b-8d98-92d6fd7f98f8 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 204 len: 0 microversion: 2.1 time: 0.160349 Sep 08 10:33:19.698012 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2088/4369] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:19 2022] DELETE /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:19.704180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-bb3eec5d-73ed-4fd1-94b3-f2861dbbfd31 req-8f6ff49f-e5eb-419d-8274-6681a39aeb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447f9c4a-3274-44aa-b371-c752e94d07ce", "tag": "8aa5f35b-ff25-4bdb-9453-722921868a1e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:19.712079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:19.714749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bb3eec5d-73ed-4fd1-94b3-f2861dbbfd31 req-8f6ff49f-e5eb-419d-8274-6681a39aeb66 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.715659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bb3eec5d-73ed-4fd1-94b3-f2861dbbfd31 req-8f6ff49f-e5eb-419d-8274-6681a39aeb66 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.715794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bb3eec5d-73ed-4fd1-94b3-f2861dbbfd31 req-8f6ff49f-e5eb-419d-8274-6681a39aeb66 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.720439 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ed5a1d1-d8d5-411c-ad4f-f5155cf9687d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.584033 Sep 08 10:33:19.721246 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2282/4370] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:19 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:19.728620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-bb3eec5d-73ed-4fd1-94b3-f2861dbbfd31 req-8f6ff49f-e5eb-419d-8274-6681a39aeb66 service nova] Creating event network-changed:8aa5f35b-ff25-4bdb-9453-722921868a1e for instance 447f9c4a-3274-44aa-b371-c752e94d07ce on n-h1-833090-19 Sep 08 10:33:19.733894 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-bb3eec5d-73ed-4fd1-94b3-f2861dbbfd31 req-8f6ff49f-e5eb-419d-8274-6681a39aeb66 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034080 Sep 08 10:33:19.734824 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2089/4371] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:19.739801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-plugged", "status": "completed", "tag": "75aab739-a5a3-48b5-b5a7-065dd5afdf52"}, {"server_uuid": "8c428be4-d1e0-4c04-a3f9-50d787654006", "name": "network-vif-unplugged", "status": "completed", "tag": "3a280d5b-ebf7-420d-bf18-1edae29fc63c"}, {"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-plugged", "status": "completed", "tag": "dcea6251-f94d-4749-908b-578984c45236"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:19.742399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:19.743023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:19.750383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.750916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.751362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.751835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.752122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.752324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.752580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.752741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.753007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.771304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Creating event network-vif-plugged:75aab739-a5a3-48b5-b5a7-065dd5afdf52 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:19.771851 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Creating event network-vif-unplugged:3a280d5b-ebf7-420d-bf18-1edae29fc63c for instance 8c428be4-d1e0-4c04-a3f9-50d787654006 on n-h2-833090-19 Sep 08 10:33:19.772401 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] Creating event network-vif-plugged:dcea6251-f94d-4749-908b-578984c45236 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:19.779359 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9561a2e2-3902-445d-b728-dbc73bda43ef req-fa6f1e20-eda4-498e-a317-ec511d2696c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.043320 Sep 08 10:33:19.780245 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2090/4372] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:19.785866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:19.786508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:19.794108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.794605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.795044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.795788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.796242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.796665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.825335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:19.833532 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Working on deleting snapshot ef7d1091-c30e-4700-a82f-4dc6e627aad1 from shelved instance... Sep 08 10:33:19.906311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:19.916173 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93ac89f3-7c61-4dcd-b1ff-04b133eac2b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.183003 Sep 08 10:33:19.916394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2283/4373] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:19 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:19.921668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:19.922082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:19.929744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.930246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.930689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:19.931592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:19.932053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:19.932483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.089163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:20.097287 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5da76dcc-6ee8-4f0a-9114-3451a5a1e99e tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1516 microversion: 2.1 time: 0.179939 Sep 08 10:33:20.098036 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2284/4374] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:19 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:20.103732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:20.104433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:20.112100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.112820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.113472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.114508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.115044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.115600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.296702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:20.308721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:20.310348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:20.311737 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d2536f5-03fe-4bed-9a53-5bf8e79e332b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.212634 Sep 08 10:33:20.320465 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2285/4375] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:20 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:20.329448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:20.330105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:20.339082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.339619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.340252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.341387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.342008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.342584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.468588 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-188e2c6a-8979-4c11-8b40-72a6504fc6ee tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 204 len: 0 microversion: 2.1 time: 0.687127 Sep 08 10:33:20.469455 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2091/4376] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:19 2022] DELETE /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:20.484795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:20.485508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:20.492942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.493137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.493415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.494129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.494578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.494997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.560811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:20.569556 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a5912a50-a129-4ee4-af5c-724af8264e60 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.247088 Sep 08 10:33:20.570692 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2286/4377] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:20 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:20.748816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:20.749458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:20.757970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.758651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.759111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.760199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.760342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.760782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.832691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:20.840779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51ed99aa-fee7-4da1-bfc4-3bf0a90ce81e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1515 microversion: 2.1 time: 0.360381 Sep 08 10:33:20.841366 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2092/4378] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:20 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:20.940986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:20.941707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:20.949013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.949805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.950465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:20.951240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:20.951780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:20.952532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.498086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:21.506743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-234abd6c-d1d5-4abe-a670-68ad03a22c14 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.762156 Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2287/4379] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:20 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:21.523730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.667115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:21.676198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f25d9ad-f186-4b06-abbd-430fdbd4a7dd tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.739257 Sep 08 10:33:21.676994 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2093/4380] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:20 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:21.685899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:21.690327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:21.703198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:21.704040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:21.704733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.705699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:21.706576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:21.707335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.914588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:21.926701 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8275b56-5264-44d9-8bd2-c1e34d5c0e84 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1516 microversion: 2.1 time: 0.417933 Sep 08 10:33:21.935161 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2288/4381] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:21 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1516 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:21.937647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:21.942089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:21.954005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:21.955055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:21.955917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.957226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:21.958059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:21.958918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:21.970763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:21.981934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:21.983743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:21.985159 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-47f584a0-d487-4f8e-9ebe-c7955d25566f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.306954 Sep 08 10:33:21.986238 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2094/4382] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:21 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:21.991351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:21.992214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:21.999311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.000223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.000806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.001695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.010378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.010839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.014832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0ea943d-8672-4b5d-a348-8948c405d121 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084467 Sep 08 10:33:22.017462 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2289/4383] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:33:21 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:33:22.022654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-343604da-ec8f-4b44-b53c-fae1dbd96509 req-a9e80421-71b1-42d6-be78-0bea7319476a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a240bd1a-088d-4f3e-8bf0-db0a4cfa53df", "name": "network-vif-deleted", "tag": "c8a794fe-d40f-4ea0-9bf3-1143b70ffb85"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:22.037776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-343604da-ec8f-4b44-b53c-fae1dbd96509 req-a9e80421-71b1-42d6-be78-0bea7319476a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.038618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-343604da-ec8f-4b44-b53c-fae1dbd96509 req-a9e80421-71b1-42d6-be78-0bea7319476a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.039387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-343604da-ec8f-4b44-b53c-fae1dbd96509 req-a9e80421-71b1-42d6-be78-0bea7319476a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.072517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-343604da-ec8f-4b44-b53c-fae1dbd96509 req-a9e80421-71b1-42d6-be78-0bea7319476a service nova] Creating event network-vif-deleted:c8a794fe-d40f-4ea0-9bf3-1143b70ffb85 for instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df on n-h1-833090-19 Sep 08 10:33:22.082229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-343604da-ec8f-4b44-b53c-fae1dbd96509 req-a9e80421-71b1-42d6-be78-0bea7319476a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063207 Sep 08 10:33:22.083182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2290/4384] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:22.089407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:22.090515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:22.097213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.097680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.098122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.098898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.099355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.099848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.488269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:22.493742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:22.497679 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83b58887-aea3-4544-bbb7-9cecf3e848b4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1515 microversion: 2.1 time: 0.413160 Sep 08 10:33:22.498368 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2291/4385] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:22 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1515 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:22.503099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f4c3a491-0f17-4a79-8258-259adaae8dfe tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.515451 Sep 08 10:33:22.516266 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2095/4386] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:21 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:22.523209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:22.523929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:22.531405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.532094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.532898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:22.533105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.533630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:22.533968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.534497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.535022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.541079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.541586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.542032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.542903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.543424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.544031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.566645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:22.676824 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f255773f-8021-4066-92da-713be85104f5 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 204 len: 0 microversion: 2.1 time: 0.160150 Sep 08 10:33:22.682775 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2292/4387] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:22 2022] DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:22.690097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:22.691061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:22.698662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.699210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.699749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.700548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:22.701111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:22.701625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:22.962821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:22.977353 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b71deac-98fe-4dff-81b1-01ebb7c33a3f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1734 microversion: 2.1 time: 0.449682 Sep 08 10:33:22.979778 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2096/4388] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:22 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1734 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:22.986688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:22.987301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:23.007697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.008472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.009103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.009971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.012286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.013058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.162152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.171203 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a49c222a-5322-43e0-b803-558603dac9ef tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1675 microversion: 2.1 time: 0.487004 Sep 08 10:33:23.172217 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2293/4389] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:22 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1675 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:23.177269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:23.177904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:23.184222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.184709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.185159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.185850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.186313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.186958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.227711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.228742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.229424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.230111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lazy-loading 'fault' on Instance uuid a240bd1a-088d-4f3e-8bf0-db0a4cfa53df {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:23.349647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.354100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:23.365846 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff4d9b82-64e6-4736-a9cd-e34cc33a65c0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1310 microversion: 2.1 time: 0.190959 Sep 08 10:33:23.373299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2294/4390] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:23 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1310 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:23.379137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:23.379137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:23.388120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.388620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.389083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.389793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.390246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.390669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.513856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.523086 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d073f8b8-13e2-4669-95b5-f56c9e714e58 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.541844 Sep 08 10:33:23.523871 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2097/4391] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:22 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:23.531043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:23.531752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:23.542903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.543905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.544712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.545942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.546496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.547009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.553637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:23.650890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.662735 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f2b710ab-d3f6-4e3e-b68f-48e0eda4a474 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 200 len: 1413 microversion: 2.1 time: 0.136795 Sep 08 10:33:23.663355 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2098/4392] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:23 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:23.674571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:23.676247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:23.682928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.683423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.683903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.684612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:23.685071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:23.685535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:23.708685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.721865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.723324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:23.724526 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa9271c9-2bd0-494d-9b88-35488d15c989 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.350301 Sep 08 10:33:23.725171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2295/4393] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:23 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:24.004925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:24.005513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:24.012883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.013393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.013838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.014562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.015021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.015484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.431900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:24.439999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38d1e525-39c0-4d70-addb-476352676842 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1354 microversion: 2.1 time: 0.775532 Sep 08 10:33:24.440694 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2099/4394] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:23 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1354 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:24.441933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:24.445318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-560e34da-dc0b-45dc-8687-729c36eb5c39 req-d01db101-8d8c-4324-8278-be657f3369a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c428be4-d1e0-4c04-a3f9-50d787654006", "name": "network-vif-deleted", "tag": "3a280d5b-ebf7-420d-bf18-1edae29fc63c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:24.453360 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe05e7f8-1ace-4bc5-8c66-2bcaeae13af5 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1714 microversion: 2.1 time: 0.452101 Sep 08 10:33:24.464785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-560e34da-dc0b-45dc-8687-729c36eb5c39 req-d01db101-8d8c-4324-8278-be657f3369a4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.464785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-560e34da-dc0b-45dc-8687-729c36eb5c39 req-d01db101-8d8c-4324-8278-be657f3369a4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.464785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-560e34da-dc0b-45dc-8687-729c36eb5c39 req-d01db101-8d8c-4324-8278-be657f3369a4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.472846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.server_external_events [req-560e34da-dc0b-45dc-8687-729c36eb5c39 req-d01db101-8d8c-4324-8278-be657f3369a4 service nova] Unable to find a host for instance 8c428be4-d1e0-4c04-a3f9-50d787654006. Dropping event network-vif-deleted {{(pid=122456) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 10:33:24.473110 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2296/4395] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:23 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1714 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:24.474286 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-560e34da-dc0b-45dc-8687-729c36eb5c39 req-d01db101-8d8c-4324-8278-be657f3369a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032330 Sep 08 10:33:24.475886 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2100/4396] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 10:33:24.481733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:24.482722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:24.487498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:24.488133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:24.502355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.503112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.505054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.505673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.505978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.510293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.510820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.511267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.516615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.520993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.523547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.524485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.598709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.599219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.599707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.600871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lazy-loading 'fault' on Instance uuid a240bd1a-088d-4f3e-8bf0-db0a4cfa53df {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:24.722980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:24.736594 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-414aa1d4-61a2-47a9-bdcc-b05e838748d7 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 200 len: 1310 microversion: 2.1 time: 0.259357 Sep 08 10:33:24.737683 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2101/4397] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:24 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 1310 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:24.743420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:24.744491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:24.752141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.753162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.753871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.755019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:24.755539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:24.755975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:24.991302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:25.002018 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dbcd902d-da44-4700-a9a2-8d5533f8fdf7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1675 microversion: 2.1 time: 0.527508 Sep 08 10:33:25.002776 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2297/4398] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:24 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1675 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:25.009086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:25.009432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:25.016450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.017187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.017798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.018680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.019295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.019914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.202559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Cannot 'detach_volume' instance 48ae1c59-e738-4c93-891f-f3fd33f5568c while it is in vm_state rescued Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments/0767b0bf-154d-4202-95f8-1ca0f4d900e8 HTTP/1.1 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot 'detach_volume' instance 48ae1c59-e738-4c93-891f-f3fd33f5568c while it is in vm_state rescued Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '48ae1c59-e738-4c93-891f-f3fd33f5568c', 'id': '0767b0bf-154d-4202-95f8-1ca0f4d900e8'} Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 48ae1c59-e738-4c93-891f-f3fd33f5568c while it is in vm_state rescued Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.204471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:25.207840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:25.207840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:25.207840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:25.207840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:25.207840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 48ae1c59-e738-4c93-891f-f3fd33f5568c while it is in vm_state rescued Sep 08 10:33:25.207840 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.210440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:25.211410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 409 to user: Cannot 'detach_volume' instance 48ae1c59-e738-4c93-891f-f3fd33f5568c while it is in vm_state rescued {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:25.212329 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-94cd7559-79c9-49e7-b9d3-a1bbfa1cb8a0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments/0767b0bf-154d-4202-95f8-1ca0f4d900e8" status: 409 len: 152 microversion: 2.1 time: 0.208454 Sep 08 10:33:25.212903 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2298/4399] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:33:25 2022] DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments/0767b0bf-154d-4202-95f8-1ca0f4d900e8 => generated 152 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:33:25.229112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:25.230034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:25.248008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.248908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.249043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d07ad8e8-c79c-4680-ba75-8232e1dd90f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.509817 Sep 08 10:33:25.250011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.250655 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2102/4400] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:24 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:25.264836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:25.266148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:25.267481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.269563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.270073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.284347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.285472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.286186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.289305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.290059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.290972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.309390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 HTTP/1.1 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8c428be4-d1e0-4c04-a3f9-50d787654006'} Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:25.314170 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:33:25.318142 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:25.320948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:25.324040 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5effad53-27fe-4d5e-887f-1683211537c2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 404 len: 111 microversion: 2.1 time: 0.106529 Sep 08 10:33:25.330320 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2299/4401] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:25 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:25.338511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:25.343224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:25.358052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.358651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.360659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.363040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.363544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.363984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.506072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-96303b1e-3e6e-4716-9a8e-74bb6fc05e6f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/action" status: 202 len: 0 microversion: 2.1 time: 0.173788 Sep 08 10:33:25.524963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2300/4402] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:33:25 2022] POST /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:33:25.540484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:25.543198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:25.551490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.552336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.553030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.554631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.555379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.556126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.910332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:25.925912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:25.929010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:25.930784 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23d246c4-ef6b-4c09-afd9-de2f001c09c4 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.678891 Sep 08 10:33:25.932365 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2103/4403] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:25 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:25.939608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:25.940467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:25.948655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.949394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.950004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:25.950885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:25.951595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:25.952356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:26.088867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:26.104496 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2eeb403e-3fc4-43ac-9ffd-e55f760bf97b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1806 microversion: 2.1 time: 0.576184 Sep 08 10:33:26.119873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2301/4404] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:25 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1806 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:26.127690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-312959949", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:26.214163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:33:26.388352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:26.398344 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98ee7875-14ed-40d9-a2f8-4f2e59f3b75b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1722 microversion: 2.1 time: 0.464070 Sep 08 10:33:26.399109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2104/4405] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:25 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:26.404767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:26.405767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: a240bd1a-088d-4f3e-8bf0-db0a4cfa53df] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:26.416948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:26.417188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:26.417826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:26.418579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:26.419051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:26.419503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:26.443123 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] HTTP exception thrown: Instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df could not be found. Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Request method failure captured: Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df HTTP/1.1 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcS2corGhM40KXDRvmwNh7sdP5sEnnLTlx-rcHUic-5hZGiFcxn8y1KwRHvN5W5dRdHh7j4ts_15-pLkupvmrXOFzp81vjAGfDLqELQthoxxqlSbgevzSzHh4WBmZRcSJOF5dWnJIRTrYlpU7uwfcMkJU6kVEH-v_FJVsSOTyW0mpjg Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: beaeeece01104ca08b7362293f061037 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/beaeeece01104ca08b7362293f061037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/beaeeece01104ca08b7362293f061037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/beaeeece01104ca08b7362293f061037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_beaeeece01104ca08b7362293f061037", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: beaeeece01104ca08b7362293f061037 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ListServerFiltersTestJSON-1563454902-project Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 02e6fae0553d463b9c7d029bda48989f Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ListServerFiltersTestJSON-1563454902-project Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df could not be found. Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'a240bd1a-088d-4f3e-8bf0-db0a4cfa53df'} Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df could not be found. Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df could not be found. Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:26.445195 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df could not be found. Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Returning 404 to user: Instance a240bd1a-088d-4f3e-8bf0-db0a4cfa53df could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38cc3ccd-e09a-48ef-a785-ffec864a87a0 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df" status: 404 len: 111 microversion: 2.1 time: 0.046376 Sep 08 10:33:26.449185 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2105/4406] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:26 2022] GET /compute/v2.1/servers/a240bd1a-088d-4f3e-8bf0-db0a4cfa53df => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:26.452954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:26.453640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:26.461649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:26.462629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:26.464010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:26.465959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:26.466452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:26.466897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:26.485843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:26.998132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:27.014737 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9da8272a-b12c-48c6-844f-24791bf82f76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1675 microversion: 2.1 time: 0.558935 Sep 08 10:33:27.019629 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2106/4407] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:26 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1675 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:27.031219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:27.031995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:27.042633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.043400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.044292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.045784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.046388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.047054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.077286 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ddbcb048-7e51-44de-b91d-4451caa7c5ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2/ips" status: 200 len: 220 microversion: 2.1 time: 0.056276 Sep 08 10:33:27.077888 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2107/4408] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:33:27 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2/ips => generated 220 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:27.082680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:27.083654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:27.091111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.091648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.092283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.093171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.093638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.094076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.747188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:33:27.748395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:33:27.749170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:33:27.749778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:33:27.750234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:33:27.762715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.763198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.764239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.764623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.765084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.765520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.809935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:27.811677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:27.818521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:27.827389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e10d2cfb-fd72-4947-a1fe-f8db50e7e20d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.747883 Sep 08 10:33:27.827993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2108/4409] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:27 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:27.839795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:33:27.840033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:27.840033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:27.840197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:33:27.846165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:27.850893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.856213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.856608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.857357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.857822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.859923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.895105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:27.906261 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e9d6afd-1435-45c3-831a-823cbe89425f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790666 Sep 08 10:33:27.914441 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2302/4410] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:33:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:33:27.921123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:27.922021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:27.932156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.933154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.933915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:27.934998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:27.935710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:27.936324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.103832 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8016e99c-eaf8-45e8-8924-b11605685d54 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 204 len: 0 microversion: 2.1 time: 0.274546 Sep 08 10:33:28.107587 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2109/4411] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:27 2022] DELETE /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:28.115701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:28.117122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:28.128824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.130557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.131861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.132944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.133887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.134619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.192558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:28.199608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:28.202826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:28.205977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:28.207892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e9424fa-d8c4-4491-a894-848fccee99ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.292069 Sep 08 10:33:28.208902 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2303/4412] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:27 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:28.232440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:28.233086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:28.249216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.250011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.250643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.251372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.251868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.252305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.345525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:28.387104 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fdcfc7de-0442-4cfd-a3cf-b55cff6b4ee1 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 204 len: 0 microversion: 2.1 time: 0.280212 Sep 08 10:33:28.391551 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2110/4413] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:28 2022] DELETE /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:28.406817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3afd8002-dc7c-4146-b8a1-6c5d0a6c446f req-3312c437-d007-43d8-a247-05a81bebdb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "name": "network-vif-plugged", "status": "completed", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:28.420345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3afd8002-dc7c-4146-b8a1-6c5d0a6c446f req-3312c437-d007-43d8-a247-05a81bebdb6e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.421173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3afd8002-dc7c-4146-b8a1-6c5d0a6c446f req-3312c437-d007-43d8-a247-05a81bebdb6e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.422383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3afd8002-dc7c-4146-b8a1-6c5d0a6c446f req-3312c437-d007-43d8-a247-05a81bebdb6e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.445169 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3afd8002-dc7c-4146-b8a1-6c5d0a6c446f req-3312c437-d007-43d8-a247-05a81bebdb6e service nova] Creating event network-vif-plugged:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h2-833090-19 Sep 08 10:33:28.474426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:28.482603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3afd8002-dc7c-4146-b8a1-6c5d0a6c446f req-3312c437-d007-43d8-a247-05a81bebdb6e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088209 Sep 08 10:33:28.487118 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2111/4414] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:28.491595 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7424932-5dcc-44e4-a023-9cb3856e165d tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1722 microversion: 2.1 time: 0.281414 Sep 08 10:33:28.492304 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2304/4415] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:28 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:28.507210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:28.507833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f8975a5-8028-46bc-8600-fb4b982c0c34 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:28.507833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f8975a5-8028-46bc-8600-fb4b982c0c34 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:28.508007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:28.512393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.513098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.513697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.514753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.515348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.515952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.565001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.566336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.567026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.567713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lazy-loading 'fault' on Instance uuid 337703bb-dc79-4187-8fab-37fa4188823a {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:28.628142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f8975a5-8028-46bc-8600-fb4b982c0c34 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:28.645575 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f8975a5-8028-46bc-8600-fb4b982c0c34 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1214 microversion: 2.1 time: 0.156688 Sep 08 10:33:28.650843 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2112/4416] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:28 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:28.655694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2508db76-baac-47b5-87c0-0eb8643ecfc1 req-5d4cdc46-d4a1-4125-8d24-eb13eb3bd288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337703bb-dc79-4187-8fab-37fa4188823a", "name": "network-vif-deleted", "tag": "02f9688e-98f0-4abb-80bd-8e16ba849e86"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:28.665217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:28.666489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2508db76-baac-47b5-87c0-0eb8643ecfc1 req-5d4cdc46-d4a1-4125-8d24-eb13eb3bd288 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.667162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2508db76-baac-47b5-87c0-0eb8643ecfc1 req-5d4cdc46-d4a1-4125-8d24-eb13eb3bd288 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.667744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2508db76-baac-47b5-87c0-0eb8643ecfc1 req-5d4cdc46-d4a1-4125-8d24-eb13eb3bd288 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.674053 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6552cb99-d63e-4a99-85a6-b8e48973ab79 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 200 len: 1328 microversion: 2.1 time: 0.180529 Sep 08 10:33:28.674955 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2305/4417] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:28 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 1328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:28.680042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:28.680645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:28.684163 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2508db76-baac-47b5-87c0-0eb8643ecfc1 req-5d4cdc46-d4a1-4125-8d24-eb13eb3bd288 service nova] Creating event network-vif-deleted:02f9688e-98f0-4abb-80bd-8e16ba849e86 for instance 337703bb-dc79-4187-8fab-37fa4188823a on n-h1-833090-19 Sep 08 10:33:28.687015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.687534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.687972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.688713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.689307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.689844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.690324 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2508db76-baac-47b5-87c0-0eb8643ecfc1 req-5d4cdc46-d4a1-4125-8d24-eb13eb3bd288 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037630 Sep 08 10:33:28.697863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2113/4418] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:28.715392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:28.717519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:28.737560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.740586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.741129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:28.743437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:28.743934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:28.744487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.002882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.015875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.022021 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a41408d0-2db5-4157-ac14-df7530b7899d tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1517 microversion: 2.1 time: 0.345683 Sep 08 10:33:29.022866 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2306/4419] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:28 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:29.027637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:29.028780 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7481bd07-8d00-4e21-a9d9-66e6ce5e3b3e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1812 microversion: 2.1 time: 0.329177 Sep 08 10:33:29.031779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:29.041187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2114/4420] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:28 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1812 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:29.041518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:29.050478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.052901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.055951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.057501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.057973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.061186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.238869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:29.240084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:29.252859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.253360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.253801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.254568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.255813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.258203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.258656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.266682 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1dcb7d1-fdcf-4bd0-8d3a-b754eeb94a13 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.242412 Sep 08 10:33:29.283498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2307/4421] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:29 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:29.288639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:29.444023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.452649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.454295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.455418 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c99734dd-0774-43f6-b243-d925959863f0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.221560 Sep 08 10:33:29.456014 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2115/4422] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:29 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:33:29.514052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:29.514665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:29.525007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.525504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.525940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.527837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.528499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.528946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.675951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:29.677080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:29.698459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.699971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.701882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.702790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.704952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.705559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.880556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.919161 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8fa1ceec-8385-4ab4-906b-cd5533c53aa2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1274 microversion: 2.1 time: 0.251953 Sep 08 10:33:29.954195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2116/4423] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:29 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:29.961345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:29.965329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:29.966498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:29.972477 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e2d236c-2887-44ca-9c04-842fdbf7142a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1722 microversion: 2.1 time: 0.462195 Sep 08 10:33:29.973368 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2308/4424] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:29 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1722 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:29.978208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.979063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.980323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:29.981618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:29.982436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:29.983404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.020183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] HTTP exception thrown: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Request method failure captured: Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a HTTP/1.1 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQSMWpJeQ1gxKJmdpzsutUIoLj0lRdFLF55ZMZUhMd26Bk7E1KPUe51nIoRPF_ZZCTyhWAhNZGmu8hDtc2jw0w4wBVPC4492OtfayPpGwEaabHF0z0709DNLAfnsXSntPuctnX6lYDhA4BzisPneskVa9VC5qYsbAL_uhN07enPC6E Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ee1af948aad445daad7abcd11441316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ee1af948aad445daad7abcd11441316", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0dd35046e12b46a59478ad7dbe2339c9 Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '337703bb-dc79-4187-8fab-37fa4188823a'} Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:30.023903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Returning 404 to user: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16546d79-025c-4eac-b3da-ba1a46d9fa7f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 404 len: 111 microversion: 2.1 time: 0.070737 Sep 08 10:33:30.028360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2117/4425] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:29 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:30.045654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4fef582-799b-49db-bbe1-702b84b84933 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '.version_select at 0x7f2351110f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:30.087430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:30.090700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:30.103812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.104665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.105543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.106814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.109444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.110901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.136188 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a4fef582-799b-49db-bbe1-702b84b84933 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480904515" status: 202 len: 0 microversion: 2.1 time: 0.101827 Sep 08 10:33:30.137610 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2309/4426] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480904515 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:33:30.144279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:30.145514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:30.152636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.153318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.153925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.155314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.156680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.157107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.473797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:30.486388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a88a35cb-2431-4370-a984-241f97210484 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1517 microversion: 2.1 time: 0.407131 Sep 08 10:33:30.486799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:30.488697 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2118/4427] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:30 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:30.496407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:30.498056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:30.510384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.510791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.512227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.513628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.513832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f5f11e8-7b7c-46cc-af2d-7d16cdc63afc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1812 microversion: 2.1 time: 0.374908 Sep 08 10:33:30.514494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.515421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.524355 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2310/4428] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:30 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1812 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:30.530060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:30.533562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:30.543564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.544286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.545040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.545900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.546801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.547375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.871415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:30.877335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:30.884731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:30.888123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:30.890110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b54e9422-89d8-4b8c-a55d-0ba66d7cb40a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.364539 Sep 08 10:33:30.891836 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-41f5795b-78ea-4e9d-bb7c-e510b1da97a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.400846 Sep 08 10:33:30.907492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2311/4429] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:30 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:30.907492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-919f395d-affb-45fc-afe1-7d762e25d531 req-0856dc76-0f5a-4886-8e6d-60f8726f308c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447f9c4a-3274-44aa-b371-c752e94d07ce", "name": "network-vif-plugged", "status": "completed", "tag": "8aa5f35b-ff25-4bdb-9453-722921868a1e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:30.907789 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2119/4430] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:30 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:30.912143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-919f395d-affb-45fc-afe1-7d762e25d531 req-0856dc76-0f5a-4886-8e6d-60f8726f308c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:30.913550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-919f395d-affb-45fc-afe1-7d762e25d531 req-0856dc76-0f5a-4886-8e6d-60f8726f308c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:30.924893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-919f395d-affb-45fc-afe1-7d762e25d531 req-0856dc76-0f5a-4886-8e6d-60f8726f308c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:30.949101 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-919f395d-affb-45fc-afe1-7d762e25d531 req-0856dc76-0f5a-4886-8e6d-60f8726f308c service nova] Creating event network-vif-plugged:8aa5f35b-ff25-4bdb-9453-722921868a1e for instance 447f9c4a-3274-44aa-b371-c752e94d07ce on n-h1-833090-19 Sep 08 10:33:30.957481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-919f395d-affb-45fc-afe1-7d762e25d531 req-0856dc76-0f5a-4886-8e6d-60f8726f308c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062903 Sep 08 10:33:30.958777 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2312/4431] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:30.988265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:30.989149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:31.001438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:31.002448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:31.012051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.012565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.014164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.023647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.024359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.027073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.034197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.039630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.040371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.041348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.042000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.050827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.057081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:31.402396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:31.417084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5e9b2f5-e3f8-4e8e-9163-1d75c5c39a66 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1314 microversion: 2.1 time: 0.441695 Sep 08 10:33:31.433529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2120/4432] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:30 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:31.467580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:31.484748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3cc2993-9b89-4f57-b0d7-da97d8704475 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1722 microversion: 2.1 time: 0.488747 Sep 08 10:33:31.489159 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2313/4433] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:30 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:31.512395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:31.519172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:31.526169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.526582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.527021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.535939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.536485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.536923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.558098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:31.562205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:31.571993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.576247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.576943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.577895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:31.578552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:31.579225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:31.921358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:31.933256 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c11fb5ca-712d-409d-b5a6-17e5f7232093 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1812 microversion: 2.1 time: 0.378914 Sep 08 10:33:31.934092 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2314/4434] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:31 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1812 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:31.940436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1caa7d29-a608-46cb-9bd8-06170d9f5ba4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: .version_select at 0x7f2350636ca0>, body: {"keypair": {"name": "tempest-keypair-1170491325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKroaZzB37Gubb8xHbGm8q6hQIg2V9Np2IZkkOUl3vj9+kCDsSHlJ9M6c3MaFq1O5jMKUysD1xpbRlHKYV//kL7wWhRDFhHCeqiqcpSUcVSYgNSaIRUVQvHWBrsn/WAzg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:31.983087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1caa7d29-a608-46cb-9bd8-06170d9f5ba4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for project 1ee1af948aad445daad7abcd11441316. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:31.991286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1caa7d29-a608-46cb-9bd8-06170d9f5ba4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for user 0dd35046e12b46a59478ad7dbe2339c9 and project 1ee1af948aad445daad7abcd11441316. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:32.040952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1caa7d29-a608-46cb-9bd8-06170d9f5ba4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104549 Sep 08 10:33:32.042074 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2315/4435] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:33:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:32.063152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:32.064671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:32.075921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.076682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.077231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.078054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.078588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.079220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.120314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.130095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aad0c509-b7cf-42fe-a05c-fddec3451cfb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1517 microversion: 2.1 time: 0.621412 Sep 08 10:33:32.132866 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2121/4436] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:31 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1517 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:32.148565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:32.149211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:32.155859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.156642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.157368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.158325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.159224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.159890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.417299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.425402 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28d47df1-dfd3-4a73-896c-96a5c07c5231 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1309 microversion: 2.1 time: 0.382022 Sep 08 10:33:32.434479 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2316/4437] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:32 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:32.448356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:32.449178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:32.455644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.456216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.456881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.457701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.458322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.458758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.483891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.498719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.500709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.502354 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42b89326-af15-4078-b93f-24894c3efa6c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.367609 Sep 08 10:33:32.503125 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2122/4438] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:32 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:32.513532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:32.516337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:32.525430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.525930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.526377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.527080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:32.527565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:32.528596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:32.813725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.822894 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79defbde-6a18-48b4-ac7a-7838b6967b0f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1314 microversion: 2.1 time: 0.380343 Sep 08 10:33:32.835491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2317/4439] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:32 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:32.870620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:32.880961 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-285b8a1a-44be-49e1-8059-6fe8d719fcc7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1722 microversion: 2.1 time: 0.372231 Sep 08 10:33:32.892324 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2123/4440] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:32 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:32.988756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a8ebb25f-1abc-4ca3-91e9-04efc38b1ff8 req-e66a007b-5b6c-4933-9610-6071be6b767d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6619364a-8281-4812-abf8-a4aaa9def357", "tag": "bfdb0ab7-10ce-4349-b5b0-d83ca0cdfab1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:33.002370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a8ebb25f-1abc-4ca3-91e9-04efc38b1ff8 req-e66a007b-5b6c-4933-9610-6071be6b767d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.003208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a8ebb25f-1abc-4ca3-91e9-04efc38b1ff8 req-e66a007b-5b6c-4933-9610-6071be6b767d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.003876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a8ebb25f-1abc-4ca3-91e9-04efc38b1ff8 req-e66a007b-5b6c-4933-9610-6071be6b767d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.020810 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a8ebb25f-1abc-4ca3-91e9-04efc38b1ff8 req-e66a007b-5b6c-4933-9610-6071be6b767d service nova] Creating event network-changed:bfdb0ab7-10ce-4349-b5b0-d83ca0cdfab1 for instance 6619364a-8281-4812-abf8-a4aaa9def357 on n-h1-833090-19 Sep 08 10:33:33.028455 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a8ebb25f-1abc-4ca3-91e9-04efc38b1ff8 req-e66a007b-5b6c-4933-9610-6071be6b767d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044367 Sep 08 10:33:33.030196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2318/4441] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:33.040924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:33.041875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:33.062766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.063533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.064174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.066240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.067955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.070498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.164759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:33.165675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:33.173627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.175726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.176336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.177850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.179222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.180569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.474051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:33.485698 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9e3cf79-8146-4096-9f31-2ae94ff2f075 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1517 microversion: 2.1 time: 0.326454 Sep 08 10:33:33.491827 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2319/4442] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:33 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1517 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:33.496655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:33.498344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:33.507166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.507961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.508481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.509305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.509840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.510346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.671939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:33.682602 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-782b7f4b-a3f0-473d-bf46-559d3ddd3425 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1812 microversion: 2.1 time: 0.645864 Sep 08 10:33:33.684173 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2124/4443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:33 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1812 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:33.694344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:33.695190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:33.711453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.712453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.713212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:33.714186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:33.714877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:33.715608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.366698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:34.377649 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-030c5bc5-0286-4346-874c-9e5b43ed9242 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1490 microversion: 2.1 time: 0.886434 Sep 08 10:33:34.378882 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2320/4444] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:33 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1490 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:34.384641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:34.385637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:34.404727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.405360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.405939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.406742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.407267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.407800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.511657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:34.522445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:34.524333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:34.525669 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c70efec-705a-48e3-b0ae-9927aa11a6c5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.836418 Sep 08 10:33:34.547560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2125/4445] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:33 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:34.650897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:34.661544 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ffc266e-8b21-425c-9b52-96b0195042c0 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1314 microversion: 2.1 time: 0.280551 Sep 08 10:33:34.662542 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2321/4446] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:34 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:34.672514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:34.676277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:34.693626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.694467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.695189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.697028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.697602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.698475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.705959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:34.708607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:34.720974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.722895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.725603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.727295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.728233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.730337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.797813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08b76cf9-729c-421b-8633-1c7578e09950 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "PUT /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1085 microversion: 2.1 time: 0.133268 Sep 08 10:33:34.811486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2322/4447] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:33:34 2022] PUT /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1085 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:34.811486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:34.811486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:34.816260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.817101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.818382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:34.820294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:34.820950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:34.821484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.025997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:35.036275 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26297736-9d27-4050-ba8d-85aa2489738b tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1728 microversion: 2.1 time: 0.486907 Sep 08 10:33:35.052613 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2126/4448] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:34 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1728 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:35.061467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:35.062320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:35.069510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.070541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.071136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.072043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.072646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.073242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.195227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:35.206105 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b92d9faf-8ef6-4ead-900d-8519056397db tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 200 len: 1517 microversion: 2.1 time: 0.404267 Sep 08 10:33:35.220643 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2323/4449] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:34 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 1517 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:35.231636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:35.232681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:35.242091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.242621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.243059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.244465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.244930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.245542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.272729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:35.281718 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e40cb8f-77a5-47bf-8387-0b6e74d74426 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1791 microversion: 2.1 time: 0.227659 Sep 08 10:33:35.282423 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2127/4450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:35 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1791 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:35.293156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:35.293842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:35.311832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.314572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.314572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.315263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.315980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.316490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.553674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:35.571325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4be65311-fee9-46f9-b234-db2e55cd3338 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1511 microversion: 2.1 time: 0.349395 Sep 08 10:33:35.572498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2324/4451] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:35 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:35.577308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-53a642eb-ade6-40a4-9ac8-414d8c663080 req-1437b11f-b4ba-42e7-93dc-1e671ca1ee68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e724ec35-a517-469c-9395-3f0318a2024c", "name": "network-vif-deleted", "tag": "c2781840-fb6e-4c56-9cc2-b29bb282e65b"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:35.604556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-53a642eb-ade6-40a4-9ac8-414d8c663080 req-1437b11f-b4ba-42e7-93dc-1e671ca1ee68 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.605265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-53a642eb-ade6-40a4-9ac8-414d8c663080 req-1437b11f-b4ba-42e7-93dc-1e671ca1ee68 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.605870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-53a642eb-ade6-40a4-9ac8-414d8c663080 req-1437b11f-b4ba-42e7-93dc-1e671ca1ee68 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.612423 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2325eaa7-019d-4bc5-92bf-67aadaa1de10 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.328795 Sep 08 10:33:35.614256 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2128/4452] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:33:35 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:35.620094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3c0ed547-9482-4603-9c4f-ac3f7027f7aa req-5cf98f2a-83f3-4732-b85e-c35d2727893a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-deleted", "tag": "75aab739-a5a3-48b5-b5a7-065dd5afdf52"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:35.635438 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-53a642eb-ade6-40a4-9ac8-414d8c663080 req-1437b11f-b4ba-42e7-93dc-1e671ca1ee68 service nova] Creating event network-vif-deleted:c2781840-fb6e-4c56-9cc2-b29bb282e65b for instance e724ec35-a517-469c-9395-3f0318a2024c on n-h2-833090-19 Sep 08 10:33:35.646585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3c0ed547-9482-4603-9c4f-ac3f7027f7aa req-5cf98f2a-83f3-4732-b85e-c35d2727893a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.649662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3c0ed547-9482-4603-9c4f-ac3f7027f7aa req-5cf98f2a-83f3-4732-b85e-c35d2727893a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.650393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3c0ed547-9482-4603-9c4f-ac3f7027f7aa req-5cf98f2a-83f3-4732-b85e-c35d2727893a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.661626 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-53a642eb-ade6-40a4-9ac8-414d8c663080 req-1437b11f-b4ba-42e7-93dc-1e671ca1ee68 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087660 Sep 08 10:33:35.667834 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2325/4453] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:35.689676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:35.693270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:35.695332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3c0ed547-9482-4603-9c4f-ac3f7027f7aa req-5cf98f2a-83f3-4732-b85e-c35d2727893a service nova] Creating event network-vif-deleted:75aab739-a5a3-48b5-b5a7-065dd5afdf52 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:35.709740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.713579 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3c0ed547-9482-4603-9c4f-ac3f7027f7aa req-5cf98f2a-83f3-4732-b85e-c35d2727893a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097834 Sep 08 10:33:35.715007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.716176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.717196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.719355 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2129/4454] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:35.719625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.720091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.732859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:35.733937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:35.757971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.759027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.763615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:35.765678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:35.766393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:35.767053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.310080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:36.328499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:36.330757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:36.333601 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a2fad60-0c27-403d-8086-57ced8f258ad tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1406 microversion: 2.20 time: 0.663141 Sep 08 10:33:36.334440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2326/4455] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:35 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1406 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:36.341668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:36.344356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f53115f3-48f5-48ca-87fc-932237560dd0 req-639cb1da-600b-4f6b-8ca9-5ead84eb919c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-unplugged", "status": "completed", "tag": "c931ed7a-54a5-4304-9ed2-f20056135a20"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:36.356725 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ff87518-2bc8-446b-8aaa-9d69a3369bff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1511 microversion: 2.1 time: 0.635112 Sep 08 10:33:36.357589 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2130/4456] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:35 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1511 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:36.360050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f53115f3-48f5-48ca-87fc-932237560dd0 req-639cb1da-600b-4f6b-8ca9-5ead84eb919c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.360842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f53115f3-48f5-48ca-87fc-932237560dd0 req-639cb1da-600b-4f6b-8ca9-5ead84eb919c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.361431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f53115f3-48f5-48ca-87fc-932237560dd0 req-639cb1da-600b-4f6b-8ca9-5ead84eb919c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.362813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-763491281", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2697db8c-2227-4a3c-87af-732f9cbcc5d8"}], "security_groups": [{"name": "tempest-securitygroup--930458363"}], "key_name": "tempest-keypair-1170491325", "user_data": "}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:36.386347 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f53115f3-48f5-48ca-87fc-932237560dd0 req-639cb1da-600b-4f6b-8ca9-5ead84eb919c service nova] Creating event network-vif-unplugged:c931ed7a-54a5-4304-9ed2-f20056135a20 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:36.397834 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f53115f3-48f5-48ca-87fc-932237560dd0 req-639cb1da-600b-4f6b-8ca9-5ead84eb919c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057046 Sep 08 10:33:36.403507 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2327/4457] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:36.409629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:36.410550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:36.417335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.418041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.418622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.419488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.420090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.420686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.695143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] validate_networks() for [('2697db8c-2227-4a3c-87af-732f9cbcc5d8', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:33:36.899919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:36.912033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5703250e-0606-421b-8996-8c6d549a755c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1314 microversion: 2.1 time: 0.507138 Sep 08 10:33:36.913561 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2328/4458] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:36 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:36.918908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:36.919873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: e724ec35-a517-469c-9395-3f0318a2024c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:36.927059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.927949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.928567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.929461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.930107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.930543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.945125 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] HTTP exception thrown: Instance e724ec35-a517-469c-9395-3f0318a2024c could not be found. Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Request method failure captured: Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c HTTP/1.1 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcS2corGhM40KXDRvmwNh7sdP5sEnnLTlx-rcHUic-5hZGiFcxn8y1KwRHvN5W5dRdHh7j4ts_15-pLkupvmrXOFzp81vjAGfDLqELQthoxxqlSbgevzSzHh4WBmZRcSJOF5dWnJIRTrYlpU7uwfcMkJU6kVEH-v_FJVsSOTyW0mpjg Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: beaeeece01104ca08b7362293f061037 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/beaeeece01104ca08b7362293f061037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/beaeeece01104ca08b7362293f061037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/beaeeece01104ca08b7362293f061037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_beaeeece01104ca08b7362293f061037", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: beaeeece01104ca08b7362293f061037 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListServerFiltersTestJSON-1563454902-project Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 02e6fae0553d463b9c7d029bda48989f Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListServerFiltersTestJSON-1563454902-project Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance e724ec35-a517-469c-9395-3f0318a2024c could not be found. Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'e724ec35-a517-469c-9395-3f0318a2024c'} Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e724ec35-a517-469c-9395-3f0318a2024c could not be found. Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e724ec35-a517-469c-9395-3f0318a2024c could not be found. Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:36.947948 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e724ec35-a517-469c-9395-3f0318a2024c could not be found. Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Returning 404 to user: Instance e724ec35-a517-469c-9395-3f0318a2024c could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01bc809e-614d-4409-8b60-f560ed3a5e55 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c" status: 404 len: 111 microversion: 2.1 time: 0.034583 Sep 08 10:33:36.952571 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2329/4459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:36 2022] GET /compute/v2.1/servers/e724ec35-a517-469c-9395-3f0318a2024c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:36.954899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:36.955472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:36.963720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.964435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.965151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:36.966063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:36.966827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:36.967439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:37.497825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:37.507330 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6cb945b2-53e8-477e-9e1d-df7dc6ec62cf tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 200 len: 1611 microversion: 2.1 time: 0.556395 Sep 08 10:33:37.511650 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2330/4460] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:36 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 1611 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:37.517077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:37.517796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:37.529704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:37.530768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:37.531892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:37.532943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:37.534122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:37.535294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:37.568455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:37.617047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:37.708907 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45e8d280-91f8-413f-aa6d-dd22682bfed7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 204 len: 0 microversion: 2.1 time: 0.199110 Sep 08 10:33:37.710094 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2331/4461] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:37 2022] DELETE /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:37.715578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:37.716347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:37.722349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:37.722923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:37.723308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:37.724838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:37.725134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:37.725553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:37.752980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:33:37.806469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=15 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:37.846906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9aff60d2-e283-4528-8998-491b1e0602f2 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 204 len: 0 microversion: 2.1 time: 0.135130 Sep 08 10:33:37.847877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2332/4462] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:33:37 2022] DELETE /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:33:37.853755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:37.854457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:37.861140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:37.861694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:37.862081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:37.862802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:37.863254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:37.863755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.202263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:33:38.203141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:33:38.204779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:33:38.215746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:33:38.217951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:33:38.237642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.238560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.241147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.243043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.243975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.245207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.294551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for project 1ee1af948aad445daad7abcd11441316. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:38.306546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:38.307628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Getting quotas for user 0dd35046e12b46a59478ad7dbe2339c9 and project 1ee1af948aad445daad7abcd11441316. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:38.324629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:38.326775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:38.331755 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f00cc8f8-94e6-4b57-a0af-594812f20e21 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1597 microversion: 2.20 time: 0.482886 Sep 08 10:33:38.334758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:33:38.335110 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2333/4463] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:33:37 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1597 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:33:38.339253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:33:38.342141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:38.347450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:38.360078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.361707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.362313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.363438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.364020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.364502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.406534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-106bc822-ac55-47ba-b1e0-a6b8fbdfe5fd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.047508 Sep 08 10:33:38.407752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2131/4464] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:33:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 2049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:33:38.415407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-deleted", "tag": "dcea6251-f94d-4749-908b-578984c45236"}, {"server_uuid": "b96838fc-ff49-49e0-be0a-5b87a257f7b2", "name": "network-vif-deleted", "tag": "c931ed7a-54a5-4304-9ed2-f20056135a20"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:38.426940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.428051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.428649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.441386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] Creating event network-vif-deleted:dcea6251-f94d-4749-908b-578984c45236 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:38.442127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] Creating event network-vif-deleted:c931ed7a-54a5-4304-9ed2-f20056135a20 for instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 on n-h2-833090-19 Sep 08 10:33:38.449999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0b2ba070-cdb6-4063-a2e0-4da01d578ce4 req-5bae1182-2692-4696-a244-e22d5f71fce4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040231 Sep 08 10:33:38.450968 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2132/4465] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:38.457777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:38.458833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:38.468896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.469628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.470228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.471363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.472053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.472638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.821167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:38.838094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:38.841948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9856dd6f-6c94-4f04-b54f-f72827b1f12b tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1518 microversion: 2.1 time: 0.386887 Sep 08 10:33:38.843854 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2133/4466] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:38 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:38.852372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ef171f6-2d00-43cb-b2fc-8e280ac224fe tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1517 microversion: 2.1 time: 0.516268 Sep 08 10:33:38.852962 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2334/4467] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:38 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:38.856005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:38.857260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:38.880581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:38.880878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:38.885115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.885782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.886510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.888015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.888769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.890156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.921128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.921939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.930957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:38.932049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:38.932748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:38.933359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.111686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b8460d5-72c7-4aa5-be86-0b10552b28a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.254827 Sep 08 10:33:39.120334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2335/4468] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:33:38 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:33:39.127257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7929d797-13a2-43b3-9d7b-04d314bb1ed6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:39.128882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7929d797-13a2-43b3-9d7b-04d314bb1ed6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:39.189417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:39.193398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:39.206648 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32371e9f-c81a-46ce-b0f7-15ebbaefbad8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1314 microversion: 2.1 time: 0.355912 Sep 08 10:33:39.222982 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2134/4469] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:38 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:39.222982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:39.222982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:39.235757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.236402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.236932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.244504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.245098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.245620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.269449 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] HTTP exception thrown: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:33:39.272106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7929d797-13a2-43b3-9d7b-04d314bb1ed6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Request method failure captured: Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 HTTP/1.1 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcTHXKmsccyshNKsO-lB39JJ2NtdeL4jl9VPUKR3Qwn9Y4QZyyRftI_VCP3os8XBrY8i9Ba5QKEUED8OdgdfEjstiU2V3syT8WGfH6eKOjvaf7ieM_WabtjKQ7dZcm58gcZl0lQQn6rimkbK7tYKj-gGfFYKpuDFMzSG32LtsVq4hIM Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_74ba3f7102ee4a859110d905535409c2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestMultiNic-119903602 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestMultiNic-119903602-project Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 23f41725e5014fa0b415fefeb73352e6 Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestMultiNic-119903602-project Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b96838fc-ff49-49e0-be0a-5b87a257f7b2'} Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:39.278331 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:39.282859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Returning 404 to user: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:39.283371 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7929d797-13a2-43b3-9d7b-04d314bb1ed6 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1237 microversion: 2.1 time: 0.157064 Sep 08 10:33:39.283490 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89a0068f-7f49-496c-9059-7af2bdd974d4 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 404 len: 111 microversion: 2.1 time: 0.071186 Sep 08 10:33:39.283490 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2135/4470] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:39 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:33:39.291823 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2336/4471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:39 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:39.312492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4ab2da54-d860-470a-9013-340d5319ee1b req-93d2789b-e58f-4114-b2a7-4b000daaa826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ae1c59-e738-4c93-891f-f3fd33f5568c", "tag": "02d0433b-b496-410d-b46c-603c4e47b66d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:39.328096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4ab2da54-d860-470a-9013-340d5319ee1b req-93d2789b-e58f-4114-b2a7-4b000daaa826 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.333848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4ab2da54-d860-470a-9013-340d5319ee1b req-93d2789b-e58f-4114-b2a7-4b000daaa826 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.334998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4ab2da54-d860-470a-9013-340d5319ee1b req-93d2789b-e58f-4114-b2a7-4b000daaa826 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.359448 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4ab2da54-d860-470a-9013-340d5319ee1b req-93d2789b-e58f-4114-b2a7-4b000daaa826 service nova] Creating event network-changed:02d0433b-b496-410d-b46c-603c4e47b66d for instance 48ae1c59-e738-4c93-891f-f3fd33f5568c on n-h2-833090-19 Sep 08 10:33:39.373308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4ab2da54-d860-470a-9013-340d5319ee1b req-93d2789b-e58f-4114-b2a7-4b000daaa826 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091196 Sep 08 10:33:39.375543 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2136/4472] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:39.889596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:39.891359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:39.892064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:39.894516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:39.907898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.908761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.910232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.910893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.911850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.912589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.913268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.913922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.914548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:39.915487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:39.917676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:39.918342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:40.566521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:40.595703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:40.609279 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a245db1-d8f1-4ead-85ff-cc343a5b78ad tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1518 microversion: 2.1 time: 0.729851 Sep 08 10:33:40.612326 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2337/4473] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:39 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1518 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:40.621060 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1fe88dee-9bc9-46c9-9e9f-dccd293e6ef9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1517 microversion: 2.1 time: 0.733586 Sep 08 10:33:40.633675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2137/4474] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:39 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1517 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:40.638173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:40.644456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:40.646251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:40.648219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:40.664400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:40.665377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:40.666074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:40.668716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:40.669902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:40.670654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:40.677015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:40.677515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:40.678051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:40.682523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:40.683254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:40.685133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:40.933467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:40.941440 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6572100a-ed34-498e-93cb-ca465fa6e23d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1295 microversion: 2.1 time: 0.306610 Sep 08 10:33:40.942231 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2138/4475] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:40 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1295 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:40.948008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ff81b4e3-5a31-4607-8f54-131ba552f76f req-1d047618-b26c-47c8-8f6b-852daf4f9b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6619364a-8281-4812-abf8-a4aaa9def357", "name": "network-vif-plugged", "status": "completed", "tag": "bfdb0ab7-10ce-4349-b5b0-d83ca0cdfab1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:40.958349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ff81b4e3-5a31-4607-8f54-131ba552f76f req-1d047618-b26c-47c8-8f6b-852daf4f9b34 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:40.958998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ff81b4e3-5a31-4607-8f54-131ba552f76f req-1d047618-b26c-47c8-8f6b-852daf4f9b34 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:40.960131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ff81b4e3-5a31-4607-8f54-131ba552f76f req-1d047618-b26c-47c8-8f6b-852daf4f9b34 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:40.977633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ff81b4e3-5a31-4607-8f54-131ba552f76f req-1d047618-b26c-47c8-8f6b-852daf4f9b34 service nova] Creating event network-vif-plugged:bfdb0ab7-10ce-4349-b5b0-d83ca0cdfab1 for instance 6619364a-8281-4812-abf8-a4aaa9def357 on n-h1-833090-19 Sep 08 10:33:40.990291 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ff81b4e3-5a31-4607-8f54-131ba552f76f req-1d047618-b26c-47c8-8f6b-852daf4f9b34 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046297 Sep 08 10:33:40.994660 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2139/4476] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:41.212099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:41.226382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-833d7a16-b2cd-4eeb-9cbc-582f8843cb2a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1314 microversion: 2.1 time: 0.610404 Sep 08 10:33:41.240305 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2338/4477] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:40 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:41.407278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-42e3bbec-2943-4baa-b9da-eb0b70c18b14 req-0f85db40-5053-4414-8bc8-fdac5c79b74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48ae1c59-e738-4c93-891f-f3fd33f5568c", "tag": "02d0433b-b496-410d-b46c-603c4e47b66d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:41.427109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-42e3bbec-2943-4baa-b9da-eb0b70c18b14 req-0f85db40-5053-4414-8bc8-fdac5c79b74e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:41.430453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-42e3bbec-2943-4baa-b9da-eb0b70c18b14 req-0f85db40-5053-4414-8bc8-fdac5c79b74e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:41.432989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-42e3bbec-2943-4baa-b9da-eb0b70c18b14 req-0f85db40-5053-4414-8bc8-fdac5c79b74e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:41.447695 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-42e3bbec-2943-4baa-b9da-eb0b70c18b14 req-0f85db40-5053-4414-8bc8-fdac5c79b74e service nova] Creating event network-changed:02d0433b-b496-410d-b46c-603c4e47b66d for instance 48ae1c59-e738-4c93-891f-f3fd33f5568c on n-h2-833090-19 Sep 08 10:33:41.456368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-42e3bbec-2943-4baa-b9da-eb0b70c18b14 req-0f85db40-5053-4414-8bc8-fdac5c79b74e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051557 Sep 08 10:33:41.457587 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2140/4478] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:41.586770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-efd89838-80fe-4fd1-a626-31adc3460867 req-5dd26092-5845-4eb5-ae5f-4c185cd3912c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:41.602925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-efd89838-80fe-4fd1-a626-31adc3460867 req-5dd26092-5845-4eb5-ae5f-4c185cd3912c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:41.603421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-efd89838-80fe-4fd1-a626-31adc3460867 req-5dd26092-5845-4eb5-ae5f-4c185cd3912c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:41.611382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-efd89838-80fe-4fd1-a626-31adc3460867 req-5dd26092-5845-4eb5-ae5f-4c185cd3912c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:41.638540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:41.639812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:41.645109 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-efd89838-80fe-4fd1-a626-31adc3460867 req-5dd26092-5845-4eb5-ae5f-4c185cd3912c service nova] Creating event network-changed:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h2-833090-19 Sep 08 10:33:41.661365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:41.661901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:41.662370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:41.664299 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-efd89838-80fe-4fd1-a626-31adc3460867 req-5dd26092-5845-4eb5-ae5f-4c185cd3912c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081100 Sep 08 10:33:41.665195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:41.665976 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2339/4479] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:41.666622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:41.680194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:41.685963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:41.686578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:41.712513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:41.713012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:41.713458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:41.714184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:41.714643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:41.715078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:42.084786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:42.095444 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08c0d637-76dd-4557-b639-c6a42c5b6f10 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1476 microversion: 2.1 time: 0.461108 Sep 08 10:33:42.111495 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2141/4480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:41 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:42.111495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:42.111495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:42.128560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:42.129071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:42.129516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:42.130266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:42.130701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:42.135956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:42.377470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:42.392633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b679017f-b5e1-4321-a552-2cf5084ff24e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1295 microversion: 2.1 time: 0.290313 Sep 08 10:33:42.420482 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2142/4481] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:42 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1295 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:42.429930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:42.431159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:42.469564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:42.473138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:42.473841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:42.476957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:42.477694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:42.486144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:42.566019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:42.589984 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c20f216c-1d3d-481c-9ce8-3864bd65ec00 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1517 microversion: 2.1 time: 0.921975 Sep 08 10:33:42.608597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2340/4482] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:41 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1517 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:43.128736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:43.129359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:43.149880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.149991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.151675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.152463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.153111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.153706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.238931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.239834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.241281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.242134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lazy-loading 'fault' on Instance uuid 3668eaf7-daff-402c-b428-bb6d6188bc08 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:43.437793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e6fae0553d463b9c7d029bda48989f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beaeeece01104ca08b7362293f061037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:43.451016 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b8dba90-12ed-4132-9d66-df03b8f01609 tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 200 len: 1311 microversion: 2.1 time: 0.325740 Sep 08 10:33:43.453589 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2341/4483] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:43 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:43.473304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:43.474411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:43.484178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.488720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.492707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.496016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.496740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.499380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.717982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:43.728576 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99c98086-1229-4468-a994-022955e13125 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1295 microversion: 2.1 time: 0.273415 Sep 08 10:33:43.730109 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2342/4484] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:43 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1295 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:43.738263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-eeecb937-8727-427a-8026-da944a853234 req-c084968e-02c0-45c1-9d10-2f4901dbf65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447f9c4a-3274-44aa-b371-c752e94d07ce", "name": "network-vif-deleted", "tag": "8aa5f35b-ff25-4bdb-9453-722921868a1e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:43.748570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:43.761320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eeecb937-8727-427a-8026-da944a853234 req-c084968e-02c0-45c1-9d10-2f4901dbf65e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.763050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eeecb937-8727-427a-8026-da944a853234 req-c084968e-02c0-45c1-9d10-2f4901dbf65e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.764429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eeecb937-8727-427a-8026-da944a853234 req-c084968e-02c0-45c1-9d10-2f4901dbf65e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.798255 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-eeecb937-8727-427a-8026-da944a853234 req-c084968e-02c0-45c1-9d10-2f4901dbf65e service nova] Creating event network-vif-deleted:8aa5f35b-ff25-4bdb-9453-722921868a1e for instance 447f9c4a-3274-44aa-b371-c752e94d07ce on n-h1-833090-19 Sep 08 10:33:43.809835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-eeecb937-8727-427a-8026-da944a853234 req-c084968e-02c0-45c1-9d10-2f4901dbf65e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078103 Sep 08 10:33:43.813643 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2343/4485] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:43.821569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:43.823054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:43.833900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.835121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.835715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.836533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.837770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.838325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.902944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.904127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.904312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:43.904820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.905395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid 447f9c4a-3274-44aa-b371-c752e94d07ce {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:33:43.916535 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5dbdcdef-37bf-4fcd-b690-f20d94686b58 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1501 microversion: 2.1 time: 1.494285 Sep 08 10:33:43.917141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2143/4486] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:42 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1501 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:43.939444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-22a9203c-4558-4db9-9cc7-eddbab8b445c req-a9c56e84-5415-4857-8f52-804db4616915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3668eaf7-daff-402c-b428-bb6d6188bc08", "name": "network-vif-deleted", "tag": "5e094197-7caf-4cde-b31c-ec217cf6ef6d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:43.948807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:43.951030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22a9203c-4558-4db9-9cc7-eddbab8b445c req-a9c56e84-5415-4857-8f52-804db4616915 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.951760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22a9203c-4558-4db9-9cc7-eddbab8b445c req-a9c56e84-5415-4857-8f52-804db4616915 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.952568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22a9203c-4558-4db9-9cc7-eddbab8b445c req-a9c56e84-5415-4857-8f52-804db4616915 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:43.966901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-22a9203c-4558-4db9-9cc7-eddbab8b445c req-a9c56e84-5415-4857-8f52-804db4616915 service nova] Creating event network-vif-deleted:5e094197-7caf-4cde-b31c-ec217cf6ef6d for instance 3668eaf7-daff-402c-b428-bb6d6188bc08 on n-h1-833090-19 Sep 08 10:33:43.972469 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-22a9203c-4558-4db9-9cc7-eddbab8b445c req-a9c56e84-5415-4857-8f52-804db4616915 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036625 Sep 08 10:33:43.973696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2144/4487] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:43.981280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fc947b96-4148-410a-9419-8dd76c729a90 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:43.988719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc947b96-4148-410a-9419-8dd76c729a90 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:43.989618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc947b96-4148-410a-9419-8dd76c729a90 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:43.990287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc947b96-4148-410a-9419-8dd76c729a90 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:44.024889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fc947b96-4148-410a-9419-8dd76c729a90 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:33:44.100050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fc947b96-4148-410a-9419-8dd76c729a90 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357/action" status: 202 len: 0 microversion: 2.1 time: 0.124267 Sep 08 10:33:44.100933 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2145/4488] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:33:43 2022] POST /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:33:44.114190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:44.115439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:44.128455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:44.128916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:44.129472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:44.133830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:44.133830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:44.133830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:44.226666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:44.242890 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e3863b8-a7ce-486e-9781-184b5fbb0a41 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 200 len: 1320 microversion: 2.1 time: 0.427847 Sep 08 10:33:44.245562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2344/4489] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:43 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 1320 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:44.480626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:44.481495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] [instance: 3668eaf7-daff-402c-b428-bb6d6188bc08] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:44.489734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:44.490743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:44.491349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:44.493506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:44.494165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:44.494759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:44.513027 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] HTTP exception thrown: Instance 3668eaf7-daff-402c-b428-bb6d6188bc08 could not be found. Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Request method failure captured: Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 HTTP/1.1 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcS2corGhM40KXDRvmwNh7sdP5sEnnLTlx-rcHUic-5hZGiFcxn8y1KwRHvN5W5dRdHh7j4ts_15-pLkupvmrXOFzp81vjAGfDLqELQthoxxqlSbgevzSzHh4WBmZRcSJOF5dWnJIRTrYlpU7uwfcMkJU6kVEH-v_FJVsSOTyW0mpjg Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: beaeeece01104ca08b7362293f061037 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/beaeeece01104ca08b7362293f061037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/beaeeece01104ca08b7362293f061037"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/beaeeece01104ca08b7362293f061037"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_beaeeece01104ca08b7362293f061037", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: beaeeece01104ca08b7362293f061037 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1563454902 Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ListServerFiltersTestJSON-1563454902-project Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 02e6fae0553d463b9c7d029bda48989f Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ListServerFiltersTestJSON-1563454902-project Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3668eaf7-daff-402c-b428-bb6d6188bc08 could not be found. Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3668eaf7-daff-402c-b428-bb6d6188bc08'} Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3668eaf7-daff-402c-b428-bb6d6188bc08 could not be found. Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3668eaf7-daff-402c-b428-bb6d6188bc08 could not be found. Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:44.515001 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3668eaf7-daff-402c-b428-bb6d6188bc08 could not be found. Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] Returning 404 to user: Instance 3668eaf7-daff-402c-b428-bb6d6188bc08 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c42c7e7-3883-4841-b3e3-d9b8cad48dbb tempest-ListServerFiltersTestJSON-1563454902 tempest-ListServerFiltersTestJSON-1563454902-project] 10.222.0.59 "GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08" status: 404 len: 111 microversion: 2.1 time: 0.039895 Sep 08 10:33:44.520010 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2345/4490] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:44 2022] GET /compute/v2.1/servers/3668eaf7-daff-402c-b428-bb6d6188bc08 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:33:44.660053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:44.670381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-57181f4f-101f-4a7e-8032-ffc6985853a1 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.563730 Sep 08 10:33:44.671517 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2146/4491] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:44 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:44.757579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:44.758738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:44.768582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:44.769203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:44.769738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:44.770618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:44.771252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:44.772437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:45.203281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:45.215613 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff0959ec-a718-4d87-9e35-26adb4e1e93a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.462597 Sep 08 10:33:45.216725 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2346/4492] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:44 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:45.270666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:45.271292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:45.284927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:45.285414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:45.285847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:45.286541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:45.287197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:45.287784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:45.303888 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce HTTP/1.1 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '447f9c4a-3274-44aa-b371-c752e94d07ce'} Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:33:45.305707 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:33:45.309269 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e6a0a142-d5dd-46e9-ae63-5bcc0a7f8dbc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 404 len: 111 microversion: 2.1 time: 0.040407 Sep 08 10:33:45.319401 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2147/4493] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:45 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:33:45.445016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-39179174", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "22840250-65b7-4843-8802-9980646adc27"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:45.528917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] validate_networks() for [('22840250-65b7-4843-8802-9980646adc27', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:33:45.706966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:45.709311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:45.730369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:45.731364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:45.733047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:45.735958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:45.736581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:45.739168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:46.098715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:46.116459 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6fc79fd6-86ee-46e7-a196-9f2a88583367 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.422371 Sep 08 10:33:46.118047 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2148/4494] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:45 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:46.249933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:46.252373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:46.260957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:46.261821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:46.262718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:46.263780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:46.264828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:46.265683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:46.690411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:33:46.691058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:33:46.692112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:46.693188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:33:46.694344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:33:46.694942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:33:46.705611 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0c2c68c-08cf-4bf2-ae25-c6b07f96934d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.461088 Sep 08 10:33:46.711649 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2149/4495] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:46 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:46.734346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:46.735639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:46.736495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:46.737940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:46.740726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:46.742484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:46.795406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:46.797006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f16a72e8-5cc2-40d3-8e64-ce1adf7f6ca0 req-16cd918a-e56f-4a57-a9ec-2a81e7998b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6133c359-37f2-48a7-a087-355b76cdd4f6", "tag": "d6dc4fb3-2700-45ae-9592-e2f32a3034b0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:46.808816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Getting quotas for user d581cec478364aa7b961ea983651ce95 and project 1188806962d8439496e4994be3522a05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:46.819950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f16a72e8-5cc2-40d3-8e64-ce1adf7f6ca0 req-16cd918a-e56f-4a57-a9ec-2a81e7998b98 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:46.820439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f16a72e8-5cc2-40d3-8e64-ce1adf7f6ca0 req-16cd918a-e56f-4a57-a9ec-2a81e7998b98 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:46.820872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f16a72e8-5cc2-40d3-8e64-ce1adf7f6ca0 req-16cd918a-e56f-4a57-a9ec-2a81e7998b98 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:46.825766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:33:46.828494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:33:46.842706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f16a72e8-5cc2-40d3-8e64-ce1adf7f6ca0 req-16cd918a-e56f-4a57-a9ec-2a81e7998b98 service nova] Creating event network-changed:d6dc4fb3-2700-45ae-9592-e2f32a3034b0 for instance 6133c359-37f2-48a7-a087-355b76cdd4f6 on n-h2-833090-19 Sep 08 10:33:46.852938 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f16a72e8-5cc2-40d3-8e64-ce1adf7f6ca0 req-16cd918a-e56f-4a57-a9ec-2a81e7998b98 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059790 Sep 08 10:33:46.853713 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2150/4496] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:33:46.912454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1385ca86-9146-4da4-9f25-f7989bd5393e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466130 Sep 08 10:33:46.916178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2347/4497] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:33:46.930089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-985dd774-74b5-428e-95aa-bfbf30328b3f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:46.931196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-985dd774-74b5-428e-95aa-bfbf30328b3f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:47.136311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-985dd774-74b5-428e-95aa-bfbf30328b3f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:47.150128 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-985dd774-74b5-428e-95aa-bfbf30328b3f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1207 microversion: 2.1 time: 0.225133 Sep 08 10:33:47.150334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:47.151252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:47.163521 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2151/4498] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:46 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1207 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:47.171693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:47.172058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:47.172821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:47.176592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:47.176592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:47.176592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:47.530868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:47.540300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0dab313a-7399-46cf-8089-970367db48b2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.399891 Sep 08 10:33:47.546291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2348/4499] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:47 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:47.745935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:47.746581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:47.798177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:47.801611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:47.802075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:47.810569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:47.813956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:47.815532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:47.912772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1500031022", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "28013719-874f-4c54-b775-7bb479913ffc"}, {"uuid": "47674706-4720-41b8-94cb-cdf19f27e701"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:48.017918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] validate_networks() for [('28013719-874f-4c54-b775-7bb479913ffc', None, None, None, None, None), ('47674706-4720-41b8-94cb-cdf19f27e701', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:33:48.275272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:48.377584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:48.404395 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2473ec21-4046-48bd-a926-5df0751ecac9 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.669595 Sep 08 10:33:48.405105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2152/4500] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:47 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:48.437553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:48.438536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:48.466884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:48.467413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:48.474202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:48.475215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:48.475902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:48.476437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:48.633342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:48.650307 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-adb3eb36-b0ec-4c69-8a7f-ec97e26f4936 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1259 microversion: 2.1 time: 0.240488 Sep 08 10:33:48.650910 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2153/4501] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:48 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:48.676862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:48.679355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:48.698019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:48.701885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:48.702396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:48.705675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:48.705897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:48.706340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:49.965720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:49.994501 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-177d175a-fb94-4c56-a5bf-0d9434554eb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 1.330023 Sep 08 10:33:49.998947 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2154/4502] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:48 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:50.044330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:50.045470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:50.063439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:50.065031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:50.066746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:50.069962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:50.070774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:50.071906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:50.582127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:33:50.583362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:33:50.584539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:33:50.585087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:33:50.585658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:33:50.616350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:50.617453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:50.619233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:50.621878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:50.624067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:50.624674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:50.685463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Getting quotas for project 74ba3f7102ee4a859110d905535409c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:33:50.699147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Getting quotas for user 23f41725e5014fa0b415fefeb73352e6 and project 74ba3f7102ee4a859110d905535409c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:33:50.737519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:33:50.753746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:33:50.887814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d1f2d34f-65b5-4e70-93de-ea5a83479e6b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.979526 Sep 08 10:33:50.889758 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2349/4503] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:33:50.903346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:50.903999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:50.923348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:50.924041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:50.924629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:50.925770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:50.927264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:50.930223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:50.941460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:51.012146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:51.026907 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d748e086-9ad1-4fc5-bdae-d96310a3826e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 1.012751 Sep 08 10:33:51.027867 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2155/4504] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:49 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:51.037375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffc68b85-5cca-4bd9-95c6-543a9c454e2a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:51.070893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffc68b85-5cca-4bd9-95c6-543a9c454e2a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:51.217875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:51.231113 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8beadfb-a8f3-4092-a6ee-fe8c1e65a75f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1265 microversion: 2.1 time: 0.340474 Sep 08 10:33:51.254612 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2350/4505] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:50 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:51.263734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:51.268934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:51.281180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:51.290067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:51.290788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:51.291559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:51.292205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:51.292826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:51.409484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ffc68b85-5cca-4bd9-95c6-543a9c454e2a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:51.446992 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffc68b85-5cca-4bd9-95c6-543a9c454e2a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1213 microversion: 2.1 time: 0.413232 Sep 08 10:33:51.448984 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2156/4506] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:51 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1213 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:51.866159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:51.896647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5be50187-8f5d-4d9d-b480-673055065562 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.631087 Sep 08 10:33:51.897881 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2351/4507] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:51 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:52.054410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:52.054761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:52.067411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.075690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.076154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.076913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.077378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.077808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.100772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:33:52.266105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:52.268062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:52.286580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.294661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.295905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.299676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.300220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.301963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.662537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:52.685988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8bb30fe4-6de6-4e52-9a1e-3100e4932c47 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1265 microversion: 2.1 time: 0.427327 Sep 08 10:33:52.713431 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2352/4508] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:52 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1265 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:52.727839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:52.732296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:52.741336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:52.746010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.748640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.749400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.751197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.752237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.753040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.757079 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02d72398-1c72-49c4-b377-5496908cf43d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.704093 Sep 08 10:33:52.769360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2157/4509] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:52 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:52.869031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:52.880454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d6f758d-a355-4ea4-8420-e04b6b58175e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1265 microversion: 2.1 time: 0.165597 Sep 08 10:33:52.881218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2353/4510] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:52 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:52.933229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:52.933972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:52.946353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.946973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.947239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:52.948908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:52.952368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:52.953936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:53.709407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:53.710266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:53.725771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:53.726503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:53.727185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:53.727912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:53.730720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:53.732184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:54.026097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:54.040375 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c57f9d7-54b6-4196-b552-cb781e773893 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 1.113162 Sep 08 10:33:54.042359 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2158/4511] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:52 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:54.080013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:54.081100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:54.088469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:54.101570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-24e626f7-77c7-414c-9955-71e378dcbfaa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.397450 Sep 08 10:33:54.110913 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2354/4512] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:53 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:54.119763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:54.121807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:54.123686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:54.124330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:54.125346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:54.126267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:54.128459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:54.129455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:54.148559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:54.151777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:54.152452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:54.160399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:54.161377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:54.162672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:54.391959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:54.405910 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61052316-545d-43ef-b68c-efbcf950049c tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1271 microversion: 2.1 time: 0.293509 Sep 08 10:33:54.415583 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2355/4513] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:54 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:54.570806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:54.578913 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e081dac-3ec3-4ca4-a835-796971340641 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.508156 Sep 08 10:33:54.597835 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2159/4514] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:54 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:55.069878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:55.070886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:55.078552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:55.079285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:55.079953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:55.081569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:55.082265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:55.082900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:55.137980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:55.138790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:55.151109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:55.151802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:55.152316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:55.153308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:55.153888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:55.154471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:55.940096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:55.950325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dcd24494-7657-4f83-8fd4-804827939c04 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.887829 Sep 08 10:33:55.950916 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2356/4515] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:55 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:55.956804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:55.957643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:55.964438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:55.964802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:55.965238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:55.965938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:55.966383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:55.966806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:55.995959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:56.010555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59599970-404d-498d-9043-4664f996b14b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.876773 Sep 08 10:33:56.012337 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2160/4516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:55 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:56.019351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:56.020156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:56.031394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:56.032505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:56.033144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:56.034129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:56.034843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:56.035966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:56.489434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:56.505941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:56.508288 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb18413f-baee-4474-8cbf-9e9c7307f727 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1313 microversion: 2.1 time: 0.552993 Sep 08 10:33:56.521976 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2357/4517] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:55 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:56.531941 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ac62ecb-adf7-486a-8550-e40841d0c032 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.518222 Sep 08 10:33:56.534369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a255c6eb-625b-48f7-bdaa-0140d8e90c3f req-2335bb89-6dbf-4e69-b2e7-317f166042a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6133c359-37f2-48a7-a087-355b76cdd4f6", "name": "network-vif-plugged", "status": "completed", "tag": "d6dc4fb3-2700-45ae-9592-e2f32a3034b0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:56.546286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a255c6eb-625b-48f7-bdaa-0140d8e90c3f req-2335bb89-6dbf-4e69-b2e7-317f166042a9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:56.547197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a255c6eb-625b-48f7-bdaa-0140d8e90c3f req-2335bb89-6dbf-4e69-b2e7-317f166042a9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:56.547727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a255c6eb-625b-48f7-bdaa-0140d8e90c3f req-2335bb89-6dbf-4e69-b2e7-317f166042a9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:56.552310 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2161/4518] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:56 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:56.559973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1742ed8b-47b1-4b87-a4e2-3200df6fa548 req-f3cf6e0d-6dfc-4166-8d41-2d322527e72f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc55b88-086c-4254-b637-2ce9d168b470", "tag": "cf3db276-1320-4db1-b109-b2fbc138b120"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:56.564229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a255c6eb-625b-48f7-bdaa-0140d8e90c3f req-2335bb89-6dbf-4e69-b2e7-317f166042a9 service nova] Creating event network-vif-plugged:d6dc4fb3-2700-45ae-9592-e2f32a3034b0 for instance 6133c359-37f2-48a7-a087-355b76cdd4f6 on n-h2-833090-19 Sep 08 10:33:56.572057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a255c6eb-625b-48f7-bdaa-0140d8e90c3f req-2335bb89-6dbf-4e69-b2e7-317f166042a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041705 Sep 08 10:33:56.573382 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2358/4519] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:56.577929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1742ed8b-47b1-4b87-a4e2-3200df6fa548 req-f3cf6e0d-6dfc-4166-8d41-2d322527e72f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:56.578420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1742ed8b-47b1-4b87-a4e2-3200df6fa548 req-f3cf6e0d-6dfc-4166-8d41-2d322527e72f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:56.578856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1742ed8b-47b1-4b87-a4e2-3200df6fa548 req-f3cf6e0d-6dfc-4166-8d41-2d322527e72f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:56.594884 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1742ed8b-47b1-4b87-a4e2-3200df6fa548 req-f3cf6e0d-6dfc-4166-8d41-2d322527e72f service nova] Creating event network-changed:cf3db276-1320-4db1-b109-b2fbc138b120 for instance 9cc55b88-086c-4254-b637-2ce9d168b470 on n-h1-833090-19 Sep 08 10:33:56.601031 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1742ed8b-47b1-4b87-a4e2-3200df6fa548 req-f3cf6e0d-6dfc-4166-8d41-2d322527e72f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044983 Sep 08 10:33:56.602239 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2162/4520] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:56.977852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:56.978809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:56.986776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:56.987318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:56.988024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:56.988965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:56.990526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:56.991161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.037401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:57.038585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:57.057292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:57.059837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:57.060546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.061745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:57.062420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:57.063026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.372394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:57.393616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f3b50942-66af-4b7d-9189-4178890c03a4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.420024 Sep 08 10:33:57.395755 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2359/4521] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:56 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:57.456076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:57.469769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3054c5e-03b1-489f-aafa-9733eb837347 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.438252 Sep 08 10:33:57.470669 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2163/4522] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:57 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:57.536500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:57.537292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:57.560147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:57.561267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:57.561639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:57.562335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:57.562644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.567635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:57.572653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:57.574193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:57.574792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.574913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:57.575909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.576827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:57.577537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:57.578526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:57.914071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:57.927155 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b99854f3-d4a5-4cd6-bc12-0d76f2ce5baa tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1362 microversion: 2.1 time: 0.372314 Sep 08 10:33:57.929560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2164/4523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:57 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:57.976967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:57.986132 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-deb29114-a31c-4c99-bba2-92e3192aede7 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.453517 Sep 08 10:33:58.002990 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2360/4524] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:57 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:58.419215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:58.419988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:58.441913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:58.442298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:58.442737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:58.444448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:58.446377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:58.447808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:58.498775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:58.499395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:58.508658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:58.509143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:58.510584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:58.511645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:58.512471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:58.513108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:58.915780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:58.921892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:58.932257 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5effd649-2991-4bb9-83e5-618b5368bfc6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.516987 Sep 08 10:33:58.936543 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2165/4525] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:58 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:58.958097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e4916a3-8ba9-433a-9199-264af57ae9a9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.463940 Sep 08 10:33:58.960263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:58.960424 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2361/4526] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:58 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:33:58.961379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:58.969236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:58.970209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:58.970919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:58.971936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:58.972607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:58.973680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.014813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:59.015440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:59.045920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.046750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.047857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.053108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.054790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.055517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.432490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:59.445607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:33:59.460741 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed6f5052-d3d5-44b8-8180-6f5a52c93a66 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.453248 Sep 08 10:33:59.461885 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8a97fc8-25a7-42f4-96fb-45bf28c9865b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1549 microversion: 2.1 time: 0.504670 Sep 08 10:33:59.463548 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2362/4527] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:59 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:59.467653 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2166/4528] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:58 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1549 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:33:59.470709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a41d86ed-b1ef-4793-92df-18b17fce78b2 req-3932934d-3242-41fd-8755-ef50b4187ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd8fd1c-d047-4664-9e75-97da41ca128f", "tag": "c7cc5dcd-3e64-44b2-8aef-43f795dc786f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:33:59.485606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a41d86ed-b1ef-4793-92df-18b17fce78b2 req-3932934d-3242-41fd-8755-ef50b4187ea4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.486526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a41d86ed-b1ef-4793-92df-18b17fce78b2 req-3932934d-3242-41fd-8755-ef50b4187ea4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.487362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a41d86ed-b1ef-4793-92df-18b17fce78b2 req-3932934d-3242-41fd-8755-ef50b4187ea4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.489909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:59.490406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:59.504160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.506752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.507443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.509216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.511169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.512837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.523980 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a41d86ed-b1ef-4793-92df-18b17fce78b2 req-3932934d-3242-41fd-8755-ef50b4187ea4 service nova] Creating event network-changed:c7cc5dcd-3e64-44b2-8aef-43f795dc786f for instance dfd8fd1c-d047-4664-9e75-97da41ca128f on n-h2-833090-19 Sep 08 10:33:59.537854 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a41d86ed-b1ef-4793-92df-18b17fce78b2 req-3932934d-3242-41fd-8755-ef50b4187ea4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069036 Sep 08 10:33:59.538494 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2363/4529] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:33:59.678804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-020948b2-e4d8-4c09-97c8-d5c56d6097b4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193157 Sep 08 10:33:59.680582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2167/4530] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:33:59 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:33:59.962172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:59.963050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:59.971164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.974115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.976424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:33:59.978250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:33:59.979183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:33:59.985307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:33:59.986618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:33:59.993502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:00.001262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:00.003003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:00.006791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:00.009171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:00.009877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:00.016713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:00.424845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:00.441017 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7e9f8cb-7779-4605-90d6-33e74460ac10 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.459748 Sep 08 10:34:00.444274 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2168/4531] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:59 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:00.486739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:00.491293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:00.492178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:00.495295 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4a35d51-1c86-46db-ab44-de50f8718e7d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.537716 Sep 08 10:34:00.499203 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2364/4532] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:33:59 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:00.512612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:00.513651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:00.514969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:00.520210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:00.520993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:00.522190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:00.886083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:00.895596 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-305dd6f2-519b-4e1a-a8fb-9923280021d5 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.408727 Sep 08 10:34:00.912493 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2169/4533] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:00 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:01.326443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:01.327394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=24 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:01.473373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:01.475554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:01.481840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:01.485929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:01.486725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:01.487311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:01.488226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:01.489149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:01.489846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:01.609903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-2f924f50-5864-46ad-bdb7-89f4c569a92b req-af703114-3f2a-42cd-9895-c9fa250b0cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6133c359-37f2-48a7-a087-355b76cdd4f6", "tag": "d6dc4fb3-2700-45ae-9592-e2f32a3034b0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:01.639246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2f924f50-5864-46ad-bdb7-89f4c569a92b req-af703114-3f2a-42cd-9895-c9fa250b0cec service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:01.640196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2f924f50-5864-46ad-bdb7-89f4c569a92b req-af703114-3f2a-42cd-9895-c9fa250b0cec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:01.642599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-2f924f50-5864-46ad-bdb7-89f4c569a92b req-af703114-3f2a-42cd-9895-c9fa250b0cec service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:01.660295 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-2f924f50-5864-46ad-bdb7-89f4c569a92b req-af703114-3f2a-42cd-9895-c9fa250b0cec service nova] Creating event network-changed:d6dc4fb3-2700-45ae-9592-e2f32a3034b0 for instance 6133c359-37f2-48a7-a087-355b76cdd4f6 on n-h2-833090-19 Sep 08 10:34:01.667665 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-2f924f50-5864-46ad-bdb7-89f4c569a92b req-af703114-3f2a-42cd-9895-c9fa250b0cec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347101 Sep 08 10:34:01.675336 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2365/4534] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:01.687455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:01.689920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:01.700885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:01.701803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:01.702579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:01.704149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:01.704628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:01.705067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:01.863778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:01.878951 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1c00ec4-898e-4ad8-9b25-3ba00b0e638a tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.411373 Sep 08 10:34:01.883342 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2170/4535] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:01 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:01.892419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-26ad9ac0-ab12-4e6c-88f5-2c853ec874a3 req-786b7ec2-a489-4108-a565-0c1112711828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd8fd1c-d047-4664-9e75-97da41ca128f", "tag": "a2ec081f-74bc-46c6-bbb0-00be3a0d21a5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:01.923786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26ad9ac0-ab12-4e6c-88f5-2c853ec874a3 req-786b7ec2-a489-4108-a565-0c1112711828 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:01.926906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26ad9ac0-ab12-4e6c-88f5-2c853ec874a3 req-786b7ec2-a489-4108-a565-0c1112711828 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:01.928165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-26ad9ac0-ab12-4e6c-88f5-2c853ec874a3 req-786b7ec2-a489-4108-a565-0c1112711828 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:01.970534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-26ad9ac0-ab12-4e6c-88f5-2c853ec874a3 req-786b7ec2-a489-4108-a565-0c1112711828 service nova] Creating event network-changed:a2ec081f-74bc-46c6-bbb0-00be3a0d21a5 for instance dfd8fd1c-d047-4664-9e75-97da41ca128f on n-h2-833090-19 Sep 08 10:34:01.982401 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-26ad9ac0-ab12-4e6c-88f5-2c853ec874a3 req-786b7ec2-a489-4108-a565-0c1112711828 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097323 Sep 08 10:34:01.983916 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2171/4536] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:01.999287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:02.000589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:02.019839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:02.020673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:02.021392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:02.022352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:02.023191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:02.023854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:02.614344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:02.632072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e414e8a2-6034-4f47-b8e4-488ca513eab3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.946813 Sep 08 10:34:02.633852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2366/4537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:01 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:02.645535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9461a8a2-dfe7-4e9c-bfb0-f826522d6266 req-8515af1d-97ad-4ff3-ad08-211ccbe39510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc55b88-086c-4254-b637-2ce9d168b470", "name": "network-vif-plugged", "status": "completed", "tag": "cf3db276-1320-4db1-b109-b2fbc138b120"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:02.672817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9461a8a2-dfe7-4e9c-bfb0-f826522d6266 req-8515af1d-97ad-4ff3-ad08-211ccbe39510 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:02.673527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9461a8a2-dfe7-4e9c-bfb0-f826522d6266 req-8515af1d-97ad-4ff3-ad08-211ccbe39510 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:02.674164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9461a8a2-dfe7-4e9c-bfb0-f826522d6266 req-8515af1d-97ad-4ff3-ad08-211ccbe39510 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:02.697676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9461a8a2-dfe7-4e9c-bfb0-f826522d6266 req-8515af1d-97ad-4ff3-ad08-211ccbe39510 service nova] Creating event network-vif-plugged:cf3db276-1320-4db1-b109-b2fbc138b120 for instance 9cc55b88-086c-4254-b637-2ce9d168b470 on n-h1-833090-19 Sep 08 10:34:02.703314 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9461a8a2-dfe7-4e9c-bfb0-f826522d6266 req-8515af1d-97ad-4ff3-ad08-211ccbe39510 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067884 Sep 08 10:34:02.704667 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2367/4538] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:02.909093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:02.912487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:02.928384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:02.929294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:02.929993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:02.934560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:02.935499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:02.936342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:02.940347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:02.956282 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7abe6dcc-4730-4920-a7ac-77caa10b92ea tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.966489 Sep 08 10:34:02.969014 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2172/4539] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:01 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:03.228363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:03.242238 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27273655-b638-416a-8549-c11da44e819f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.337774 Sep 08 10:34:03.257019 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2368/4540] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:02 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:03.661562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:03.662253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:03.669500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:03.669992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:03.670424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:03.671126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:03.671743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:03.672177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:03.980557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:03.996793 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93f78ed3-f033-4575-ac46-cb733c49bbe4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.339216 Sep 08 10:34:03.998061 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2173/4541] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:03 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:04.008608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:04.009688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:04.027752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:04.033018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:04.034569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:04.037083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:04.040097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:04.042325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:04.071655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:04.223529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:04.235378 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dfe4ff26-a8b5-44d8-80d7-5df134c6cd2f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.249309 Sep 08 10:34:04.236259 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2369/4542] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:03 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:04.272216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:04.273065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:04.282073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:04.283120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:04.284033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:04.284944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:04.285778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:04.286427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:04.438865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:04.449055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3cb48f2b-caea-4495-8d38-a93ce3aa7473 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1307 microversion: 2.1 time: 0.182416 Sep 08 10:34:04.450479 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2174/4543] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:04 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:05.021744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:05.022388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:05.031090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.031987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.032597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.033409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.033926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.034750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.191791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:05.200957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4606b1c-8df2-431a-9ccf-06e94f7b56d4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.183486 Sep 08 10:34:05.203675 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2370/4544] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:05 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:05.262296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:05.263449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:05.271679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.272527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.273248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.274059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.274619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.275154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.307098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:05.474659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:05.476160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:05.486305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.486818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.487341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.488121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.488582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.489008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.502752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:05.513591 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef790893-a22a-41ae-8ba8-fc02c59e9f72 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.257264 Sep 08 10:34:05.514172 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2175/4545] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:05 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:05.663429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:05.673127 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89190ed1-86a3-4dcd-8d6e-66a61583419c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1488 microversion: 2.1 time: 0.203357 Sep 08 10:34:05.674392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2371/4546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:05 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1488 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:05.695924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1655584718"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:05.698418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:05.704354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.705007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.705590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.706453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.707047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.707644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.832174 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e348703a-2a91-4790-804f-09fbf2e62406 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "PUT /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1075 microversion: 2.1 time: 0.140151 Sep 08 10:34:05.844470 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2176/4547] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:34:05 2022] PUT /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1075 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:05.853802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:05.854217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:05.861311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.862802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.863669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:05.864586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:05.865275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:05.865966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.042517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:06.060726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f0032752-88d3-41cc-aa80-e660e608ffe7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1501 microversion: 2.1 time: 0.211173 Sep 08 10:34:06.061579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2372/4548] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:05 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:06.088245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:06.088936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:06.100304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.103890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.103993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.104740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.105208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.105660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.229648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:06.230510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:06.245063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.246169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.247152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.247958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.248422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.248851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.297615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:06.308611 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d333529b-2e96-47cf-a894-b369acf4dddc tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1501 microversion: 2.1 time: 0.225403 Sep 08 10:34:06.309452 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2177/4549] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:06 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:06.331514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a0e154e-92ee-4fbe-aa0c-73a2cc6296fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:06.343809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a0e154e-92ee-4fbe-aa0c-73a2cc6296fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.344805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a0e154e-92ee-4fbe-aa0c-73a2cc6296fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.345412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a0e154e-92ee-4fbe-aa0c-73a2cc6296fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.379353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a0e154e-92ee-4fbe-aa0c-73a2cc6296fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:34:06.459487 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a0e154e-92ee-4fbe-aa0c-73a2cc6296fa tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "POST /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470/action" status: 202 len: 0 microversion: 2.1 time: 0.131157 Sep 08 10:34:06.464627 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2178/4550] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:34:06 2022] POST /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:34:06.474735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:06.476031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:06.485827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.486696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.487899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.489546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.490914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.491682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.537291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:06.547106 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-705d5f5d-1b7a-416d-ab6e-f5df150d994d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.321204 Sep 08 10:34:06.560319 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2373/4551] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:06 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:06.566604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:06.568661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:06.575184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.575699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.576347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.577071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:06.578815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:06.579245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:06.737482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:06.749816 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f9eb773a-a17e-456b-b22e-2736bf036ada tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.283298 Sep 08 10:34:06.750626 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2179/4552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:06 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:06.807523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:06.815977 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72dd9e52-6e28-4a91-b625-4375b5e93ac9 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.253301 Sep 08 10:34:06.816510 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2374/4553] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:06 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:07.589784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:07.590570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:07.598281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:07.598731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:07.599721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:07.600631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:07.601205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:07.601758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:07.763362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:07.775203 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de3cfee2-c62a-4d87-ba09-68e2a2f84ce3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.190533 Sep 08 10:34:07.775660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:07.776304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:07.783443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:07.783961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:07.784404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:07.785119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:07.785579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:07.786011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:07.788869 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2180/4554] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:07 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:07.840424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:07.841217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:07.854316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:07.855141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:07.855763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:07.856651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:07.857276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:07.857864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:08.025789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:08.047108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5d4ad39-165c-45a4-af30-5eccab7ff7b5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.266684 Sep 08 10:34:08.062314 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2375/4555] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:07 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:08.073484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1b6f61dc-4506-40bc-85d8-de000a6608e8 req-068a5821-0821-4232-a639-4b561d14485c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd8fd1c-d047-4664-9e75-97da41ca128f", "name": "network-vif-plugged", "status": "completed", "tag": "c7cc5dcd-3e64-44b2-8aef-43f795dc786f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:08.076180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:08.086401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1b6f61dc-4506-40bc-85d8-de000a6608e8 req-068a5821-0821-4232-a639-4b561d14485c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:08.087064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1b6f61dc-4506-40bc-85d8-de000a6608e8 req-068a5821-0821-4232-a639-4b561d14485c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:08.087713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1b6f61dc-4506-40bc-85d8-de000a6608e8 req-068a5821-0821-4232-a639-4b561d14485c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:08.088005 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97723ffe-bca5-4233-8f87-694be6ba3df0 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.252980 Sep 08 10:34:08.101722 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1b6f61dc-4506-40bc-85d8-de000a6608e8 req-068a5821-0821-4232-a639-4b561d14485c service nova] Creating event network-vif-plugged:c7cc5dcd-3e64-44b2-8aef-43f795dc786f for instance dfd8fd1c-d047-4664-9e75-97da41ca128f on n-h2-833090-19 Sep 08 10:34:08.102216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2181/4556] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:07 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:08.107629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1b6f61dc-4506-40bc-85d8-de000a6608e8 req-068a5821-0821-4232-a639-4b561d14485c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043982 Sep 08 10:34:08.108430 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2376/4557] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:08.800953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:08.801557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:08.808245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:08.808799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:08.809298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:08.810116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:08.810897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:08.811507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:08.973241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:08.982343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d743af2e-c695-4282-8a2d-eb03a4d0d937 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1511 microversion: 2.1 time: 0.185749 Sep 08 10:34:08.982933 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2182/4558] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:08 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:09.078341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:09.079081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:09.086772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:09.087271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:09.087750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:09.088622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:09.089236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:09.089932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:09.118193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:09.119123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:09.155149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:09.156406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:09.156963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:09.157771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:09.158517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:09.159059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:09.352578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:09.360628 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1bea31b9-a0e5-4fe2-92c3-8dedb77dd433 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.288123 Sep 08 10:34:09.361210 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2377/4559] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:09 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:09.394942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:09.405273 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea3ba4d2-8bb5-41bc-a268-7e12e24b715f tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.294206 Sep 08 10:34:09.406454 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2183/4560] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:09 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:10.008481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:10.009453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:10.013830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:10.018392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.018890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.019695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.020377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.021046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.021796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.125596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f3cd4e74-bfbb-4a3f-b8a1-36bd9a545605 req-f636da28-d3a6-426f-a9de-097c5445c825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd8fd1c-d047-4664-9e75-97da41ca128f", "name": "network-vif-plugged", "status": "completed", "tag": "a2ec081f-74bc-46c6-bbb0-00be3a0d21a5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:10.145730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f3cd4e74-bfbb-4a3f-b8a1-36bd9a545605 req-f636da28-d3a6-426f-a9de-097c5445c825 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.146338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f3cd4e74-bfbb-4a3f-b8a1-36bd9a545605 req-f636da28-d3a6-426f-a9de-097c5445c825 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.147044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f3cd4e74-bfbb-4a3f-b8a1-36bd9a545605 req-f636da28-d3a6-426f-a9de-097c5445c825 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.161066 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f3cd4e74-bfbb-4a3f-b8a1-36bd9a545605 req-f636da28-d3a6-426f-a9de-097c5445c825 service nova] Creating event network-vif-plugged:a2ec081f-74bc-46c6-bbb0-00be3a0d21a5 for instance dfd8fd1c-d047-4664-9e75-97da41ca128f on n-h2-833090-19 Sep 08 10:34:10.167122 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f3cd4e74-bfbb-4a3f-b8a1-36bd9a545605 req-f636da28-d3a6-426f-a9de-097c5445c825 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045105 Sep 08 10:34:10.167914 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2184/4561] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:10.217653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:10.227891 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82dca2d9-f461-4c04-ae84-d13d3b503178 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1488 microversion: 2.1 time: 0.224547 Sep 08 10:34:10.236128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2378/4562] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:10 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:10.251788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:10.252403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:10.260116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.260546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.260991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.261737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.262164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.262598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.293185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:34:10.386019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:10.386818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:10.403344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.404192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.405714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.407375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.408186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.410096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.419003 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-983b6322-9e93-4717-aa5b-dc33188642ed tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 204 len: 0 microversion: 2.1 time: 0.170673 Sep 08 10:34:10.419814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2185/4563] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:10 2022] DELETE /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:34:10.429559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:10.430686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:10.440614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.442211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.442701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.443953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.445289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.445985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.745860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:10.764039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:10.764845 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6cb09e3a-f561-41e7-9076-fe4d6b2b4f70 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.340336 Sep 08 10:34:10.766635 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2186/4564] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:10 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:10.772068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:10.772771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:10.779666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.780441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.781082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.782016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:10.782689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:10.783319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:10.794389 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27a695d6-ec2b-47ea-bb9b-3bee51f77b8c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.412170 Sep 08 10:34:10.798528 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2379/4565] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:10 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:10.954547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:10.963196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f78dfbf-28bd-46eb-93b5-37dc9bc18d81 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1494 microversion: 2.1 time: 0.195489 Sep 08 10:34:10.964017 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2187/4566] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:10 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1494 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:11.799776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:11.801531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:11.822653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:11.823445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:11.835856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:11.836662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:11.839174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:11.839498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:11.841195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:11.842552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:11.843265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:11.843892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:11.846204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:11.849539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:11.855020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:11.855628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:12.287436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:12.298788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:12.300267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44f849cc-cb87-47ec-9026-590274aac6ba tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1334 microversion: 2.1 time: 0.507311 Sep 08 10:34:12.304798 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2380/4567] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:11 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1334 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:12.311013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:12.312113 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b17963f-d919-4859-a5c4-c519bf0e4036 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.494714 Sep 08 10:34:12.318615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:12.326626 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2188/4568] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:11 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:12.331797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:12.332713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:12.333517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:12.335058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:12.335775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:12.336397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:12.657914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:12.675401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7bc545b3-bf6c-43fa-8ae2-534ca8e5cfb3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 200 len: 1494 microversion: 2.1 time: 0.369261 Sep 08 10:34:12.676873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2381/4569] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:12 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 1494 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:12.983450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-922f1a31-87ca-4d8e-be8c-2add2021e354 req-83f5b295-b2e8-4ff3-9178-46bce6dfa7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6619364a-8281-4812-abf8-a4aaa9def357", "name": "network-vif-deleted", "tag": "bfdb0ab7-10ce-4349-b5b0-d83ca0cdfab1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:12.993701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:12.995829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-922f1a31-87ca-4d8e-be8c-2add2021e354 req-83f5b295-b2e8-4ff3-9178-46bce6dfa7ab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:12.996448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-922f1a31-87ca-4d8e-be8c-2add2021e354 req-83f5b295-b2e8-4ff3-9178-46bce6dfa7ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:12.996948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-922f1a31-87ca-4d8e-be8c-2add2021e354 req-83f5b295-b2e8-4ff3-9178-46bce6dfa7ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.014610 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-922f1a31-87ca-4d8e-be8c-2add2021e354 req-83f5b295-b2e8-4ff3-9178-46bce6dfa7ab service nova] Creating event network-vif-deleted:bfdb0ab7-10ce-4349-b5b0-d83ca0cdfab1 for instance 6619364a-8281-4812-abf8-a4aaa9def357 on n-h1-833090-19 Sep 08 10:34:13.020547 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-922f1a31-87ca-4d8e-be8c-2add2021e354 req-83f5b295-b2e8-4ff3-9178-46bce6dfa7ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354748 Sep 08 10:34:13.021551 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2189/4570] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:13.327800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:13.329281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:13.345659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:13.347521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:13.352677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.353462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.354209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.356216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.356990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.357623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.364016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.366774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.368509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.370265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.371453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.372638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.417917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:13.629051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:13.632540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:13.639122 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8dec15ae-5ed6-408e-ba9a-22640bb7d2dc tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1670 microversion: 2.1 time: 0.316381 Sep 08 10:34:13.639959 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2382/4571] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:13 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1670 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:13.647264 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e7475dbd-9137-49b4-b886-735538888db9 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.311266 Sep 08 10:34:13.647876 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2190/4572] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:13 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:13.664260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:13.664849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:13.672002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.673063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.673613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.676019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.676203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.677195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.701121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:13.701884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:13.709767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.712176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.713159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.714255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.714901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.715539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.722945 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-054b0c0a-a73e-4ad9-b395-81ef5b81531e tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f/ips" status: 200 len: 180 microversion: 2.1 time: 0.063430 Sep 08 10:34:13.731404 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2383/4573] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:34:13 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f/ips => generated 180 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:13.733542 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 HTTP/1.1 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6619364a-8281-4812-abf8-a4aaa9def357'} Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:13.735808 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:13.741616 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:13.743208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:13.743208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:13.744683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:13.746410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96bc857a-a94e-4d00-8e1e-b42367577e75 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 404 len: 111 microversion: 2.1 time: 0.049153 Sep 08 10:34:13.747530 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2191/4574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:13 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:13.759662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.759662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.759662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.759662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.759662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.760214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.790807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:34:13.895402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2690721", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "e5a8ae01-84f5-499a-a6cd-2a4920841b49"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:13.936494 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ac6a653-040c-4bca-b1f1-a019ce0bff61 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 204 len: 0 microversion: 2.1 time: 0.202663 Sep 08 10:34:13.937560 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2384/4575] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:13 2022] DELETE /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:34:13.947127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:13.948006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:13.954082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.954709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.955149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.955872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:13.956822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:13.957248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:13.975141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] validate_networks() for [('e5a8ae01-84f5-499a-a6cd-2a4920841b49', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:34:13.990750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:14.294093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:14.308002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-513c1b9f-15cb-472e-bacf-19efb6b93bca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1676 microversion: 2.1 time: 0.365615 Sep 08 10:34:14.310472 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2385/4576] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:13 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1676 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:14.590410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:34:14.590935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:34:14.591625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:34:14.592139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:34:14.592656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:34:14.606757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:14.607620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:14.608087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:14.609006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:14.609463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:14.610374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:14.636061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:34:14.642621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Getting quotas for user 9b49e0e4bbca4e85bb71d834be6314ec and project 40ac047143f4409e85cf89020c881242. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:34:14.660198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:34:14.663371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:34:14.670719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:14.671295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:14.679612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:14.680289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:14.680885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:14.681739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:14.682340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:14.682924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:14.742196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8925be14-5bae-4b1c-b339-00746fe8e492 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850903 Sep 08 10:34:14.743189 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2192/4577] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:34:14.757748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f880d933-de5e-4e96-a5b1-4cf95e41452a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:14.758718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f880d933-de5e-4e96-a5b1-4cf95e41452a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:14.866235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f880d933-de5e-4e96-a5b1-4cf95e41452a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:14.876086 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f880d933-de5e-4e96-a5b1-4cf95e41452a tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1212 microversion: 2.1 time: 0.123620 Sep 08 10:34:14.877424 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2193/4578] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:14 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1212 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:14.901774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:14.910945 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7de03fc6-874a-4f40-a814-18e66b5878ff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.243988 Sep 08 10:34:14.920722 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2386/4579] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:14 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:15.336463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:15.337606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:15.347310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:15.348624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:15.350129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:15.352739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:15.353465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:15.354602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:15.532909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:15.544813 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84c650c0-b47e-4b2c-9470-754ebf9a007b tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1676 microversion: 2.1 time: 0.212914 Sep 08 10:34:15.545883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2194/4580] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:15 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:15.901310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:15.901952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:15.909003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:15.909576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:15.910106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:15.911068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:15.912317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:15.912940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:15.934800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:15.935454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:15.949911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:15.953865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:15.954383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:15.956797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:15.957515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:15.958942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:16.008358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:16.018413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0936d838-1cd3-4fd4-9c72-25198bfa413d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1264 microversion: 2.1 time: 0.121138 Sep 08 10:34:16.019010 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2387/4581] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:15 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1264 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:16.188994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:16.201232 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cd8dca7-77a5-4560-99a3-49c9015b5a91 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.270928 Sep 08 10:34:16.203668 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2195/4582] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:15 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:16.581315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:16.582175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:16.591047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:16.591840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:16.592471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:16.593583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:16.594540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:16.595308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:16.875687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2a4e2f00-e796-4e03-b90d-209ea72a62b2 req-e3f97661-c914-448e-9cb9-5852164e41c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd8fd1c-d047-4664-9e75-97da41ca128f", "name": "network-vif-deleted", "tag": "a2ec081f-74bc-46c6-bbb0-00be3a0d21a5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:16.914557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a4e2f00-e796-4e03-b90d-209ea72a62b2 req-e3f97661-c914-448e-9cb9-5852164e41c3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:16.918604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a4e2f00-e796-4e03-b90d-209ea72a62b2 req-e3f97661-c914-448e-9cb9-5852164e41c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:16.920087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a4e2f00-e796-4e03-b90d-209ea72a62b2 req-e3f97661-c914-448e-9cb9-5852164e41c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:16.960513 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2a4e2f00-e796-4e03-b90d-209ea72a62b2 req-e3f97661-c914-448e-9cb9-5852164e41c3 service nova] Creating event network-vif-deleted:a2ec081f-74bc-46c6-bbb0-00be3a0d21a5 for instance dfd8fd1c-d047-4664-9e75-97da41ca128f on n-h2-833090-19 Sep 08 10:34:16.985003 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2a4e2f00-e796-4e03-b90d-209ea72a62b2 req-e3f97661-c914-448e-9cb9-5852164e41c3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112747 Sep 08 10:34:16.985978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:16.991387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2196/4583] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:17.001546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0cc633d-f2a5-4f30-880c-3d3120e15b92 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1655 microversion: 2.1 time: 0.426376 Sep 08 10:34:17.007517 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2388/4584] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:16 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1655 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:17.046214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:17.047245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:17.055823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:17.056604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:17.057202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:17.058071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:17.058683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:17.059265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:17.159803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:17.177011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9560a4c3-6f6c-4a46-80e6-60e9ac5ccc54 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1270 microversion: 2.1 time: 0.130881 Sep 08 10:34:17.191687 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2197/4585] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:17 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:17.230832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:17.231930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:17.242115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:17.244543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:17.249121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:17.250455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:17.253584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:17.254243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:17.536797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:17.556071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ea8b96d-4ef8-4df6-8079-df5915389d60 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.329179 Sep 08 10:34:17.568030 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2389/4586] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:17 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:18.026584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:18.027195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:18.040744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.041570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.043699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.044755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.053968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.054863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.118660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.119150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.119602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.120242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lazy-loading 'fault' on Instance uuid dfd8fd1c-d047-4664-9e75-97da41ca128f {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:34:18.205968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:18.207946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:18.220732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f41725e5014fa0b415fefeb73352e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba3f7102ee4a859110d905535409c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:18.233396 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b9b752c3-2d9c-4dd5-916f-b9c590d1366a tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 200 len: 1303 microversion: 2.1 time: 0.210795 Sep 08 10:34:18.235662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.252422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.252663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2198/4587] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:18 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:18.254499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.256013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.258608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.260002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.588559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:18.588744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:18.595711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.596373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.597416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.598313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:18.598929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:18.599524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:18.611748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:18.622375 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d19286f0-8d18-48e3-a480-0b81b8ea96d6 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.420584 Sep 08 10:34:18.639931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2390/4588] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:18 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:18.869808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:18.886694 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd71bec8-e573-4171-8d9d-f8f9d5109d75 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.305526 Sep 08 10:34:18.888049 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2199/4589] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:18 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:19.031769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-cfb5b4b5-e9e8-43b5-9372-8d9358d2e1cf req-ece1db48-6076-4e31-8435-6d9ba7f310be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd8fd1c-d047-4664-9e75-97da41ca128f", "name": "network-vif-deleted", "tag": "c7cc5dcd-3e64-44b2-8aef-43f795dc786f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:19.042555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cfb5b4b5-e9e8-43b5-9372-8d9358d2e1cf req-ece1db48-6076-4e31-8435-6d9ba7f310be service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.043430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cfb5b4b5-e9e8-43b5-9372-8d9358d2e1cf req-ece1db48-6076-4e31-8435-6d9ba7f310be service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.044081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cfb5b4b5-e9e8-43b5-9372-8d9358d2e1cf req-ece1db48-6076-4e31-8435-6d9ba7f310be service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.074387 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-cfb5b4b5-e9e8-43b5-9372-8d9358d2e1cf req-ece1db48-6076-4e31-8435-6d9ba7f310be service nova] Creating event network-vif-deleted:c7cc5dcd-3e64-44b2-8aef-43f795dc786f for instance dfd8fd1c-d047-4664-9e75-97da41ca128f on n-h2-833090-19 Sep 08 10:34:19.080741 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-cfb5b4b5-e9e8-43b5-9372-8d9358d2e1cf req-ece1db48-6076-4e31-8435-6d9ba7f310be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053205 Sep 08 10:34:19.082020 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2391/4590] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:19.265687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:19.266199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:19.274851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.275353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.279093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.279868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.280462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.282127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.298473 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] HTTP exception thrown: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Request method failure captured: Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f HTTP/1.1 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcTHXKmsccyshNKsO-lB39JJ2NtdeL4jl9VPUKR3Qwn9Y4QZyyRftI_VCP3os8XBrY8i9Ba5QKEUED8OdgdfEjstiU2V3syT8WGfH6eKOjvaf7ieM_WabtjKQ7dZcm58gcZl0lQQn6rimkbK7tYKj-gGfFYKpuDFMzSG32LtsVq4hIM Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_74ba3f7102ee4a859110d905535409c2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 23f41725e5014fa0b415fefeb73352e6 Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'dfd8fd1c-d047-4664-9e75-97da41ca128f'} Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:19.300191 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:19.306922 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:19.308590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Returning 404 to user: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:19.310401 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0f5ef18-cb6f-4007-b198-e209a207ec33 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 404 len: 111 microversion: 2.1 time: 0.048005 Sep 08 10:34:19.311544 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2200/4591] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:19 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:19.340571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-fb290484-ea95-4192-88c3-c6baf2506a43 req-c7ebee16-413a-4990-a043-e014bb54d116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f211e199-9d73-49b6-97b0-8198cf3fe124", "tag": "d6a44364-b65d-4fb4-b1c6-010aafcacb3f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:19.366532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fb290484-ea95-4192-88c3-c6baf2506a43 req-c7ebee16-413a-4990-a043-e014bb54d116 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.367339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fb290484-ea95-4192-88c3-c6baf2506a43 req-c7ebee16-413a-4990-a043-e014bb54d116 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.369255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-fb290484-ea95-4192-88c3-c6baf2506a43 req-c7ebee16-413a-4990-a043-e014bb54d116 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.389327 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-fb290484-ea95-4192-88c3-c6baf2506a43 req-c7ebee16-413a-4990-a043-e014bb54d116 service nova] Creating event network-changed:d6a44364-b65d-4fb4-b1c6-010aafcacb3f for instance f211e199-9d73-49b6-97b0-8198cf3fe124 on n-h1-833090-19 Sep 08 10:34:19.399587 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-fb290484-ea95-4192-88c3-c6baf2506a43 req-c7ebee16-413a-4990-a043-e014bb54d116 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066329 Sep 08 10:34:19.400579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2392/4592] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:19.653721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:19.654503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:19.672771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.679924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.681336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.685339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.686493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.689215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.933506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:19.934786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:19.943688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.944527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.945338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:19.946580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:19.947433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:19.948284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:20.088222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:20.106410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17cc6d01-2f41-4692-991f-65013e05b19d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.457547 Sep 08 10:34:20.107190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2201/4593] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:19 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:20.228917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:20.241743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-950b9fd3-3ace-49b7-98b6-4cbb726978b4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.320838 Sep 08 10:34:20.247323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2393/4594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:19 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:21.131909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:21.133178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:21.153936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:21.154487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:21.155169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:21.156023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:21.156539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:21.157060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:21.275506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:21.276807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:21.298311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:21.299085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:21.301220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:21.304216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:21.306940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:21.307785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:21.385161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:21.393485 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d3c91d0-c1e8-496b-88ec-c741204f220b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.267012 Sep 08 10:34:21.398080 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2202/4595] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:21 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:21.623190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:21.633534 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0fc432ca-d6ff-4f36-9a68-4b31ad6218b7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.362536 Sep 08 10:34:21.636493 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2394/4596] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:21 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:22.420347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:22.422221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:22.433085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:22.433997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:22.435663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:22.437390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:22.438123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:22.439148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:22.664102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:22.664723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:22.672465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:22.673178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:22.673765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:22.674655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:22.675266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:22.679218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.001908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:23.029920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-050fb420-c88b-4cb9-ae8c-9fc27bad5c6c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.613506 Sep 08 10:34:23.031081 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2203/4597] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:22 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:23.128745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:23.136889 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05118bba-1197-4a4a-91ed-2d0a3932aa35 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.477535 Sep 08 10:34:23.140955 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2395/4598] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:22 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:23.579556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:23.580063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:23.594667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.595436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.596116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.597026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.598222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.599380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.618166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] HTTP exception thrown: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Request method failure captured: Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f HTTP/1.1 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcTHXKmsccyshNKsO-lB39JJ2NtdeL4jl9VPUKR3Qwn9Y4QZyyRftI_VCP3os8XBrY8i9Ba5QKEUED8OdgdfEjstiU2V3syT8WGfH6eKOjvaf7ieM_WabtjKQ7dZcm58gcZl0lQQn6rimkbK7tYKj-gGfFYKpuDFMzSG32LtsVq4hIM Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_74ba3f7102ee4a859110d905535409c2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 23f41725e5014fa0b415fefeb73352e6 Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'dfd8fd1c-d047-4664-9e75-97da41ca128f'} Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:23.620830 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.624437 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.627636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Returning 404 to user: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:23.628707 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db872ee8-7a8b-4c4b-bd75-6de6375ab0d6 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 404 len: 111 microversion: 2.1 time: 0.054359 Sep 08 10:34:23.629774 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2204/4599] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:23 2022] DELETE /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:23.637847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:23.638476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: dfd8fd1c-d047-4664-9e75-97da41ca128f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:23.644962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.645633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.646289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.647359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.647855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.648287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.664481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] HTTP exception thrown: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Request method failure captured: Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f HTTP/1.1 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcTHXKmsccyshNKsO-lB39JJ2NtdeL4jl9VPUKR3Qwn9Y4QZyyRftI_VCP3os8XBrY8i9Ba5QKEUED8OdgdfEjstiU2V3syT8WGfH6eKOjvaf7ieM_WabtjKQ7dZcm58gcZl0lQQn6rimkbK7tYKj-gGfFYKpuDFMzSG32LtsVq4hIM Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_74ba3f7102ee4a859110d905535409c2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 23f41725e5014fa0b415fefeb73352e6 Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'dfd8fd1c-d047-4664-9e75-97da41ca128f'} Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.666401 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.670995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Returning 404 to user: Instance dfd8fd1c-d047-4664-9e75-97da41ca128f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:23.672166 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9269d58-a73e-4f22-aecf-738f31e53203 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f" status: 404 len: 111 microversion: 2.1 time: 0.038080 Sep 08 10:34:23.676086 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2396/4600] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:23 2022] GET /compute/v2.1/servers/dfd8fd1c-d047-4664-9e75-97da41ca128f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:23.681766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:23.682639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:23.691049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.691812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.693030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.693975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.694664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.695305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.713983 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] HTTP exception thrown: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Request method failure captured: Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 HTTP/1.1 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcTHXKmsccyshNKsO-lB39JJ2NtdeL4jl9VPUKR3Qwn9Y4QZyyRftI_VCP3os8XBrY8i9Ba5QKEUED8OdgdfEjstiU2V3syT8WGfH6eKOjvaf7ieM_WabtjKQ7dZcm58gcZl0lQQn6rimkbK7tYKj-gGfFYKpuDFMzSG32LtsVq4hIM Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_74ba3f7102ee4a859110d905535409c2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 23f41725e5014fa0b415fefeb73352e6 Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b96838fc-ff49-49e0-be0a-5b87a257f7b2'} Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:23.715685 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Returning 404 to user: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:23.719260 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc70bb51-36a1-4b9b-a092-8706294205ca tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 404 len: 111 microversion: 2.1 time: 0.039496 Sep 08 10:34:23.720909 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2205/4601] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:23 2022] DELETE /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:23.726713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:23.727331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] [instance: b96838fc-ff49-49e0-be0a-5b87a257f7b2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:23.736478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.737351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.738151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.739211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:23.739958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:23.740686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:23.761004 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] HTTP exception thrown: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Request method failure captured: Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 HTTP/1.1 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcTHXKmsccyshNKsO-lB39JJ2NtdeL4jl9VPUKR3Qwn9Y4QZyyRftI_VCP3os8XBrY8i9Ba5QKEUED8OdgdfEjstiU2V3syT8WGfH6eKOjvaf7ieM_WabtjKQ7dZcm58gcZl0lQQn6rimkbK7tYKj-gGfFYKpuDFMzSG32LtsVq4hIM Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/74ba3f7102ee4a859110d905535409c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_74ba3f7102ee4a859110d905535409c2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 74ba3f7102ee4a859110d905535409c2 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestMultiNic-119903602 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 23f41725e5014fa0b415fefeb73352e6 Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestMultiNic-119903602-project Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b96838fc-ff49-49e0-be0a-5b87a257f7b2'} Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:23.763067 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] Returning 404 to user: Instance b96838fc-ff49-49e0-be0a-5b87a257f7b2 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89dc2033-d01f-4f91-9bba-10395759a708 tempest-ServersTestMultiNic-119903602 tempest-ServersTestMultiNic-119903602-project] 10.222.0.59 "GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2" status: 404 len: 111 microversion: 2.1 time: 0.042702 Sep 08 10:34:23.766629 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2397/4602] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:23 2022] GET /compute/v2.1/servers/b96838fc-ff49-49e0-be0a-5b87a257f7b2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:24.054686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:24.055519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:24.061848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:24.062879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:24.063593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:24.064315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:24.064975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:24.065413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:24.163823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:24.164852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:24.174560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:24.175543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:24.176543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:24.177977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:24.178780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:24.179235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:24.430733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:24.446524 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2811c3e7-b11e-4424-9983-93eeada98f14 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.396310 Sep 08 10:34:24.447889 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2206/4603] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:24 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:24.564180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:24.573329 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ca79e55-b573-4f48-a6ef-46eef64c53b8 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.413887 Sep 08 10:34:24.575108 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2398/4604] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:24 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:25.476678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:25.478076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:25.490544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:25.493707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:25.497075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:25.499256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:25.507137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:25.507751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:25.508240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:25.508677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:25.597093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:25.597695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:25.605452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:25.606525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:25.607194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:25.608084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:25.608716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:25.609359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:26.293129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:26.312366 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e6aebe5-e933-4dc6-9a84-21d65625318f tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.842103 Sep 08 10:34:26.313837 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2207/4605] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:25 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:26.346165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:26.360194 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80918ed2-8892-4e5e-81b7-12383a94a0f4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.766881 Sep 08 10:34:26.360793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2399/4606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:25 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:26.676285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a263b042-988f-4b3a-9685-3c7f454fb289 req-ddc20aad-74ca-4ede-9549-b3dd1cbae680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f211e199-9d73-49b6-97b0-8198cf3fe124", "name": "network-vif-plugged", "status": "completed", "tag": "d6a44364-b65d-4fb4-b1c6-010aafcacb3f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:26.691915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a263b042-988f-4b3a-9685-3c7f454fb289 req-ddc20aad-74ca-4ede-9549-b3dd1cbae680 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:26.692440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a263b042-988f-4b3a-9685-3c7f454fb289 req-ddc20aad-74ca-4ede-9549-b3dd1cbae680 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:26.692875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a263b042-988f-4b3a-9685-3c7f454fb289 req-ddc20aad-74ca-4ede-9549-b3dd1cbae680 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:26.715733 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a263b042-988f-4b3a-9685-3c7f454fb289 req-ddc20aad-74ca-4ede-9549-b3dd1cbae680 service nova] Creating event network-vif-plugged:d6a44364-b65d-4fb4-b1c6-010aafcacb3f for instance f211e199-9d73-49b6-97b0-8198cf3fe124 on n-h1-833090-19 Sep 08 10:34:26.721080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a263b042-988f-4b3a-9685-3c7f454fb289 req-ddc20aad-74ca-4ede-9549-b3dd1cbae680 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304463 Sep 08 10:34:26.722010 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2208/4607] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:27.341165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:27.341798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:27.359149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:27.359680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:27.363888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:27.365206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:27.365682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:27.366186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:27.386911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:27.387637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:27.405599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:27.406116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:27.406554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:27.407272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:27.407764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:27.408193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:27.752367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:27.767504 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f3bb1b08-b12c-4dcf-af7c-1374c7f18d03 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1312 microversion: 2.1 time: 0.428833 Sep 08 10:34:27.782605 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2400/4608] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:27 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1312 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:27.876197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:27.889223 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7096c233-051b-42a2-a517-168ff92f95c7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.506534 Sep 08 10:34:27.890214 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2209/4609] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:27 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:28.794771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:28.795401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:28.810123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:28.810908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:28.811559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:28.812452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:28.813142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:28.813838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:28.914493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:28.915504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:28.930732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:28.931583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:28.932265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:28.933218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:28.936329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:28.937110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:29.136147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:29.164921 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f15f472-2d02-48be-a58d-2a668f0d9e69 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1499 microversion: 2.1 time: 0.374821 Sep 08 10:34:29.168151 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2401/4610] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:28 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1499 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:29.190876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:29.191925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:29.202566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:29.211308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:29.212930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:29.216376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:29.217118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:29.217797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:29.290767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lazy-loading 'flavor' on Instance uuid f211e199-9d73-49b6-97b0-8198cf3fe124 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:34:29.349765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:29.362521 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-25200d33-f33a-4440-b10c-a351be2e6f82 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.452493 Sep 08 10:34:29.376096 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2210/4611] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:28 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:29.447045 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7326bfb-4867-4f7e-a15b-4dcf5ba85711 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "POST /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124/action" status: 202 len: 0 microversion: 2.1 time: 0.260834 Sep 08 10:34:29.450405 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2402/4612] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:34:29 2022] POST /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:34:29.464825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:29.466418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:29.481013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:29.481695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:29.482278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:29.489615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:29.490907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:29.491545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:29.871502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:29.881814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea27a00e-af74-4f4b-aad9-e24cbc6ab08c tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1507 microversion: 2.1 time: 0.429526 Sep 08 10:34:29.898874 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2211/4613] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:29 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:30.389394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:30.390111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:30.414143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:30.414655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:30.415107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:30.415911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:30.416371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:30.416807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:30.445354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:30.611006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:30.621519 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8534705-729d-4da7-b97c-b3f538a74be1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.236503 Sep 08 10:34:30.622646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2403/4614] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:30 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:30.905804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:30.906422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:30.923661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:30.924142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:30.924585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:30.925300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:30.925756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:30.926438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:30.940520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:31.175128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:31.192026 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26a74e47-6f9a-469d-9896-1453f02d9818 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1490 microversion: 2.1 time: 0.288836 Sep 08 10:34:31.193120 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2212/4615] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:30 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1490 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:31.219426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:31.220384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:31.229552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:31.230880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:31.231703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:31.232790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:31.233416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:31.234008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:31.266978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:34:31.389227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dd4461a5-5269-47a6-89f7-de725334b1cf tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 204 len: 0 microversion: 2.1 time: 0.176621 Sep 08 10:34:31.390548 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2404/4616] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:31 2022] DELETE /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:34:31.400190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:31.401799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:31.412331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:31.413094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:31.413613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:31.414401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:31.414936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:31.415436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:31.599455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:31.613562 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-19ed823d-3834-4c5c-9c0a-9eba0de90c22 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1496 microversion: 2.1 time: 0.218727 Sep 08 10:34:31.615032 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2213/4617] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:31 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1496 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:31.649484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:31.650176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:31.657245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:31.657949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:31.658537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:31.659417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:31.660072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:31.660695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:31.866966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:31.876283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c932be52-a23c-4025-9e58-7042ce215129 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1511 microversion: 2.1 time: 0.231159 Sep 08 10:34:31.877184 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2405/4618] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:31 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:32.229072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-048cd946-a2da-467c-9d28-907d0f89b2cd tempest-ExtensionsTest-163832144 tempest-ExtensionsTest-163832144-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:32.230815 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-048cd946-a2da-467c-9d28-907d0f89b2cd tempest-ExtensionsTest-163832144 tempest-ExtensionsTest-163832144-project] 10.222.0.59 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.412598 Sep 08 10:34:32.231710 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2214/4619] 10.222.0.59 () {58 vars in 1170 bytes} [Thu Sep 8 10:34:31 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:32.243821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-945b66e0-ee23-48db-ab61-6149dfe4e7c7 tempest-ExtensionsTest-163832144 tempest-ExtensionsTest-163832144-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:32.246531 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-945b66e0-ee23-48db-ab61-6149dfe4e7c7 tempest-ExtensionsTest-163832144 tempest-ExtensionsTest-163832144-project] 10.222.0.59 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008631 Sep 08 10:34:32.256065 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2406/4620] 10.222.0.59 () {58 vars in 1134 bytes} [Thu Sep 8 10:34:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:34:32.639391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:32.640367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:32.647667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:32.649806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:32.651219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:32.652205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:32.655006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:32.655476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:32.902566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:32.903813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:32.915375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:32.917039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:32.927302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:32.928576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:32.930962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:32.931413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:32.950921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:32.984508 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-deff2038-c1dd-4256-90d7-749fe3fdb9b3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1496 microversion: 2.1 time: 0.349349 Sep 08 10:34:32.985222 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2215/4621] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:32 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1496 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:33.410289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:33.422729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8bcd842c-1e6f-43b7-8060-ed2732f6880e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1488 microversion: 2.1 time: 0.525055 Sep 08 10:34:33.423341 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2407/4622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:32 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1488 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:33.449946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-442211731"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:33.453471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:33.461505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:33.462608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:33.463111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:33.464098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:33.465075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:33.465836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:33.568891 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-73ef2668-4fb2-41de-9e26-00cf0f763e5c tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "PUT /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1060 microversion: 2.1 time: 0.123367 Sep 08 10:34:33.570261 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2216/4623] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:34:33 2022] PUT /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1060 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:33.589722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:33.592978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:33.602691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:33.603190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:33.603861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:33.604911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:33.605553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:33.605996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:33.878416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5f9e9698-9125-4edb-82bd-5d53a0c3c6ca req-48a71012-c311-4a62-b265-0c8503cfcea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f211e199-9d73-49b6-97b0-8198cf3fe124", "name": "network-vif-deleted", "tag": "d6a44364-b65d-4fb4-b1c6-010aafcacb3f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:33.902539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f9e9698-9125-4edb-82bd-5d53a0c3c6ca req-48a71012-c311-4a62-b265-0c8503cfcea4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:33.905020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f9e9698-9125-4edb-82bd-5d53a0c3c6ca req-48a71012-c311-4a62-b265-0c8503cfcea4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:33.905608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f9e9698-9125-4edb-82bd-5d53a0c3c6ca req-48a71012-c311-4a62-b265-0c8503cfcea4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:33.939493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5f9e9698-9125-4edb-82bd-5d53a0c3c6ca req-48a71012-c311-4a62-b265-0c8503cfcea4 service nova] Creating event network-vif-deleted:d6a44364-b65d-4fb4-b1c6-010aafcacb3f for instance f211e199-9d73-49b6-97b0-8198cf3fe124 on n-h1-833090-19 Sep 08 10:34:33.961357 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5f9e9698-9125-4edb-82bd-5d53a0c3c6ca req-48a71012-c311-4a62-b265-0c8503cfcea4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086518 Sep 08 10:34:33.965896 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2217/4624] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:33.967268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:33.998355 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67bca2c8-e9d0-43ba-aa01-28760e406b49 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1487 microversion: 2.1 time: 0.409964 Sep 08 10:34:33.999537 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2408/4625] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:33 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1487 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:34.024935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:34.025852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:34.031027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:34.031838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:34.036928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.037924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.040761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.042683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.043030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.043713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.048371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.065404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.066866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.068280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.072162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.072597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.100265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.101289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.102276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.102857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lazy-loading 'fault' on Instance uuid f211e199-9d73-49b6-97b0-8198cf3fe124 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:34:34.183407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b49e0e4bbca4e85bb71d834be6314ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ac047143f4409e85cf89020c881242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:34.198082 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9babbd37-e810-452d-b517-068ecf5c5bc7 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 200 len: 1302 microversion: 2.1 time: 0.184764 Sep 08 10:34:34.198688 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2218/4626] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:34 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 1302 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:34.319760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:34.342904 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c11c645e-e962-45d9-a671-37796a323015 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1487 microversion: 2.1 time: 0.319485 Sep 08 10:34:34.343554 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2409/4627] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:34 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1487 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:34.366034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:34.366533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:34.373658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.374151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.374620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.375643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.376308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.376739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.403247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:34:34.516142 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74bc9510-e2b3-4ede-a33c-8ed9171bcc80 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 204 len: 0 microversion: 2.1 time: 0.154304 Sep 08 10:34:34.519961 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2219/4628] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:34 2022] DELETE /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:34:34.528379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:34.529016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:34.542008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.542510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.543247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.544473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:34.545562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:34.546274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:34.720877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:34.733043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17aca5f7-0cfb-459c-ada9-67ee1e6e524f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1493 microversion: 2.1 time: 0.211214 Sep 08 10:34:34.734357 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2410/4629] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:34 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1493 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:35.210123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24a3a547-4c25-40d4-b097-fc7bd90e8ae6 tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] Calling method '.version_select at 0x7f23505b9c10>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.223922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.225825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.245865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.246849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.247290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.249266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.249725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.250188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.265995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 HTTP/1.1 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f211e199-9d73-49b6-97b0-8198cf3fe124'} Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.267859 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb775282-4fe9-4796-8b1a-94f20bc6d157 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 404 len: 111 microversion: 2.1 time: 0.051020 Sep 08 10:34:35.278042 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2411/4630] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:35.282502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.283008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.289735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.290230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.290815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.291557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.292025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.292791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.293267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24a3a547-4c25-40d4-b097-fc7bd90e8ae6 tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.316516 Sep 08 10:34:35.294054 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2220/4631] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:34:34 2022] GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9/defaults => generated 371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:35.312520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d19c9abd-508a-471a-8812-1aeaed2edd3d tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] Calling method '.version_select at 0x7f23517e90d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.322556 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 HTTP/1.1 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f211e199-9d73-49b6-97b0-8198cf3fe124'} Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.324443 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-554c9755-b24b-46f4-922c-b380da06aa9b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 404 len: 111 microversion: 2.1 time: 0.047797 Sep 08 10:34:35.328378 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2412/4632] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:35 2022] DELETE /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.335246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.336151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: f211e199-9d73-49b6-97b0-8198cf3fe124] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.342576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.343380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.343858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.344559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.345010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.345436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.362507 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 HTTP/1.1 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f211e199-9d73-49b6-97b0-8198cf3fe124'} Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.364816 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance f211e199-9d73-49b6-97b0-8198cf3fe124 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d44d26d1-3eb7-446c-a4fb-1f3de3053986 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124" status: 404 len: 111 microversion: 2.1 time: 0.035624 Sep 08 10:34:35.369486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2413/4633] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/f211e199-9d73-49b6-97b0-8198cf3fe124 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:35.384024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.386208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.394523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.395579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.396096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.397206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.397751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.398271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.413822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 HTTP/1.1 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6619364a-8281-4812-abf8-a4aaa9def357'} Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.415678 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-feec6a4d-3a54-47b7-9405-27bb5b8e214b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 404 len: 111 microversion: 2.1 time: 0.044669 Sep 08 10:34:35.421206 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2414/4634] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:35 2022] DELETE /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.427324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.428101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 6619364a-8281-4812-abf8-a4aaa9def357] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.435230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.435756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.436194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.437038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.437616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.438056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.453758 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 HTTP/1.1 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6619364a-8281-4812-abf8-a4aaa9def357'} Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.455492 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 6619364a-8281-4812-abf8-a4aaa9def357 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-644c7cea-1e12-4eb0-acd2-2a850b889196 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357" status: 404 len: 111 microversion: 2.1 time: 0.035024 Sep 08 10:34:35.460396 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2415/4635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/6619364a-8281-4812-abf8-a4aaa9def357 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:35.465589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.466092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.472550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.473045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.474012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.474772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.475233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.476331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.491432 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 HTTP/1.1 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8c428be4-d1e0-4c04-a3f9-50d787654006'} Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.493042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4314b70-b877-4b51-9714-58aa3d6325f2 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 404 len: 111 microversion: 2.1 time: 0.032705 Sep 08 10:34:35.496892 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2416/4636] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:35 2022] DELETE /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:35.502944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.503581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 8c428be4-d1e0-4c04-a3f9-50d787654006] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.510316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.510807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.511253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.511996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.512452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.512880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.552646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 HTTP/1.1 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8c428be4-d1e0-4c04-a3f9-50d787654006'} Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.556193 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. Sep 08 10:34:35.559852 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.561930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 8c428be4-d1e0-4c04-a3f9-50d787654006 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.562985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81892491-0e91-4547-a009-50b4818d6d9e tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006" status: 404 len: 111 microversion: 2.1 time: 0.063767 Sep 08 10:34:35.563924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2417/4637] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/8c428be4-d1e0-4c04-a3f9-50d787654006 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.573864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.574690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.582977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.585353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.585861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.586618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.587086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.588187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.605618 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef HTTP/1.1 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b0c572bf-23a4-4d57-ade4-6e1823b9a5ef'} Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.607662 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.611447 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.614777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.615915 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81bcc927-6c04-4487-87f9-1468b61e75c3 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 404 len: 111 microversion: 2.1 time: 0.048133 Sep 08 10:34:35.617305 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2418/4638] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:35 2022] DELETE /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.630383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.631486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: b0c572bf-23a4-4d57-ade4-6e1823b9a5ef] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.641740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.642767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.643407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.644596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.645376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.646005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.666606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef HTTP/1.1 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b0c572bf-23a4-4d57-ade4-6e1823b9a5ef'} Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.668582 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. Sep 08 10:34:35.672474 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.674287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance b0c572bf-23a4-4d57-ade4-6e1823b9a5ef could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.675522 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5db467b3-3475-4d84-9264-b4426a62f2e4 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef" status: 404 len: 111 microversion: 2.1 time: 0.054407 Sep 08 10:34:35.677420 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2419/4639] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/b0c572bf-23a4-4d57-ade4-6e1823b9a5ef => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.688328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.689431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.698112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.698782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.699376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.700377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.701021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.701621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.728732 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 HTTP/1.1 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ca22e520-0eda-42dd-af19-913fa4991b90'} Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.738014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e67a83a-8eb6-44a5-b297-3937b9f56786 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 404 len: 111 microversion: 2.1 time: 0.057511 Sep 08 10:34:35.746226 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2420/4640] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:35 2022] DELETE /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.749975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.760648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: ca22e520-0eda-42dd-af19-913fa4991b90] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.771297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.771835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.772277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.775255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.775752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.776347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.823686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d19c9abd-508a-471a-8812-1aeaed2edd3d tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9" status: 200 len: 371 microversion: 2.1 time: 0.520232 Sep 08 10:34:35.824485 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 HTTP/1.1 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ca22e520-0eda-42dd-af19-913fa4991b90'} Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:35.826115 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance ca22e520-0eda-42dd-af19-913fa4991b90 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:35.830309 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2127ecc8-709d-4606-b73b-1f423869e266 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90" status: 404 len: 111 microversion: 2.1 time: 0.081640 Sep 08 10:34:35.830831 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2221/4641] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9 => generated 371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:35.834364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2421/4642] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/ca22e520-0eda-42dd-af19-913fa4991b90 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:35.836920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.836920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:35.843919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aed29af2-2011-4d52-8e2b-a233b15eb1dd tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] Calling method '.version_select at 0x7f2351cd99d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:35.854338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.856839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.857320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:35.858092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:35.858558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:35.858993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:36.182058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aed29af2-2011-4d52-8e2b-a233b15eb1dd tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.342535 Sep 08 10:34:36.185038 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2422/4643] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9/defaults => generated 371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:36.204834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-721a3e8f-6aab-4ebb-9c12-7e7312bce657 tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] Calling method '.version_select at 0x7f235547ddc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:36.327352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:36.336500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-adf53c4a-3df3-46b9-ae1d-fc391a9a08e1 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1493 microversion: 2.1 time: 0.505006 Sep 08 10:34:36.344132 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2222/4644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:35 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1493 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:36.541024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:36.561106 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-721a3e8f-6aab-4ebb-9c12-7e7312bce657 tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9" status: 200 len: 371 microversion: 2.1 time: 0.364441 Sep 08 10:34:36.570947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2423/4645] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 10:34:36 2022] GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9 => generated 371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:36.574911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1aeb4fb-3e15-4de2-912e-a4d9f203fc83 tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] Calling method '.version_select at 0x7f23505b9d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:36.708389 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1aeb4fb-3e15-4de2-912e-a4d9f203fc83 tempest-QuotasTestJSON-1345899476 tempest-QuotasTestJSON-1345899476-project] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9?user_id=bd5b5e8dae4a4a778828bd5200391d3e" status: 200 len: 371 microversion: 2.1 time: 0.137995 Sep 08 10:34:36.709001 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2223/4646] 10.222.0.59 () {58 vars in 1323 bytes} [Thu Sep 8 10:34:36 2022] GET /compute/v2.1/os-quota-sets/7ce1635d5b73409cb5d450deafd2e1a9?user_id=bd5b5e8dae4a4a778828bd5200391d3e => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:36.837599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b7f92e13-809a-402a-901f-c7f0240f6454 req-97d7e75f-6f0f-4715-8204-31c10ceb2274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc55b88-086c-4254-b637-2ce9d168b470", "name": "network-vif-deleted", "tag": "cf3db276-1320-4db1-b109-b2fbc138b120"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:36.856899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b7f92e13-809a-402a-901f-c7f0240f6454 req-97d7e75f-6f0f-4715-8204-31c10ceb2274 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:36.858463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b7f92e13-809a-402a-901f-c7f0240f6454 req-97d7e75f-6f0f-4715-8204-31c10ceb2274 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:36.860212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b7f92e13-809a-402a-901f-c7f0240f6454 req-97d7e75f-6f0f-4715-8204-31c10ceb2274 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:36.887156 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b7f92e13-809a-402a-901f-c7f0240f6454 req-97d7e75f-6f0f-4715-8204-31c10ceb2274 service nova] Creating event network-vif-deleted:cf3db276-1320-4db1-b109-b2fbc138b120 for instance 9cc55b88-086c-4254-b637-2ce9d168b470 on n-h1-833090-19 Sep 08 10:34:36.901677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b7f92e13-809a-402a-901f-c7f0240f6454 req-97d7e75f-6f0f-4715-8204-31c10ceb2274 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069474 Sep 08 10:34:36.903395 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2424/4647] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:37.381680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:37.382317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:37.386209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:37.395662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:37.396190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:37.396634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:37.397361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:37.397817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:37.400201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:37.547832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:37.548950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:37.549999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:37.550673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid 9cc55b88-086c-4254-b637-2ce9d168b470 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:34:37.665211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:37.682745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20842f8c-a82b-4e33-8cea-81f57ae24e4f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 200 len: 1309 microversion: 2.1 time: 0.314052 Sep 08 10:34:37.700716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2224/4648] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:37 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:38.710921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:38.711656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:38.718440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.719118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.719744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.720786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.722060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.722741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.762688 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 HTTP/1.1 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9cc55b88-086c-4254-b637-2ce9d168b470'} Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.767710 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.772750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:38.780589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39d8935c-8298-4f86-ae72-a751f667ca0e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 404 len: 111 microversion: 2.1 time: 0.075148 Sep 08 10:34:38.786642 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2425/4649] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:38 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:38.807857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:38.809713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:38.820264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.821305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.822437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.824296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.825405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.826312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.855151 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 HTTP/1.1 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9cc55b88-086c-4254-b637-2ce9d168b470'} Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:38.857434 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.862230 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.865333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:38.866756 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63a1df1f-9e8f-4fce-8e70-0ba351bc0c43 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 404 len: 111 microversion: 2.1 time: 0.063220 Sep 08 10:34:38.871068 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2225/4650] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:38 2022] DELETE /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:38.880533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:38.881137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 9cc55b88-086c-4254-b637-2ce9d168b470] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:38.891318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.892291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.893475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.893993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.894511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.894953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.923436 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 HTTP/1.1 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9cc55b88-086c-4254-b637-2ce9d168b470'} Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.935365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. Sep 08 10:34:38.939620 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.941808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 9cc55b88-086c-4254-b637-2ce9d168b470 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:38.943629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0766b5ab-95a9-42bc-b23c-2ce1494781e6 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470" status: 404 len: 111 microversion: 2.1 time: 0.069890 Sep 08 10:34:38.948199 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2426/4651] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:38 2022] GET /compute/v2.1/servers/9cc55b88-086c-4254-b637-2ce9d168b470 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:38.955429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:38.956270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:38.972157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.972696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.973284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.974096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:38.974578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:38.975026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:38.996252 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce HTTP/1.1 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '447f9c4a-3274-44aa-b371-c752e94d07ce'} Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:38.997907 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.001641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f069aa6-7c0a-4885-89df-8c931cfd105f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 404 len: 111 microversion: 2.1 time: 0.050423 Sep 08 10:34:39.010049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.010663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 447f9c4a-3274-44aa-b371-c752e94d07ce] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.014206 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2226/4652] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:38 2022] DELETE /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.017768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.018502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.019103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.020081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.020704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.021294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.038089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce HTTP/1.1 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '447f9c4a-3274-44aa-b371-c752e94d07ce'} Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.039977 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. Sep 08 10:34:39.044694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.046598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 447f9c4a-3274-44aa-b371-c752e94d07ce could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.048355 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-527d1972-b8a7-445b-afd9-20e0db523279 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce" status: 404 len: 111 microversion: 2.1 time: 0.042663 Sep 08 10:34:39.061324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.062051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.065793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2427/4653] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/447f9c4a-3274-44aa-b371-c752e94d07ce => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.074844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.076671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.077224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.078558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.081161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.081725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.108155 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 HTTP/1.1 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '820014b3-4ed2-4cc3-bb9a-b3266dcf3060'} Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.110998 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.115197 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.117592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.118703 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-806ec8f7-5e8d-423f-be9d-2a2d2a42639b tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 404 len: 111 microversion: 2.1 time: 0.064206 Sep 08 10:34:39.119524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2227/4654] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:39 2022] DELETE /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.129455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.131355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 820014b3-4ed2-4cc3-bb9a-b3266dcf3060] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.139020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.139966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.141488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.142466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.143251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.143947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.164860 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 HTTP/1.1 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '820014b3-4ed2-4cc3-bb9a-b3266dcf3060'} Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.166431 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.170367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 820014b3-4ed2-4cc3-bb9a-b3266dcf3060 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.175238 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-acf91b53-f0ae-49f5-818c-d9ee61b4397f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060" status: 404 len: 111 microversion: 2.1 time: 0.046052 Sep 08 10:34:39.179860 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2428/4655] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/820014b3-4ed2-4cc3-bb9a-b3266dcf3060 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.186572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.187129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.196599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.197094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.199560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.200493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.201327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.203446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.232245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 HTTP/1.1 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'e5706297-ee53-472b-b105-a94832c371a7'} Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.234793 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.240002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.245176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.246489 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b83521ab-095f-4f17-8d99-bab2196f7fac tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 404 len: 111 microversion: 2.1 time: 0.065433 Sep 08 10:34:39.248156 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2228/4656] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:39 2022] DELETE /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:39.257386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.258345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: e5706297-ee53-472b-b105-a94832c371a7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.266227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.266907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.267530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.268411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.269026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.269613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.293817 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 HTTP/1.1 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'e5706297-ee53-472b-b105-a94832c371a7'} Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.297028 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. Sep 08 10:34:39.300749 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.306015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance e5706297-ee53-472b-b105-a94832c371a7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.312425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6d0a8e95-e321-42d5-8f35-5b765f2cd2d2 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7" status: 404 len: 111 microversion: 2.1 time: 0.059657 Sep 08 10:34:39.313630 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2429/4657] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/e5706297-ee53-472b-b105-a94832c371a7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.322226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.322815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.331018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.331552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.331999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.351268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.352470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.352924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.374488 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b HTTP/1.1 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'bdfe335c-1c4c-41d4-983b-19732d20d69b'} Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.376163 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.380683 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.384966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.386308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2324ed70-9cf9-4c28-a38e-cc7a50e722f0 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 404 len: 111 microversion: 2.1 time: 0.068815 Sep 08 10:34:39.387501 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2229/4658] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:39 2022] DELETE /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.398035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.398670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: bdfe335c-1c4c-41d4-983b-19732d20d69b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.414087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.414655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.415119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.415887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.417226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.417603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.446006 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b HTTP/1.1 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bdfe335c-1c4c-41d4-983b-19732d20d69b'} Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.447956 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance bdfe335c-1c4c-41d4-983b-19732d20d69b could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dcaadc8c-256b-4791-a9d0-12493c220241 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b" status: 404 len: 111 microversion: 2.1 time: 0.057750 Sep 08 10:34:39.453458 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2430/4659] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/bdfe335c-1c4c-41d4-983b-19732d20d69b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.459600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.460276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.467072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.467946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.468715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.469503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.469955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.470484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.485789 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 HTTP/1.1 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '76119686-ee23-4963-b8c0-31ab04408821'} Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.487668 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.491832 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c0c958a-06b4-4315-bdf0-2c8dc35f9954 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 404 len: 111 microversion: 2.1 time: 0.034211 Sep 08 10:34:39.498990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.499859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 76119686-ee23-4963-b8c0-31ab04408821] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.504665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2230/4660] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:39 2022] DELETE /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.506243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.507454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.508069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.509263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.510594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.511337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.534412 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 HTTP/1.1 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '76119686-ee23-4963-b8c0-31ab04408821'} Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.536544 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.541132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 76119686-ee23-4963-b8c0-31ab04408821 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.560593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9364c848-aa97-4833-9e75-d4f4969947c4 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821" status: 404 len: 111 microversion: 2.1 time: 0.042890 Sep 08 10:34:39.569222 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2431/4661] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/76119686-ee23-4963-b8c0-31ab04408821 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.570509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.570948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 668e1e1c-98e6-47a7-97e7-f10fe36ed11a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.580580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.581273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.581885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.583304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.583940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.584360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.601748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a HTTP/1.1 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '668e1e1c-98e6-47a7-97e7-f10fe36ed11a'} Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.604089 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.608436 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.610281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.611677 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b02113d5-5e5e-44e9-8903-60e8f5bfbac7 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a" status: 404 len: 111 microversion: 2.1 time: 0.045972 Sep 08 10:34:39.612427 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2231/4662] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:39 2022] DELETE /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:39.624079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.624817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 668e1e1c-98e6-47a7-97e7-f10fe36ed11a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.641234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.642842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.643305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.645233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.645864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.645993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.663804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a HTTP/1.1 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '668e1e1c-98e6-47a7-97e7-f10fe36ed11a'} Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:39.665570 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. Sep 08 10:34:39.670312 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:39.671747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 668e1e1c-98e6-47a7-97e7-f10fe36ed11a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:39.673061 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-faf07f2d-778a-4264-bab5-35e80e1df990 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a" status: 404 len: 111 microversion: 2.1 time: 0.054226 Sep 08 10:34:39.674324 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2432/4663] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/668e1e1c-98e6-47a7-97e7-f10fe36ed11a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:39.685039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.685596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.693657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.694324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.694831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.695648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.696190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.696680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.725954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:34:39.852115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45c9ea23-5ba2-420e-8f26-7759f48f471e tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "DELETE /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 204 len: 0 microversion: 2.1 time: 0.171683 Sep 08 10:34:39.856781 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2232/4664] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:39 2022] DELETE /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:34:39.866079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:39.868115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:39.879177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.880332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.880936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:39.882217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:39.883622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:39.884218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.059088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:40.075490 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b36ddc93-f636-47f4-a17f-03fca53ea86f tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1480 microversion: 2.1 time: 0.217353 Sep 08 10:34:40.076251 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2433/4665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:39 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1480 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:40.369376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:40.372343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:40.384230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.384748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.386302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.387036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.387527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.389908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.406514 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b HTTP/1.1 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'bae77cab-a3f8-42bf-ade8-a0705608902b'} Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:40.419365 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:40.424305 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8192890b-6512-4860-a210-b6555772237d tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 404 len: 111 microversion: 2.1 time: 0.063231 Sep 08 10:34:40.430645 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2233/4666] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:40 2022] DELETE /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:40.432658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:40.433611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: bae77cab-a3f8-42bf-ade8-a0705608902b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:40.444283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.445102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.445693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.446540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.448145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.448934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.468545 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b HTTP/1.1 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bae77cab-a3f8-42bf-ade8-a0705608902b'} Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.470706 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance bae77cab-a3f8-42bf-ade8-a0705608902b could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e618e3cd-a887-4bdc-9816-2fd955141ca8 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b" status: 404 len: 111 microversion: 2.1 time: 0.044307 Sep 08 10:34:40.475242 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2434/4667] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:40 2022] GET /compute/v2.1/servers/bae77cab-a3f8-42bf-ade8-a0705608902b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:40.480957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:40.481584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:40.488117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.489418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.490118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.491120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.491840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.492485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.497312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:40.508962 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 HTTP/1.1 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '86438198-bffb-477f-8aa7-ed6ea338b3a4'} Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:40.511303 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.514975 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.516532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:40.517131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2da17812-96a1-4630-9d34-d90ed9308f5b tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "DELETE /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 404 len: 111 microversion: 2.1 time: 0.040049 Sep 08 10:34:40.517716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2234/4668] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:40 2022] DELETE /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:34:40.527994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:40.528688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] [instance: 86438198-bffb-477f-8aa7-ed6ea338b3a4] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:40.538548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.539534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.540472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.541608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:40.542495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:40.543113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:40.548339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:40.579344 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] HTTP exception thrown: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Request method failure captured: Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 HTTP/1.1 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQzrRoj5lNGAo8haIPTHsQNvJtgH7axgfqc2WcvwnoXH5eltmCW5xTtb-mtnaZ5eIAhz0iZjNGMEcViAx7fCWlZY3Lbh2sNIWnjJVOXpUjPaMpMfwQ-HbZl6Ihkl5L1NkcNt6O2tNWzAvknkt6VcVQNcTNFt_nW7jeQqjOM8ic0ZWs Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40ac047143f4409e85cf89020c881242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40ac047143f4409e85cf89020c881242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40ac047143f4409e85cf89020c881242", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 40ac047143f4409e85cf89020c881242 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1395694140 Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 9b49e0e4bbca4e85bb71d834be6314ec Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-1395694140-project Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '86438198-bffb-477f-8aa7-ed6ea338b3a4'} Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:40.584549 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. Sep 08 10:34:40.590843 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:40.597464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] Returning 404 to user: Instance 86438198-bffb-477f-8aa7-ed6ea338b3a4 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:40.598459 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-daf87474-07ac-4c9d-98b6-0bfb9e6d9a06 tempest-DeleteServersTestJSON-1395694140 tempest-DeleteServersTestJSON-1395694140-project] 10.222.0.59 "GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4" status: 404 len: 111 microversion: 2.1 time: 0.076121 Sep 08 10:34:40.599267 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2435/4669] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:40 2022] GET /compute/v2.1/servers/86438198-bffb-477f-8aa7-ed6ea338b3a4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:41.106220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:41.108140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:41.133897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:41.134936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:41.136441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:41.139915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:41.141770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:41.142618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:41.543715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:41.562414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a75e6cf-40fb-4b89-9e0d-554875c23fff tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1480 microversion: 2.1 time: 0.460099 Sep 08 10:34:41.563769 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2235/4670] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:41 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1480 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:42.184864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:42.186143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:42.199977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.201556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.202309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.203486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.204173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.204832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.371396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'services' on Instance uuid 48ae1c59-e738-4c93-891f-f3fd33f5568c {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:34:42.497294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d6c6b34-656f-4296-a06a-e4ab6fa27baf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments/0767b0bf-154d-4202-95f8-1ca0f4d900e8" status: 202 len: 0 microversion: 2.1 time: 0.317014 Sep 08 10:34:42.498283 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2436/4671] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:34:42 2022] DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments/0767b0bf-154d-4202-95f8-1ca0f4d900e8 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:34:42.516816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:42.521393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:42.530837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.532031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.532672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.533599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.534331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.534929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.598814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:42.600644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:42.623004 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e179f6b-ffe6-4b78-b6b8-aa8874042def tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116304 Sep 08 10:34:42.628122 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2236/4672] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:42 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:42.633897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.635282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.635974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.636784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.637483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.639662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.657875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-881c4a47-da6f-415b-a56c-9ee619f7dd49 req-0f8379de-2a07-4dd0-a3ce-c8aab9b18df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c96259-d5ca-4900-b512-a20d2cf6dda2", "name": "network-vif-deleted", "tag": "61f90d63-3ebd-48a3-96d7-1b7080f3cd65"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:42.673619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-881c4a47-da6f-415b-a56c-9ee619f7dd49 req-0f8379de-2a07-4dd0-a3ce-c8aab9b18df3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:42.674231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-881c4a47-da6f-415b-a56c-9ee619f7dd49 req-0f8379de-2a07-4dd0-a3ce-c8aab9b18df3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:42.675425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-881c4a47-da6f-415b-a56c-9ee619f7dd49 req-0f8379de-2a07-4dd0-a3ce-c8aab9b18df3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:42.692827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-881c4a47-da6f-415b-a56c-9ee619f7dd49 req-0f8379de-2a07-4dd0-a3ce-c8aab9b18df3 service nova] Creating event network-vif-deleted:61f90d63-3ebd-48a3-96d7-1b7080f3cd65 for instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 on n-h2-833090-19 Sep 08 10:34:42.699710 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-881c4a47-da6f-415b-a56c-9ee619f7dd49 req-0f8379de-2a07-4dd0-a3ce-c8aab9b18df3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045913 Sep 08 10:34:42.700544 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2237/4673] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:42.877712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:42.893832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5054480b-dfef-4dff-933a-def9f1d8ca09 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1438 microversion: 2.1 time: 0.310488 Sep 08 10:34:42.895053 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2437/4674] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:42 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1438 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:43.641806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:43.647943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:43.668710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:43.669445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:43.670053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:43.670943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:43.671404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:43.671906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:43.762503 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-44f4ebfb-8398-4c30-be29-f7b2c8589ce7 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128848 Sep 08 10:34:43.767554 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2238/4675] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:43 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:43.918077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:43.918700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:43.941352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:43.941963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:43.946673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:43.947553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:43.948695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:43.949152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:44.044667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:44.050075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:44.051905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:44.056153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lazy-loading 'fault' on Instance uuid 48c96259-d5ca-4900-b512-a20d2cf6dda2 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:34:44.163209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd581cec478364aa7b961ea983651ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1188806962d8439496e4994be3522a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:44.186566 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4dab11a-61d1-4249-8ecc-fcec675d5f9d tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 200 len: 1283 microversion: 2.1 time: 0.272671 Sep 08 10:34:44.188113 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2438/4676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:43 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 1283 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:44.779397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:44.782044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:44.798110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:44.798749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:44.799225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:44.800173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:44.800582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:44.801327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:44.911083 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce31dab1-c350-40c6-98b3-9f9d09ba9e8a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135208 Sep 08 10:34:44.918030 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2239/4677] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:44 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:45.212352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:45.213622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] [instance: 48c96259-d5ca-4900-b512-a20d2cf6dda2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:45.220592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:45.232022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:45.234513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:45.236489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:45.237468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:45.238285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:45.288898 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] HTTP exception thrown: Instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 could not be found. Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Request method failure captured: Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 HTTP/1.1 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcRuCjah5ee7eqDzvaREWwOA_dwjZO36R7V_tn8agQg06VXk3tIgS001EIUR1pm3CzE-cDo9AyGvzUrfkV8BGuZrdAK0q8RtS9aeRxEm6ibyHuOLjS5M9S1BrXHeC58Ly6nMFakuyo7Waq_Ul4slvesXCrZtq2OVp6LzblS-V-iLNBk Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1188806962d8439496e4994be3522a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1188806962d8439496e4994be3522a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1188806962d8439496e4994be3522a05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersTestJSON-1672034682 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1188806962d8439496e4994be3522a05 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersTestJSON-1672034682 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: d581cec478364aa7b961ea983651ce95 Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersTestJSON-1672034682-project Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 could not be found. Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '48c96259-d5ca-4900-b512-a20d2cf6dda2'} Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 could not be found. Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 could not be found. Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:45.290915 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 could not be found. Sep 08 10:34:45.295122 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:45.299678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] Returning 404 to user: Instance 48c96259-d5ca-4900-b512-a20d2cf6dda2 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:45.300915 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d05d2d2e-6328-4f05-ae7a-64d51a4a86f5 tempest-ServersTestJSON-1672034682 tempest-ServersTestJSON-1672034682-project] 10.222.0.59 "GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2" status: 404 len: 111 microversion: 2.1 time: 0.092351 Sep 08 10:34:45.308345 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2439/4678] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:45 2022] GET /compute/v2.1/servers/48c96259-d5ca-4900-b512-a20d2cf6dda2 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:34:45.926734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:45.929363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:45.955507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:45.956100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:45.956557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:45.957327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:45.957819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:45.961387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:46.082039 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5982055-0598-49f2-8f36-cd2b9c3d4e8f tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158643 Sep 08 10:34:46.084030 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2240/4679] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:45 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:47.099557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:47.101996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:47.110304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:47.124012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:47.125167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:47.125630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:47.126361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:47.126827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:47.127265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:47.202055 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfbd8774-8032-432c-9769-77d64ddfbf20 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109085 Sep 08 10:34:47.202924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2440/4680] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:47 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:48.226861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:48.230802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:48.237862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:34:48.243024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:48.247282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:48.248157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:48.250454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:48.251524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:48.252434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:48.338797 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97ecc316-1ae5-44d2-8bf6-123b50153c98 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124769 Sep 08 10:34:48.342048 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2241/4681] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:48 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:49.359435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:49.365225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:49.379911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:49.381052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:49.382840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:49.384857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:49.386850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:49.387953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:49.516427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e8b3109-03d3-4e2c-b2cf-0c88c64bb510 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159176 Sep 08 10:34:49.525141 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2441/4682] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:49 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:34:50.531561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:50.535399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:50.552285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:50.554168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:50.555583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:50.556655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:50.558489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:50.560841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:50.671441 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4bd487ee-cc04-44fb-acd6-abaee3354884 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144929 Sep 08 10:34:50.672127 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2242/4683] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:50 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:51.686629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:51.689412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:51.705225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:51.705795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:51.706280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:51.724337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:51.724923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:51.726443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:51.772181 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c0381ed-532b-4a0c-bac3-9bee24758343 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089827 Sep 08 10:34:51.773197 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2442/4684] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:34:51 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:34:51.915182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:51.917970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:51.937528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:51.938383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:51.939047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:51.940578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:51.941413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:51.942628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.003296 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Cannot 'reboot' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action HTTP/1.1 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 28 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: {"reboot": {"type": "HARD"}} Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'reboot' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'a8165897-981d-4253-af24-45c63192b227', 'body': {'reboot': {'type': 'HARD'}}} Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a8165897-981d-4253-af24-45c63192b227 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:34:52.005740 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 409 to user: Cannot 'reboot' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-75b41f21-1b52-4cc8-ba3d-62994085be11 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action" status: 409 len: 145 microversion: 2.1 time: 0.100351 Sep 08 10:34:52.015449 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2243/4685] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:34:51 2022] POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action => generated 145 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:34:52.018526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:52.022732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:52.034199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:52.034691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:52.035131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.058425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:52.058602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:52.066401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.125360 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Cannot 'rebuild' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action HTTP/1.1 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 65 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot 'rebuild' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'a8165897-981d-4253-af24-45c63192b227', 'body': {'rebuild': {'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb'}}} Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a8165897-981d-4253-af24-45c63192b227 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:34:52.127365 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued Sep 08 10:34:52.133024 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:34:52.136550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 409 to user: Cannot 'rebuild' instance a8165897-981d-4253-af24-45c63192b227 while it is in vm_state rescued {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:34:52.137633 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe03ed95-7f7f-472a-9c61-1b74b82bccfe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action" status: 409 len: 146 microversion: 2.1 time: 0.123999 Sep 08 10:34:52.138884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2443/4686] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:34:52 2022] POST /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227/action => generated 146 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:34:52.149727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:52.150449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:52.161056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:52.161753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:52.162358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.163223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:52.164471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:52.165052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.211381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:34:52.378802 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28261858-d6ea-4a01-8298-1ab66df1dec1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 204 len: 0 microversion: 2.1 time: 0.230530 Sep 08 10:34:52.384595 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2244/4687] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:34:52 2022] DELETE /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:34:52.390693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:52.394051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:52.414743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:52.415490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:52.416343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.417814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:52.419675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:52.420169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:52.916150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:52.932394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb8c1ef5-b002-4e46-86d4-1542b8dfa4d1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1688 microversion: 2.1 time: 0.546034 Sep 08 10:34:52.933857 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2444/4688] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:52 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1688 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:34:53.962766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:53.963672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:53.980570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:53.981991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:53.983165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:53.984494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:53.985127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:53.986568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:54.494685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:54.505033 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa1281ba-2fda-4eb8-93dd-c359d8e5fdf4 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1688 microversion: 2.1 time: 0.548183 Sep 08 10:34:54.508909 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2245/4689] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:53 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1688 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:55.547679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:55.552509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:55.583392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:55.583971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:55.586004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:55.588164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:55.588867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:55.589727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:56.008245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:56.017577 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-099ec8a6-ff3f-4d8b-a624-03b3005320fe tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1688 microversion: 2.1 time: 0.478419 Sep 08 10:34:56.037583 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2445/4690] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:55 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1688 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:57.042150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:57.043316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:57.057886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:57.058577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:57.059330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:57.060216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:57.060828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:57.061417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:57.989620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:34:58.012890 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f4306a5b-1379-498c-a13b-399ab69a00f2 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1688 microversion: 2.1 time: 0.969023 Sep 08 10:34:58.014896 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2246/4691] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:57 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1688 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:34:58.749939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-674b94f5-bbcd-4c1e-8d6c-68a8486c5963 req-db89a5d6-d84d-4177-8187-d528ef082ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48ae1c59-e738-4c93-891f-f3fd33f5568c", "name": "network-vif-deleted", "tag": "02d0433b-b496-410d-b46c-603c4e47b66d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:34:58.805085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-674b94f5-bbcd-4c1e-8d6c-68a8486c5963 req-db89a5d6-d84d-4177-8187-d528ef082ee7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:58.812041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-674b94f5-bbcd-4c1e-8d6c-68a8486c5963 req-db89a5d6-d84d-4177-8187-d528ef082ee7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:58.812041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-674b94f5-bbcd-4c1e-8d6c-68a8486c5963 req-db89a5d6-d84d-4177-8187-d528ef082ee7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:58.840383 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-674b94f5-bbcd-4c1e-8d6c-68a8486c5963 req-db89a5d6-d84d-4177-8187-d528ef082ee7 service nova] Creating event network-vif-deleted:02d0433b-b496-410d-b46c-603c4e47b66d for instance 48ae1c59-e738-4c93-891f-f3fd33f5568c on n-h2-833090-19 Sep 08 10:34:58.878690 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-674b94f5-bbcd-4c1e-8d6c-68a8486c5963 req-db89a5d6-d84d-4177-8187-d528ef082ee7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128877 Sep 08 10:34:58.882437 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2446/4692] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:34:59.043301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:34:59.043941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:34:59.062635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:59.071079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:59.074487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:59.076792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:59.076792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:59.091867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:59.363003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:34:59.365298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:34:59.367449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:34:59.368713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'fault' on Instance uuid 48ae1c59-e738-4c93-891f-f3fd33f5568c {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:35:00.100731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:00.116594 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9fe3d8bb-66b5-46a9-844e-647da6cef4b3 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 200 len: 1335 microversion: 2.1 time: 1.078330 Sep 08 10:35:00.117201 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2247/4693] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:34:59 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 1335 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:01.174423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:01.176530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: 48ae1c59-e738-4c93-891f-f3fd33f5568c] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:01.187496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:01.193525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:01.194179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:01.200274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:01.200942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:01.201826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:01.237445 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c could not be found. Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c HTTP/1.1 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c could not be found. Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '48ae1c59-e738-4c93-891f-f3fd33f5568c'} Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c could not be found. Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c could not be found. Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:35:01.239772 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c could not be found. Sep 08 10:35:01.243614 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:35:01.248611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 404 to user: Instance 48ae1c59-e738-4c93-891f-f3fd33f5568c could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:35:01.249914 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e56af149-5eb3-452e-b18a-021f4caa931e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c" status: 404 len: 111 microversion: 2.1 time: 0.080626 Sep 08 10:35:01.256309 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2447/4694] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:01 2022] GET /compute/v2.1/servers/48ae1c59-e738-4c93-891f-f3fd33f5568c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:35:01.259807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6c4d553b-17c2-4cc0-a312-5541d1a6ee00 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '.version_select at 0x7f23505b9790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:01.314609 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6c4d553b-17c2-4cc0-a312-5541d1a6ee00 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094183046" status: 202 len: 0 microversion: 2.1 time: 0.059071 Sep 08 10:35:01.319897 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2248/4695] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094183046 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:35:08.779870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:08.781480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:08.789692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=54 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:08.822917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:08.824419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:08.827820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:08.829106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:08.834872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:08.840618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:08.907060 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a4cf922d-6ea8-4f2b-a671-a082b2d6bd47 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/ips" status: 200 len: 151 microversion: 2.20 time: 0.133130 Sep 08 10:35:08.910052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2448/4696] 10.222.0.59 () {60 vars in 1289 bytes} [Thu Sep 8 10:35:08 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/ips => generated 151 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:35:09.936110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-218134104", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:09.980572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:10.036814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] validate_networks() for [('6a31b811-fdf4-47f5-84de-f0d87838fc52', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:35:10.104482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:11.205304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:35:11.205878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:35:11.206217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:35:11.207185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:35:11.207802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:35:11.236007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:11.236486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:11.236938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:11.237727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:11.238228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:11.238654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:11.312152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Getting quotas for project 5515e18960864987b0c62d82ffc45897. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:35:11.343123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Getting quotas for user db4e0fa30b874e4f9ff56c000c48dc50 and project 5515e18960864987b0c62d82ffc45897. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:35:11.391768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:35:11.398128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:35:11.597462 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2f75e77f-2b15-4e88-9445-e1574f238ba0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.473515 Sep 08 10:35:11.599077 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2249/4697] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:35:11.614809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cba66d83-6aea-4637-bc76-85cdc52bc037 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:11.615517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cba66d83-6aea-4637-bc76-85cdc52bc037 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:12.107546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cba66d83-6aea-4637-bc76-85cdc52bc037 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:12.119320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cba66d83-6aea-4637-bc76-85cdc52bc037 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1216 microversion: 2.1 time: 0.507386 Sep 08 10:35:12.136149 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2449/4698] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1216 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:13.165135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:13.165734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:13.193633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:13.194131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:13.194560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:13.195283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:13.195757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:13.196187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:13.431483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:13.440732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-254b17b8-9f86-4eb0-9f76-c6b20efae45d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1212 microversion: 2.1 time: 0.279518 Sep 08 10:35:13.444515 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2250/4699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:13 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1212 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:13.579111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:13.580787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:13.602418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:13.603227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:13.605206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:13.607683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:13.609159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:13.610995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:13.629838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:13.692055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lazy-loading 'flavor' on Instance uuid ccd99d66-bb97-408e-aacc-53461264af19 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:35:14.346043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f0c7c3f6-3497-47d5-b1b9-18a1c51b906b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/action" status: 202 len: 0 microversion: 2.20 time: 0.771448 Sep 08 10:35:14.360883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:14.362660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:14.371570 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2450/4700] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:35:13 2022] POST /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:35:14.387377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:14.388084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:14.388537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:14.389281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:14.389735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:14.390161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:14.468926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:14.469684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:14.493969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:14.495667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:14.501152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:14.505159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:14.505662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:14.506652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:14.892234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:14.913788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d225729-e145-401c-8744-c6b8d35722ca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1274 microversion: 2.1 time: 0.449970 Sep 08 10:35:14.933830 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2451/4701] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:14 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1274 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:15.965246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:15.965960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:16.008899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:16.014582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:16.019625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:16.027997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:16.030778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:16.031273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:16.294429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:16.309473 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab0ad950-a920-41c9-906e-1752b0f1f921 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1274 microversion: 2.1 time: 0.353162 Sep 08 10:35:16.310448 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2452/4702] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:15 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1274 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:16.447762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:16.448428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:16.455998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:16.457030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:16.457479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:16.458203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:16.458665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:16.459098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:16.503153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:16.516369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:16.528448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:16.538405 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d95c9b5c-55fa-4a9f-b867-67a8fd0d0945 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 2.183510 Sep 08 10:35:16.544153 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2251/4703] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:14 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:16.605696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:35:16.890958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-919c002e-eb30-4957-9eee-41d6142096c0 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 204 len: 0 microversion: 2.1 time: 0.446788 Sep 08 10:35:16.894599 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2453/4704] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:35:16 2022] DELETE /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:35:16.904410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:16.905382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:16.924714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:16.929612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:16.941302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:16.944640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:16.948694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:16.950681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:17.344818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:17.348573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:17.375789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:17.379611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:17.380881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:17.383131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:17.383744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:17.395799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:17.690071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:17.701228 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c68bdb6f-8808-446d-bcaf-1f76ea711cae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1274 microversion: 2.1 time: 0.371860 Sep 08 10:35:17.701816 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2454/4705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:17 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1274 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:17.706997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:17.727398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:17.746069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:17.748086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:17.751526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:17.753102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:17.754528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:17.756754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:17.807324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:17.816948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0e521fc-96a6-45a7-9595-908ce08f83c1 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1507 microversion: 2.1 time: 0.918276 Sep 08 10:35:17.822137 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2252/4706] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:16 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1507 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:18.740841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:18.743773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:18.765927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:18.766552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:18.767170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:18.768390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:18.769564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:18.770162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:18.995096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:19.006972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-597ea328-d3d1-4838-a221-38363ff5ec14 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1274 microversion: 2.1 time: 0.280946 Sep 08 10:35:19.024002 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2253/4707] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:18 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1274 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:19.035387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:19.041098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:19.041456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:19.058345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:19.058847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:19.059286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:19.067652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:19.068411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:19.068954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:19.078526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:19.080980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:19.083057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af7bd636-64e8-46cb-bd9b-f3028321584a tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 1.379814 Sep 08 10:35:19.100977 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2455/4708] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:17 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:19.607774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:19.634796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5aeb4087-755b-4b8f-b883-98e1ebd0432a tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1507 microversion: 2.1 time: 0.609174 Sep 08 10:35:19.640593 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2254/4709] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:19 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:20.046047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:20.046682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:20.071315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:20.091230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:20.091824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:20.093733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:20.094392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:20.094984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:20.113548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:20.114304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:20.132219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:20.132714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:20.136849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:20.139425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:20.140736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:20.141359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:21.148334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:21.179306 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99117118-c934-44ad-8ebe-18912b1cf1e1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 1.141647 Sep 08 10:35:21.185409 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2456/4710] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:20 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:21.204221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:21.209203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:21.231370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:21.232150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:21.236403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:21.240426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:21.241137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:21.243604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:21.268034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:21.351826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:21.358386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:21.407571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:21.420410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:21.429207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a41e903-3c18-49e1-8419-c079e86456d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 1.320970 Sep 08 10:35:21.429961 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2255/4711] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:20 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:21.448365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a5e29e1c-ba2e-4b08-b52c-fe3936390ed2 req-a80ca958-19c7-47ae-b803-38b695296ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8165897-981d-4253-af24-45c63192b227", "name": "network-vif-deleted", "tag": "a9600c2b-4955-4603-a053-45d1dcb05f5c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:21.482963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a5e29e1c-ba2e-4b08-b52c-fe3936390ed2 req-a80ca958-19c7-47ae-b803-38b695296ee7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:21.484355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a5e29e1c-ba2e-4b08-b52c-fe3936390ed2 req-a80ca958-19c7-47ae-b803-38b695296ee7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:21.485121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a5e29e1c-ba2e-4b08-b52c-fe3936390ed2 req-a80ca958-19c7-47ae-b803-38b695296ee7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:21.517332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a5e29e1c-ba2e-4b08-b52c-fe3936390ed2 req-a80ca958-19c7-47ae-b803-38b695296ee7 service nova] Creating event network-vif-deleted:a9600c2b-4955-4603-a053-45d1dcb05f5c for instance a8165897-981d-4253-af24-45c63192b227 on n-h2-833090-19 Sep 08 10:35:21.535036 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a5e29e1c-ba2e-4b08-b52c-fe3936390ed2 req-a80ca958-19c7-47ae-b803-38b695296ee7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097716 Sep 08 10:35:21.536799 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2256/4712] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:21.563756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:21.584472 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aa68f1aa-7663-4581-ae39-61995c30ab48 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 200 len: 1293 microversion: 2.1 time: 0.389093 Sep 08 10:35:21.586134 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2457/4713] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:21 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 1293 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:22.213859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:22.222213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:22.246671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:22.249571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:22.254772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:22.270116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:22.270795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:22.271046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:22.460712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:22.461436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:22.475938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:22.502060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:22.504128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:22.504590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:22.505359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:22.505822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:22.520899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:22.833417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:22.845381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d00516a9-670f-4448-ac07-84e5bd00e9b4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 0.639232 Sep 08 10:35:22.847920 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2257/4714] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:22 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:22.859041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:22.861932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: a8165897-981d-4253-af24-45c63192b227] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:22.875531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:22.877525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:22.881676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:22.882758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:22.883709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:22.886741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:22.936107 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Instance a8165897-981d-4253-af24-45c63192b227 could not be found. Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 HTTP/1.1 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance a8165897-981d-4253-af24-45c63192b227 could not be found. Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'a8165897-981d-4253-af24-45c63192b227'} Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8165897-981d-4253-af24-45c63192b227 could not be found. Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8165897-981d-4253-af24-45c63192b227 could not be found. Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:22.945952 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8165897-981d-4253-af24-45c63192b227 could not be found. Sep 08 10:35:22.951036 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:22.956070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 404 to user: Instance a8165897-981d-4253-af24-45c63192b227 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:35:22.962644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-939baed1-52b7-4634-8a21-e736e7b6d188 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227" status: 404 len: 111 microversion: 2.1 time: 0.113121 Sep 08 10:35:22.964892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2258/4715] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:22 2022] GET /compute/v2.1/servers/a8165897-981d-4253-af24-45c63192b227 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:35:22.980734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:22.981414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:23.015140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.015999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.022792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:23.024004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.025159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.025159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:23.093463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:35:23.236088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:23.246350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:23.247855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:23.270065 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4dc09f34-eb56-4fa7-8f8a-12aef1f6bb5e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 0.813825 Sep 08 10:35:23.270679 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2458/4716] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:22 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:23.362623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f57e025-935e-4151-9711-1c31f2f5bbfb tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 204 len: 0 microversion: 2.1 time: 0.392882 Sep 08 10:35:23.369562 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2259/4717] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:35:22 2022] DELETE /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:35:23.377492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:23.378158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:23.386726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.387223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.403414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:23.404576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.405087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.405543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:23.581758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fb02a3b1-d389-465d-905e-fa8550634c82 req-c485b0c0-3c22-4c20-9ffa-d119bae50cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:23.609229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fb02a3b1-d389-465d-905e-fa8550634c82 req-c485b0c0-3c22-4c20-9ffa-d119bae50cc0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.613853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fb02a3b1-d389-465d-905e-fa8550634c82 req-c485b0c0-3c22-4c20-9ffa-d119bae50cc0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.616086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fb02a3b1-d389-465d-905e-fa8550634c82 req-c485b0c0-3c22-4c20-9ffa-d119bae50cc0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:23.646228 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fb02a3b1-d389-465d-905e-fa8550634c82 req-c485b0c0-3c22-4c20-9ffa-d119bae50cc0 service nova] Creating event network-changed:3711f68e-a7bd-4648-9f34-af0cc36d1f25 for instance ab066901-fa02-4e6f-957c-65bc129387a6 on n-h1-833090-19 Sep 08 10:35:23.665685 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fb02a3b1-d389-465d-905e-fa8550634c82 req-c485b0c0-3c22-4c20-9ffa-d119bae50cc0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088505 Sep 08 10:35:23.666294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2260/4718] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:35:23.762550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:23.779838 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b4a9563-1fb4-476d-a43a-20994c11ee64 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 0.406095 Sep 08 10:35:23.781193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2459/4719] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:23 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:23.869837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:23.870644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:23.886093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.886625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.887072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:23.892394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:23.892948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:23.893401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:24.297113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:24.297730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:24.311933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:24.312981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:24.313605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:24.314806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:24.321411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:24.322134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:24.394415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:24.412110 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-66be5097-3295-431f-bcf2-46981fee1838 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 0.546888 Sep 08 10:35:24.414933 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2261/4720] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:23 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:24.809423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:24.810243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:24.824054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:24.824966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:24.826595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:24.829120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:24.829797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:24.834919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:25.751102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:25.769509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:25.773418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:25.779214 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b285a2f-9da7-4b84-808e-2c12cb112bbe tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 1.485875 Sep 08 10:35:25.781328 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2460/4721] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:24 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:25.800902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:25.801804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:25.828751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:25.831492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:25.834205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:25.835154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:25.835822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:25.837850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:25.990995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:26.024881 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-13680fc1-fad2-43ce-8631-fd3524ab6adf tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1521 microversion: 2.1 time: 1.218213 Sep 08 10:35:26.030889 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2262/4722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:24 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1521 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:26.416748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:26.427261 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ae2de8d-1b22-4381-bc95-6669cfa88698 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 0.643898 Sep 08 10:35:26.455884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2461/4723] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:25 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:26.846714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:26.848828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:26.877404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:26.879077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:26.880191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:26.883744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:26.885070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:26.888298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:26.985702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f46a55a9-5588-45f4-8bb5-41fbf76e4258 req-c7a9c680-28a3-4a71-ad82-f18d2ea1890c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed661293-2de7-4a28-8de8-d4b538451e23", "name": "network-vif-deleted", "tag": "cd4be0f7-1cea-4fbc-af31-35d0c3bd5ebd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:27.048073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f46a55a9-5588-45f4-8bb5-41fbf76e4258 req-c7a9c680-28a3-4a71-ad82-f18d2ea1890c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:27.048961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f46a55a9-5588-45f4-8bb5-41fbf76e4258 req-c7a9c680-28a3-4a71-ad82-f18d2ea1890c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:27.049583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f46a55a9-5588-45f4-8bb5-41fbf76e4258 req-c7a9c680-28a3-4a71-ad82-f18d2ea1890c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:27.095301 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f46a55a9-5588-45f4-8bb5-41fbf76e4258 req-c7a9c680-28a3-4a71-ad82-f18d2ea1890c service nova] Creating event network-vif-deleted:cd4be0f7-1cea-4fbc-af31-35d0c3bd5ebd for instance ed661293-2de7-4a28-8de8-d4b538451e23 on n-h1-833090-19 Sep 08 10:35:27.132542 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f46a55a9-5588-45f4-8bb5-41fbf76e4258 req-c7a9c680-28a3-4a71-ad82-f18d2ea1890c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150402 Sep 08 10:35:27.136136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2462/4724] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:35:27.163273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:27.167720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:27.200125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:27.210525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:27.211755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:27.212696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:27.219117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:27.222567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:27.321798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:27.324633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:27.325529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:27.327277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lazy-loading 'fault' on Instance uuid ed661293-2de7-4a28-8de8-d4b538451e23 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:35:27.357811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:27.696662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cc1615daf5e4df5900068455d7109ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41785319e3f242ca9cd86981db6e1789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:27.736097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b59a5057-b6f3-4bb9-b3ca-7dbbee83d38e tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 200 len: 1311 microversion: 2.1 time: 0.595841 Sep 08 10:35:27.747305 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2463/4725] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:27 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 1311 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:27.765875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:27.767438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:27.784195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:27.785052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:27.785665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:27.798099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:27.819432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:27.819924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:27.953392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:27.966269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:27.977260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:27.979329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d3c2f98-a153-44f4-8327-f0f8a9624362 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1743 microversion: 2.20 time: 1.142202 Sep 08 10:35:27.980083 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2263/4726] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:26 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1743 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:28.154557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:28.166235 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4fb8f1c-b7c4-4451-8506-a7aabe801c4a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 0.417271 Sep 08 10:35:28.169652 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2464/4727] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:27 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:28.761790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:28.762485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] [instance: ed661293-2de7-4a28-8de8-d4b538451e23] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:28.776990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:28.777708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:28.779310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:28.780346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:28.784858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:28.785544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:28.813915 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] HTTP exception thrown: Instance ed661293-2de7-4a28-8de8-d4b538451e23 could not be found. Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Request method failure captured: Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 HTTP/1.1 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcPQQ_-VJQhchufMv_T6MWsxPFlGSsrdY4HQTvJTXCPPo6hY3yzNqS-LT2dyz-H6eL7EtK0v_8i-PagNB1gz3jgpqNCrlDh3Hl8LNOinrpfH67tGv8REadHhcEWaNBNClorZfSMPNChL4x5G61LEWYfvWxIKevCiijlJYfkhxRDW2Ig Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/41785319e3f242ca9cd86981db6e1789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_41785319e3f242ca9cd86981db6e1789", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 41785319e3f242ca9cd86981db6e1789 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-825191853 Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3cc1615daf5e4df5900068455d7109ee Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-825191853-project Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance ed661293-2de7-4a28-8de8-d4b538451e23 could not be found. Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ed661293-2de7-4a28-8de8-d4b538451e23'} Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed661293-2de7-4a28-8de8-d4b538451e23 could not be found. Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed661293-2de7-4a28-8de8-d4b538451e23 could not be found. Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:28.822505 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed661293-2de7-4a28-8de8-d4b538451e23 could not be found. Sep 08 10:35:28.826785 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:35:28.829198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] Returning 404 to user: Instance ed661293-2de7-4a28-8de8-d4b538451e23 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:35:28.830726 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-999c556d-5324-48bc-a8c0-42a5dbed01a6 tempest-ServerRescueNegativeTestJSON-825191853 tempest-ServerRescueNegativeTestJSON-825191853-project] 10.222.0.59 "GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23" status: 404 len: 111 microversion: 2.1 time: 0.072801 Sep 08 10:35:28.832431 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2264/4728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:28 2022] GET /compute/v2.1/servers/ed661293-2de7-4a28-8de8-d4b538451e23 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:35:29.019426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:29.020072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:29.034394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:29.036958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:29.043544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:29.044555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:29.047643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:29.050724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:29.194550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:29.195308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:29.208255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:29.212012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:29.213843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:29.218393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:29.219127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:29.221633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:30.188565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:30.191541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:30.200506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:30.201944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:30.207214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-359886d7-5442-4f9e-87c9-18bf8417e25d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 1.015600 Sep 08 10:35:30.207928 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3db88609-c1be-47f7-95bc-597a3870b898 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1743 microversion: 2.20 time: 1.195204 Sep 08 10:35:30.226224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2265/4729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:29 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:30.227658 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2465/4730] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:29 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1743 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:30.317129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a0c3cc04-8236-4f64-9ab6-a9b520122e0a req-ea86ac5a-f005-43bc-ab15-8a63158d6286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "name": "network-vif-plugged", "status": "completed", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:30.337180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a0c3cc04-8236-4f64-9ab6-a9b520122e0a req-ea86ac5a-f005-43bc-ab15-8a63158d6286 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:30.337837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a0c3cc04-8236-4f64-9ab6-a9b520122e0a req-ea86ac5a-f005-43bc-ab15-8a63158d6286 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:30.341217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a0c3cc04-8236-4f64-9ab6-a9b520122e0a req-ea86ac5a-f005-43bc-ab15-8a63158d6286 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:30.370755 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a0c3cc04-8236-4f64-9ab6-a9b520122e0a req-ea86ac5a-f005-43bc-ab15-8a63158d6286 service nova] Creating event network-vif-plugged:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h2-833090-19 Sep 08 10:35:30.383630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a0c3cc04-8236-4f64-9ab6-a9b520122e0a req-ea86ac5a-f005-43bc-ab15-8a63158d6286 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073312 Sep 08 10:35:30.387880 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2466/4731] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:35:30.950846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:30.951636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:30.986582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:30.988924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:30.989485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:30.990331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:30.996209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:30.998181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:31.111826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-730cd3f6-53c6-493b-ba40-a9046e3f4ef2 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/ips" status: 200 len: 147 microversion: 2.1 time: 0.883383 Sep 08 10:35:31.116244 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2266/4732] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:35:30 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/ips => generated 147 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:31.235261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:31.236734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:31.237601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:31.238219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:31.247134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:31.247657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:31.258603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:31.270287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:31.271149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:31.271657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:31.272263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:31.278868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:31.283005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:31.285039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:31.291096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:31.292869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:31.362918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:32.017095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:32.036503 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6a5701a-27c1-4269-a869-9ef1dcc0c608 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 0.801787 Sep 08 10:35:32.051712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:32.053060 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2267/4733] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:31 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:32.066393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:32.084287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:32.088631 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e6254e9-36f1-4248-9916-9cf986acc58e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1743 microversion: 2.20 time: 0.857727 Sep 08 10:35:32.090774 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2467/4734] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:31 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1743 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:32.419361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-68a51360-1ab4-4959-ac64-3294ebc0fee8 req-7a5b9115-7312-4645-9e25-2f54296160ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "name": "network-vif-plugged", "status": "completed", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:32.460097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-68a51360-1ab4-4959-ac64-3294ebc0fee8 req-7a5b9115-7312-4645-9e25-2f54296160ed service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:32.460662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-68a51360-1ab4-4959-ac64-3294ebc0fee8 req-7a5b9115-7312-4645-9e25-2f54296160ed service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:32.461104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-68a51360-1ab4-4959-ac64-3294ebc0fee8 req-7a5b9115-7312-4645-9e25-2f54296160ed service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:32.499606 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-68a51360-1ab4-4959-ac64-3294ebc0fee8 req-7a5b9115-7312-4645-9e25-2f54296160ed service nova] Creating event network-vif-plugged:3711f68e-a7bd-4648-9f34-af0cc36d1f25 for instance ab066901-fa02-4e6f-957c-65bc129387a6 on n-h1-833090-19 Sep 08 10:35:32.524841 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-68a51360-1ab4-4959-ac64-3294ebc0fee8 req-7a5b9115-7312-4645-9e25-2f54296160ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115963 Sep 08 10:35:32.525828 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2268/4735] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:33.073254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:33.074521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:33.093272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:33.116483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:33.119556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:33.121094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:33.122154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:33.125134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:33.127146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:33.129192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:33.140985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:33.141859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:33.142493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:33.145361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:33.146902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:33.151845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:33.645656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:33.661879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:33.669204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:33.678796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-216a46de-82fd-4d82-9ea4-f7666404f338 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.565446 Sep 08 10:35:33.688236 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2269/4736] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:33 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:33.699988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:33.723741 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7b60f47-6e69-44be-847d-e1d3cd09df27 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1316 microversion: 2.1 time: 0.650327 Sep 08 10:35:33.727534 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2468/4737] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:33 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:34.351775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8124f900-05a8-4b12-8bf6-53c0171baead"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:34.359993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:34.383147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:34.385645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:34.387597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:34.396938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:34.397780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:34.400157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:34.762578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:34.767489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:34.801046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:34.805242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:34.806021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:34.809349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:34.812904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:34.815930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:35.228752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:35.243344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:35.253628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:35.264748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16b7c9be-822d-4b2a-a190-1459f8c07af5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.546685 Sep 08 10:35:35.267346 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2469/4738] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:34 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:35.285774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:35.296647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:35.332458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:35.336108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:35.336575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:35.337333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:35.337806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:35.345879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:35.802857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:35.818023 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8011ede6-b9bd-454a-85f4-abd17d267c7c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.547525 Sep 08 10:35:35.819505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2470/4739] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:35 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:36.105759 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4378f6b-aff4-41a2-9942-4e5ba249e5cd tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.762031 Sep 08 10:35:36.118805 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2270/4740] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:35:34 2022] POST /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments => generated 194 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:36.159976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-82620569", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:36.293733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:36.296238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:36.317619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:36.321251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:36.321804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:36.324891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:36.325444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:36.325886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:36.802279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:36.818528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:36.827357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:36.828972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b55cbe83-235d-4e46-a52d-36e8f52b8701 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.540219 Sep 08 10:35:36.832370 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2271/4741] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:36 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:37.865349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:37.866731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:37.883836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:37.898029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:37.902305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:37.906317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:37.907017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:37.908577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:38.344750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:38.361995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:38.363980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:38.368191 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6df92035-db66-4ce8-bafd-2abeb05d1ff2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.505646 Sep 08 10:35:38.369612 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2272/4742] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:37 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:39.405860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:39.406543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:39.434734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:39.435440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:39.436096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:39.437005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:39.437632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:39.438386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:39.993100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:40.006558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:40.008315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:40.013975 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d51eb57b-fcce-4938-9ffb-4c95d6b0b146 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.612281 Sep 08 10:35:40.015404 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2273/4743] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:39 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:41.047346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:41.048247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:41.066683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:41.085911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:41.086825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:41.088016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:41.094485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:41.095253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:41.095903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:41.738091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:41.753297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:41.763932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:41.765692 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51f98019-603a-439b-8525-3a384a8b29b1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.722262 Sep 08 10:35:41.770472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2274/4744] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:41 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:42.553552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] validate_networks() for [('6a31b811-fdf4-47f5-84de-f0d87838fc52', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:35:42.796222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:42.797445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:42.819540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:42.820070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:42.820527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:42.821261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:42.821724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:42.822162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:44.130596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:44.147448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:44.149566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:44.154141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a77eecc-e203-485b-8c36-9777a1c861ba tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 1.359895 Sep 08 10:35:44.155663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2275/4745] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:42 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:44.458100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1464759648", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:44.693357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:35:44.694954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:35:44.695698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:35:44.696442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:35:44.697029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:35:44.733584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:44.738503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:44.738819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:35:44.739455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:35:44.739883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:35:44.740427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:35:44.740951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:35:44.741201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:44.742625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:44.743352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:44.744067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:44.748556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:44.770878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:44.772658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:44.774043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:44.775116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:44.776990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:44.778887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:44.780291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Getting quotas for project e9c5a838f5a34b6d9f2849c2f006f569. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:35:44.790369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Getting quotas for user 229c2edf560c44178157d1038567418d and project e9c5a838f5a34b6d9f2849c2f006f569. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:35:44.810687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:35:44.814078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:35:44.826436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Getting quotas for project 5515e18960864987b0c62d82ffc45897. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:35:44.845976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Getting quotas for user db4e0fa30b874e4f9ff56c000c48dc50 and project 5515e18960864987b0c62d82ffc45897. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:35:44.906650 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c46ffa79-d1b1-4cf8-99ef-dd922e9b5a3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.748503 Sep 08 10:35:44.909445 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2276/4746] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:35:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:35:44.936079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-345d2851-259b-4b91-8415-008dd1c69295 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:44.936805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-345d2851-259b-4b91-8415-008dd1c69295 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:44.948611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:35:44.951267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:35:45.124792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-345d2851-259b-4b91-8415-008dd1c69295 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.154917 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17d260c2-9123-409e-96a8-d4af2de88fd3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.006516 Sep 08 10:35:45.162303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2471/4747] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 9014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:35:45.163137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-345d2851-259b-4b91-8415-008dd1c69295 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.171671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-345d2851-259b-4b91-8415-008dd1c69295 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.175633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-345d2851-259b-4b91-8415-008dd1c69295 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab" status: 200 len: 1278 microversion: 2.47 time: 0.257232 Sep 08 10:35:45.179554 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2277/4748] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:44 2022] GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:45.180140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b728ed19-ac4b-4b5a-b483-3fbcd4b57f69 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:45.180952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b728ed19-ac4b-4b5a-b483-3fbcd4b57f69 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:45.202370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:45.203658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:45.219254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:45.220054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:45.221721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:45.225940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:45.226668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:45.227499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:45.399294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b728ed19-ac4b-4b5a-b483-3fbcd4b57f69 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.434446 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b728ed19-ac4b-4b5a-b483-3fbcd4b57f69 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1215 microversion: 2.1 time: 0.259597 Sep 08 10:35:45.435413 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2472/4749] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:45 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:45.448559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1006291489", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:45.781972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:35:45.783387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:35:45.784159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:35:45.784795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:35:45.786316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:35:45.824010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.825329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:45.826648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:45.830959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:45.833606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:45.836010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:45.836705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:45.837217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.840581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:45.842145 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29a02d1e-2bdf-4160-858d-50486c08d57e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.644654 Sep 08 10:35:45.844758 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2278/4750] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:45 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:45.938699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Getting quotas for project e9c5a838f5a34b6d9f2849c2f006f569. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:35:45.970379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Getting quotas for user 229c2edf560c44178157d1038567418d and project e9c5a838f5a34b6d9f2849c2f006f569. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:35:46.033508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:35:46.040169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:35:46.265072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f739b26-bd69-4f3f-b851-55c7ecc7636f tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.828101 Sep 08 10:35:46.266150 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2473/4751] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:35:46.286853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fba5a98f-0540-405f-bab4-e1befb575c3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:46.290007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fba5a98f-0540-405f-bab4-e1befb575c3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:46.458510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-74132c52-044a-40d8-ab26-2ae189b4cc4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:46.459448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-74132c52-044a-40d8-ab26-2ae189b4cc4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:46.466650 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fba5a98f-0540-405f-bab4-e1befb575c3a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "PUT /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 992 microversion: 2.47 time: 0.186171 Sep 08 10:35:46.470483 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2279/4752] 10.222.0.59 () {62 vars in 1297 bytes} [Thu Sep 8 10:35:46 2022] PUT /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 992 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:35:46.507989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-21be94dd-bfc9-4d0b-8bf4-a19011a87b82 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:46.509691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-21be94dd-bfc9-4d0b-8bf4-a19011a87b82 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:46.677912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-74132c52-044a-40d8-ab26-2ae189b4cc4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:46.699513 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-74132c52-044a-40d8-ab26-2ae189b4cc4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1215 microversion: 2.1 time: 0.237276 Sep 08 10:35:46.701259 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2474/4753] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:46 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:46.839279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-21be94dd-bfc9-4d0b-8bf4-a19011a87b82 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:46.855655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-21be94dd-bfc9-4d0b-8bf4-a19011a87b82 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:46.865014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-21be94dd-bfc9-4d0b-8bf4-a19011a87b82 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:46.870811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:46.871325 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-21be94dd-bfc9-4d0b-8bf4-a19011a87b82 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1278 microversion: 2.47 time: 0.371337 Sep 08 10:35:46.871511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:46.884236 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2280/4754] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:46 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1278 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:46.889318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:46.890044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:46.890662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:46.891387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:46.891893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:46.892321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:47.415046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:47.424739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:47.426864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:47.428714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38c0cc89-f0d2-4a92-bc47-e6bd3bb4c769 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.561928 Sep 08 10:35:47.441901 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2475/4755] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:46 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:47.726994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:47.729072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:47.755857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:47.758016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:47.761669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:47.767331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:47.767905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:47.772829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:47.866030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:47.887676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-047abc8a-eb4e-4f1a-87a5-eba66e375827 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1267 microversion: 2.1 time: 0.163161 Sep 08 10:35:47.900777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:47.901403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:47.919233 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2281/4756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:47 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:47.923579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:47.926184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:47.927105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:47.928028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:47.929572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:47.930324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:48.277694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:48.301966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:48.305303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:48.307598 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-21f9022e-7230-404c-b5f0-b90c8da34e4b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1282 microversion: 2.47 time: 0.413063 Sep 08 10:35:48.321271 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2476/4757] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:47 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1282 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:48.457772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:48.458403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:48.474683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:48.479595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:48.480217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:48.481026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:48.481605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:48.484584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:48.910810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:48.911432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:48.948634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:48.953343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:48.960332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:48.963138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:48.967082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:48.973535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:49.971723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:49.983184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f46140a4-88de-4518-9a58-37a2feafd655 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1273 microversion: 2.1 time: 1.075734 Sep 08 10:35:49.984367 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2477/4758] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:48 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1273 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:49.990753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:49.991596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:50.003432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:50.004361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:50.005746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:50.007873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:50.009389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:50.011039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:50.185216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:50.199171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:50.211796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:50.216814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04bff35e-5e98-4c30-bd35-d9aaffadbcbc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1330 microversion: 2.47 time: 0.229368 Sep 08 10:35:50.222244 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2478/4759] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:49 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1330 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:50.332184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:50.341257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:50.348894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:50.350417 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82773c3a-22e8-4d7d-a5c7-970932a3d363 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 1.897867 Sep 08 10:35:50.353424 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2282/4760] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:48 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:51.012939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:51.013595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:51.026493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:51.028162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:51.029298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:51.030831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:51.036955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:51.040110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:51.255760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:51.256387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:51.306046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:51.306464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:51.332406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:51.333052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:51.333486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:51.342240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:51.741683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:51.750325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:51.751804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:51.763991 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1156421f-5018-44da-8cb1-875627456014 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1348 microversion: 2.47 time: 0.514488 Sep 08 10:35:51.771790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2283/4761] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:51 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1348 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:51.804862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:51.809002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:51.824208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:51.833869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:51.834627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:51.837075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:51.838025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:51.838635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:51.962771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:51.987996 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ebb99ae7-537c-4a92-991c-8e74ff5f3f8f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.981547 Sep 08 10:35:51.990627 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2479/4762] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:51 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:52.282753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:52.302277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:52.305138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:52.307798 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04107de4-8fcb-49d5-b820-bd5e9dab5330 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.512091 Sep 08 10:35:52.339414 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2284/4763] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:51 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:52.800247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:52.802968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:52.839216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:52.868518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:52.868518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:52.868518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:52.868518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:52.868518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:53.011871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:53.012489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:53.052410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:53.053011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:53.053552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:53.072030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:53.072640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:53.073183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:53.091313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:53.116579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:53.120187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:53.127092 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7277b7b4-666f-4427-a886-692280958364 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1348 microversion: 2.47 time: 0.329452 Sep 08 10:35:53.130655 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2480/4764] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:52 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1348 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:53.347434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:53.348183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:53.364158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:53.371633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:53.373712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:53.374968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:53.379045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:53.383110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:54.215536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.225226 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14c6d7f0-41af-436d-9da6-18e01d9a035a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 1.217130 Sep 08 10:35:54.228496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2285/4765] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:53 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:54.239421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:54.240473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:54.251697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:54.256135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:54.256821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:54.257838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:54.260651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:54.261295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:54.370100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.385496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.386978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.392408 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b8e9bba-7bcc-4686-901c-62adf2db4e0c tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 1.049960 Sep 08 10:35:54.394270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2481/4766] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:53 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:54.522287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.531390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.540075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:54.541383 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e17251de-223d-406c-886e-ef65e3b68341 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1336 microversion: 2.47 time: 0.311623 Sep 08 10:35:54.547363 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2286/4767] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:54 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1336 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:54.979379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-dc5dfef2-3845-444c-b01d-475e2212cacc req-0d903ec4-f50c-45c3-a95b-8577d3c91dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d569c76-daca-4439-af2f-7ba6fd4a69ea", "tag": "4c059c7a-02aa-4824-b903-4539394f4eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:55.006580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dc5dfef2-3845-444c-b01d-475e2212cacc req-0d903ec4-f50c-45c3-a95b-8577d3c91dac service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:55.010336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dc5dfef2-3845-444c-b01d-475e2212cacc req-0d903ec4-f50c-45c3-a95b-8577d3c91dac service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:55.013650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dc5dfef2-3845-444c-b01d-475e2212cacc req-0d903ec4-f50c-45c3-a95b-8577d3c91dac service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:55.047146 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-dc5dfef2-3845-444c-b01d-475e2212cacc req-0d903ec4-f50c-45c3-a95b-8577d3c91dac service nova] Creating event network-changed:4c059c7a-02aa-4824-b903-4539394f4eae for instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea on n-h2-833090-19 Sep 08 10:35:55.062269 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-dc5dfef2-3845-444c-b01d-475e2212cacc req-0d903ec4-f50c-45c3-a95b-8577d3c91dac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084775 Sep 08 10:35:55.067656 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2482/4768] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:55.254188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:55.254867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:55.292653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:55.303848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:55.304523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:55.304982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:55.305731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:55.310914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:55.312529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:55.336579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:55.423939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:55.425408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:55.442390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:55.443377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:55.444195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:55.445984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:55.451373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:55.452126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:55.868561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:56.124780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.139408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e170393d-1d27-407b-af05-9a30a0599ecd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.892884 Sep 08 10:35:56.145602 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2287/4769] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:55 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:56.166186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:56.168393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:56.184904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:56.186346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:56.187299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:56.188847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:56.189733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:56.191610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:56.215733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.242017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.251693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.254770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2e71587-2277-4a15-b988-7fccab25c1ca tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.835690 Sep 08 10:35:56.259641 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2483/4770] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:55 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:56.433245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.445177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.446675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:56.462250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d43db85a-8526-405a-a8aa-11fe7cec6b85 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1336 microversion: 2.47 time: 0.300891 Sep 08 10:35:56.464853 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2288/4771] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:56 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1336 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:56.516600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:56.519713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:56.527018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:56.527793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:56.528398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:56.529295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:56.529933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:56.530631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:56.568310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:56.572440 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2eec7381-fcd4-4819-a600-d3bee3edd83c tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061349 Sep 08 10:35:56.580971 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2484/4772] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:35:56 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:56.585963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:56.587002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:56.600916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:56.601870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:56.602531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:56.606218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:56.607909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:56.609018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:56.687155 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16ae72b5-1e34-4623-ae80-322062f8b086 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/8124f900-05a8-4b12-8bf6-53c0171baead" status: 200 len: 194 microversion: 2.1 time: 0.105475 Sep 08 10:35:56.689095 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2289/4773] 10.222.0.59 () {58 vars in 1413 bytes} [Thu Sep 8 10:35:56 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/8124f900-05a8-4b12-8bf6-53c0171baead => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:35:57.184798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:57.185470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:57.192619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:57.219635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:57.220230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:57.221404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:57.223054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:57.226870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:57.228858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:57.291153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:57.291818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:57.293684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:35:57.321745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:57.322241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:57.322680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:57.323394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:57.323878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:57.324301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:57.711071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.729687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.742294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.746964 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6fc8403e-9c15-465b-905e-df7d20846aa9 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.459711 Sep 08 10:35:57.748951 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2290/4774] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:57 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:35:57.766469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:57.774752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:57.785859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.795381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:57.795626 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-50b1c82f-0735-4d1b-a2bb-b4fc86a75026 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.631785 Sep 08 10:35:57.795986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:57.796442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:57.797184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:57.797641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:57.799989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:57.819186 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2485/4775] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:57 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:35:57.904777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.917686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.924504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:57.928323 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df1082ad-6ad9-4daa-952f-ea962baa1d17 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1336 microversion: 2.47 time: 0.175364 Sep 08 10:35:57.931534 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2291/4776] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:57 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:58.778898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:58.779565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:58.796106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.796688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:58.797059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:58.797800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.803575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:58.804227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:58.825130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:58.825764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:58.844422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.851157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:58.851996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:58.852986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:58.855696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:58.856897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.294398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.310087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.317001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.326575 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8601aed9-9a15-4da1-a941-92e61905108b tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.552748 Sep 08 10:35:59.345026 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2486/4777] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:58 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:35:59.366366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:35:59.367004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:59.412546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:59.413569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:59.416675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.419655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:59.420211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:59.421490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.454413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.482582 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a73c7ec2-8766-4e07-be3e-621b35702793 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.661900 Sep 08 10:35:59.483214 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2292/4778] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:35:58 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:35:59.693546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a13145b7-1e7a-4812-be38-1186720eb292"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:35:59.696531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:35:59.711196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:59.719768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:59.722114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.723510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:35:59.725537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:35:59.730002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.741217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:35:59.742722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.749062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:35:59.752794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5422477-ccd1-414f-8d07-aa5609cf6fdf tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1336 microversion: 2.47 time: 0.405117 Sep 08 10:35:59.755682 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2487/4779] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:35:59 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1336 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:00.359710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:00.361216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:00.375585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:00.385011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:00.392029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:00.393652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:00.395935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:00.400025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:00.456727 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eea6a4bd-b1c3-49ce-8193-c23eb7fd5d11 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "POST /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768004 Sep 08 10:36:00.465450 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2293/4780] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:35:59 2022] POST /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:00.506873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:00.507872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:00.527395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:00.528448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:00.531482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:00.536590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:00.537799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:00.540769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:01.361084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.391803 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-219b977c-d0ca-47c1-9c6b-7ab7fbb70aba tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.890017 Sep 08 10:36:01.392443 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2294/4781] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:00 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:01.441202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:01.444496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:01.454510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:01.459509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:01.460731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:01.461745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:01.462380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:01.463012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:01.816874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.835770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.839263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.841586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.846011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4564def4-e908-43e5-b397-eb28ff626020 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1357 microversion: 2.47 time: 0.428587 Sep 08 10:36:01.848473 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2295/4782] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:01 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1357 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:01.865261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.869030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:01.872053 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8e41c67-c77e-464f-bf46-b7e72016eecb tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 1.516248 Sep 08 10:36:01.872652 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2488/4783] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:00 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:01.878112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:01.881873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:01.897259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:01.899337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:01.900858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:01.902190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:01.908927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:01.911902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.120946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:36:02.128469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:36:02.138725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:36:02.139437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:36:02.140066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:36:02.372614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:02.397161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.397709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.398409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.398900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.399357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.400594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.420902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:02.422590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:02.439181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.442023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.442249 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eaf86302-29bc-4241-a990-8e8af92ba5d4 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "POST /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a/action" status: 202 len: 1079 microversion: 2.47 time: 0.569169 Sep 08 10:36:02.444398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.446156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.449985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.450972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.459384 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2296/4784] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:36:01 2022] POST /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a/action => generated 1079 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:36:02.466078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:02.466706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:02.473960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.474541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.474985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.475728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.476185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.476922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.754631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:02.767143 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f2f7d48-aefe-4e3c-81a2-4c5461751b85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.349789 Sep 08 10:36:02.785837 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2489/4785] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:02 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:02.795947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:02.813084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:02.814819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:02.816100 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e3a040a-8fca-4a2b-b90e-1d9a2d68d136 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.355959 Sep 08 10:36:02.828041 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2297/4786] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:02 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:02.899224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:02.899883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:02.918490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.921587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.922314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:02.924195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:02.933584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:02.934855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:03.280523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:03.292932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:03.296948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:03.300188 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35acc27a-fd84-4ddf-8d7b-3f35d71917d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.405443 Sep 08 10:36:03.302637 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2490/4787] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:02 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:03.795434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:03.802799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:03.823853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:03.824391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:03.824843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:03.825653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:03.826114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:03.826543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:03.865476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:03.866124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:03.887647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:03.888698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:03.889151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:03.889905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:03.890368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:03.895766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:04.184837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.195176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.197213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.198835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5f2326d0-c720-427a-9012-1eee84490351 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.342179 Sep 08 10:36:04.219023 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2491/4788] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:03 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:04.329923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:04.331455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:04.349156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:04.349884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:04.350436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:04.351282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:04.354808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:04.355406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:04.462360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.479681 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff39e29b-7908-4c2e-b7c3-270ff48b0893 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.683794 Sep 08 10:36:04.491881 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2298/4789] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:03 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:04.615433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.632913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.634968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:04.637192 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec222b4b-3920-4c80-811c-a6ebffc4e7ce tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.312176 Sep 08 10:36:04.646645 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2492/4790] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:04 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:05.237672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:05.240126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:05.262161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:05.269012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:05.269716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:05.270951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:05.271709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:05.276044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:05.440290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.455637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.457108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.458343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-37ab9c28-1369-4e69-9d90-a96aa00b4b1e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.233023 Sep 08 10:36:05.475285 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2299/4791] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:05 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:05.499155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:05.502714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:05.513359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:05.516435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:05.517166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:05.518195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:05.521610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:05.522319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:05.683629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:05.684744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:05.694068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:05.696048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:05.697557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:05.698565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:05.701446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:05.702161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:05.748737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:05.874030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.888449 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58fc3c38-ca43-46db-a8cf-a5a1a57c01c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.393516 Sep 08 10:36:05.889749 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2493/4792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:05 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:05.945904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.962555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.965342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:05.967411 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0d3b2dc-5127-41e4-bd35-eb550ea3f041 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1738 microversion: 2.20 time: 0.290046 Sep 08 10:36:05.974146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2300/4793] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:05 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:06.488329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:06.490014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:06.519504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:06.523020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:06.524961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:06.529903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:06.531600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:06.532353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:06.914585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:06.915212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:06.925064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:06.925559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:06.930400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:06.931437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:06.934164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:06.935767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:07.325022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:07.340865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:07.346566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:07.352300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8a2cd5b-72b4-432a-98d8-77958b4b3c5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.870700 Sep 08 10:36:07.354768 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2494/4794] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:06 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:07.366414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:07.368454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:07.384259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:07.387182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:07.388032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:07.388954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:07.391620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:07.392246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:07.404272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:07.413190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-65a6c437-19fb-4aa4-879c-239eede28b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.503334 Sep 08 10:36:07.415773 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2301/4795] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:06 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:08.101868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:08.113447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:08.117642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:08.118902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-914523f3-6a4a-48a1-9ead-dff18cc650a5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1720 microversion: 2.20 time: 0.762474 Sep 08 10:36:08.137858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2495/4796] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:07 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1720 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:08.401655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:08.403160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:08.433382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:08.437647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:08.446212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:08.446837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:08.458864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:08.459821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:08.460327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:08.460797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:08.468392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:08.476972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:08.477528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:08.478243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:08.486638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:08.487580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:08.687749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:08.709584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:08.712023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:08.713577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4081f477-bd14-4e8e-be51-a7b799c47ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.335609 Sep 08 10:36:08.727501 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2302/4797] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:08 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:09.136707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.156590 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-673ef7a7-6747-4dfe-905a-779c16eaa13c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.713734 Sep 08 10:36:09.158997 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2496/4798] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:08 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:09.181125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:09.182099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:09.214308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:09.214843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:09.222536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:09.223419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:09.223940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:09.224394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:09.744696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:09.745952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:09.755478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:09.756252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:09.756950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:09.757857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:09.760042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:09.760688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:09.817620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.864873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.869754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.873939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10d58464-ae79-4fc2-a5e7-b430c80cfa73 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1720 microversion: 2.20 time: 0.699490 Sep 08 10:36:09.876181 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2303/4799] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:09 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1720 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:09.889758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.891242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1d289fe1-303f-473d-89af-cb646e25eccd req-c3e04c6f-9847-4e86-ad46-2694f7a77ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d569c76-daca-4439-af2f-7ba6fd4a69ea", "name": "network-vif-plugged", "status": "completed", "tag": "4c059c7a-02aa-4824-b903-4539394f4eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:09.903692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.906704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:09.912558 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25dde0ce-f754-4562-a927-eb7ba105fb72 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.172599 Sep 08 10:36:09.918123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1d289fe1-303f-473d-89af-cb646e25eccd req-c3e04c6f-9847-4e86-ad46-2694f7a77ea0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:09.918741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1d289fe1-303f-473d-89af-cb646e25eccd req-c3e04c6f-9847-4e86-ad46-2694f7a77ea0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:09.919194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1d289fe1-303f-473d-89af-cb646e25eccd req-c3e04c6f-9847-4e86-ad46-2694f7a77ea0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:09.929075 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2497/4800] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:09 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:09.948287 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1d289fe1-303f-473d-89af-cb646e25eccd req-c3e04c6f-9847-4e86-ad46-2694f7a77ea0 service nova] Creating event network-vif-plugged:4c059c7a-02aa-4824-b903-4539394f4eae for instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea on n-h2-833090-19 Sep 08 10:36:09.959575 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1d289fe1-303f-473d-89af-cb646e25eccd req-c3e04c6f-9847-4e86-ad46-2694f7a77ea0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081571 Sep 08 10:36:09.964041 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2304/4801] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:10.187606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:10.188448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:10.197849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:10.198731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:10.199388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:10.200987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:10.201663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:10.202338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:10.443154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:10.454994 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8a039b2-747c-4498-89f9-b1d63e4b687d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.272078 Sep 08 10:36:10.456165 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2498/4802] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:10 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:10.907774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:10.908827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:10.934901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:10.935724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:10.938665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:10.940102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:10.948030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:10.949644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:10.955876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:10.959294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:10.971684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:10.973205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:10.977064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:10.980138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:10.980923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:10.981628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:11.191000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.206259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.212235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.213587 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98fa2dbc-8f74-4de7-be4b-e03549e1656e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.270301 Sep 08 10:36:11.226568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2499/4803] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:10 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:11.483000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:11.484109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:11.495224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:11.497407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:11.508238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:11.512433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:11.513983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:11.519059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:11.534545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.581681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.598094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.602509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b575145-c4cf-4370-970c-eefa320e05e2 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1723 microversion: 2.20 time: 0.698029 Sep 08 10:36:11.637716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2305/4804] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:10 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1723 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:11.651109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b4cd6ff-b522-4a0c-839f-9bba0e0dfa6f"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:11.654270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:11.660962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:11.664295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:11.665102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:11.670428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:11.671568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:11.672276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:11.672937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:11.910622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:11.922094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b99ecb7-e7fd-4d33-983b-798d66399088 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1315 microversion: 2.1 time: 0.445696 Sep 08 10:36:11.925224 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2500/4805] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:11 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:11.992611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-36c27aa7-eb99-4230-8e12-590d3254e19f req-78a54d1f-618c-4ade-9a3f-fe8f2b3e9258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "name": "network-vif-unplugged", "status": "completed", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:12.009939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-36c27aa7-eb99-4230-8e12-590d3254e19f req-78a54d1f-618c-4ade-9a3f-fe8f2b3e9258 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.010433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-36c27aa7-eb99-4230-8e12-590d3254e19f req-78a54d1f-618c-4ade-9a3f-fe8f2b3e9258 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.010869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-36c27aa7-eb99-4230-8e12-590d3254e19f req-78a54d1f-618c-4ade-9a3f-fe8f2b3e9258 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:12.050431 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-36c27aa7-eb99-4230-8e12-590d3254e19f req-78a54d1f-618c-4ade-9a3f-fe8f2b3e9258 service nova] Creating event network-vif-unplugged:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h2-833090-19 Sep 08 10:36:12.068013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-36c27aa7-eb99-4230-8e12-590d3254e19f req-78a54d1f-618c-4ade-9a3f-fe8f2b3e9258 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078952 Sep 08 10:36:12.074868 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2501/4806] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:12.257778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:12.258678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:12.275316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.285156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.285762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:12.286610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.287162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.287709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:12.297933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:12.339255 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b1ffa557-1698-4685-8f28-d8e29087bb46 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.697261 Sep 08 10:36:12.340705 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2306/4807] 10.222.0.59 () {62 vars in 1364 bytes} [Thu Sep 8 10:36:11 2022] POST /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-volume_attachments => generated 188 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:36:12.535008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:12.545861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:12.560219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:12.563195 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab9f744a-5d02-44d6-a1e1-c029c1fab58b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.309674 Sep 08 10:36:12.569648 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2502/4808] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:12 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:12.702184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:12.702952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:12.713424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.714266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.714908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:12.716163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.717078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.717916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:12.950034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:12.950738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:12.972019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.972539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.972986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:12.973722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:12.974175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:12.988265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.419912 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-071afc81-bc91-4306-9102-bf9e618b53c8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-volume_attachments/0b4cd6ff-b522-4a0c-839f-9bba0e0dfa6f" status: 202 len: 0 microversion: 2.20 time: 0.722075 Sep 08 10:36:13.450518 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2307/4809] 10.222.0.59 () {60 vars in 1457 bytes} [Thu Sep 8 10:36:12 2022] DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-volume_attachments/0b4cd6ff-b522-4a0c-839f-9bba0e0dfa6f => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:36:13.546162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:13.546780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:13.556923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:13.557435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:13.557890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.558627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:13.559097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:13.561211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:13.567733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.574344 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d1d063fa-d3ed-4e52-be76-8e0cc663da01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1505 microversion: 2.1 time: 0.628307 Sep 08 10:36:13.577936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2503/4810] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:12 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:13.605815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:13.606441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:13.619278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:13.626121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:13.633419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.644024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122456) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:36:13.645284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:13.646016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:13.650298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.805889 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2f37869e-e658-4183-b330-dc943cff963e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "POST /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/action" status: 202 len: 0 microversion: 2.20 time: 0.263358 Sep 08 10:36:13.808059 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2308/4811] 10.222.0.59 () {62 vars in 1319 bytes} [Thu Sep 8 10:36:13 2022] POST /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:36:13.824193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:13.826005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:13.840672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:13.845181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:13.846413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.847539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:13.851905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:13.852570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:13.933960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:36:14.056959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:14.069956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:14.078504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:14.083148 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c819def0-9148-402f-b5ab-ea047ec2f101 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.483223 Sep 08 10:36:14.084470 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2504/4812] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:13 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:14.116370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:14.117598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:14.147285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:14.158730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:14.159200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:14.160003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:14.160479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:14.160928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:14.186316 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32464f7f-069b-4526-b845-32ae0544c833 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 204 len: 0 microversion: 2.1 time: 0.372147 Sep 08 10:36:14.186935 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2309/4813] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:36:13 2022] DELETE /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:36:14.196380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:14.197096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:14.210098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:14.210615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:14.211064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:14.211840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:14.212327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:14.216901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:14.256563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=7,nova_cell1:UPDATE=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:15.159723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:15.170393 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02f839a8-7135-4637-8f2c-7891e2d04581 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1511 microversion: 2.1 time: 0.978296 Sep 08 10:36:15.171208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2310/4814] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:14 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1511 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:15.188761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:15.215417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:15.230641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:15.253510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:15.260424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:15.260926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:15.261369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:15.262416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:15.262966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:15.263391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:15.263662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:15.270918 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca9839dd-928e-4ff7-96c8-9d4da4f83474 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1671 microversion: 2.20 time: 1.172510 Sep 08 10:36:15.274898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2505/4815] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:14 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1671 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:16.126432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:16.137607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:16.139437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:16.146806 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dea1f074-2ecf-4511-a347-2eea3e6ed8fd tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.968928 Sep 08 10:36:16.148189 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2311/4816] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:15 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:16.200643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:16.201516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:16.204483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:16.227697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:16.228417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:16.228614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:16.229531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:16.232170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:16.232568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:16.304997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:16.305620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:16.320209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:16.320714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:16.321322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:16.322054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:16.322514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:16.322942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.290904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.305688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.309918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.317867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b9dfd71-fb22-4271-98e0-e6c8773cd205 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1671 microversion: 2.20 time: 1.012474 Sep 08 10:36:17.318536 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2312/4817] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:16 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1671 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:17.327508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:17.335094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:17.349337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.367918 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e473d68c-a32f-4ebd-a854-907c4c949b2c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1511 microversion: 2.1 time: 1.170935 Sep 08 10:36:17.373510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.374315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.381023 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2506/4818] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:16 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1511 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:17.382579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.384638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.392640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.393109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.558333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.564976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:17.568608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:17.585078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.585729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.586505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.589560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.591833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.593036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.595773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.595940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:17.605869 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-634f6048-5d0e-4ab3-aa17-2d976cd6cdc3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.276183 Sep 08 10:36:17.606532 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2313/4819] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:17 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:17.671325 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f463e56-63f6-41d4-bb2b-c62018470dd7 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.128757 Sep 08 10:36:17.674472 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2507/4820] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:36:17 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:36:17.840164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:17.841767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:17.852692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.853221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.853740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.854495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.854959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.855444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.889620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9430237e-a746-432a-b3a6-1f186df62ab4 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/8124f900-05a8-4b12-8bf6-53c0171baead" status: 200 len: 194 microversion: 2.1 time: 0.065443 Sep 08 10:36:17.890715 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2314/4821] 10.222.0.59 () {58 vars in 1413 bytes} [Thu Sep 8 10:36:17 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/8124f900-05a8-4b12-8bf6-53c0171baead => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:17.902087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:17.906566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:17.915576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.916826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.917502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:17.918494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:17.919482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:17.920157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:18.086543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lazy-loading 'services' on Instance uuid 6133c359-37f2-48a7-a087-355b76cdd4f6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:36:18.242534 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b08a949-a1d2-40f6-b0c8-6f909d2afe1d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/8124f900-05a8-4b12-8bf6-53c0171baead" status: 202 len: 0 microversion: 2.1 time: 0.339528 Sep 08 10:36:18.244269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2508/4822] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:36:17 2022] DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/8124f900-05a8-4b12-8bf6-53c0171baead => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:18.301199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-61709781-6963-4e3b-aa51-f99ef0add0ea tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Action: 'create', calling method: .version_select at 0x7f235087ff70>, body: {"keypair": {"name": "tempest-keypair-1274459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK95BX1CaXISs6lOwzLFkJklTZSTZgCPGunfbvufzBLRSplcRaF0V69pV5qysF2XqIYphKEzzaVC5QWNS7+pEcLfpjf6M9kbNatsw9eZoWdy3Mi5TSWHhYq2xPhEfeKuRg=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:18.321608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-61709781-6963-4e3b-aa51-f99ef0add0ea tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Getting quotas for project 069cf433a0a845c5847ef39874a8d04d. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:36:18.338989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-61709781-6963-4e3b-aa51-f99ef0add0ea tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Getting quotas for user 638f7b6e991f41ae827f36a3f599987c and project 069cf433a0a845c5847ef39874a8d04d. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:36:18.353925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:18.355996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:18.366498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:18.367813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:18.368522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:18.381046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:18.382117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:18.383703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:18.393732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-61709781-6963-4e3b-aa51-f99ef0add0ea tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.32 time: 0.104341 Sep 08 10:36:18.395070 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2315/4823] 10.222.0.59 () {62 vars in 1200 bytes} [Thu Sep 8 10:36:18 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 10:36:18.405821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:18.415875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:18.443619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:18.444125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:18.444578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:18.446646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:18.448068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:18.448515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:18.769173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:18.794679 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38080785-4a06-40e0-9017-10f5495709e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1469 microversion: 2.1 time: 0.382224 Sep 08 10:36:18.795795 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2316/4824] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:18 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:18.805970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:18.808174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:18.827549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:18.833259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:18.833837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:18.836089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:18.839788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:18.840775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:19.100078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:19.112551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:19.114020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:19.115258 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e45621a-559a-4aba-b0a3-ee982d71b6fc tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.318277 Sep 08 10:36:19.137114 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2317/4825] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:18 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:19.150464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-eceea4c6-2a55-4566-b92a-cbdfc6ce9f1c req-ab90f8be-f017-4a96-8013-b218d613c45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d569c76-daca-4439-af2f-7ba6fd4a69ea", "name": "network-vif-deleted", "tag": "4c059c7a-02aa-4824-b903-4539394f4eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:19.161272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eceea4c6-2a55-4566-b92a-cbdfc6ce9f1c req-ab90f8be-f017-4a96-8013-b218d613c45f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:19.162066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eceea4c6-2a55-4566-b92a-cbdfc6ce9f1c req-ab90f8be-f017-4a96-8013-b218d613c45f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:19.162794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eceea4c6-2a55-4566-b92a-cbdfc6ce9f1c req-ab90f8be-f017-4a96-8013-b218d613c45f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:19.176406 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-eceea4c6-2a55-4566-b92a-cbdfc6ce9f1c req-ab90f8be-f017-4a96-8013-b218d613c45f service nova] Creating event network-vif-deleted:4c059c7a-02aa-4824-b903-4539394f4eae for instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea on n-h2-833090-19 Sep 08 10:36:19.186748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-eceea4c6-2a55-4566-b92a-cbdfc6ce9f1c req-ab90f8be-f017-4a96-8013-b218d613c45f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043298 Sep 08 10:36:19.186748 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2318/4826] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:19.402531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:19.413458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:19.415729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:19.417794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d920d193-52d9-4cc7-b91f-10526a8f7cde tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 1.073185 Sep 08 10:36:19.419249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2509/4827] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:18 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:19.819773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:19.821119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:19.843331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:19.843994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:19.844461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:19.845750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:19.846482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:19.847085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:19.904716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:19.905600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:19.906205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:19.906839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lazy-loading 'fault' on Instance uuid 3d569c76-daca-4439-af2f-7ba6fd4a69ea {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:36:20.073400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:20.087765 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-568d47b2-2697-4970-978a-1285b6b5fa43 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 200 len: 1305 microversion: 2.1 time: 0.273024 Sep 08 10:36:20.088425 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2319/4828] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:19 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 1305 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:20.153463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:20.154198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:20.164220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:20.164723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:20.165170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:20.169434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:20.169955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:20.170411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:20.377436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:20.446664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:20.447552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:20.452635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:20.458571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:20.459071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:20.459533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:20.462078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:20.464356 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d6c493b4-9f51-4023-ad3c-cc80ed6ef598 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.314427 Sep 08 10:36:20.465672 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2510/4829] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:20 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:20.471559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:20.472346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:20.473071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.035835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.047530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.057791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.059348 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2c9ecfa6-bbd3-4ade-9859-53b62641a04e tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.617398 Sep 08 10:36:21.072787 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2320/4830] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:20 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:21.112059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:21.112869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:21.127209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.135794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.137272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.138232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.139853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.141333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.166788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea HTTP/1.1 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3d569c76-daca-4439-af2f-7ba6fd4a69ea'} Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:21.168766 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:36:21.172997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:21.175646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:21.177131 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f9c9106-1020-4431-a9c5-e3dfefb723de tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 404 len: 111 microversion: 2.1 time: 0.069926 Sep 08 10:36:21.178622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2511/4831] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:21 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:21.193615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:21.196224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:21.213669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.214184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.214635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.216781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.219501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.219959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.495483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:21.496710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:21.510681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.520547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.521242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.522155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.522767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.523351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.720523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.737376 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a53fccd5-dfdd-4c3b-b8d2-328ff49dfad6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.554152 Sep 08 10:36:21.753278 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2321/4832] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:21 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:21.763977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.772872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.795863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:21.798886 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59a05a54-408c-4a50-b1db-9c12111b853c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.305955 Sep 08 10:36:21.800628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2512/4833] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:21 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:21.810601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-665913676", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8bf95a7d-0981-412b-9ae5-b63f1ff2f1d8"}, {"port": "7f802e01-b8f5-4de2-b080-1ced4f14e689", "tag": "port-1"}, {"port": "07b04276-05e1-4d43-956b-944bf1031fde", "tag": "port-2"}, {"uuid": "01a9f4e6-780c-4300-860e-726c94988c3c", "tag": "net-1"}, {"uuid": "01a9f4e6-780c-4300-860e-726c94988c3c"}, {"uuid": "dc7a25a6-a3c2-477c-b766-d24e426408a8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "dc7a25a6-a3c2-477c-b766-d24e426408a8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d60bd1c2-e2b9-4270-8f7b-baa9e809f38f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a5dae758-6f9a-4769-a2cf-c1f8206e443e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "138cca9f-4b7b-4ec3-9476-0b32bd127fbb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2035420369"}], "key_name": "tempest-keypair-1274459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:21.885923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5ec366b3-97da-4024-ba33-3161fcf22cd3 req-46eb52cf-2c12-4e66-a5f8-a90306fee1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:21.918191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ec366b3-97da-4024-ba33-3161fcf22cd3 req-46eb52cf-2c12-4e66-a5f8-a90306fee1c5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:21.919382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ec366b3-97da-4024-ba33-3161fcf22cd3 req-46eb52cf-2c12-4e66-a5f8-a90306fee1c5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:21.921338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ec366b3-97da-4024-ba33-3161fcf22cd3 req-46eb52cf-2c12-4e66-a5f8-a90306fee1c5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:21.976958 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5ec366b3-97da-4024-ba33-3161fcf22cd3 req-46eb52cf-2c12-4e66-a5f8-a90306fee1c5 service nova] Creating event network-changed:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h1-833090-19 Sep 08 10:36:21.994703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5ec366b3-97da-4024-ba33-3161fcf22cd3 req-46eb52cf-2c12-4e66-a5f8-a90306fee1c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111454 Sep 08 10:36:21.997174 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2513/4834] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:22.070182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-294d12f7-87e4-4875-8da5-5238069be487 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-294d12f7-87e4-4875-8da5-5238069be487 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 163 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": 12345, "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 12345 Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:22.077382 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-294d12f7-87e4-4875-8da5-5238069be487 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:22.081336 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-294d12f7-87e4-4875-8da5-5238069be487 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.020584 Sep 08 10:36:22.091951 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2514/4835] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:22 2022] POST /compute/v2.1/servers => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:36:22.101459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:22.106028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:22.123142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:22.134145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:22.134785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:22.135607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:22.136163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:22.136612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:22.152541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] validate_networks() for [('8bf95a7d-0981-412b-9ae5-b63f1ff2f1d8', None, None, None, None, None), (None, None, '7f802e01-b8f5-4de2-b080-1ced4f14e689', None, None, None), (None, None, '07b04276-05e1-4d43-956b-944bf1031fde', None, None, None), ('01a9f4e6-780c-4300-860e-726c94988c3c', None, None, None, None, None), ('01a9f4e6-780c-4300-860e-726c94988c3c', None, None, None, None, None), ('dc7a25a6-a3c2-477c-b766-d24e426408a8', '10.2.2.100', None, None, None, None), ('dc7a25a6-a3c2-477c-b766-d24e426408a8', '10.2.2.200', None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:36:23.069627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.084138 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85a591d5-a808-4e29-b20c-4f6bb0448d72 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.989321 Sep 08 10:36:23.089529 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2515/4836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:22 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:23.098782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:23.102933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:23.112175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:23.116682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:23.117391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:23.118304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:23.120439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:23.121578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:23.652901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.666277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.668337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.670076 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57d79143-5ba5-4487-8674-2e8276bf7296 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.579145 Sep 08 10:36:23.670876 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2516/4837] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:23 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:23.693744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:23.694721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:23.702819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:23.703820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:23.704808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:23.705785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:23.706916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:23.708617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:23.896519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.910945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.918447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:23.920589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-68a64546-257d-4934-a4e9-b22f3cd0b89e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.248306 Sep 08 10:36:23.921180 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2517/4838] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:23 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:23.935488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:23.936152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:23.952206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:23.953037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:23.954993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:23.956186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:23.956875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:23.960845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:24.838149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:24.852729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bce97dd1-0393-4886-9c37-ece4b773f504 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.927998 Sep 08 10:36:24.870630 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2518/4839] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:23 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:24.884168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:24.895303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:24.909060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:24.914624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:24.915291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:24.916522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:24.917177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:24.917808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:25.206290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:25.223687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:25.234545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:25.239730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82567d1e-3443-4e71-9483-0369bb391cf0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.366690 Sep 08 10:36:25.241424 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2519/4840] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:24 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:25.268055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:25.271206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:25.280908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:25.281740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:25.283082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:25.284149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:25.284809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:25.285694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:25.318257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:25.441365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:25.456986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:25.459915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:25.463621 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-004b94bc-6ddb-4795-b684-1751a46cbb5a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.216719 Sep 08 10:36:25.483542 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2520/4841] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:25 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:26.270467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:26.271407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:26.304307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:26.309232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:26.310824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:26.322093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:26.322741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:26.323258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:27.978359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:27.997355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:27.998813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:28.000084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a77ee51-e1dd-411f-8cfc-b91c57e9f92f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 1.734827 Sep 08 10:36:28.011962 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2521/4842] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:26 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:28.027358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:28.030506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:28.044244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:28.044827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:28.045263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:28.047697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:28.049543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:28.052220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:28.228729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:28.261334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:28.265028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:28.268267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae30a874-599f-4983-9aa1-7eeaf16ab414 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.255162 Sep 08 10:36:28.273576 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2522/4843] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:28 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:28.290198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:28.291505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:28.307958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:28.308754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:28.313256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:28.315370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:28.316047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:28.316673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:28.359353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:28.395557 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42f9a1e5-d7db-43ba-96c9-32f2c8cbfc43 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/a13145b7-1e7a-4812-be38-1186720eb292" status: 200 len: 194 microversion: 2.1 time: 0.119895 Sep 08 10:36:28.398682 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2523/4844] 10.222.0.59 () {58 vars in 1413 bytes} [Thu Sep 8 10:36:28 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/a13145b7-1e7a-4812-be38-1186720eb292 => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:28.412363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:28.413047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:28.433027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:28.433884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:28.434569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:28.435786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:28.436547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:28.437330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:28.626757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lazy-loading 'services' on Instance uuid 6133c359-37f2-48a7-a087-355b76cdd4f6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:36:28.836369 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-62282094-9628-4883-a9e7-629e26166800 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/a13145b7-1e7a-4812-be38-1186720eb292" status: 202 len: 0 microversion: 2.1 time: 0.428830 Sep 08 10:36:28.837747 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2524/4845] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:36:28 2022] DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments/a13145b7-1e7a-4812-be38-1186720eb292 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:28.847415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea19c972-ebc5-48b8-8d9e-09d935088317 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1498168565", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "d8ead47e-049c-4693-a754-0e6d4092219e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:29.010587 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-ea19c972-ebc5-48b8-8d9e-09d935088317 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Block Device d8ead47e-049c-4693-a754-0e6d4092219e is not bootable. Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea19c972-ebc5-48b8-8d9e-09d935088317 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 358 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1498168565", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "d8ead47e-049c-4693-a754-0e6d4092219e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: exception: Block Device d8ead47e-049c-4693-a754-0e6d4092219e is not bootable. Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1498168565', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'd8ead47e-049c-4693-a754-0e6d4092219e'}], 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device d8ead47e-049c-4693-a754-0e6d4092219e is not bootable. Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:29.024623 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device d8ead47e-049c-4693-a754-0e6d4092219e is not bootable. Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device d8ead47e-049c-4693-a754-0e6d4092219e is not bootable. Sep 08 10:36:29.029190 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:29.032137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea19c972-ebc5-48b8-8d9e-09d935088317 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Block Device d8ead47e-049c-4693-a754-0e6d4092219e is not bootable. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:29.033290 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea19c972-ebc5-48b8-8d9e-09d935088317 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.194150 Sep 08 10:36:29.034202 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2525/4846] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:29.043314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:29.046202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:29.064559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:29.067899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:29.068744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:29.070336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:29.072334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:29.073008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:29.432833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:29.447596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:29.450865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:29.452828 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2eaf0386-2c56-4dbf-af48-a70d3efb14d0 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.414052 Sep 08 10:36:29.474852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2526/4847] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:29 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:29.480267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:29.481266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:29.489119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:29.489975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:29.490609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:29.491567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:29.492233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:29.492882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:30.792322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:30.805816 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f10a81ad-abb2-4f9d-9f93-2c24687a4fbb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.329392 Sep 08 10:36:30.828291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2527/4848] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:29 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:30.835923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:30.844533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:30.852235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:30.853157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:30.854585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:30.857747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:30.858461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:30.859139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:31.005535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:31.020184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:31.022002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:31.032330 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae7a3c74-86fd-4fdd-8068-aa2c31405050 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1366 microversion: 2.47 time: 0.202034 Sep 08 10:36:31.035108 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2528/4849] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:30 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:31.045247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:31.047905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:31.060519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:31.062029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:31.069329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:31.070436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:31.071119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:31.071956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:31.485107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:31.496722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:31.503730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:31.505057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc095970-ddd4-4e43-a1b8-f4458f1b6123 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.465466 Sep 08 10:36:31.505821 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2529/4850] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:31 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:31.528781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:31.532279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:31.546893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:31.547758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:31.548883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:31.549780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:31.550383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:31.550958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:31.730673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=63 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:32.014408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:32.052849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b34ab5a3-6ae2-4905-80c1-a9995a4dbaae tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.532852 Sep 08 10:36:32.054983 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2530/4851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:31 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:32.077461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:32.089295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:32.108460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:32.108962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:32.110722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:32.111119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:32.114748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:32.115202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:32.182989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:36:32.183558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:36:32.184134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:36:32.184556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:36:32.184967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:36:32.209692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:32.214613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:32.215955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:32.217640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:32.219643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:32.221038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:32.294039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Getting quotas for project 069cf433a0a845c5847ef39874a8d04d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:36:32.328820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Getting quotas for user 638f7b6e991f41ae827f36a3f599987c and project 069cf433a0a845c5847ef39874a8d04d. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:36:32.355786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:32.378793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:32.382730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:32.386365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29cc29dd-7b2f-4a8b-a01a-6078e719adfa tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1372 microversion: 2.47 time: 0.318888 Sep 08 10:36:32.390311 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2531/4852] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:32 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:32.538112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:32.540480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:32.555877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:32.558124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:32.558798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:32.564622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:32.565791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:32.570689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:33.055062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:33.070801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:33.073498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:33.078029 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6174777-c6ef-4b1c-9cb1-4a8dac7d53f5 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.548746 Sep 08 10:36:33.091514 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2532/4853] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:32 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:33.417803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:33.418929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:33.440320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:33.441221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:33.441874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:33.442827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:33.443989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:33.448321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:33.669046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:33.687543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:33.692244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:36:33.696715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d60bd1c2-e2b9-4270-8f7b-baa9e809f38f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a5dae758-6f9a-4769-a2cf-c1f8206e443e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='138cca9f-4b7b-4ec3-9476-0b32bd127fbb',volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:36:33.698227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:33.702637 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1366e37d-8221-48be-9a15-daa575add8a9 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1372 microversion: 2.47 time: 0.288707 Sep 08 10:36:33.710740 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2533/4854] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:33 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1372 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:34.103763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:34.105080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:34.113382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:34.128134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:34.128675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:34.129542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:34.135638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:34.136352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:34.726858 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fc36bfa1-f827-48e8-af3b-b9fbd9418b12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.921042 Sep 08 10:36:34.727892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2322/4855] 10.222.0.59 () {62 vars in 1189 bytes} [Thu Sep 8 10:36:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 12925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 10:36:34.743223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:34.744458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:34.759527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:34.760434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:34.763606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:34.765855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:34.767065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:34.768251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:35.189609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.244708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.266367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.301752 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54705f52-3607-4f8b-9b97-dd633c448a3d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 1.195402 Sep 08 10:36:35.302669 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2534/4856] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:34 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:35.343205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c2f1d0c-0886-43ef-b8a7-bffdc21722df tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:35.343998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c2f1d0c-0886-43ef-b8a7-bffdc21722df tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:35.654023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c2f1d0c-0886-43ef-b8a7-bffdc21722df tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.663314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c2f1d0c-0886-43ef-b8a7-bffdc21722df tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.673111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c2f1d0c-0886-43ef-b8a7-bffdc21722df tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.683163 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c2f1d0c-0886-43ef-b8a7-bffdc21722df tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1282 microversion: 2.32 time: 0.361847 Sep 08 10:36:35.685214 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2535/4857] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:35 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1282 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:35.714039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.729465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.734666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-662540ca-2df8-4944-99df-ff1e93d81212 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1219568257", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "destination_type": "local"}, {"source_type": "volume", "uuid": "c1958c32-e6da-430e-a44d-47b9e0249c75", "destination_type": "invalid"}], "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:35.735910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:35.739376 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07940ff0-eddd-45a1-9723-c3c11f2b8e23 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1372 microversion: 2.47 time: 1.005759 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-662540ca-2df8-4944-99df-ff1e93d81212 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 495 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1219568257", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "destination_type": "local"}, {"source_type": "volume", "uuid": "c1958c32-e6da-430e-a44d-47b9e0249c75", "destination_type": "invalid"}], "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1219568257', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c1958c32-e6da-430e-a44d-47b9e0249c75', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:35.752519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 10:36:35.756728 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:35.763957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-662540ca-2df8-4944-99df-ff1e93d81212 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:35.766492 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-662540ca-2df8-4944-99df-ff1e93d81212 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.055545 Sep 08 10:36:35.768334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2536/4858] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:35.778150 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2323/4859] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:34 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1372 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:35.787803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:35.790260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:35.808132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:35.812013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:35.812735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:35.815753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:35.816680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:35.819613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:36.335549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:36.336500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:36.362729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:36.364713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:36.365784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:36.369014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:36.371765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:36.376397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:36.839478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:36.875548 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fda1169-bd72-4535-8427-ebaad06dc869 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.096853 Sep 08 10:36:36.893054 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2537/4860] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:35 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:36.918292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:36.929800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:36.949362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:36.957303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:36.957769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:36.959068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:36.965367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:36.966062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:36.968991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:36.981060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:36.985342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.005572 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0c454032-a933-43f2-89ff-cbda55625283 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.674735 Sep 08 10:36:37.009641 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2324/4861] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:36 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:37.028611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:37.040428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:37.071406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.072286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:37.072952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:37.073911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.074605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:37.075259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:37.241930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.271748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.273426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.279043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25e4689c-5097-4fdc-8ba3-426a6b0aed43 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1524 microversion: 2.32 time: 0.384799 Sep 08 10:36:37.279685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2538/4862] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:36 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:37.304439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:37.311042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:37.333385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.335388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:37.335893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:37.336634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.337099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:37.337530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:37.405856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:37.610696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.626657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.629881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.636093 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b43ce0db-b6d8-4907-b34b-e552aa2ebfee tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1357 microversion: 2.47 time: 0.625117 Sep 08 10:36:37.637216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2325/4863] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:37 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1357 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:37.670057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:37.677411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.682426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Searching by: {'deleted': False, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:36:37.694967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.698749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:37.700104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:37.700503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.704211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:37.704891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:37.766075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:37.777505 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf8fcb08-93e0-46d2-85c9-9455cebb8abe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.490403 Sep 08 10:36:37.785174 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2539/4864] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:37 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:37.895753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a263e2f-35cc-41dc-b34e-e85aff66605a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2011257577", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a263e2f-35cc-41dc-b34e-e85aff66605a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 492 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2011257577", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2011257577', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.900513 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:37.903876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a263e2f-35cc-41dc-b34e-e85aff66605a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:37.920472 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a263e2f-35cc-41dc-b34e-e85aff66605a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.029075 Sep 08 10:36:37.928253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2540/4865] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:37 2022] POST /compute/v2.1/servers => generated 624 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:36:37.936551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:37.937170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:37.991087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:37.999772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.000348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.001419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:38.002065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.002657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.109925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:36:38.279576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:38.288994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:38.289915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.290608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.322230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:38.325733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:38.462744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:38.475622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4960830-dcdf-43a6-b79e-22b0d76cadb0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.542924 Sep 08 10:36:38.483422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e221dc95-2897-447e-93d2-7afd9bdbe61c tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.817471 Sep 08 10:36:38.485897 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2326/4866] 10.222.0.59 () {60 vars in 1187 bytes} [Thu Sep 8 10:36:37 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:38.492490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2541/4867] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:37 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:38.496020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:38.496896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:38.514048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:38.514936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.519821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.520910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:38.521572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.522176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.534000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:38.534891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:38.555637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:38.559963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.560568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.561385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:38.561929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:38.564745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:38.984693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.002666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.008016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.016023 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7ae4435-f22b-489c-976c-56c9fed60af2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1572 microversion: 2.32 time: 0.521950 Sep 08 10:36:39.017498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2542/4868] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:38 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1572 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:39.038551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:39.042862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:39.050371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:39.056285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:39.056944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:39.057908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:39.058531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:39.059140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:39.320744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.339817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.343775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.348663 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f6d4687-4c96-4f78-8aa8-2d6c903615ee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.860806 Sep 08 10:36:39.366293 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2327/4869] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:38 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:39.393753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:39.397009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:39.416714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:39.418225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:39.418713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:39.419479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:39.420061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:39.420363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:39.506244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:36:39.730422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f100aef-fe12-465d-ba10-73cb026231ea tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 204 len: 0 microversion: 2.47 time: 0.361526 Sep 08 10:36:39.731335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2328/4870] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:36:39 2022] DELETE /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:36:39.746436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:39.754869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:39.761827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:39.772538 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-147eaa77-3638-4bd0-a2f3-566394cd0b9e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.753606 Sep 08 10:36:39.796693 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2543/4871] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:39 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:39.807719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:39.808572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:39.809309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:39.814380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:39.817368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:39.821013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:40.045940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:40.046655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:40.070628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:40.071117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:40.076805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:40.087344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:40.089135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:40.092369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:40.248200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:40.250589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:40.258773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:40.264481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:40.265618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:40.268405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:40.269045 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f4cfeac-6c60-48fb-9bc3-d29f0c18f2ed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1590 microversion: 2.32 time: 0.227096 Sep 08 10:36:40.269646 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46db8a98-9e09-4acc-bc97-94e641b3156b tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1363 microversion: 2.47 time: 0.533414 Sep 08 10:36:40.270232 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2329/4872] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:39 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1363 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:40.271265 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2544/4873] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:40 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1590 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:40.305985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ef2d34c-afcd-4862-955b-242e2028643d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ef2d34c-afcd-4862-955b-242e2028643d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 416 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.315098 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:36:40.318775 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:40.322325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ef2d34c-afcd-4862-955b-242e2028643d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:40.326567 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ef2d34c-afcd-4862-955b-242e2028643d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.030991 Sep 08 10:36:40.327351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2330/4874] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:40 2022] POST /compute/v2.1/servers => generated 619 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:40.335811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:40.336687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:40.345901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:40.346672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:40.348037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:40.352567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:40.353259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:40.353859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:40.383097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:40.384166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:40.400127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:40.403907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:40.404563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:40.405487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:40.406116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:40.411956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.058505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.072346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.077088 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-deab8f90-fb4c-4caa-8169-944120c33c92 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.745083 Sep 08 10:36:41.078325 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2545/4875] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:40 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:41.084702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.088221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.099381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.099381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.099381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-12c1371f-5d0b-4e3d-84da-d9fb4cd2436f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.719533 Sep 08 10:36:41.099381 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2331/4876] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:40 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:41.115505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.116209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.117638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.117781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.118237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.118767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.123937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.125406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.127045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.132100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.132724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.133633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.134247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.134839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.168394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80dc71bd-e47d-410a-9c2f-655ad38a2f8f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088557 Sep 08 10:36:41.169840 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2546/4877] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:41.305166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.305956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.317788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.319779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.323202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.326639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.327389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.329386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.473167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.479171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.492133 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-efa74fc7-023a-47e5-a946-099ed4265d3d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.378266 Sep 08 10:36:41.492735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2332/4878] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:41.497227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.497885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.498702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.499724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.501761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-605851c8-af88-4389-a13a-89518e77b7cd tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1590 microversion: 2.32 time: 0.205771 Sep 08 10:36:41.508119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:41.519754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.519988 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2547/4879] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1590 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:41.527121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.535777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.536700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.537192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.537631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.546840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.552405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.569358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.569794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.570235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.571674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.572146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.572584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.658112 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5ba19c2-6d68-4640-a2a8-3c86feb6bb81 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134740 Sep 08 10:36:41.661769 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2548/4880] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:36:41.706278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644df211-eb12-4f3c-b91e-89a5212f80d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1437212761", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": -1, "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:41.732361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-644df211-eb12-4f3c-b91e-89a5212f80d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Flavor -1 could not be found. Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644df211-eb12-4f3c-b91e-89a5212f80d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 206 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1437212761", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": -1, "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor -1 could not be found. Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1437212761', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': -1, 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:41.736952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:41.741137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-644df211-eb12-4f3c-b91e-89a5212f80d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:41.743730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-644df211-eb12-4f3c-b91e-89a5212f80d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.040040 Sep 08 10:36:41.747977 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2549/4881] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 10:36:41.764217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.765374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.772396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.786809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.796130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:41.800675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.803016 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84f4d464-0bbe-44e1-a9af-8b1f6baff0ad tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1363 microversion: 2.47 time: 0.306949 Sep 08 10:36:41.804206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.805045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.806042 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2333/4882] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:41.807758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.809390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.812010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.816433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:41.821911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:41.836543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.837051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.856370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.857268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:41.862924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:41.863927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:41.928979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:36:42.046138 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c15baaae-2959-46d8-b617-cdc822e4bb1a tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 204 len: 0 microversion: 2.1 time: 0.237156 Sep 08 10:36:42.046739 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2334/4883] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:36:41 2022] DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:36:42.070690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.071764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:42.082922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.083421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.083885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.084603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.085056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.085486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.303655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:42.320567 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6109079f-19a4-4279-bbf7-31d2abd3ede8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.570695 Sep 08 10:36:42.335535 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2550/4884] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:41 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:42.346585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.347681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:42.355277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.356218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.356961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.357921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.358615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.359538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.583625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:42.594100 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe4fe844-1289-41ae-b5f7-daefe587efee tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1674 microversion: 2.1 time: 0.542343 Sep 08 10:36:42.600935 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2335/4885] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1674 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:42.615433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.623101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:42.657689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.658194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.658638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.659392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.659848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.660280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.664936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:42.667625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:42.685273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:42.687395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:42.692645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a22d1159-4689-49d1-9958-dc30ce0bc1d1 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.355706 Sep 08 10:36:42.693594 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2551/4886] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:42.701085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:42.701947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:42.746997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.747643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.748177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:42.748965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:42.752226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:42.752945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.108534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.118127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a7f0526-efe8-42bd-90ba-628fca672a9d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.516139 Sep 08 10:36:43.123675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2336/4887] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:43.135889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:43.136799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:43.149032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.149839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.150491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.151421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.154139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.154794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.193329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.207650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.212486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.225127 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af1e54dd-6bef-4eb2-a136-ca11ec2cb19a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1658 microversion: 2.32 time: 0.530141 Sep 08 10:36:43.227608 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2552/4888] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:42 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1658 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:43.287553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.297312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.300134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.302067 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-955a5ee4-363a-4909-ae14-75b9d59b8c4a tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 200 len: 1363 microversion: 2.47 time: 0.176972 Sep 08 10:36:43.307922 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2337/4889] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:43 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:43.398578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0be22052-08b1-40c1-bde0-3a74b8cc897a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1973380446", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0be22052-08b1-40c1-bde0-3a74b8cc897a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 173 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1973380446", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1973380446', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi -1 Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:36:43.402986 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0be22052-08b1-40c1-bde0-3a74b8cc897a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0be22052-08b1-40c1-bde0-3a74b8cc897a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009818 Sep 08 10:36:43.408640 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2553/4890] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:43.414923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:43.415844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:43.423933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.424982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.425762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.426700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.427915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.428560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.626793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:43.627625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:43.644164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.644653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.645259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.646148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:43.646776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:43.647387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:43.976192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:43.987129 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c88f11c-6403-489f-92a3-a61bcaff6574 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1674 microversion: 2.1 time: 0.364811 Sep 08 10:36:43.995166 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2554/4891] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:43 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1674 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:44.009498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.010126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:44.021127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.021644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.022097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.027955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.030141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.030621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.143519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:44.156194 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-656e9d85-425f-4ba2-a456-d72cbfa60287 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.743714 Sep 08 10:36:44.157269 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2338/4892] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:43 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:44.189752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:44.190780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:44.200016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.203327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.204118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:44.205634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:44.206333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:44.206984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.038668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:45.048140 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2e0cd8e-979b-40b3-a84e-4b3b6ddbd1eb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.864535 Sep 08 10:36:45.068234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:45.071889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:45.075733 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2339/4893] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:44 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:36:45.079416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:45.087397 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0ffb3845-8df6-47bc-85f0-66ab48146f14 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 1.090773 Sep 08 10:36:45.090953 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2555/4894] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:43 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:45.091939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.093771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:45.107015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.108222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.110605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.111207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.115241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.115923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.116789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.117408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: c4a5addb-783b-45d9-9f7f-90a2dba63f9a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:45.140368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.141633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.146239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.147125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.147637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.151765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.209513 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] HTTP exception thrown: Instance c4a5addb-783b-45d9-9f7f-90a2dba63f9a could not be found. Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Request method failure captured: Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a HTTP/1.1 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcV_cuaZakhYDUIxgCOmbET3b28Kghjmzc2_V4XuPpvBtKnHRsrzrEYxxqOG2u8a9P6QtFVctCZ5Ogy2I91Kcg5l8wmV0C5vx8f5vzWuILdwzaPDVB7CfhfJaLy_bkXVYXwMQAbh-tilh7wspv5Gemn8nq1_8LWhwIiMKLNX77rsG7k Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e9c5a838f5a34b6d9f2849c2f006f569 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerShowV247Test-1725144954 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e9c5a838f5a34b6d9f2849c2f006f569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e9c5a838f5a34b6d9f2849c2f006f569"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e9c5a838f5a34b6d9f2849c2f006f569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e9c5a838f5a34b6d9f2849c2f006f569", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerShowV247Test-1725144954 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e9c5a838f5a34b6d9f2849c2f006f569 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerShowV247Test-1725144954 Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerShowV247Test-1725144954-project Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 229c2edf560c44178157d1038567418d Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerShowV247Test-1725144954-project Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance c4a5addb-783b-45d9-9f7f-90a2dba63f9a could not be found. Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'c4a5addb-783b-45d9-9f7f-90a2dba63f9a'} Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a5addb-783b-45d9-9f7f-90a2dba63f9a could not be found. Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a5addb-783b-45d9-9f7f-90a2dba63f9a could not be found. Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:45.211089 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a5addb-783b-45d9-9f7f-90a2dba63f9a could not be found. Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:45.215896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Returning 404 to user: Instance c4a5addb-783b-45d9-9f7f-90a2dba63f9a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:45.224136 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7c03d1a-009a-4248-9dff-3b24ff9b3ba3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a" status: 404 len: 111 microversion: 2.47 time: 0.120358 Sep 08 10:36:45.225453 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2556/4895] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/servers/c4a5addb-783b-45d9-9f7f-90a2dba63f9a => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:45.243905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:45.248171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:45.281088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.281599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.282085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.282806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:45.283266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:45.283727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:45.662897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:46.185713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.199969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.202087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.203717 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-166e9d68-87a0-4c3c-8019-5fdb4f776fdb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1752 microversion: 2.32 time: 1.126629 Sep 08 10:36:46.217208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2340/4896] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1752 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:46.230964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.231785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:46.239287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.240076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.240721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.241621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.242223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.242813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.256665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.269144 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1aa8eb46-80fa-4c7f-b63d-773902168c3d tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1674 microversion: 2.1 time: 1.038242 Sep 08 10:36:46.270227 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2557/4897] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:45 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1674 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:46.286048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5527582-1b3e-486d-9153-7f4450eefdd1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-698953231", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:46.306155 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b5527582-1b3e-486d-9153-7f4450eefdd1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:36:46.307987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5527582-1b3e-486d-9153-7f4450eefdd1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 215 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-698953231", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-698953231', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.308630 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 10:36:46.314464 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:46.316042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5527582-1b3e-486d-9153-7f4450eefdd1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:46.317231 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5527582-1b3e-486d-9153-7f4450eefdd1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.045554 Sep 08 10:36:46.319368 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2558/4898] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:46.324380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.325001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:46.334442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=98 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:46.348236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.349364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.350045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.350999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.351786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.352462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.464421 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b44536c-36bd-4760-bc64-9ec4f6ce8552 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "DELETE /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab" status: 204 len: 0 microversion: 2.47 time: 0.244946 Sep 08 10:36:46.465812 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2341/4899] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:36:46 2022] DELETE /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:36:46.475524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.476945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:46.486231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.486875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.487328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.488156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.488716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.489361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.802764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.823401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.829801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.835841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57017d60-1d7e-49f7-9b80-ba674476e6c7 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.515200 Sep 08 10:36:46.839879 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2559/4900] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:46.853157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.854892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:46.864226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.865648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.866641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.868461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.869210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.869871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.873640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:46.882911 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a84be0c9-63c1-491e-910b-5156c9b009e4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.415581 Sep 08 10:36:46.925679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2342/4901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:46.932081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:46.939701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:46.963053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.967043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.968062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:46.970775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:46.972548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:46.974286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.041323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.044690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:47.060091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.071654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.073209 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac6da9ca-ce60-4b5f-a8f5-f03aaec72e7e tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab" status: 200 len: 1363 microversion: 2.47 time: 0.230850 Sep 08 10:36:47.074107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2560/4902] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:47.234172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.235323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:47.243916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.244319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.244768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.245483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.245945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.246377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.650276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.659395 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6165501d-d162-4b7b-bfe1-b54b2e0916e5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.732535 Sep 08 10:36:47.673228 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2343/4903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:46 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:47.701004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1600490143", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:47.808890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:36:47.833012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:47.874529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.911967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.913435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:47.914660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a99c5f3-8ab4-41b2-8c84-2874592122e8 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1799 microversion: 2.32 time: 0.684441 Sep 08 10:36:47.926528 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2561/4904] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1799 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:47.937366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:47.940934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:47.966482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.967016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.967782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:47.979082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:47.979672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:47.980130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.187973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:48.202367 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d5739bd-d494-4ea5-9e7c-d86f744b080f tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1607 microversion: 2.1 time: 0.274294 Sep 08 10:36:48.202893 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2562/4905] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:47 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1607 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:48.229011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f6cc5132-2931-4a55-8793-dfca075cc595 req-5713d29a-0231-4ab3-85e0-fff6c0edfbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "name": "network-vif-plugged", "status": "completed", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:48.260127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f6cc5132-2931-4a55-8793-dfca075cc595 req-5713d29a-0231-4ab3-85e0-fff6c0edfbd3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.260871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f6cc5132-2931-4a55-8793-dfca075cc595 req-5713d29a-0231-4ab3-85e0-fff6c0edfbd3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.262180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f6cc5132-2931-4a55-8793-dfca075cc595 req-5713d29a-0231-4ab3-85e0-fff6c0edfbd3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.276390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:48.311255 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f6cc5132-2931-4a55-8793-dfca075cc595 req-5713d29a-0231-4ab3-85e0-fff6c0edfbd3 service nova] Creating event network-vif-plugged:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h1-833090-19 Sep 08 10:36:48.322006 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f6cc5132-2931-4a55-8793-dfca075cc595 req-5713d29a-0231-4ab3-85e0-fff6c0edfbd3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117803 Sep 08 10:36:48.327127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2563/4906] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:48.345548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:48.346510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:48.354830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.355652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.356370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.357313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.357947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.358616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.598769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:36:48.613549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:36:48.614749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:36:48.616852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:36:48.617487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:36:48.647098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.648802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.651140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.655477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:48.656536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:48.659095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:48.725297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Getting quotas for project 1eb6b0b71b6447018fb5e29ca2875639. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:36:48.754435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Getting quotas for user 098c66314d294bb380bcfee358a069e2 and project 1eb6b0b71b6447018fb5e29ca2875639. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:36:48.778365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:36:48.805391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:36:48.819322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:48.834293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:48.838220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:48.840885 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00377f11-4283-4c07-b4e5-b50ffe3787b6 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.510798 Sep 08 10:36:48.857498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2564/4907] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:48 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:48.879257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0da4bac2-069e-49a7-a1ff-0e2e323bc6c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1995704596", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-key-248803758", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:48.980905 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55e09de9-496a-420d-aea1-39d37934c09d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303331 Sep 08 10:36:48.992279 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2344/4908] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:36:48.997754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-0da4bac2-069e-49a7-a1ff-0e2e323bc6c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] validate_networks() for [('6a31b811-fdf4-47f5-84de-f0d87838fc52', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:36:49.004170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:49.011956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:49.042453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.043023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.043503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.046488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.049387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.062404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.229853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.232711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.235986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.241072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lazy-loading 'fault' on Instance uuid 94bcb159-d122-406c-8ff7-707249c9e5ab {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:36:49.419383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:49.437291 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-0da4bac2-069e-49a7-a1ff-0e2e323bc6c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Invalid key_name provided. Sep 08 10:36:49.451675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0da4bac2-069e-49a7-a1ff-0e2e323bc6c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 246 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1995704596", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-key-248803758", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid key_name provided. Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1995704596', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'key_name': 'tempest-key-248803758', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-248803758 not found for user db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:49.455803 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0da4bac2-069e-49a7-a1ff-0e2e323bc6c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid key_name provided. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:49.459783 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0da4bac2-069e-49a7-a1ff-0e2e323bc6c6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.599247 Sep 08 10:36:49.464565 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2565/4909] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 602 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 10:36:49.467429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229c2edf560c44178157d1038567418d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c5a838f5a34b6d9f2849c2f006f569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:49.469911 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4b951f5c-1c3c-4ac8-9ede-1f5376ff4852 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab" status: 200 len: 1368 microversion: 2.47 time: 0.480897 Sep 08 10:36:49.470710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-165be095-bc92-484d-8e4d-693ab2e2acc7 req-4918f9d0-3d8e-4635-8c8a-4a1999bd15d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6133c359-37f2-48a7-a087-355b76cdd4f6", "name": "network-vif-deleted", "tag": "d6dc4fb3-2700-45ae-9592-e2f32a3034b0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:49.471012 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2345/4910] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:48 2022] GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:49.482305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-165be095-bc92-484d-8e4d-693ab2e2acc7 req-4918f9d0-3d8e-4635-8c8a-4a1999bd15d3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.482790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-165be095-bc92-484d-8e4d-693ab2e2acc7 req-4918f9d0-3d8e-4635-8c8a-4a1999bd15d3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.483552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-165be095-bc92-484d-8e4d-693ab2e2acc7 req-4918f9d0-3d8e-4635-8c8a-4a1999bd15d3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.497240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:49.501510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:49.519518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.522394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-165be095-bc92-484d-8e4d-693ab2e2acc7 req-4918f9d0-3d8e-4635-8c8a-4a1999bd15d3 service nova] Creating event network-vif-deleted:d6dc4fb3-2700-45ae-9592-e2f32a3034b0 for instance 6133c359-37f2-48a7-a087-355b76cdd4f6 on n-h2-833090-19 Sep 08 10:36:49.523186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.523939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.524931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:49.527748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:49.528458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:49.529553 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-165be095-bc92-484d-8e4d-693ab2e2acc7 req-4918f9d0-3d8e-4635-8c8a-4a1999bd15d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067456 Sep 08 10:36:49.537114 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2566/4911] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:49.551584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ce668486-b406-428d-b688-481a40071385 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:49.554528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ce668486-b406-428d-b688-481a40071385 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:49.947047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ce668486-b406-428d-b688-481a40071385 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:49.967547 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ce668486-b406-428d-b688-481a40071385 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1215 microversion: 2.1 time: 0.428903 Sep 08 10:36:49.968610 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2567/4912] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:49 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:49.981023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:49.982218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:49.996517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.010782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.026850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.035045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.038685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.040014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.121406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.161520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.165083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.178283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5aeee809-4935-432f-b112-54096433281a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1846 microversion: 2.32 time: 0.703275 Sep 08 10:36:50.186347 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2346/4913] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:49 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1846 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:50.205520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:50.218035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:50.238628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.239535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.240110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.240870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lazy-loading 'fault' on Instance uuid 6133c359-37f2-48a7-a087-355b76cdd4f6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:36:50.244360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.245091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.245691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.247842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.248821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.250943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.361567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dd35046e12b46a59478ad7dbe2339c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee1af948aad445daad7abcd11441316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.379412 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d4b46228-7ce3-4d45-b1f4-0ead0e4c1bac tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 200 len: 1327 microversion: 2.1 time: 0.409337 Sep 08 10:36:50.381818 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2568/4914] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:49 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 1327 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:50.411209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:50.411894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:50.455357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.458367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.460631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.462425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:50.462903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:50.463337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:50.971706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:50.988541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ce7fc02-fff8-4840-9844-cbe1cf5c9aca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.792698 Sep 08 10:36:50.989217 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2347/4915] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:50.998242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.024846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.036166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] [instance: 94bcb159-d122-406c-8ff7-707249c9e5ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:51.039843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.041798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.044427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fbb127a7-445b-4ac8-8624-9608ee2bfbda tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1729 microversion: 2.20 time: 0.659832 Sep 08 10:36:51.059568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2569/4916] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1729 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:51.077546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.078164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.082104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.082504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.083258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:51.087589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.090018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.091428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.099042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.099713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.100748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.103316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.103940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.108645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.185399 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] HTTP exception thrown: Instance 94bcb159-d122-406c-8ff7-707249c9e5ab could not be found. Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Request method failure captured: Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab HTTP/1.1 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcV_cuaZakhYDUIxgCOmbET3b28Kghjmzc2_V4XuPpvBtKnHRsrzrEYxxqOG2u8a9P6QtFVctCZ5Ogy2I91Kcg5l8wmV0C5vx8f5vzWuILdwzaPDVB7CfhfJaLy_bkXVYXwMQAbh-tilh7wspv5Gemn8nq1_8LWhwIiMKLNX77rsG7k Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e9c5a838f5a34b6d9f2849c2f006f569 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerShowV247Test-1725144954 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e9c5a838f5a34b6d9f2849c2f006f569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e9c5a838f5a34b6d9f2849c2f006f569"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e9c5a838f5a34b6d9f2849c2f006f569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e9c5a838f5a34b6d9f2849c2f006f569", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerShowV247Test-1725144954 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e9c5a838f5a34b6d9f2849c2f006f569 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerShowV247Test-1725144954 Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerShowV247Test-1725144954-project Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 229c2edf560c44178157d1038567418d Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerShowV247Test-1725144954-project Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 94bcb159-d122-406c-8ff7-707249c9e5ab could not be found. Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '94bcb159-d122-406c-8ff7-707249c9e5ab'} Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94bcb159-d122-406c-8ff7-707249c9e5ab could not be found. Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94bcb159-d122-406c-8ff7-707249c9e5ab could not be found. Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:51.187203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94bcb159-d122-406c-8ff7-707249c9e5ab could not be found. Sep 08 10:36:51.193681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.195494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.202117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] Returning 404 to user: Instance 94bcb159-d122-406c-8ff7-707249c9e5ab could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:51.203112 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d52a6194-4e50-47e5-84d4-e375e25990a3 tempest-ServerShowV247Test-1725144954 tempest-ServerShowV247Test-1725144954-project] 10.222.0.59 "GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab" status: 404 len: 111 microversion: 2.47 time: 0.208689 Sep 08 10:36:51.208468 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d1aad31-385a-48ed-ae35-f044c2d7aa90 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1267 microversion: 2.1 time: 0.145748 Sep 08 10:36:51.217433 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2570/4917] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:51.225455 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2348/4918] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:50 2022] GET /compute/v2.1/servers/94bcb159-d122-406c-8ff7-707249c9e5ab => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:51.234409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.236013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:51.244302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.245148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.245887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.246889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.247995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.248662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.259096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.259762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:51.323803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.324469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.326543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.328242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.332477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.333127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.543186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:51.557143 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4bccce12-3140-46b8-bef1-d80a30346d3b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.337753 Sep 08 10:36:51.607020 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2571/4919] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:51.646245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:51.647033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:51.670723 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:36:51.670900 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 10:36:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 (ip 10.222.0.59) !!! Sep 08 10:36:51.713028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.717812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.718891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.720813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:51.721286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:51.726990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:51.789947 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] HTTP exception thrown: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Request method failure captured: Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 HTTP/1.1 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQSMWpJeQ1gxKJmdpzsutUIoLj0lRdFLF55ZMZUhMd26Bk7E1KPUe51nIoRPF_ZZCTyhWAhNZGmu8hDtc2jw0w4wBVPC4492OtfayPpGwEaabHF0z0709DNLAfnsXSntPuctnX6lYDhA4BzisPneskVa9VC5qYsbAL_uhN07enPC6E Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ee1af948aad445daad7abcd11441316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ee1af948aad445daad7abcd11441316", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0dd35046e12b46a59478ad7dbe2339c9 Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6133c359-37f2-48a7-a087-355b76cdd4f6'} Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:51.793099 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:36:51.798976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:51.802499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Returning 404 to user: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:51.808779 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15d17c58-105c-4f2e-be35-bd4f44f9236b tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 404 len: 111 microversion: 2.1 time: 0.192605 Sep 08 10:36:51.816340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2572/4920] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:51.829335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24d51227-7f6a-4bda-b8bf-f5741926ba9b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-951882833", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:52.080714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:52.099455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:52.104451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:52.106181 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b75af5d7-ce90-423f-a4f6-514b0c84ef4f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1846 microversion: 2.32 time: 0.879431 Sep 08 10:36:52.109452 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2349/4921] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:51 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1846 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:52.121741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-64302954-2d76-4b1d-b75c-9803deeb7425 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '.version_select at 0x7f23516a4670>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.174082 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-64302954-2d76-4b1d-b75c-9803deeb7425 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170491325" status: 202 len: 0 microversion: 2.1 time: 0.060872 Sep 08 10:36:52.177501 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2350/4922] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:36:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170491325 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:36:52.209481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.211257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:52.242535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.244892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.246628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.250372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.254405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.255020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.377211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.security_group_api [None req-24d51227-7f6a-4bda-b8bf-f5741926ba9b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Neutron security group does_not_exist not found {{(pid=122457) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 08 10:36:52.378135 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-24d51227-7f6a-4bda-b8bf-f5741926ba9b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24d51227-7f6a-4bda-b8bf-f5741926ba9b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 257 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-951882833", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-951882833', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 08 10:36:52.387311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 08 10:36:52.392436 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:52.396582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24d51227-7f6a-4bda-b8bf-f5741926ba9b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:52.398338 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-24d51227-7f6a-4bda-b8bf-f5741926ba9b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.579830 Sep 08 10:36:52.398338 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2573/4923] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:36:51 2022] POST /compute/v2.1/servers => generated 106 bytes in 581 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:36:52.407663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.412726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:52.430415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.431237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.431832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.433293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.433892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.434558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.749988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:52.761720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-13c12bb2-fff8-4934-ab53-1baf75f22fd8 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1273 microversion: 2.1 time: 0.358748 Sep 08 10:36:52.775035 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2574/4924] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1273 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:52.783687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:52.790860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:52.840447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.840893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.841358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:52.842083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:52.843588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:52.844507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.194515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:53.204520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:53.217379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:53.219946 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-687824b3-17c0-4edb-ac84-795567cafd12 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1716 microversion: 2.20 time: 1.030579 Sep 08 10:36:53.221151 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2351/4925] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1716 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:53.229818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.231351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:53.244720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.245439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.246062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.247552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.250703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.251502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.512613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:53.522252 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f015a9f-4969-4a0d-8ef7-eddd56ca4f48 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.742504 Sep 08 10:36:53.536052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2575/4926] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:52 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:53.550008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ffafed4b-e76f-4e57-a05e-7b2b22a07a52 req-f86344a2-4dfa-497f-8564-0d5177d5a973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:53.561472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ffafed4b-e76f-4e57-a05e-7b2b22a07a52 req-f86344a2-4dfa-497f-8564-0d5177d5a973 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.562290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ffafed4b-e76f-4e57-a05e-7b2b22a07a52 req-f86344a2-4dfa-497f-8564-0d5177d5a973 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.563643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ffafed4b-e76f-4e57-a05e-7b2b22a07a52 req-f86344a2-4dfa-497f-8564-0d5177d5a973 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.578036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ffafed4b-e76f-4e57-a05e-7b2b22a07a52 req-f86344a2-4dfa-497f-8564-0d5177d5a973 service nova] Creating event network-changed:cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:36:53.584760 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ffafed4b-e76f-4e57-a05e-7b2b22a07a52 req-f86344a2-4dfa-497f-8564-0d5177d5a973 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041069 Sep 08 10:36:53.585558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2576/4927] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:53.592634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:53.593741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:53.604404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.606837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.607611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:53.612778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:53.614949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:53.616132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.114418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:54.130181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:54.131921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:54.133157 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ea9fa39-fc05-40b1-b9b1-b84b6ceb2e08 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1846 microversion: 2.32 time: 0.910511 Sep 08 10:36:54.133731 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2352/4928] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:53 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1846 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:54.149077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:54.149077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:54.162957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.163455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.163923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.164636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:54.165103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:54.165512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:54.170829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:54.851962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:54.867111 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1774185e-201d-427d-9d99-2baa6f3c5c7f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1273 microversion: 2.1 time: 0.727464 Sep 08 10:36:54.869915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2353/4929] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:54 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1273 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.137751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.148257 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe4bc3b4-aaa8-4da0-8eb1-d9aeb7fb7ca5 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.561322 Sep 08 10:36:55.159895 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2577/4930] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:53 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.173808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.174430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:55.184395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.184914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.185333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.186038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.188907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d692e71c-ffbf-41a4-a57a-684859fec8a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.190042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d692e71c-ffbf-41a4-a57a-684859fec8a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3164c526-270b-4d4e-8777-e0173483efde] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:55.190333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.190789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.200270 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d692e71c-ffbf-41a4-a57a-684859fec8a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 3164c526-270b-4d4e-8777-e0173483efde could not be found. Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d692e71c-ffbf-41a4-a57a-684859fec8a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/3164c526-270b-4d4e-8777-e0173483efde HTTP/1.1 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3164c526-270b-4d4e-8777-e0173483efde could not be found. Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3164c526-270b-4d4e-8777-e0173483efde'} Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3164c526-270b-4d4e-8777-e0173483efde could not be found. Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3164c526-270b-4d4e-8777-e0173483efde could not be found. Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:55.211310 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3164c526-270b-4d4e-8777-e0173483efde could not be found. Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d692e71c-ffbf-41a4-a57a-684859fec8a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 3164c526-270b-4d4e-8777-e0173483efde could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d692e71c-ffbf-41a4-a57a-684859fec8a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3164c526-270b-4d4e-8777-e0173483efde" status: 404 len: 111 microversion: 2.1 time: 0.032589 Sep 08 10:36:55.216209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2578/4931] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:36:55 2022] DELETE /compute/v2.1/servers/3164c526-270b-4d4e-8777-e0173483efde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:36:55.232882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.233550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:55.244477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.245240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.247605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.248698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.249336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.249931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.861286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.873881 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b6120b08-fbb0-4b27-a342-c6f49cf46918 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.653311 Sep 08 10:36:55.877045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2579/4932] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:55.885979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-faf52639-b12a-430e-8ffe-53023eab75ae req-b96d9664-b864-4fff-8b67-a06e54566a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "7f802e01-b8f5-4de2-b080-1ced4f14e689"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:55.912825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-faf52639-b12a-430e-8ffe-53023eab75ae req-b96d9664-b864-4fff-8b67-a06e54566a24 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:55.913592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-faf52639-b12a-430e-8ffe-53023eab75ae req-b96d9664-b864-4fff-8b67-a06e54566a24 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:55.914170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-faf52639-b12a-430e-8ffe-53023eab75ae req-b96d9664-b864-4fff-8b67-a06e54566a24 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:55.927491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.944641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.948725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:55.950380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32f12ec6-6974-4926-a720-f7e1657bb9e6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1867 microversion: 2.32 time: 0.787043 Sep 08 10:36:55.952572 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-faf52639-b12a-430e-8ffe-53023eab75ae req-b96d9664-b864-4fff-8b67-a06e54566a24 service nova] Creating event network-changed:7f802e01-b8f5-4de2-b080-1ced4f14e689 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:36:55.953532 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2354/4933] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1867 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:55.967518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-faf52639-b12a-430e-8ffe-53023eab75ae req-b96d9664-b864-4fff-8b67-a06e54566a24 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085451 Sep 08 10:36:55.968719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2580/4934] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:55.982750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:55.986873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:56.003158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.005262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.009603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.010594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.011237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.011895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.238497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:56.247681 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a9c2e65-c12a-4df8-929e-8ee3f806bfd5 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1273 microversion: 2.1 time: 0.274927 Sep 08 10:36:56.268715 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2581/4935] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:55 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:56.274057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:56.279380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:56.303022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.303901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.304563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.305486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.306141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.306767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.372513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1972967016", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": "none"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:56.461618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:36:56.462294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:36:56.462932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:36:56.463555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:36:56.464141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:36:56.488268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.496470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.497287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.498325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:56.499013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:56.499663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:56.546959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Getting quotas for project 86a4352e884a421aa0c4d6e85dd89669. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:36:56.560933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Getting quotas for user 29ce27f4263a4c24aedc2c2ad80620f8 and project 86a4352e884a421aa0c4d6e85dd89669. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:36:56.590201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:36:56.592819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:36:56.683117 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9f5cd08-77c4-486f-8ce9-a6862980367b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.725116 Sep 08 10:36:56.686794 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2355/4936] 10.222.0.59 () {62 vars in 1188 bytes} [Thu Sep 8 10:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 10:36:56.699404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b59a3ec8-7311-4b3f-ba17-ce5b8cf8a0aa tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:56.700974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b59a3ec8-7311-4b3f-ba17-ce5b8cf8a0aa tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:57.191841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b59a3ec8-7311-4b3f-ba17-ce5b8cf8a0aa tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:57.229198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b59a3ec8-7311-4b3f-ba17-ce5b8cf8a0aa tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:57.232932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b59a3ec8-7311-4b3f-ba17-ce5b8cf8a0aa tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:57.240686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b59a3ec8-7311-4b3f-ba17-ce5b8cf8a0aa tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1278 microversion: 2.57 time: 0.540430 Sep 08 10:36:57.241928 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2356/4937] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:56 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1278 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:36:57.267499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:57.268350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:57.293113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:57.293633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:57.302573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:57.303484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:57.303978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:57.304433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:57.341872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:57.358283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65ebff95-046d-475d-80bd-fd8bbf1ab29c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.080784 Sep 08 10:36:57.360183 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2582/4938] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:56 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:57.375397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:57.376378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:57.399979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:57.400557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:57.404221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:57.405123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:57.405666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:57.406231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.026511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.066061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.075748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.077312 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a26b4b1-a072-4dbb-b611-f19ba0851deb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 0.832662 Sep 08 10:36:58.077943 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2357/4939] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:57 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:58.102576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-265fbfc5-a58c-429c-9317-45154d555b41 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:58.103516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-265fbfc5-a58c-429c-9317-45154d555b41 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:36:58.104282 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-265fbfc5-a58c-429c-9317-45154d555b41 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-265fbfc5-a58c-429c-9317-45154d555b41 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9223372036854775808 could not be found. Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9223372036854775808'} Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:36:58.106328 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:36:58.111311 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:36:58.111311 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:36:58.111311 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:36:58.111311 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 08 10:36:58.111311 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:36:58.114625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-265fbfc5-a58c-429c-9317-45154d555b41 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:36:58.115713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-265fbfc5-a58c-429c-9317-45154d555b41 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022826 Sep 08 10:36:58.116466 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2358/4940] 10.222.0.59 () {58 vars in 1188 bytes} [Thu Sep 8 10:36:58 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:36:58.122037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f255e910-94c3-4be2-b7a7-36fb215b5320 req-57b2cf78-5d8d-4b35-8779-93a2c6c2a6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "07b04276-05e1-4d43-956b-944bf1031fde"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:36:58.145565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f255e910-94c3-4be2-b7a7-36fb215b5320 req-57b2cf78-5d8d-4b35-8779-93a2c6c2a6b9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.146135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f255e910-94c3-4be2-b7a7-36fb215b5320 req-57b2cf78-5d8d-4b35-8779-93a2c6c2a6b9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.146493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f255e910-94c3-4be2-b7a7-36fb215b5320 req-57b2cf78-5d8d-4b35-8779-93a2c6c2a6b9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.166474 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f255e910-94c3-4be2-b7a7-36fb215b5320 req-57b2cf78-5d8d-4b35-8779-93a2c6c2a6b9 service nova] Creating event network-changed:07b04276-05e1-4d43-956b-944bf1031fde for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:36:58.182900 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f255e910-94c3-4be2-b7a7-36fb215b5320 req-57b2cf78-5d8d-4b35-8779-93a2c6c2a6b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064082 Sep 08 10:36:58.183970 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2359/4941] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:36:58.194447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:58.195712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:58.204225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.205368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.206002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.206909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.207564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.208150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.371982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.394621 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a82633f-8c29-4bfc-a1e8-6d17d54fd613 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 1.032917 Sep 08 10:36:58.396782 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2583/4942] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:57 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:58.409451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:58.413799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:58.438218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.442877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.443546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.444295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:58.445866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:58.449625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:58.492507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:58.749847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.770740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.777957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:58.779162 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90e34859-106c-489c-ad14-930094b9a37e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1330 microversion: 2.57 time: 0.381182 Sep 08 10:36:58.780117 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2584/4943] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:58 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1330 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:36:59.106037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:59.106723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:59.121760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:59.122251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:59.122691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:59.123409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:59.132530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:59.133066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:59.554262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:36:59.571262 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-356752cd-2579-4637-9880-dd381a6548cc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.385524 Sep 08 10:36:59.576008 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2360/4944] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:58 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:36:59.593078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:36:59.593739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:36:59.622724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:36:59.624831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:59.633257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:59.633918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:59.634695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:36:59.635176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:36:59.635644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:36:59.954114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:00.071897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:00.101952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:00.107197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:00.108703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-32715ffa-9d8e-4dbb-be49-a75b66b8a405 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 1.007375 Sep 08 10:37:00.111777 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2585/4945] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:36:59 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:00.121155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:00.126347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:00.142828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:00.144515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:00.146814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:00.153263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:00.158715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:00.159411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:00.820680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:00.862747 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-261de2e0-86b5-4a2b-9c3b-33594f3a1ede tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.749471 Sep 08 10:37:00.869455 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2586/4946] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:00 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:00.884197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:00.886800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:00.900328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:00.912189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:00.912734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:00.920728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:00.923655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:00.925257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:01.140763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:01.152293 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d35906f0-264b-436c-87ae-1e84de238855 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 1.575277 Sep 08 10:37:01.157873 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2361/4947] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:36:59 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:01.162950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-e6bb7a26-4ec2-4059-882e-d8d9e6648aa8 req-dab8b7fd-df27-4765-984d-ccd7dcacac1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "34569af1-d152-412e-a374-fb9ebc4707e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:01.188333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e6bb7a26-4ec2-4059-882e-d8d9e6648aa8 req-dab8b7fd-df27-4765-984d-ccd7dcacac1d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.191011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e6bb7a26-4ec2-4059-882e-d8d9e6648aa8 req-dab8b7fd-df27-4765-984d-ccd7dcacac1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.191687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e6bb7a26-4ec2-4059-882e-d8d9e6648aa8 req-dab8b7fd-df27-4765-984d-ccd7dcacac1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:01.219772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:01.236224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-e6bb7a26-4ec2-4059-882e-d8d9e6648aa8 req-dab8b7fd-df27-4765-984d-ccd7dcacac1d service nova] Creating event network-changed:34569af1-d152-412e-a374-fb9ebc4707e1 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:01.236563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:01.244714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:01.246227 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-e6bb7a26-4ec2-4059-882e-d8d9e6648aa8 req-dab8b7fd-df27-4765-984d-ccd7dcacac1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086819 Sep 08 10:37:01.249643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-160a8d41-514e-4be8-96bb-85038a3de20b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1336 microversion: 2.57 time: 0.378830 Sep 08 10:37:01.251014 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2587/4948] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:00 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1336 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:01.251490 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2362/4949] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:01.259420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-814f298e-bc03-47f3-b1bc-6fbde27ab6b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:01.262824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-814f298e-bc03-47f3-b1bc-6fbde27ab6b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Failed to fetch instance by id -1 {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 10:37:01.263340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:01.264031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:01.266391 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-814f298e-bc03-47f3-b1bc-6fbde27ab6b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance -1 could not be found. Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-814f298e-bc03-47f3-b1bc-6fbde27ab6b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance -1 could not be found. Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '-1'} Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:01.270189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:01.274229 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:01.274229 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:01.274229 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 08 10:37:01.274229 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:01.278567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-814f298e-bc03-47f3-b1bc-6fbde27ab6b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:01.280352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.280975 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-814f298e-bc03-47f3-b1bc-6fbde27ab6b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.027591 Sep 08 10:37:01.281263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.282659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:01.283443 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2363/4950] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:37:01 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:01.284424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.286526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.289264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:01.294521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:01.296462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:01.314109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.318933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.319556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:01.320410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:01.325929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:01.326698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.043100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.061948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81e6f227-3735-4381-b7f9-bd717da5415d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.774121 Sep 08 10:37:03.070739 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2364/4951] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:01 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:03.076117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.076960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:03.088384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.091178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.092028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.093041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.093792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.094486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.183748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.200746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.203835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.210193 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e72eb81-b044-42ff-b70f-7a9dd7f5f860 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 1.954795 Sep 08 10:37:03.211054 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2588/4952] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:01 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:03.227486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.228464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:03.235615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.240963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.241730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.242708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.243400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.244107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.512366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.523098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.534140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.535532 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-837f5b30-948b-48fe-a9bd-095d6d1f8f07 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1336 microversion: 2.57 time: 0.321653 Sep 08 10:37:03.536661 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2589/4953] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1336 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:03.544774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:03.545749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:03.565178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.565814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.566376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.567213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.567813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.568352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.625691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:03.634231 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42f5e53b-c326-477c-bc37-8689aadd20e4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.561952 Sep 08 10:37:03.648549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2365/4954] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:03.659369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5e421b7d-9e58-448e-8f5b-3db27811ee5e req-7ed45647-d21a-4946-8b60-743ac7bf4f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "b81e79ba-50d4-4a9b-910e-ff60e991b1a9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:03.688796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5e421b7d-9e58-448e-8f5b-3db27811ee5e req-7ed45647-d21a-4946-8b60-743ac7bf4f00 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.694368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5e421b7d-9e58-448e-8f5b-3db27811ee5e req-7ed45647-d21a-4946-8b60-743ac7bf4f00 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.695194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5e421b7d-9e58-448e-8f5b-3db27811ee5e req-7ed45647-d21a-4946-8b60-743ac7bf4f00 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.721474 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5e421b7d-9e58-448e-8f5b-3db27811ee5e req-7ed45647-d21a-4946-8b60-743ac7bf4f00 service nova] Creating event network-changed:b81e79ba-50d4-4a9b-910e-ff60e991b1a9 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:03.729453 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5e421b7d-9e58-448e-8f5b-3db27811ee5e req-7ed45647-d21a-4946-8b60-743ac7bf4f00 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079446 Sep 08 10:37:03.735085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2366/4955] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:03.772592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7c26991d-f54c-4ecd-a747-2b1fd0a91b20 req-c5f2b513-eb9b-41d0-8809-265e3486232d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557d0aad-5e23-4867-acc1-ade68ba834f3", "tag": "c8a52cf4-18ed-453e-bf91-a5fb5b4325cc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:03.794211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7c26991d-f54c-4ecd-a747-2b1fd0a91b20 req-c5f2b513-eb9b-41d0-8809-265e3486232d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:03.795011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7c26991d-f54c-4ecd-a747-2b1fd0a91b20 req-c5f2b513-eb9b-41d0-8809-265e3486232d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:03.797734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7c26991d-f54c-4ecd-a747-2b1fd0a91b20 req-c5f2b513-eb9b-41d0-8809-265e3486232d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:03.829523 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7c26991d-f54c-4ecd-a747-2b1fd0a91b20 req-c5f2b513-eb9b-41d0-8809-265e3486232d service nova] Creating event network-changed:c8a52cf4-18ed-453e-bf91-a5fb5b4325cc for instance 557d0aad-5e23-4867-acc1-ade68ba834f3 on n-h2-833090-19 Sep 08 10:37:03.842156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7c26991d-f54c-4ecd-a747-2b1fd0a91b20 req-c5f2b513-eb9b-41d0-8809-265e3486232d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076957 Sep 08 10:37:03.843617 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2367/4956] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:04.242996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:04.243802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:04.258403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.258914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.259629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.260690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.262052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.272284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.344518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:04.370763 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a919bc0d-24ec-4611-9282-d70b26cfff26 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.832636 Sep 08 10:37:04.371967 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2590/4957] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:03 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:04.397265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f0144ce-e8d3-4a24-8091-d054052844b7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:04.398197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1f0144ce-e8d3-4a24-8091-d054052844b7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 2406db0c-6522-449f-89a8-dd1f6fa35e43] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:04.411094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1f0144ce-e8d3-4a24-8091-d054052844b7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 2406db0c-6522-449f-89a8-dd1f6fa35e43 could not be found. Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f0144ce-e8d3-4a24-8091-d054052844b7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/2406db0c-6522-449f-89a8-dd1f6fa35e43/action HTTP/1.1 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 19 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: {"forceDelete": {}} Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 2406db0c-6522-449f-89a8-dd1f6fa35e43 could not be found. Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '2406db0c-6522-449f-89a8-dd1f6fa35e43', 'body': {'forceDelete': {}}} Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2406db0c-6522-449f-89a8-dd1f6fa35e43 could not be found. Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2406db0c-6522-449f-89a8-dd1f6fa35e43 could not be found. Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:04.417903 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:04.421862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:04.421862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:04.421862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2406db0c-6522-449f-89a8-dd1f6fa35e43 could not be found. Sep 08 10:37:04.421862 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:04.423854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f0144ce-e8d3-4a24-8091-d054052844b7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 2406db0c-6522-449f-89a8-dd1f6fa35e43 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:04.424965 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f0144ce-e8d3-4a24-8091-d054052844b7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/2406db0c-6522-449f-89a8-dd1f6fa35e43/action" status: 404 len: 111 microversion: 2.1 time: 0.031742 Sep 08 10:37:04.426415 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2591/4958] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:04 2022] POST /compute/v2.1/servers/2406db0c-6522-449f-89a8-dd1f6fa35e43/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:04.435502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:04.438900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:04.457486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.463318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.464236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:04.465220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:04.465908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:04.466612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.515412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.532114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e8f8df91-8d01-4162-b6db-d56407550db2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.098714 Sep 08 10:37:05.533233 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2592/4959] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:04 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:05.539785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.555428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:05.556482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:05.557644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.559124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.560376 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7fe63ad4-ddea-4479-ba58-7b49dd025a77 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 1.322772 Sep 08 10:37:05.568639 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2368/4960] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:04 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:05.569647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.570166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.570615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.571344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.574793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:05.579587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.580204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.580854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:05.598224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.598715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.599159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.604649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:05.605128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:05.605564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:05.960526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.969469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.973792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:05.977743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae22d166-ed7d-4fac-a6e3-52f392fb1edb tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1357 microversion: 2.57 time: 0.443216 Sep 08 10:37:06.011604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2593/4961] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:05 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1357 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:06.016866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:06.017478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:06.036390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.036888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.037322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.042463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.047621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.048681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.322634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:06.335581 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96fe5348-0914-4d52-9444-40b44ac93303 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.760774 Sep 08 10:37:06.335581 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2369/4962] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:05 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:06.342897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ea7fd8c5-b603-4409-b854-db2cc3e29da3 req-b5db0e0b-7579-41e7-a482-b60d89626cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "5b35b0d3-db83-4920-a2b2-2380f917b7a2"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:06.371739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ea7fd8c5-b603-4409-b854-db2cc3e29da3 req-b5db0e0b-7579-41e7-a482-b60d89626cc7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.372221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ea7fd8c5-b603-4409-b854-db2cc3e29da3 req-b5db0e0b-7579-41e7-a482-b60d89626cc7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.372847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ea7fd8c5-b603-4409-b854-db2cc3e29da3 req-b5db0e0b-7579-41e7-a482-b60d89626cc7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.394799 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ea7fd8c5-b603-4409-b854-db2cc3e29da3 req-b5db0e0b-7579-41e7-a482-b60d89626cc7 service nova] Creating event network-changed:5b35b0d3-db83-4920-a2b2-2380f917b7a2 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:06.404229 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ea7fd8c5-b603-4409-b854-db2cc3e29da3 req-b5db0e0b-7579-41e7-a482-b60d89626cc7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066067 Sep 08 10:37:06.407329 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2370/4963] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:06.419347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:06.423329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:06.433540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.434563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.435184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.436789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.437539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.438142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.521622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:06.542316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:06.577103 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57f02cba-7bba-4e5c-9167-cc3ef64c9dcf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.564130 Sep 08 10:37:06.581944 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2594/4964] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:06 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:06.606573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:37:06.608291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:06.608937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:06.620821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:37:06.621880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:37:06.622626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:37:06.623218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:37:06.688075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.698576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.704256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.705103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.706569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.707227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.873518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:06.883501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.891498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.895706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.897111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:06.897755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:06.898410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:06.997836 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-23866bd7-bcee-44a4-b08c-43a97c2937bc tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "POST /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed/action" status: 202 len: 1138 microversion: 2.57 time: 0.588836 Sep 08 10:37:07.005014 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2371/4965] 10.222.0.59 () {62 vars in 1320 bytes} [Thu Sep 8 10:37:06 2022] POST /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed/action => generated 1138 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 10:37:07.021010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4eade9e-75d0-401f-8d4c-072c58401b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:07.029601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b4eade9e-75d0-401f-8d4c-072c58401b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 87d2d248-a442-44f5-9f32-490b1e16e908] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.042812 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b4eade9e-75d0-401f-8d4c-072c58401b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 87d2d248-a442-44f5-9f32-490b1e16e908 could not be found. Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4eade9e-75d0-401f-8d4c-072c58401b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/87d2d248-a442-44f5-9f32-490b1e16e908/action HTTP/1.1 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 39 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: {"os-getConsoleOutput": {"length": 10}} Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 87d2d248-a442-44f5-9f32-490b1e16e908 could not be found. Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '87d2d248-a442-44f5-9f32-490b1e16e908', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d2d248-a442-44f5-9f32-490b1e16e908 could not be found. Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d2d248-a442-44f5-9f32-490b1e16e908 could not be found. Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.045845 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.049941 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:07.049941 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:07.049941 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:07.049941 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:07.049941 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d2d248-a442-44f5-9f32-490b1e16e908 could not be found. Sep 08 10:37:07.049941 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.059795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4eade9e-75d0-401f-8d4c-072c58401b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 87d2d248-a442-44f5-9f32-490b1e16e908 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:07.060922 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b4eade9e-75d0-401f-8d4c-072c58401b7a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/87d2d248-a442-44f5-9f32-490b1e16e908/action" status: 404 len: 111 microversion: 2.1 time: 0.054783 Sep 08 10:37:07.061757 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2372/4966] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:07 2022] POST /compute/v2.1/servers/87d2d248-a442-44f5-9f32-490b1e16e908/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:07.077897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.079454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.086704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.094310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.095126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.096217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.096794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.097340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.219318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:07.289901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.300881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.305627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.307489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.308998 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b92c4962-55a4-4a3a-938e-cbd15669646e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.245512 Sep 08 10:37:07.311217 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2373/4967] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:07 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:07.318763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.324214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.325705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.329820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.334372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49b1bacd-ef11-4df1-93dc-d600da8be044 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 0.741862 Sep 08 10:37:07.345800 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2595/4968] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:06 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:07.347357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.355298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.355298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.356851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.363900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.365783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.366471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.367270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.378894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.379413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.382154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.382812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.383428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.383902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.409859 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] HTTP exception thrown: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Request method failure captured: Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 HTTP/1.1 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcQSMWpJeQ1gxKJmdpzsutUIoLj0lRdFLF55ZMZUhMd26Bk7E1KPUe51nIoRPF_ZZCTyhWAhNZGmu8hDtc2jw0w4wBVPC4492OtfayPpGwEaabHF0z0709DNLAfnsXSntPuctnX6lYDhA4BzisPneskVa9VC5qYsbAL_uhN07enPC6E Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ee1af948aad445daad7abcd11441316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ee1af948aad445daad7abcd11441316", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 0dd35046e12b46a59478ad7dbe2339c9 Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6133c359-37f2-48a7-a087-355b76cdd4f6'} Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:07.424735 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.429472 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.433991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Returning 404 to user: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:07.435061 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7a4aefc-7a14-4c19-9af8-2bb707ec5d38 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 404 len: 111 microversion: 2.1 time: 0.098544 Sep 08 10:37:07.436199 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2596/4969] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:07 2022] DELETE /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:07.444363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.445294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.453443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.454161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.454768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.455695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.456309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.456894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.700871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.702258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:07.713450 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2ee8fe09-8f51-4430-8bb4-c77889777138 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.400783 Sep 08 10:37:07.714791 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ea579e4-b9eb-43e4-bedd-9ccf84859a65 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.276783 Sep 08 10:37:07.715560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2374/4970] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:07 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:07.725491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.735932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 6133c359-37f2-48a7-a087-355b76cdd4f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.736338 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2597/4971] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:07 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:07.743190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.743965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.746825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:07.747748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:07.747908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.748735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.749317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.750061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.756390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.757128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.757758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.758705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:07.759351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:07.761563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:07.765892 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] HTTP exception thrown: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Request method failure captured: Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 HTTP/1.1 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQSMWpJeQ1gxKJmdpzsutUIoLj0lRdFLF55ZMZUhMd26Bk7E1KPUe51nIoRPF_ZZCTyhWAhNZGmu8hDtc2jw0w4wBVPC4492OtfayPpGwEaabHF0z0709DNLAfnsXSntPuctnX6lYDhA4BzisPneskVa9VC5qYsbAL_uhN07enPC6E Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ee1af948aad445daad7abcd11441316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ee1af948aad445daad7abcd11441316", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0dd35046e12b46a59478ad7dbe2339c9 Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6133c359-37f2-48a7-a087-355b76cdd4f6'} Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:07.769274 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. Sep 08 10:37:07.774103 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:07.775965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Returning 404 to user: Instance 6133c359-37f2-48a7-a087-355b76cdd4f6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:07.777030 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-565d7c8d-8b3c-43e7-91fb-cad9a5634cdb tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6" status: 404 len: 111 microversion: 2.1 time: 0.060250 Sep 08 10:37:07.778110 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2375/4972] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:07 2022] GET /compute/v2.1/servers/6133c359-37f2-48a7-a087-355b76cdd4f6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:08.042335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.063847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5450c5f-29d2-4468-bb6c-40b87179f468 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.320471 Sep 08 10:37:08.065958 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2598/4973] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:07 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:08.088679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1e6e96b-30f8-4575-8bf8-8d26909d9fb7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:08.089557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b1e6e96b-30f8-4575-8bf8-8d26909d9fb7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: edc0f783-2395-4cd0-8468-9fa4ce30edca] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:08.095676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b1e6e96b-30f8-4575-8bf8-8d26909d9fb7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance edc0f783-2395-4cd0-8468-9fa4ce30edca could not be found. Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1e6e96b-30f8-4575-8bf8-8d26909d9fb7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/edc0f783-2395-4cd0-8468-9fa4ce30edca HTTP/1.1 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance edc0f783-2395-4cd0-8468-9fa4ce30edca could not be found. Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'edc0f783-2395-4cd0-8468-9fa4ce30edca'} Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc0f783-2395-4cd0-8468-9fa4ce30edca could not be found. Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc0f783-2395-4cd0-8468-9fa4ce30edca could not be found. Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:08.097377 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:08.102183 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:08.102183 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:08.102183 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:08.102183 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc0f783-2395-4cd0-8468-9fa4ce30edca could not be found. Sep 08 10:37:08.102183 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:08.103635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1e6e96b-30f8-4575-8bf8-8d26909d9fb7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance edc0f783-2395-4cd0-8468-9fa4ce30edca could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:08.104879 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b1e6e96b-30f8-4575-8bf8-8d26909d9fb7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/edc0f783-2395-4cd0-8468-9fa4ce30edca" status: 404 len: 111 microversion: 2.1 time: 0.020225 Sep 08 10:37:08.115579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:08.116487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:08.121432 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2376/4974] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/edc0f783-2395-4cd0-8468-9fa4ce30edca => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:08.124278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.125861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.126464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.127376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.128196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.128861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.341557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:08.342185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:08.356028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.359990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.360482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.361236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.361713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.362261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.402116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.407341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:08.413393 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3645298-b6be-4424-a2c9-32ea5e1ac463 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.301828 Sep 08 10:37:08.428401 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2599/4975] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:08.452711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:08.454027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:08.469761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.470768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.471583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.472645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.473269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.473861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.506069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.514728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.516967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.518179 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-249439b2-7da5-4792-99de-33ab4dab2247 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.180836 Sep 08 10:37:08.518739 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2377/4976] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:08.537566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:08.544457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:08.558994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.559646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.560151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.560989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.561509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.562142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.936631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.949457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.951308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:08.953174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5fdaa87-b666-4ae9-b484-a78b5d7b16f2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 0.523031 Sep 08 10:37:08.954393 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2600/4977] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:08.959743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7dc27697-e395-4737-bd40-388f558f0b22 req-c3e3ff96-ccf1-4643-b9ed-264593deac85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "445a89cf-7bb9-413b-bc07-2c9a3d19d168"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:08.971906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7dc27697-e395-4737-bd40-388f558f0b22 req-c3e3ff96-ccf1-4643-b9ed-264593deac85 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:08.972711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7dc27697-e395-4737-bd40-388f558f0b22 req-c3e3ff96-ccf1-4643-b9ed-264593deac85 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:08.973649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7dc27697-e395-4737-bd40-388f558f0b22 req-c3e3ff96-ccf1-4643-b9ed-264593deac85 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:08.987351 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7dc27697-e395-4737-bd40-388f558f0b22 req-c3e3ff96-ccf1-4643-b9ed-264593deac85 service nova] Creating event network-changed:445a89cf-7bb9-413b-bc07-2c9a3d19d168 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:08.993161 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7dc27697-e395-4737-bd40-388f558f0b22 req-c3e3ff96-ccf1-4643-b9ed-264593deac85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037277 Sep 08 10:37:08.994372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2601/4978] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:09.000918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.002466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:09.011894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.012636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.013262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.014233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.015055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.015776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.029308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:09.041684 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c1b44625-a1d1-426b-9d4e-de5cb6d3d605 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.512731 Sep 08 10:37:09.042397 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2378/4979] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:09.268006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d189a40-67da-4d7d-bd11-e611bee15bd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1086351911", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d189a40-67da-4d7d-bd11-e611bee15bd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 238 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1086351911", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1086351911', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.289145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 10:37:09.293678 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:09.298080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d189a40-67da-4d7d-bd11-e611bee15bd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:09.298984 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d189a40-67da-4d7d-bd11-e611bee15bd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035541 Sep 08 10:37:09.303814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2379/4980] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:09 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:37:09.311187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.311855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:09.319480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:09.321231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.321741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.322187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.322900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.323586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.324183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.328858 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95d8a7f8-3626-4cfc-aede-34a09c5d509f tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.333023 Sep 08 10:37:09.329470 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2602/4981] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:08 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:09.536301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:09.550031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.550031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:09.553513 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bcb56855-13b0-4ce9-a592-92a3123e27a0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.248629 Sep 08 10:37:09.555915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2380/4982] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:09 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:09.569162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.569802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.570309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.571090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.571649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.572151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.581564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.582101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:09.590188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:09.593014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.593592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.594531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.595255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.595775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.596192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.680528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:09.693804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:09.696559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:09.702667 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e626eb39-661f-4f8e-ad4f-ea43fba925d0 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.155653 Sep 08 10:37:09.720054 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2603/4983] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:09 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:09.986997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:09.988648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:09.996881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:09.997662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:09.998259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:09.999353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.000885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.001663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.473693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:10.494709 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-306e71b6-8b7b-47cd-ae25-3decee528ae1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.918134 Sep 08 10:37:10.495695 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2381/4984] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:09 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:10.501184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:10.501800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:10.520711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.521216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.524781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.525737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.526381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.527881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.780580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:10.790841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:10.797481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:10.808847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10e9a6a4-3386-4efb-9918-ef59ce76ee22 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1888 microversion: 2.32 time: 0.828183 Sep 08 10:37:10.809927 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2604/4985] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:09 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1888 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:10.817737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee6184ac-04d8-43e1-bfb4-690d221c26ec tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1901416345", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee6184ac-04d8-43e1-bfb4-690d221c26ec tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 235 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1901416345", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1901416345', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.823745 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 10:37:10.829256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:10.844357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee6184ac-04d8-43e1-bfb4-690d221c26ec tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:10.845518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee6184ac-04d8-43e1-bfb4-690d221c26ec tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.034476 Sep 08 10:37:10.846272 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2605/4986] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:10 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:10.850983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:10.851816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:10.872215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.872998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.873601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:10.874482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:10.875640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:10.876223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.006163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.016830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.018521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.018991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.020201 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b98ef093-8bc3-45b5-8e74-e633c95044e4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.172853 Sep 08 10:37:11.021292 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2606/4987] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:10 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:11.037369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.038239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.040441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:11.056028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.056767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.057435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.058385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.059067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.059758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.079748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e3ec8f6-eaae-4db1-bcb4-61beb5834a03 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.582236 Sep 08 10:37:11.080878 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2382/4988] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:10 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.280916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.290525 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7a7f8eeb-2556-4599-af4b-c130526532a9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.263455 Sep 08 10:37:11.292129 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2607/4989] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.321683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.322914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.334149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.334654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.335366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.336119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.336585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.337010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.631552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:11.647071 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f75acd89-45eb-46f0-8f70-ac704c5032cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.329045 Sep 08 10:37:11.651634 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2383/4990] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:11.672548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa53468a-c510-4d23-be76-e358c07d668f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:11.673361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa53468a-c510-4d23-be76-e358c07d668f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 352709d7-53e7-418b-b4e7-b30cb813a3c2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.680430 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-fa53468a-c510-4d23-be76-e358c07d668f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 352709d7-53e7-418b-b4e7-b30cb813a3c2 could not be found. Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa53468a-c510-4d23-be76-e358c07d668f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/352709d7-53e7-418b-b4e7-b30cb813a3c2/action HTTP/1.1 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 13 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: {"pause": {}} Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 352709d7-53e7-418b-b4e7-b30cb813a3c2 could not be found. Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '352709d7-53e7-418b-b4e7-b30cb813a3c2', 'body': {'pause': {}}} Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 352709d7-53e7-418b-b4e7-b30cb813a3c2 could not be found. Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 352709d7-53e7-418b-b4e7-b30cb813a3c2 could not be found. Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:11.689897 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:11.696916 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:11.696916 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:11.696916 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 352709d7-53e7-418b-b4e7-b30cb813a3c2 could not be found. Sep 08 10:37:11.696916 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:11.700538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa53468a-c510-4d23-be76-e358c07d668f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 352709d7-53e7-418b-b4e7-b30cb813a3c2 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:11.702049 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa53468a-c510-4d23-be76-e358c07d668f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/352709d7-53e7-418b-b4e7-b30cb813a3c2/action" status: 404 len: 111 microversion: 2.1 time: 0.034454 Sep 08 10:37:11.703731 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2608/4991] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:11 2022] POST /compute/v2.1/servers/352709d7-53e7-418b-b4e7-b30cb813a3c2/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:11.713800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.715039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.723677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.730508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.731318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.732353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.733045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.733710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.843734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:11.844636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:11.856924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.857731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.858422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:11.859947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:11.860643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:11.861297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.194668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.206003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.212876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.214732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.216493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cab4027b-fe96-414e-8ad7-d8cb90c6eb36 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.379144 Sep 08 10:37:12.219226 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2609/4992] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:12.230583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.231551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:12.232418 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-61bdb8ee-0ef5-4a06-9342-ba6bd51ce2b9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.524484 Sep 08 10:37:12.243498 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2384/4993] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:12.252128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.252756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:12.267544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.276175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.276415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.276883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.277028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.277376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.277660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.278091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.278207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.278541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.278669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.278964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.491982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.501738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.503249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:12.504538 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-984c4fcf-fe4a-41ae-ba8d-29a0c20d2c6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.284115 Sep 08 10:37:12.505319 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2610/4994] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:12.524122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:12.524624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:12.533642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.535763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.537219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.540698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:12.541320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:12.542026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:12.984099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.014191 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c7703c6f-9710-4963-b3d2-b8325382b150 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.776747 Sep 08 10:37:13.018426 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2385/4995] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:13.024493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.043335 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42530dcf-303e-418c-b40d-700f5bfb7b5c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.529723 Sep 08 10:37:13.043993 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2611/4996] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:12 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:13.068904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:13.072255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:13.079551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.080811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.082119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.084426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.085145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.085830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.189074 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad5d6e19-d8fa-4020-84c4-54c3a9cfd905 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 202 len: 0 microversion: 2.1 time: 0.121002 Sep 08 10:37:13.190927 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2386/4997] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:13 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:37:13.204019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:13.211720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:13.242593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.244987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.246474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.249021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.249541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:13.250785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:13.251408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.252177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.261840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.264583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.265037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.266351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.273130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.273710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.705030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.719883 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-039c7e07-30a9-4bad-87ac-d129af4a58f4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1511 microversion: 2.1 time: 0.523606 Sep 08 10:37:13.732808 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2612/4998] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:13 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:13.744116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-078a12f8-7866-409e-aff8-0fc468c72a9f req-7e114bf1-9a2d-4273-917c-4f48153c91b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557d0aad-5e23-4867-acc1-ade68ba834f3", "name": "network-vif-plugged", "status": "completed", "tag": "c8a52cf4-18ed-453e-bf91-a5fb5b4325cc"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:13.758519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-078a12f8-7866-409e-aff8-0fc468c72a9f req-7e114bf1-9a2d-4273-917c-4f48153c91b7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.759404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-078a12f8-7866-409e-aff8-0fc468c72a9f req-7e114bf1-9a2d-4273-917c-4f48153c91b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.760176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-078a12f8-7866-409e-aff8-0fc468c72a9f req-7e114bf1-9a2d-4273-917c-4f48153c91b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.783555 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-078a12f8-7866-409e-aff8-0fc468c72a9f req-7e114bf1-9a2d-4273-917c-4f48153c91b7 service nova] Creating event network-vif-plugged:c8a52cf4-18ed-453e-bf91-a5fb5b4325cc for instance 557d0aad-5e23-4867-acc1-ade68ba834f3 on n-h2-833090-19 Sep 08 10:37:13.794331 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-078a12f8-7866-409e-aff8-0fc468c72a9f req-7e114bf1-9a2d-4273-917c-4f48153c91b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055548 Sep 08 10:37:13.795337 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2613/4999] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:13.804167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:13.804998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:13.815109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.816069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.816716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.817797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:13.818263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:13.818702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:13.841695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.858050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.859715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:13.860965 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36a78365-6733-4812-b0b3-c3de84d2ceed tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.617134 Sep 08 10:37:13.875680 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2387/5000] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:13 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:14.048791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:14.056584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:14.058740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:14.072941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.073440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.073999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.074726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.075191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.075815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.076986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:14.082834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:14.084382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3d1467e-6f06-4bc6-b7c6-54c7360ac67a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.287817 Sep 08 10:37:14.088204 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2614/5001] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:13 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:14.427824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:14.444400 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4e66f6a-1e6d-4656-98c4-3378c0c62bd7 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.404487 Sep 08 10:37:14.446216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2388/5002] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:14 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:14.746136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:14.746744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:14.764000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.764495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.764937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.768255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.769426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.780318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.899364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:14.900098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:14.910943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.911602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.912150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:14.912972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:14.920122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:14.920830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.235454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.274089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e42d403b-df14-4e5a-9662-280fcb92488d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1491 microversion: 2.1 time: 0.530110 Sep 08 10:37:15.275329 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2615/5003] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:14 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1491 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:15.285457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:15.290272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.305534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.308155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.308823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.309499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.310311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.310958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.311637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.343034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.347173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.349658 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0de3e265-8045-4b09-a3ef-025e8918f2e0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.454216 Sep 08 10:37:15.350669 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2389/5004] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:14 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:15.361844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:15.362955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.388670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.389413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.391815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.392734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.396178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.397671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.398903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.412347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.414357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.415819 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c75aa16-d18d-4118-87a6-0398758b193c tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.139124 Sep 08 10:37:15.432067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2616/5005] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:15 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:15.442932 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'pause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state paused Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 13 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: {"pause": {}} Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'pause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state paused Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'pause': {}}} Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state paused. Cannot pause while the instance is in this state. Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state paused Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.454118 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state paused Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'pause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state paused {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-632eef4e-1b2c-4c7e-afd0-85dfddf0a79c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 143 microversion: 2.1 time: 0.102298 Sep 08 10:37:15.459296 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2390/5006] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:15 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 143 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:15.464788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:15.471015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:15.471709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.472535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.485748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.487722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.488228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.488675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.489405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.489867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.490299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.493707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.494191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.494912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.495378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.495842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.651963 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ff1d342-68cb-4265-99c0-12651b26f378 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 202 len: 0 microversion: 2.1 time: 0.190954 Sep 08 10:37:15.666605 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2617/5007] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:15 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:15.677845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:15.678558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.689837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.690339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.690778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.691517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.693018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.693626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.707015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:15.721963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-52a48006-5612-4199-a333-7a52a1532e1d tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1315 microversion: 2.1 time: 0.250717 Sep 08 10:37:15.722953 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2391/5008] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:15 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:15.732720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:15.733226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.745126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.748468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.752560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.753396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.753866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.754296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.784968 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] HTTP exception thrown: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Request method failure captured: Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a HTTP/1.1 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQSMWpJeQ1gxKJmdpzsutUIoLj0lRdFLF55ZMZUhMd26Bk7E1KPUe51nIoRPF_ZZCTyhWAhNZGmu8hDtc2jw0w4wBVPC4492OtfayPpGwEaabHF0z0709DNLAfnsXSntPuctnX6lYDhA4BzisPneskVa9VC5qYsbAL_uhN07enPC6E Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ee1af948aad445daad7abcd11441316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ee1af948aad445daad7abcd11441316", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0dd35046e12b46a59478ad7dbe2339c9 Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '337703bb-dc79-4187-8fab-37fa4188823a'} Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:15.786980 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.793433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.798882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Returning 404 to user: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:15.800141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86d21129-9e96-4d15-8832-b4a69108918e tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 404 len: 111 microversion: 2.1 time: 0.076207 Sep 08 10:37:15.801120 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2392/5009] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:15 2022] DELETE /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:15.812240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:15.813157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] [instance: 337703bb-dc79-4187-8fab-37fa4188823a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:15.821028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.821851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.822571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.823982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:15.825004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:15.825648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:15.860940 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] HTTP exception thrown: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Request method failure captured: Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a HTTP/1.1 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcQSMWpJeQ1gxKJmdpzsutUIoLj0lRdFLF55ZMZUhMd26Bk7E1KPUe51nIoRPF_ZZCTyhWAhNZGmu8hDtc2jw0w4wBVPC4492OtfayPpGwEaabHF0z0709DNLAfnsXSntPuctnX6lYDhA4BzisPneskVa9VC5qYsbAL_uhN07enPC6E Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ee1af948aad445daad7abcd11441316"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ee1af948aad445daad7abcd11441316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ee1af948aad445daad7abcd11441316", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1ee1af948aad445daad7abcd11441316 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-55420652 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 0dd35046e12b46a59478ad7dbe2339c9 Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeTestJSON-55420652-project Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '337703bb-dc79-4187-8fab-37fa4188823a'} Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:15.865332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. Sep 08 10:37:15.869433 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:15.872158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] Returning 404 to user: Instance 337703bb-dc79-4187-8fab-37fa4188823a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:15.873943 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fff306bb-3dd5-4523-9def-3351c8edea76 tempest-AttachVolumeTestJSON-55420652 tempest-AttachVolumeTestJSON-55420652-project] 10.222.0.59 "GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a" status: 404 len: 111 microversion: 2.1 time: 0.068094 Sep 08 10:37:15.879523 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2393/5010] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:15 2022] GET /compute/v2.1/servers/337703bb-dc79-4187-8fab-37fa4188823a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:16.008980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:16.022906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-be050261-065f-4eff-8cae-890ad2ccb593 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1498 microversion: 2.1 time: 0.351293 Sep 08 10:37:16.025235 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2618/5011] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:15 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:16.378824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:16.380069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:16.397961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.398450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.399131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.399929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.400574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.401186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.443841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:16.444723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:16.462014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.464868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.465712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.467181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.467930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.469431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.732830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:16.747292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:16.750084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:16.751561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b75d8d1-a1a8-409c-b9e1-8b710e5b6794 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.311744 Sep 08 10:37:16.752743 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2619/5012] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:16 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:16.769599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:16.772270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:16.779566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.780595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.781757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:16.782713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:16.783392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:16.784339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.057435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.071727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.073256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.074377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1467158a-25cb-407b-8b2e-e664fb598605 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.700170 Sep 08 10:37:17.076303 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2394/5013] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:16 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:17.082257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.083055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.094378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.095237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.097090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.101402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.104434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.104956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.151227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.163503 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-188ccdfd-ed11-46be-abfb-b77d03b5d586 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1465 microversion: 2.1 time: 0.408330 Sep 08 10:37:17.164222 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2620/5014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:16 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1465 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:17.232805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.233354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.241410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.243250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.244040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.245500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.246334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.247098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.303194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:37:17.309010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:17.422845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df7405fa-ada2-4990-a508-7e1bfa74bac4 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "DELETE /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 204 len: 0 microversion: 2.1 time: 0.204843 Sep 08 10:37:17.424811 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2621/5015] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:37:17 2022] DELETE /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:37:17.435640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.436686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.447017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.448541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.449684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.450879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.451749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.452963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.506448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.512782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:17.515261 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7f0efacc-0a14-4388-a66e-e9f68f9b16f3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.437562 Sep 08 10:37:17.515903 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2395/5016] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:17.542576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.543437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.550979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.551767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.552687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.553609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.554297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.554932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.836046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.849002 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4eb14535-b005-4d85-87f1-fba9266a1702 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1471 microversion: 2.1 time: 0.418442 Sep 08 10:37:17.849611 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2622/5017] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1471 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:17.864532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.864532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.873634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.874710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.877343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.881590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:17.898772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.899696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.900825 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-484397ad-1342-4af1-82ff-46bb9d040062 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.362617 Sep 08 10:37:17.901488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.902309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2396/5018] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:17.925799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:17.928891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.935279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.935741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.936501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.937256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.937712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.938136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.956174 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea/action HTTP/1.1 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 28 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: {"reboot": {"type": "SOFT"}} Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3d569c76-daca-4439-af2f-7ba6fd4a69ea', 'body': {'reboot': {'type': 'SOFT'}}} Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:17.958524 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:17.963546 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:17.966971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:17.968099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8e95156-dfc5-4fe4-b492-83c141e41f5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea/action" status: 404 len: 111 microversion: 2.1 time: 0.046860 Sep 08 10:37:17.972637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2397/5019] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:17 2022] POST /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:17.978555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:17.979172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:17.986475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.987272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.987756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:17.988466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:17.988923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:17.989348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.026545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.041116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.045166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.046920 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4bb3f434-0e11-426d-94b8-9bbe0e106e8f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.195849 Sep 08 10:37:18.055699 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2623/5020] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:18.105580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:18.106446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.115818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.119132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.119788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.121143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.123107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.128779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.328496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.350558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-790bd2b3-ee59-4235-8cde-3b7ad9bb446e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.373893 Sep 08 10:37:18.351549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2398/5021] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:17 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:18.380723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:18.381385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.387984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.388476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.389244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.389962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.391262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.391980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.598317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.618360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.620239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.621476 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52a65b98-55f5-4e32-8886-69fd0968ec51 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.519777 Sep 08 10:37:18.622051 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2624/5022] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:18 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:18.710657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:18.718797 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ced9665c-bc4c-4801-a3c8-ae6c239a9780 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.345879 Sep 08 10:37:18.719311 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2399/5023] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:18 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:18.744589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc21ef04-7c0e-4077-950b-c4cb629f7516 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:18.747119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc21ef04-7c0e-4077-950b-c4cb629f7516 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.767668 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-cc21ef04-7c0e-4077-950b-c4cb629f7516 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404 could not be found. Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc21ef04-7c0e-4077-950b-c4cb629f7516 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404/action HTTP/1.1 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 28 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: {"reboot": {"type": "SOFT"}} Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404 could not be found. Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404', 'body': {'reboot': {'type': 'SOFT'}}} Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404 could not be found. Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404 could not be found. Sep 08 10:37:18.769343 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404 could not be found. Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc21ef04-7c0e-4077-950b-c4cb629f7516 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc21ef04-7c0e-4077-950b-c4cb629f7516 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404/action" status: 404 len: 111 microversion: 2.1 time: 0.031229 Sep 08 10:37:18.773311 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2625/5024] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:18 2022] POST /compute/v2.1/servers/8ac2f1c0-a81b-4454-9e82-f7bc7d4fb404/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:18.783698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:18.789400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.806139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.808168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.809019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.810849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.811987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.813162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.876155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:18.876993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:18.901392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.901907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.902390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:18.903123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:18.903612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:18.904087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.540275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:19.549653 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8982736c-e686-4bbc-b7cc-47d4e11a5cad tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.773486 Sep 08 10:37:19.555657 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2400/5025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:18 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:19.569297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:19.570958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:19.591066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.592056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.592500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.594526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.595159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.595802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.607436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:19.625702 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f613391-a935-4e8a-be92-945e2968c938 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1471 microversion: 2.1 time: 0.753817 Sep 08 10:37:19.635492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2626/5026] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:18 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1471 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:19.635492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:19.635492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:19.647245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.648151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.649495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.650881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.653095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.654610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.740884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:19.752907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:19.754944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:19.756444 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ecc4901e-a0ac-4d52-bd7b-5042a0ccd5e1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.199698 Sep 08 10:37:19.757158 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2401/5027] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:19 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:19.769135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:19.769771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:19.786411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.786911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.787345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:19.788260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:19.789899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:19.791299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.205909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:20.217502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c406a2cb-7780-4080-9235-a0c1867e6024 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.589782 Sep 08 10:37:20.220165 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2627/5028] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:19 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:20.250218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:20.253685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:20.263612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.264613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.265370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.266425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.267150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.267862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.287076 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea/action HTTP/1.1 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 65 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3d569c76-daca-4439-af2f-7ba6fd4a69ea', 'body': {'rebuild': {'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb'}}} Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 10:37:20.290126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14b54b93-8125-4a86-b345-49318e915987 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea/action" status: 404 len: 111 microversion: 2.1 time: 0.047002 Sep 08 10:37:20.294233 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2628/5029] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:20 2022] POST /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:20.305460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:20.306644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:20.329660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.329660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.329660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.342416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.342416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.342416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.424979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:20.446702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:20.462067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:20.463606 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fff7ab8b-69fa-4db5-af9d-d318c6a169c6 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.704957 Sep 08 10:37:20.480209 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2402/5030] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:19 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:20.663748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:20.664378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:20.685880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.686403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.686880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.687822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.688448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.689047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.898796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:20.913294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d4b65f7-ca17-434c-9a6b-7865ee1b2273 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.615401 Sep 08 10:37:20.914079 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2629/5031] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:20 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:20.929125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:20.929756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:20.949041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.949548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.949986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:20.950706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:20.951162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:20.951637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.134611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.157387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.158855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.160383 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4aa7c851-b42b-43da-bced-01b847ebdf55 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.245560 Sep 08 10:37:21.162267 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2630/5032] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:20 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:21.167260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:21.168177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:21.174596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.175329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.176005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.176936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.177750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.178281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.418454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098c66314d294bb380bcfee358a069e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6b0b71b6447018fb5e29ca2875639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.431328 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df3e4fd5-13b5-46a6-baba-98959dbd364a tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 200 len: 1471 microversion: 2.1 time: 0.776915 Sep 08 10:37:21.451786 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2403/5033] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:20 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 1471 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:21.459688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7ef14592-cb7d-4b68-aef6-59bdc905104f req-d397d141-6ea8-4b7d-acc0-96b2300605b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557d0aad-5e23-4867-acc1-ade68ba834f3", "name": "network-vif-deleted", "tag": "c8a52cf4-18ed-453e-bf91-a5fb5b4325cc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:21.487492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7ef14592-cb7d-4b68-aef6-59bdc905104f req-d397d141-6ea8-4b7d-acc0-96b2300605b1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.488166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7ef14592-cb7d-4b68-aef6-59bdc905104f req-d397d141-6ea8-4b7d-acc0-96b2300605b1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.491650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7ef14592-cb7d-4b68-aef6-59bdc905104f req-d397d141-6ea8-4b7d-acc0-96b2300605b1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.529785 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7ef14592-cb7d-4b68-aef6-59bdc905104f req-d397d141-6ea8-4b7d-acc0-96b2300605b1 service nova] Creating event network-vif-deleted:c8a52cf4-18ed-453e-bf91-a5fb5b4325cc for instance 557d0aad-5e23-4867-acc1-ade68ba834f3 on n-h2-833090-19 Sep 08 10:37:21.544353 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7ef14592-cb7d-4b68-aef6-59bdc905104f req-d397d141-6ea8-4b7d-acc0-96b2300605b1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086621 Sep 08 10:37:21.545447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2404/5034] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:21.561421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:21.565216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:21.573997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.574950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.576154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.577107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.578565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.579188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.608486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:21.624978 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c696766e-7540-4c8f-b108-c4060ea5d32f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.460861 Sep 08 10:37:21.625866 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2631/5035] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:21 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:21.654828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61be5566-b859-4410-90ab-5bc394b65956 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:21.657745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61be5566-b859-4410-90ab-5bc394b65956 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: e83b4ca1-f083-4c72-9235-14331df2cbdc] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:21.668734 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-61be5566-b859-4410-90ab-5bc394b65956 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance e83b4ca1-f083-4c72-9235-14331df2cbdc could not be found. Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61be5566-b859-4410-90ab-5bc394b65956 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/e83b4ca1-f083-4c72-9235-14331df2cbdc/action HTTP/1.1 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 65 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance e83b4ca1-f083-4c72-9235-14331df2cbdc could not be found. Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'e83b4ca1-f083-4c72-9235-14331df2cbdc', 'body': {'rebuild': {'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb'}}} Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83b4ca1-f083-4c72-9235-14331df2cbdc could not be found. Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 10:37:21.670392 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83b4ca1-f083-4c72-9235-14331df2cbdc could not be found. Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83b4ca1-f083-4c72-9235-14331df2cbdc could not be found. Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61be5566-b859-4410-90ab-5bc394b65956 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance e83b4ca1-f083-4c72-9235-14331df2cbdc could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:21.678037 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61be5566-b859-4410-90ab-5bc394b65956 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/e83b4ca1-f083-4c72-9235-14331df2cbdc/action" status: 404 len: 111 microversion: 2.1 time: 0.022057 Sep 08 10:37:21.688057 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2632/5036] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:21 2022] POST /compute/v2.1/servers/e83b4ca1-f083-4c72-9235-14331df2cbdc/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:21.706180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:21.709277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:21.735221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.736227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.740007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:21.743432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:21.745021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:21.746229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.109930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.128198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.130884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.135386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1d1647f-e8e5-4af8-867a-7068613593a5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.585124 Sep 08 10:37:22.142179 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2405/5037] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:21 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:22.193394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:22.194389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.208613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.209332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.210057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.213797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.214193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.215006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.215807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.252629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-86323311-683a-44b2-b985-58a42140f788 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.558170 Sep 08 10:37:22.275440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2633/5038] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:21 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:22.290399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:22.291038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.316607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.319003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.324214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.325010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.325487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.325922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.369391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.394963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.396492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.399311 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc55e186-785f-4522-abcf-9fd41074f89e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.210780 Sep 08 10:37:22.400291 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2406/5039] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:22 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:22.455490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:22.456311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] [instance: 557d0aad-5e23-4867-acc1-ade68ba834f3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.463063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.464071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.464526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.465309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.465761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.466223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.481542 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] HTTP exception thrown: Instance 557d0aad-5e23-4867-acc1-ade68ba834f3 could not be found. Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Request method failure captured: Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 HTTP/1.1 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcW7_r5oQ04H7mEQa2HYxfoYZan9JjeI2cfbFnL4K8YN1wP0u9LC6Iga072XjMnauEawwS7misRP4aSlBbmzOJQgpuK2xj8Q1QxCeLm8NgYL9qv0APQPSpe8EW8wOH84-fZFJ51H7GwskYSGcipmdUuIPMGx9uGOUWJlHda04525V-Q Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1eb6b0b71b6447018fb5e29ca2875639 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesNegativeTest-2030848658 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1eb6b0b71b6447018fb5e29ca2875639"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1eb6b0b71b6447018fb5e29ca2875639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1eb6b0b71b6447018fb5e29ca2875639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1eb6b0b71b6447018fb5e29ca2875639", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesNegativeTest-2030848658 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1eb6b0b71b6447018fb5e29ca2875639 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesNegativeTest-2030848658 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesNegativeTest-2030848658-project Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 098c66314d294bb380bcfee358a069e2 Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesNegativeTest-2030848658-project Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 557d0aad-5e23-4867-acc1-ade68ba834f3 could not be found. Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '557d0aad-5e23-4867-acc1-ade68ba834f3'} Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557d0aad-5e23-4867-acc1-ade68ba834f3 could not be found. Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557d0aad-5e23-4867-acc1-ade68ba834f3 could not be found. Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:22.483575 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557d0aad-5e23-4867-acc1-ade68ba834f3 could not be found. Sep 08 10:37:22.488970 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.490562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] Returning 404 to user: Instance 557d0aad-5e23-4867-acc1-ade68ba834f3 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:22.492214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef04713e-ce0e-4cec-803e-a9b286e1da68 tempest-VolumesNegativeTest-2030848658 tempest-VolumesNegativeTest-2030848658-project] 10.222.0.59 "GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3" status: 404 len: 111 microversion: 2.1 time: 0.040599 Sep 08 10:37:22.493362 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2407/5040] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:22 2022] GET /compute/v2.1/servers/557d0aad-5e23-4867-acc1-ade68ba834f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:37:22.593246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:22.604033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3acf396-5941-4f83-a34c-babe56c4b1c9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.326440 Sep 08 10:37:22.604870 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2634/5041] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:22 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:22.630820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99f82b0a-9766-4b54-bdc3-f5d286a15551 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:22.631162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99f82b0a-9766-4b54-bdc3-f5d286a15551 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: d0153302-fd93-4780-b037-183a0474f5d5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.637762 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-99f82b0a-9766-4b54-bdc3-f5d286a15551 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance d0153302-fd93-4780-b037-183a0474f5d5 could not be found. Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99f82b0a-9766-4b54-bdc3-f5d286a15551 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/d0153302-fd93-4780-b037-183a0474f5d5/action HTTP/1.1 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: {"restore": {}} Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance d0153302-fd93-4780-b037-183a0474f5d5 could not be found. Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'd0153302-fd93-4780-b037-183a0474f5d5', 'body': {'restore': {}}} Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0153302-fd93-4780-b037-183a0474f5d5 could not be found. Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0153302-fd93-4780-b037-183a0474f5d5 could not be found. Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:22.640584 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:22.645773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:22.645773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:22.645773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0153302-fd93-4780-b037-183a0474f5d5 could not be found. Sep 08 10:37:22.645773 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:22.647069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99f82b0a-9766-4b54-bdc3-f5d286a15551 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance d0153302-fd93-4780-b037-183a0474f5d5 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:22.648819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99f82b0a-9766-4b54-bdc3-f5d286a15551 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/d0153302-fd93-4780-b037-183a0474f5d5/action" status: 404 len: 111 microversion: 2.1 time: 0.022746 Sep 08 10:37:22.658753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:22.659781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:22.665359 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2408/5042] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:22 2022] POST /compute/v2.1/servers/d0153302-fd93-4780-b037-183a0474f5d5/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:22.666881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.667575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.668188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:22.669022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:22.669460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:22.670064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.049471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:23.054069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:23.065133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:23.074016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.074524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.074969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.075317 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4600802-3dc3-47a1-b978-57c9d801a11b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.419698 Sep 08 10:37:23.080579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2635/5043] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:22 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:23.092882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.093971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.098179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.105934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:23.106789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:23.119840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.120339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.120778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.123133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.126350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.126840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.188787 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c986272a-a978-4546-bdf6-34ad1c4c433f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.140574 Sep 08 10:37:23.195382 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2409/5044] 10.222.0.59 () {60 vars in 1343 bytes} [Thu Sep 8 10:37:23 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:23.202330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:23.205770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:23.214060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.214903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.215693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:23.217661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:23.218448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:23.219728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.100230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.111859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.113543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.114745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8557998e-596d-4bc1-8715-4c273ad5f86b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.922081 Sep 08 10:37:24.115318 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2410/5045] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:23 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:24.120632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.124429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:24.135523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:24.141306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.143386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.143928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.147661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.149473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.150107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.204906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:37:24.273017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.285921 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0791efcd-c5eb-46a7-b7a9-0bae4bafac8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.188586 Sep 08 10:37:24.288598 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2636/5046] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:23 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:24.300684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.304303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:24.332117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.332610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.333055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.333748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.334198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.334684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.367153 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b150fa6b-2f95-4617-82fc-afb916626eee tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 204 len: 0 microversion: 2.20 time: 0.245144 Sep 08 10:37:24.373683 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2411/5047] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:37:24 2022] DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:37:24.387821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:24.388646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:24.401775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.402253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.402699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.403430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.404206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.405108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.438641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'restore' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: {"restore": {}} Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'restore' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'restore': {}}} Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state active. Cannot restore while the instance is in this state. Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:24.440906 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:24.445104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:24.445104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:24.445104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:24.445104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:24.445104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:24.446908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'restore' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:24.449285 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac231571-cebd-45d7-89b9-c53418d2bbe8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 145 microversion: 2.1 time: 0.075639 Sep 08 10:37:24.453728 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2412/5048] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:24 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 145 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:37:24.456164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.457097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:24.466002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.466612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.467111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.468653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.469522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.470510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.478647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.502377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.504523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.506070 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-12a59b47-3fe2-44f2-b5f2-768d2d219d97 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.215586 Sep 08 10:37:24.508405 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2637/5049] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:24.535303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:24.535963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:24.542672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.543538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.546680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.547599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:24.548074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:24.548503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:24.957217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.979265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:24.981864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.005158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.031931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5d0c92f-4ebd-40d8-8b60-c2af16853e72 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 0.545011 Sep 08 10:37:25.032634 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2413/5050] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:25.038273 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b077c13c-0cf9-4b4f-a580-6dc2c4991856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.512336 Sep 08 10:37:25.038883 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2638/5051] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:24 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:25.066468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.067131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:25.082929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.083419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.083884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.084787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.088328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.088981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.100162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:25.148509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.149140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:25.156129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.172789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.173528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.177370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.177370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.177370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.250882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:25.553816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.568467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48597ebc-d6d5-404e-aee9-4cf3d5caa5dc tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.505530 Sep 08 10:37:25.570354 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2414/5052] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:25.587423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.588178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:25.601261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.601261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.601673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.602456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.604924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.606010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.636659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.655080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.657982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.659454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42e5783e-8647-4323-8307-d13f99827cd1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.521994 Sep 08 10:37:25.660445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2639/5053] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:25.670361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54f71b07-05b2-4f3f-b54b-b8e60bd17740 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:25.671415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54f71b07-05b2-4f3f-b54b-b8e60bd17740 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 155867e7-7c60-455e-ac58-2958fb069d63] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:25.678103 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-54f71b07-05b2-4f3f-b54b-b8e60bd17740 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 155867e7-7c60-455e-ac58-2958fb069d63 could not be found. Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54f71b07-05b2-4f3f-b54b-b8e60bd17740 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/155867e7-7c60-455e-ac58-2958fb069d63/action HTTP/1.1 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 14 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: {"resume": {}} Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 155867e7-7c60-455e-ac58-2958fb069d63 could not be found. Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '155867e7-7c60-455e-ac58-2958fb069d63', 'body': {'resume': {}}} Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155867e7-7c60-455e-ac58-2958fb069d63 could not be found. Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155867e7-7c60-455e-ac58-2958fb069d63 could not be found. Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:25.687893 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:25.692014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:25.692014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:25.692014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155867e7-7c60-455e-ac58-2958fb069d63 could not be found. Sep 08 10:37:25.692014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:25.693975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54f71b07-05b2-4f3f-b54b-b8e60bd17740 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 155867e7-7c60-455e-ac58-2958fb069d63 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:25.695113 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54f71b07-05b2-4f3f-b54b-b8e60bd17740 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/155867e7-7c60-455e-ac58-2958fb069d63/action" status: 404 len: 111 microversion: 2.1 time: 0.033572 Sep 08 10:37:25.695518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.696276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2640/5054] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:25 2022] POST /compute/v2.1/servers/155867e7-7c60-455e-ac58-2958fb069d63/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:25.705928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:25.706846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:25.709482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.712953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:25.716259 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58bb4858-fb58-42ee-8dd2-37f4572e63f2 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.144614 Sep 08 10:37:25.717222 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2415/5055] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:25.722231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.723059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.723777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.724872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:25.725804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:25.726559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:25.995053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.008195 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8dc594f3-257b-4920-8337-d38f8e3483a2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.307403 Sep 08 10:37:26.008779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2641/5056] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:25 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:26.035393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.036048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:26.047712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.048521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.049192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.050169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.053970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.058590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.069549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.070176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:26.076919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.077980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.078425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.079141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.079622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.080053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.448908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.460266 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45d53d44-a891-43c0-8cda-609c7eafe2d9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.431464 Sep 08 10:37:26.461409 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2416/5057] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:26 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:26.490483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:26.494507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.498292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:26.509070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.520097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.520652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.520868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:26.522499 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ddcbd4b8-ddbf-4e12-a81a-57ae661fc66d tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1722 microversion: 2.20 time: 0.464971 Sep 08 10:37:26.523201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.524179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.524569 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2642/5058] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:26 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:26.525032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.525641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.579061 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'resume' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 14 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: {"resume": {}} Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'resume' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'resume': {}}} Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state active. Cannot resume while the instance is in this state. Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:26.581129 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'resume' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b0dab9bb-3773-4df9-8c6d-d00fcd9ab200 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 144 microversion: 2.1 time: 0.096333 Sep 08 10:37:26.585525 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2417/5059] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:26 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 144 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 10:37:26.593557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.600416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:26.617560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.618305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.618941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.621800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.623284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.624912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.709041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:26.710027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:26.724086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.725017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.725643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:26.726541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:26.727743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:26.729229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:27.672683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:27.691382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34b81060-fea3-4def-84ab-eeada0f85486 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 1.101921 Sep 08 10:37:27.712245 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2643/5060] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:26 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:27.727727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:27.730594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:27.741514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:27.753814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:27.760549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:27.761452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:27.762630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:27.765596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:27.767723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:27.770977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:27.773380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:27.774604 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad5212b9-fb53-4c11-b334-2925f878eb7d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.069527 Sep 08 10:37:27.786337 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2418/5061] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:26 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:27.791363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:27.806637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:27.829409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:27.830185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:27.833914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:27.834845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:27.835418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:27.836019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.069836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.083775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.097704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.103995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.106288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98c97cd324034c9297200125111c3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a73a158fede41208b272a3e9c4d6e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.111576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.114562 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e08841e-9ca7-442c-90d1-ca0a7b1232e8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 200 len: 1655 microversion: 2.20 time: 0.321396 Sep 08 10:37:28.116442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-458284bf-89b4-4b10-980a-5dc49c2d967e tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.402976 Sep 08 10:37:28.117046 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2644/5062] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:27 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:28.118713 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2419/5063] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:27 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 1655 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:28.128164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a3c1bf56-f3af-4f0c-b08e-cd78a83e9250 req-1949e7b3-9364-4070-bd06-72a10b3acaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd99d66-bb97-408e-aacc-53461264af19", "name": "network-vif-deleted", "tag": "c001065c-6ae2-4e83-8b0c-c963a293fd5c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:28.134556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:28.136790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:28.197255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.201045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.203123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.204347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.205703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a3c1bf56-f3af-4f0c-b08e-cd78a83e9250 req-1949e7b3-9364-4070-bd06-72a10b3acaab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.207138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.207877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a3c1bf56-f3af-4f0c-b08e-cd78a83e9250 req-1949e7b3-9364-4070-bd06-72a10b3acaab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.208785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.210375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a3c1bf56-f3af-4f0c-b08e-cd78a83e9250 req-1949e7b3-9364-4070-bd06-72a10b3acaab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.271539 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a3c1bf56-f3af-4f0c-b08e-cd78a83e9250 req-1949e7b3-9364-4070-bd06-72a10b3acaab service nova] Creating event network-vif-deleted:c001065c-6ae2-4e83-8b0c-c963a293fd5c for instance ccd99d66-bb97-408e-aacc-53461264af19 on n-h1-833090-19 Sep 08 10:37:28.285356 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a3c1bf56-f3af-4f0c-b08e-cd78a83e9250 req-1949e7b3-9364-4070-bd06-72a10b3acaab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165350 Sep 08 10:37:28.286234 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2420/5064] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:28.583611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:28.604497 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bdbb709d-2f71-4e60-8d4b-5af6cfa863a1 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.478943 Sep 08 10:37:28.606419 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2645/5065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:28 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:28.817381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:28.818244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:28.842735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.850058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.850840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.854418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.863307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0560435e-51ac-48f9-b2f2-f0542b219182 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0560435e-51ac-48f9-b2f2-f0542b219182 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 160 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6a31b811-fdf4-47f5-84de-f0d87838fc52"}]}} Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'server': {'name': '', 'imageRef': 'fe14f6a4-d144-40d8-8fee-904fb43a30eb', 'flavorRef': '452', 'networks': [{'uuid': '6a31b811-fdf4-47f5-84de-f0d87838fc52'}]}}} Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi '' Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:37:28.869656 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:37:28.874951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:28.879061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.880796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.881225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0560435e-51ac-48f9-b2f2-f0542b219182 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:28.883081 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0560435e-51ac-48f9-b2f2-f0542b219182 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024043 Sep 08 10:37:28.890929 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2646/5066] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:28 2022] POST /compute/v2.1/servers => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:28.902661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:28.910564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:28.940066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.948044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.948835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:28.949806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:28.950493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:28.950989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.340430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.353250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.360219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.361447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-74cfa56d-e3b6-4bf2-afad-4c2a5fcb3006 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.550282 Sep 08 10:37:29.371379 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2421/5067] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:28 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:29.385177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.387560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.395371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.405123 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efe2f1ea-59ab-45ea-a04b-0f58b77af993 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.508441 Sep 08 10:37:29.408193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2647/5068] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:28 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:29.413881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.416537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.426234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.426753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.427403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.427623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.427989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.428718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.429183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.429508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.429634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.433535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.434228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.437730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.457032 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] HTTP exception thrown: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Request method failure captured: Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 HTTP/1.1 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOELNILFdXXwetg1qLtNPYWapnbPiYgzKI5ouAU87UP18x6pqWOOgsZZ0DFkaORfznPB5jLTzY9pJgoI1uYWbpZR8RNRDFbeZtV8m0Msaz0bUBkWrp6kmglz69klmkc4353VxGe5fBPRlTvW45SIwzogvsBkVRr7Xpyvfv9f58tmPw Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3a73a158fede41208b272a3e9c4d6e47", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 98c97cd324034c9297200125111c3029 Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ccd99d66-bb97-408e-aacc-53461264af19'} Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.459354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:29.463658 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.466676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Returning 404 to user: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:29.471486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-129b8aeb-788f-47cb-962f-bfddf3344043 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 404 len: 111 microversion: 2.20 time: 0.058023 Sep 08 10:37:29.472758 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2648/5069] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:29.477924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.479010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.495278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.496738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.498701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.500991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.502541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.503898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.588905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.598490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.599992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.601224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ad8dcd0-3575-487a-bc19-a3ba1caea4a1 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.228585 Sep 08 10:37:29.612293 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2422/5070] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:29.677851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8853fc31-b845-41b1-8a78-d5edfece976f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '.version_select at 0x7f23553f95e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.765430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8853fc31-b845-41b1-8a78-d5edfece976f tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640598117" status: 204 len: 0 microversion: 2.20 time: 0.151556 Sep 08 10:37:29.767781 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2423/5071] 10.222.0.59 () {60 vars in 1259 bytes} [Thu Sep 8 10:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640598117 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:37:29.798385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:29.811814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-725a8939-696d-4e24-a79b-0f2c7fd22454 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.337624 Sep 08 10:37:29.818899 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2649/5072] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:29.845752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2bcceb0-6615-494d-bf84-ab343839f6fe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:29.847429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2bcceb0-6615-494d-bf84-ab343839f6fe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.859310 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c2bcceb0-6615-494d-bf84-ab343839f6fe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6 could not be found. Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2bcceb0-6615-494d-bf84-ab343839f6fe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6/action HTTP/1.1 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 14 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: {"shelve": {}} Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6 could not be found. Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6', 'body': {'shelve': {}}} Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6 could not be found. Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6 could not be found. Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:29.880443 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6 could not be found. Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2bcceb0-6615-494d-bf84-ab343839f6fe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2bcceb0-6615-494d-bf84-ab343839f6fe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6/action" status: 404 len: 111 microversion: 2.1 time: 0.042944 Sep 08 10:37:29.886607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2424/5073] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:29 2022] POST /compute/v2.1/servers/f99ae872-2a7f-4a5e-9f6f-edf097ed7ec6/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:37:29.892414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:29.893652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:29.907836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.908359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.908830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:29.909545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:29.910002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:29.910425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.276952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.285413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28bd29e2-7a5d-4fa6-adcf-ec6bcf3663cb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.397991 Sep 08 10:37:30.286009 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2650/5074] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:29 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:30.312003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.312779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:30.337360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.337887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.338342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.339084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.339572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.340000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.398321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.399110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:30.411643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.412178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.413322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.415758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.416413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.418035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.769646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.784084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff8f08a6-ef83-441c-817f-a1891ee82151 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.471942 Sep 08 10:37:30.785226 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2425/5075] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:30.813080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:30.814043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:30.821045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.821887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.822506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.823382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:30.824173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:30.824790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:30.939602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.960882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.970744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:30.979517 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a1797bf-a4d9-4988-a9e8-6ae03b609cc0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.578501 Sep 08 10:37:30.983446 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2651/5076] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:31.001060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:31.001961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:31.009699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.010652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.011266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.012463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.013165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.013785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.023035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:31.041169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:31.042666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:31.043957 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18d82b90-af45-4fc9-b617-57a0a6dabe15 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.255918 Sep 08 10:37:31.044539 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2426/5077] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:30 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:31.048328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lazy-loading 'flavor' on Instance uuid ab066901-fa02-4e6f-957c-65bc129387a6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:31.380475 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-534b4203-7509-4e4e-b5b6-8194f9dd029e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 202 len: 0 microversion: 2.1 time: 0.393810 Sep 08 10:37:31.382653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2652/5078] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:37:30 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:37:31.393146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:31.393797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:31.407152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.407801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.408256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.409045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:31.409506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:31.410245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:31.910503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:31.924428 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1efd488f-bc3b-4aa7-9c5a-cec0c960092a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.535930 Sep 08 10:37:31.926635 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2427/5079] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:31 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:32.012426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:32.013262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:32.049246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.050869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.052639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.054272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.055180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.057505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.089154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:32.089965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:32.111159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.113900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.115021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.118952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.121366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.121838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.457505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.471801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.473583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.477304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94d4675f-1e4a-4e3e-a776-356e46349522 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.392239 Sep 08 10:37:32.480637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2428/5080] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:32 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:32.724814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.737139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.744158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:32.748188 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6c6b9535-b764-4627-8b81-cb07a8fa17f9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.741482 Sep 08 10:37:32.751388 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2653/5081] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:32 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:32.949545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:32.950021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:32.961572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.962068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.962511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:32.967786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:32.968653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:32.969340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.446212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:33.459479 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5b3f0ca6-4d8d-49ea-893d-d5ad1caf9f58 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.512608 Sep 08 10:37:33.464461 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2429/5082] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:32 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:33.510054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:33.510696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:33.523112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.523949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.525937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.526796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.527506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.529165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.782938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:33.785563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:33.786180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:33.794297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:33.798929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:33.802649 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4b97897-a5ae-4815-9273-25f7b50b896d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.294832 Sep 08 10:37:33.804822 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2654/5083] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:33 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:33.818941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.819443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.819901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:33.832488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:33.837508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:33.840563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:34.492932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:34.493547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:34.500868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:34.531004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:34.535482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:34.536099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:34.540474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:34.541025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:34.541469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.412460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.429497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.429695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.433834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.437831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b1c0427f-502c-4b41-ad8b-df1a2895c3c7 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.658411 Sep 08 10:37:35.441212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2430/5084] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:33 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:35.450505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:35.453598 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-91178da4-fab5-455b-90d3-eadd346ee5bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.961719 Sep 08 10:37:35.454571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:35.477481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:35.484600 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2655/5085] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:34 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:35.484810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:35.486481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.487359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:35.490689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:35.491365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:35.599375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.611785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.614043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:35.619994 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a7e498d4-a012-464b-bd9e-be5e6dbb00e3 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1366 microversion: 2.57 time: 0.177403 Sep 08 10:37:35.621261 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2431/5086] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:35 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:36.466814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:36.467448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:36.491226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:36.491940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:36.500564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:36.503763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:36.504555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:36.505525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:36.529209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:36.542221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:36.556475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:36.556940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:36.559038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:36.559532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:36.559970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:36.562456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.340271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.354419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c818197-78bb-4988-aa5f-75bcd1647173 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 1.869615 Sep 08 10:37:38.356070 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2432/5087] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:36 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:38.362419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.365564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:38.369583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.370589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:38.380967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.384819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.386528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.387727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.388294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-001355a0-cde2-49cf-bde9-0237e71c0719 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.925450 Sep 08 10:37:38.388851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.391059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2656/5088] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:36 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:38.391435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.392556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.393792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.398615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.407455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:38.421653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.422527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.423244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.424223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.424903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.427039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.471683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] HTTP exception thrown: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Request method failure captured: Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 HTTP/1.1 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOELNILFdXXwetg1qLtNPYWapnbPiYgzKI5ouAU87UP18x6pqWOOgsZZ0DFkaORfznPB5jLTzY9pJgoI1uYWbpZR8RNRDFbeZtV8m0Msaz0bUBkWrp6kmglz69klmkc4353VxGe5fBPRlTvW45SIwzogvsBkVRr7Xpyvfv9f58tmPw Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3a73a158fede41208b272a3e9c4d6e47", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 98c97cd324034c9297200125111c3029 Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ccd99d66-bb97-408e-aacc-53461264af19'} Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:38.476288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.481682 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.493228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Returning 404 to user: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:38.512246 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03559edc-a54b-45ab-9728-6c0180eeca32 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 404 len: 111 microversion: 2.20 time: 0.101110 Sep 08 10:37:38.512916 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2657/5089] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:37:38 2022] DELETE /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:38.532379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:38.533010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: ccd99d66-bb97-408e-aacc-53461264af19] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:38.566661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.567322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.567809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.568562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:38.569019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:38.569447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:38.636853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.645667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:38.649425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] HTTP exception thrown: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Request method failure captured: Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 HTTP/1.1 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcOELNILFdXXwetg1qLtNPYWapnbPiYgzKI5ouAU87UP18x6pqWOOgsZZ0DFkaORfznPB5jLTzY9pJgoI1uYWbpZR8RNRDFbeZtV8m0Msaz0bUBkWrp6kmglz69klmkc4353VxGe5fBPRlTvW45SIwzogvsBkVRr7Xpyvfv9f58tmPw Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3a73a158fede41208b272a3e9c4d6e47", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 98c97cd324034c9297200125111c3029 Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ccd99d66-bb97-408e-aacc-53461264af19'} Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.658515 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Returning 404 to user: Instance ccd99d66-bb97-408e-aacc-53461264af19 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:38.663234 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-715d645d-ac1d-468a-b13f-1eefde9a4af8 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19" status: 404 len: 111 microversion: 2.20 time: 0.142572 Sep 08 10:37:38.664025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.667782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:38.674460 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2658/5090] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/servers/ccd99d66-bb97-408e-aacc-53461264af19 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:38.685142 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-133a164c-2e5b-46a1-8408-10bc039154c9 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1372 microversion: 2.57 time: 0.311027 Sep 08 10:37:38.687259 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2433/5091] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:38 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1372 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:39.380772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:39.384087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:39.409911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.412497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.413209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.416658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.417397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.419784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.420384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:39.421939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:39.470725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.474335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.476412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:39.479127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:39.480003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:39.480962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.116550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.132120 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7de7bd7f-129a-4d75-bd72-118fb1eb5e0d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.755529 Sep 08 10:37:40.139798 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2659/5092] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:39 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:40.166681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:40.167552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:40.232512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.232881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.239528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.239528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.240177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:40.249277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:40.251589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:40.309190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.324548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.341544 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2787807-8677-49c5-9a09-7bc711299c0d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.911227 Sep 08 10:37:40.356655 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2434/5093] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:39 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:40.486343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.499875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.505896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:40.510849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1d8984c-a106-47ca-a9e3-000e26d6c0b4 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1372 microversion: 2.57 time: 0.366259 Sep 08 10:37:40.514215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2660/5094] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:40 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1372 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:41.162483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:41.163772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:41.202959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.205535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.206232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.207629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.210040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.212145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.378440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:41.379007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:41.400785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.401396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.405467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:41.406260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:41.406729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:41.407175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.025156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.042351 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-75b82feb-e439-48c1-b8ee-7433cc6c4c78 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.884566 Sep 08 10:37:42.071600 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2435/5095] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:41 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:42.085964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:42.086804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:42.109249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.109745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.110179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.122860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.123421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.123957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.223411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.256532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.259125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.263067 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc3c6cc8-b75e-4637-b8af-a2112f6fc1ad tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.888606 Sep 08 10:37:42.279408 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2661/5096] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:41 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:42.319953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.335980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.341620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.348167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6e8ce13-6abd-47bb-88e5-53124d525a9a tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1357 microversion: 2.57 time: 0.277594 Sep 08 10:37:42.348810 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2436/5097] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:42 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:42.380176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:42.381094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:42.388391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.389147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.390301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.391425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.392056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.392654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.424279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:37:42.582128 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-637cbc1a-6dc5-4007-b989-77992cf54698 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "DELETE /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 204 len: 0 microversion: 2.57 time: 0.206089 Sep 08 10:37:42.582872 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2662/5098] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:37:42 2022] DELETE /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:37:42.593999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:42.594945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:42.602812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.603618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.604242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.605129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:42.605810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:42.606402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:42.793807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.819106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.821700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:42.828064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5eddda6f-0684-402f-8bae-9686bbab7f1b tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1363 microversion: 2.57 time: 0.240741 Sep 08 10:37:42.833356 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2437/5099] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:42 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:43.077985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:43.079698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:43.091176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.093046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.094509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.095827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.098184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.098800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.300631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:43.301736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:43.320541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.324247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.326296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.329844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.330671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.331944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.394763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:43.415886 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-36821fdb-aedb-4aca-a541-791edc8556b2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1533 microversion: 2.1 time: 0.346360 Sep 08 10:37:43.433993 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2663/5100] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:43 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1533 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:43.859896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:43.860528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:43.879782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.885177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.885820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:43.886928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:43.887579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:43.888175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.000157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.011543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.016860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.018374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c535b5d7-276d-4d4f-adb1-9eace71d6acf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.726109 Sep 08 10:37:44.020431 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2438/5101] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:43 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:44.035947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.048105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.049900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.051624 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aaaa956f-15da-488b-a873-54a74d9e8e6d tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1363 microversion: 2.57 time: 0.195503 Sep 08 10:37:44.053020 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2664/5102] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:43 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:37:44.062810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c73abb33-30ef-4127-a590-bb40a6627aab req-1ecbe27f-111b-4148-9d85-d7b8b9077175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "34569af1-d152-412e-a374-fb9ebc4707e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:44.085066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c73abb33-30ef-4127-a590-bb40a6627aab req-1ecbe27f-111b-4148-9d85-d7b8b9077175 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.087743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c73abb33-30ef-4127-a590-bb40a6627aab req-1ecbe27f-111b-4148-9d85-d7b8b9077175 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.089682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c73abb33-30ef-4127-a590-bb40a6627aab req-1ecbe27f-111b-4148-9d85-d7b8b9077175 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.124493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c73abb33-30ef-4127-a590-bb40a6627aab req-1ecbe27f-111b-4148-9d85-d7b8b9077175 service nova] Creating event network-vif-plugged:34569af1-d152-412e-a374-fb9ebc4707e1 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:44.138128 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c73abb33-30ef-4127-a590-bb40a6627aab req-1ecbe27f-111b-4148-9d85-d7b8b9077175 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080671 Sep 08 10:37:44.140948 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2439/5103] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:37:44.446730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:44.448098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:44.462589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.463387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.464006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.464975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:44.467853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:44.470662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:44.958248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:44.971414 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab04c3f9-c559-4ca5-9ece-2a4c0728d35e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.526747 Sep 08 10:37:44.973304 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2665/5104] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:44 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:45.053771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.054560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.066265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.069061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.069709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.072312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.073120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.075733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.088441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:45.089262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:45.106107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.114920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.115303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.120273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.120763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.131373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.246111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:45.246746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:45.247190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:45.247863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lazy-loading 'fault' on Instance uuid 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:37:45.357764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.369995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.374162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29ce27f4263a4c24aedc2c2ad80620f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4352e884a421aa0c4d6e85dd89669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:45.377343 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95b7b9a0-6393-4a99-b666-362a8509ecc5 tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 200 len: 1368 microversion: 2.57 time: 0.295849 Sep 08 10:37:45.392443 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2666/5105] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:45.844022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-096f02c0-bc16-4cf7-8bd2-a00312f1904e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: .version_select at 0x7f234be684c0>, body: {"keypair": {"name": "tempest-keypair-1569896712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaNnD5Vb/dspHqVyDijiF5X5iIWdXLDBMgqkoH90oJJj/cWYT2UWdlIFZDlKBrh380zj4vCnwAZlX+9tN94KEh/X46F5G+S/UGYxBUagetplpvjre02LL+udYlNK+pDyw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:45.871668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-096f02c0-bc16-4cf7-8bd2-a00312f1904e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:37:45.884110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-096f02c0-bc16-4cf7-8bd2-a00312f1904e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:37:45.942805 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-096f02c0-bc16-4cf7-8bd2-a00312f1904e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360110 Sep 08 10:37:45.944148 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2667/5106] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:37:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:46.001828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.023037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:46.032035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:46.042746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.046332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.050057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.051439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.052354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.053167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.053903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.055183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.058111 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-608064e9-d31a-4461-b52e-670f293e20c2 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.012410 Sep 08 10:37:46.087505 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2440/5107] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:46.230134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:46.230773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:46.252831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.266879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.268133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.275438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.277332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.279034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.341527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] HTTP exception thrown: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Request method failure captured: Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 HTTP/1.1 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOELNILFdXXwetg1qLtNPYWapnbPiYgzKI5ouAU87UP18x6pqWOOgsZZ0DFkaORfznPB5jLTzY9pJgoI1uYWbpZR8RNRDFbeZtV8m0Msaz0bUBkWrp6kmglz69klmkc4353VxGe5fBPRlTvW45SIwzogvsBkVRr7Xpyvfv9f58tmPw Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3a73a158fede41208b272a3e9c4d6e47", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 98c97cd324034c9297200125111c3029 Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f9caece1-c0d1-4b20-bb15-9156d669bcd8'} Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:46.353104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.358462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Returning 404 to user: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:46.363814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14709606-653a-40e0-ab38-83e740c08335 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 404 len: 111 microversion: 2.20 time: 0.137375 Sep 08 10:37:46.364699 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2441/5108] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:37:46 2022] DELETE /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:37:46.386875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:46.394412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] [instance: f9caece1-c0d1-4b20-bb15-9156d669bcd8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:46.416066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.434428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.435101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.436014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.436609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.440831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.471524 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] HTTP exception thrown: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Request method failure captured: Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 HTTP/1.1 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcOELNILFdXXwetg1qLtNPYWapnbPiYgzKI5ouAU87UP18x6pqWOOgsZZ0DFkaORfznPB5jLTzY9pJgoI1uYWbpZR8RNRDFbeZtV8m0Msaz0bUBkWrp6kmglz69klmkc4353VxGe5fBPRlTvW45SIwzogvsBkVRr7Xpyvfv9f58tmPw Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/3a73a158fede41208b272a3e9c4d6e47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_3a73a158fede41208b272a3e9c4d6e47", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 3a73a158fede41208b272a3e9c4d6e47 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-816201502 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 98c97cd324034c9297200125111c3029 Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-816201502-project Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f9caece1-c0d1-4b20-bb15-9156d669bcd8'} Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.478473 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. Sep 08 10:37:46.482519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.488667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] Returning 404 to user: Instance f9caece1-c0d1-4b20-bb15-9156d669bcd8 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:46.489720 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dc37ba3a-972c-4a74-96ad-0849a7b42c79 tempest-AttachVolumeShelveTestJSON-816201502 tempest-AttachVolumeShelveTestJSON-816201502-project] 10.222.0.59 "GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8" status: 404 len: 111 microversion: 2.20 time: 0.119051 Sep 08 10:37:46.494377 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2442/5109] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:46 2022] GET /compute/v2.1/servers/f9caece1-c0d1-4b20-bb15-9156d669bcd8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:46.504880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:46.508215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] [instance: 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:46.531747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.533967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.536606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.538019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:46.541186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:46.544639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:46.578790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:46.595223 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] HTTP exception thrown: Instance 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed could not be found. Sep 08 10:37:46.596509 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-678aabb7-c7d5-4bc8-9c77-84f9ec5f734b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.597191 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Request method failure captured: Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed HTTP/1.1 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcXHvA0JMtArLh2LYfkcTEpfvXlxn0wQ4uVLUOh6Y-soxb5qvdSYUuhxwzrloZZfgO95SVRTopydJi4QCJQNVpA93w2ayLnLGhBQuOQ7x-uLIM8xqooBoqexTy6o7pWnYQqrmBpAV16w92hB-cqB3joO3j9v0N4-wAusBYURRHEZIe4 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.57 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 86a4352e884a421aa0c4d6e85dd89669 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerShowV257Test-1230910609 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86a4352e884a421aa0c4d6e85dd89669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/86a4352e884a421aa0c4d6e85dd89669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/86a4352e884a421aa0c4d6e85dd89669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_86a4352e884a421aa0c4d6e85dd89669", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerShowV257Test-1230910609 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 86a4352e884a421aa0c4d6e85dd89669 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerShowV257Test-1230910609 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerShowV257Test-1230910609-project Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 29ce27f4263a4c24aedc2c2ad80620f8 Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerShowV257Test-1230910609-project Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed could not be found. Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '52c14fee-42b4-4a4a-abb7-aa4d36dc25ed'} Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed could not be found. Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed could not be found. Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:37:46.599205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed could not be found. Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:37:46.604403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] Returning 404 to user: Instance 52c14fee-42b4-4a4a-abb7-aa4d36dc25ed could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:37:46.605777 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac9d0ef6-538e-4f8b-8b8b-f69f40d13d1f tempest-ServerShowV257Test-1230910609 tempest-ServerShowV257Test-1230910609-project] 10.222.0.59 "GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed" status: 404 len: 111 microversion: 2.57 time: 0.110295 Sep 08 10:37:46.615770 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2443/5110] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:46 2022] GET /compute/v2.1/servers/52c14fee-42b4-4a4a-abb7-aa4d36dc25ed => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:37:46.617366 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2668/5111] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:45 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:47.106273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:47.107796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:47.125091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:47.131278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:47.134804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:47.148100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:47.149325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:47.151308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:47.628027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:47.629456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:47.652985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:47.674952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:47.681028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:47.684575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:47.700215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:47.712992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:47.733164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:47.750709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:47.752568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:47.754231 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a3eefac-2e81-4482-b25d-4c29276fd232 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.653278 Sep 08 10:37:47.755588 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2444/5112] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:47 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:48.435745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:48.447006 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42b88979-9cbe-43b4-88ee-a16e55f5af75 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.825204 Sep 08 10:37:48.450340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2669/5113] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:47 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:48.785686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:48.786236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:48.801824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:48.802742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:48.803193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:48.812315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:48.812808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:48.813245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:49.479055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:49.480555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:49.492613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:49.498440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:49.500840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:49.504397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:49.506429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:49.507116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:50.523101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.549388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.551325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.552953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d2eb14c-19ba-4a84-b4db-a9aea6115e0b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.771890 Sep 08 10:37:50.555438 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2445/5114] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:48 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:50.572803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2ac35a3e-86cc-4803-b557-15f179cef8e2 req-4875d775-6570-4ab0-b928-c529813f1194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "7f802e01-b8f5-4de2-b080-1ced4f14e689"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:50.593919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2ac35a3e-86cc-4803-b557-15f179cef8e2 req-4875d775-6570-4ab0-b928-c529813f1194 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:50.603568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2ac35a3e-86cc-4803-b557-15f179cef8e2 req-4875d775-6570-4ab0-b928-c529813f1194 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:50.604018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2ac35a3e-86cc-4803-b557-15f179cef8e2 req-4875d775-6570-4ab0-b928-c529813f1194 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:50.675648 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2ac35a3e-86cc-4803-b557-15f179cef8e2 req-4875d775-6570-4ab0-b928-c529813f1194 service nova] Creating event network-vif-plugged:7f802e01-b8f5-4de2-b080-1ced4f14e689 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:50.700210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:50.713230 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2ac35a3e-86cc-4803-b557-15f179cef8e2 req-4875d775-6570-4ab0-b928-c529813f1194 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155938 Sep 08 10:37:50.714388 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2446/5115] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:50.721446 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f9fcc06e-395d-4217-b210-6aa31b093e59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.244317 Sep 08 10:37:50.722212 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2670/5116] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:49 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:51.583423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:51.584816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:51.599031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.603402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.605500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:51.608757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.609434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.610032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:51.744907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:51.745747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:51.756753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.772513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.774448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:51.775643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:51.781227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:51.782763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:53.323326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:53.341549 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51f6087a-44f0-4d59-a7c4-b8f6cbef75d6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.600521 Sep 08 10:37:53.346698 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2671/5117] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:51 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:53.382955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-47044bf6-1282-4e89-8532-a4d46eebadb1 req-3fc3de6c-093f-44d4-88e7-6ee7f1b28a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "5b35b0d3-db83-4920-a2b2-2380f917b7a2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:53.431394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-47044bf6-1282-4e89-8532-a4d46eebadb1 req-3fc3de6c-093f-44d4-88e7-6ee7f1b28a55 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:53.442683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-47044bf6-1282-4e89-8532-a4d46eebadb1 req-3fc3de6c-093f-44d4-88e7-6ee7f1b28a55 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:53.443184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-47044bf6-1282-4e89-8532-a4d46eebadb1 req-3fc3de6c-093f-44d4-88e7-6ee7f1b28a55 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:53.506397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:53.508447 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-47044bf6-1282-4e89-8532-a4d46eebadb1 req-3fc3de6c-093f-44d4-88e7-6ee7f1b28a55 service nova] Creating event network-vif-plugged:5b35b0d3-db83-4920-a2b2-2380f917b7a2 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:53.537901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:53.544912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-47044bf6-1282-4e89-8532-a4d46eebadb1 req-3fc3de6c-093f-44d4-88e7-6ee7f1b28a55 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185182 Sep 08 10:37:53.550533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:53.553239 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2672/5118] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:53.556045 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bad292f3-d2e6-4003-8ff4-4226d0e3d7bb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.977310 Sep 08 10:37:53.563184 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2447/5119] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:51 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:53.578415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1049707780", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04c0b3e9-1a56-4979-8ca2-71d86eb54d89"}], "security_groups": [{"name": "tempest-securitygroup--556775247"}], "key_name": "tempest-keypair-1569896712", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:54.373729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:54.374344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:54.401906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:54.411615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:54.412373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:54.416423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:54.433955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:54.435097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:54.439614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:55.701502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] validate_networks() for [('04c0b3e9-1a56-4979-8ca2-71d86eb54d89', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:37:55.896800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:37:56.996168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:57.014238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96127984-87c5-4811-9d45-3d930192426e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 2.644260 Sep 08 10:37:57.017040 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2448/5120] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:54 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:37:57.030706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:57.031920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:57.074708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:57.075439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:57.076116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:57.077669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:57.078284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:57.078865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:58.338158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:58.360165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:58.365141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:58.369324 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c4d0290-4ead-4052-8bba-d804e0fc0d07 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.351178 Sep 08 10:37:58.372271 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2449/5121] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:57 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:37:58.381382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3"}, {"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "07b04276-05e1-4d43-956b-944bf1031fde"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:37:58.406792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:58.408919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:58.412168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:58.488240 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] Creating event network-vif-plugged:cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:58.489478 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] Creating event network-vif-plugged:07b04276-05e1-4d43-956b-944bf1031fde for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:37:58.508295 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7f769425-1cce-4d7e-aaf7-9b8f3c360b05 req-28fb1e57-83fc-4021-a04d-733986af9e03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.133132 Sep 08 10:37:58.514301 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2450/5122] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:58.534418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-095cf0c8-d003-4285-ad66-5f5c34f6da34 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f23505cce50>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:58.610086 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-095cf0c8-d003-4285-ad66-5f5c34f6da34 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f48b55e7-29c5-4ace-b197-a8d0317f3a56" status: 200 len: 351 microversion: 2.1 time: 0.092042 Sep 08 10:37:58.610944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2451/5123] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:37:58 2022] GET /compute/v2.1/os-volumes/f48b55e7-29c5-4ace-b197-a8d0317f3a56 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:37:58.616138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:58.617915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:58.636422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:58.637122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:58.637936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:58.640033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:58.644021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:58.645241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:59.715064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:37:59.729083 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88d49be0-bd10-4aa2-a669-5de27e5e1a4c tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.116830 Sep 08 10:37:59.733451 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2452/5124] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:37:58 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:37:59.744991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:37:59.753706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:37:59.778935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:59.786970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:59.788667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:59.792856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:59.794721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:59.797915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:59.893535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:37:59.893535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:37:59.893535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:37:59.895094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:37:59.895094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:37:59.943739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:59.948170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:59.950623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:37:59.952270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:37:59.957080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:37:59.973494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:00.041674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:38:00.070599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:38:00.113620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:38:00.120730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:38:00.302437 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1eea5188-1e62-4ca5-8c66-e16f2832fd57 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.738183 Sep 08 10:38:00.304170 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2673/5125] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:37:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 6750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:38:00.319800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d783ec6e-7efe-43b4-a4e5-9546fb8734d6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:00.320812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d783ec6e-7efe-43b4-a4e5-9546fb8734d6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:00.563910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d783ec6e-7efe-43b4-a4e5-9546fb8734d6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.572207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d783ec6e-7efe-43b4-a4e5-9546fb8734d6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1242 microversion: 2.1 time: 0.257641 Sep 08 10:38:00.585139 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2674/5126] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:00 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1242 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:00.627441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.661223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.663200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:00.666728 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a7c4588-939a-4ff1-b9b0-71b61498a1fb tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 0.931898 Sep 08 10:38:00.668019 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2453/5127] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:37:59 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:00.758756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:00.759694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:00.775397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:00.781686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:00.787157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:00.800606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:00.801914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:00.811070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:00.987122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "445a89cf-7bb9-413b-bc07-2c9a3d19d168"}, {"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-plugged", "status": "completed", "tag": "b81e79ba-50d4-4a9b-910e-ff60e991b1a9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:01.037038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:01.037532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:01.037969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:01.102398 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] Creating event network-vif-plugged:445a89cf-7bb9-413b-bc07-2c9a3d19d168 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:38:01.109267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] Creating event network-vif-plugged:b81e79ba-50d4-4a9b-910e-ff60e991b1a9 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:38:01.133859 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0e8be3c0-9fad-4144-97c2-11326af2c650 req-0c6961ba-9832-4c2e-b899-dcb63f295b74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.150478 Sep 08 10:38:01.137696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2454/5128] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:38:01.382768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:01.395237 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8cb5716d-8d23-4f2c-9434-4bbd86ff5621 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.640893 Sep 08 10:38:01.412441 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2675/5129] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:00 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:01.621296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-25989d0f-7444-4a3e-8597-e41ca5dc033c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:01.624606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-25989d0f-7444-4a3e-8597-e41ca5dc033c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:01.707285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:01.707939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:01.737900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:01.742390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:01.745691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:01.752104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:01.752641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:01.756382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:01.883687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:01.968208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-25989d0f-7444-4a3e-8597-e41ca5dc033c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:01.981492 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-25989d0f-7444-4a3e-8597-e41ca5dc033c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1242 microversion: 2.1 time: 0.366105 Sep 08 10:38:01.984073 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2455/5130] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:01 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1242 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:02.421456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:02.422086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:02.446046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:02.446845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:02.451311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:02.456425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:02.460160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:02.460797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:02.919892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:02.963945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:02.971144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:02.972399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-071a1501-ddc2-496e-85fd-dfb5afe8c133 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1876 microversion: 2.32 time: 1.270141 Sep 08 10:38:02.980513 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2676/5131] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:01 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1876 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:38:03.020751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:03.022018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:03.032128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:03.032744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:03.033882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.034830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:03.035538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:03.036547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.151724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:03.174695 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b524780-7cf4-46a9-8805-bfd5a80df901 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.758145 Sep 08 10:38:03.195346 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2456/5132] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:02 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:03.205155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d31bf470-f83a-4fc8-868a-91e0dde8eb99 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f235539ddc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:03.323595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:03.348077 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb7b2918-df72-418b-a8ee-fdf4d74604c5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1294 microversion: 2.1 time: 0.338908 Sep 08 10:38:03.376949 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2677/5133] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:03 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1294 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:03.407168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e02d0c5a-c58a-4c3e-856a-233ad65dcb28 req-71557ce4-22fb-40aa-b27d-e768701d40fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "name": "network-vif-plugged", "status": "completed", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:03.482919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e02d0c5a-c58a-4c3e-856a-233ad65dcb28 req-71557ce4-22fb-40aa-b27d-e768701d40fd service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:03.490365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e02d0c5a-c58a-4c3e-856a-233ad65dcb28 req-71557ce4-22fb-40aa-b27d-e768701d40fd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:03.496183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e02d0c5a-c58a-4c3e-856a-233ad65dcb28 req-71557ce4-22fb-40aa-b27d-e768701d40fd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:03.496362 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d31bf470-f83a-4fc8-868a-91e0dde8eb99 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/2a1bba78-8961-4d37-bdca-d1514b000519" status: 200 len: 350 microversion: 2.1 time: 0.300457 Sep 08 10:38:03.512563 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2457/5134] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:38:03 2022] GET /compute/v2.1/os-volumes/2a1bba78-8961-4d37-bdca-d1514b000519 => generated 350 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:03.588719 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e02d0c5a-c58a-4c3e-856a-233ad65dcb28 req-71557ce4-22fb-40aa-b27d-e768701d40fd service nova] Creating event network-vif-plugged:3711f68e-a7bd-4648-9f34-af0cc36d1f25 for instance ab066901-fa02-4e6f-957c-65bc129387a6 on n-h1-833090-19 Sep 08 10:38:03.625425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e02d0c5a-c58a-4c3e-856a-233ad65dcb28 req-71557ce4-22fb-40aa-b27d-e768701d40fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244783 Sep 08 10:38:03.637142 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2678/5135] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:04.016980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:04.017859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:04.038503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.052540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.059899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:04.060973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.064438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.065096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:04.091232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:04.208808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:04.210749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:04.254816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.255497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.255964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:04.275939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:04.275939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:04.275939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.794159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.806871 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ed10936-aee7-43e9-9f03-5bc724d37a6b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.603902 Sep 08 10:38:05.829413 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2679/5136] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:04 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:05.847125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:05.848505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:05.859160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:05.870826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:05.871718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:05.877162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.878530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:05.879345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:05.880092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:05.936510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.963664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.965606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:05.971246 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe27af46-df81-4347-b26b-e65745502afa tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2827 microversion: 2.32 time: 1.958166 Sep 08 10:38:05.973109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2458/5137] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:04 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2827 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:06.010218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:06.011407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:06.025834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:06.026697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:06.027337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:06.032328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:06.033034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:06.033843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:06.091253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:06.104588 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f62a26dd-c702-4f94-85e8-e3f835ba6374 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1300 microversion: 2.1 time: 0.273610 Sep 08 10:38:06.106374 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2680/5138] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:05 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1300 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:06.500262 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42f780cd-d0b3-4561-9217-dacdcceb5212 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.493670 Sep 08 10:38:06.501216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2459/5139] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:38:06 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6/os-interface => generated 1830 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:06.844934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:06.848915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:06.886127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:06.890522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:06.892523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:06.893716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:06.894762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:06.896411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.134338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:07.135746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:07.147524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:07.150340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:07.155076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.156080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:07.162465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:07.163583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:07.781431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:07.790172 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16830196-be3d-470b-ae31-a2afb5f46431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1300 microversion: 2.1 time: 0.659901 Sep 08 10:38:07.807280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2460/5140] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:07 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1300 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:07.832535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dbb46a10-bb52-426f-8519-5f04240a39c7 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f2350bd0790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:07.946283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dbb46a10-bb52-426f-8519-5f04240a39c7 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/faab5c77-a4bb-4374-aa5a-bc907f70978b" status: 200 len: 350 microversion: 2.1 time: 0.127535 Sep 08 10:38:07.956164 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2461/5141] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:38:07 2022] GET /compute/v2.1/os-volumes/faab5c77-a4bb-4374-aa5a-bc907f70978b => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:07.962938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-52e77690-67f6-4fb5-a349-214ed313acf0 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f23507e6a60>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.106431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-52e77690-67f6-4fb5-a349-214ed313acf0 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.147701 Sep 08 10:38:08.117105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2462/5142] 10.222.0.59 () {58 vars in 1134 bytes} [Thu Sep 8 10:38:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:08.121943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49bea3e9-27fc-4209-8370-0cd7dae9a26f tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f23507134c0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.352873 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49bea3e9-27fc-4209-8370-0cd7dae9a26f tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.234601 Sep 08 10:38:08.353460 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2463/5143] 10.222.0.59 () {58 vars in 1149 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:08.368655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97fa3606-a1ba-47c8-8b00-bd1f078efb69 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f23501eb040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.543867 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97fa3606-a1ba-47c8-8b00-bd1f078efb69 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.178874 Sep 08 10:38:08.544459 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2464/5144] 10.222.0.59 () {58 vars in 1134 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:08.558596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e0fe4f85-22d3-43c9-b2fd-d95708877b44 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f23507e6820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.759737 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e0fe4f85-22d3-43c9-b2fd-d95708877b44 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.204740 Sep 08 10:38:08.760254 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2465/5145] 10.222.0.59 () {58 vars in 1167 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:08.778791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-583488c4-1d9a-4bb9-8df5-930f53da32a0 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f235539d5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.942167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-583488c4-1d9a-4bb9-8df5-930f53da32a0 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.170807 Sep 08 10:38:08.944123 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2466/5146] 10.222.0.59 () {58 vars in 1170 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:08.949650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:08.950441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:08.969846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.975680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.976289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:08.977159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:08.985619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:08.985619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:09.324782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:09.333947 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e2b91916-ce2f-4d6a-b940-7edf492662f2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 2.500508 Sep 08 10:38:09.337716 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2681/5147] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:06 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:09.352555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b13147f0-5ce3-4974-9a44-f988c01d6fe2 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f234bdebaf0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:09.504952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b13147f0-5ce3-4974-9a44-f988c01d6fe2 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164852 Sep 08 10:38:09.505851 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2682/5148] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:38:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:09.520038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a9cb9804-0ea0-4997-bc54-b412d6c10855 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f234bda3af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:09.709527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a9cb9804-0ea0-4997-bc54-b412d6c10855 tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.193334 Sep 08 10:38:09.712356 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2683/5149] 10.222.0.59 () {58 vars in 1188 bytes} [Thu Sep 8 10:38:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:38:09.726772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-029db650-2d6d-471b-9c8f-4435199b953e tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] Calling method '.version_select at 0x7f234bda3d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:09.902677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-029db650-2d6d-471b-9c8f-4435199b953e tempest-VolumesTestJSON-181054334 tempest-VolumesTestJSON-181054334-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.179828 Sep 08 10:38:09.903271 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2684/5150] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:38:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:10.370297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:10.371108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:10.386738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:10.397612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:10.402012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:10.408067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:10.413966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:10.414650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:10.415078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:10.467516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:10.483706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5e71c150-8b02-4708-aa2e-a3f228426729 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 1.535725 Sep 08 10:38:10.511980 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2467/5151] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:08 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:10.571737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:11.515345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:11.522190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:11.525390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:11.546077 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6fc9474-833f-466f-be42-999b2d511044 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.174745 Sep 08 10:38:11.547243 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2685/5152] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:10 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:11.562107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:11.565768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:11.569395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:11.573164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:11.576599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:11.578616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:11.977440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:12.324219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:12.339579 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6055f0ed-3b11-4524-b0ce-5fd525534659 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.830832 Sep 08 10:38:12.351560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2468/5153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:11 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:12.470105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-28592bfe-69b4-4b54-aaa3-6f83a5543f37 req-d8a85167-a9c1-437e-ba00-b359eafff968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "tag": "cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:12.555553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28592bfe-69b4-4b54-aaa3-6f83a5543f37 req-d8a85167-a9c1-437e-ba00-b359eafff968 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:12.557634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28592bfe-69b4-4b54-aaa3-6f83a5543f37 req-d8a85167-a9c1-437e-ba00-b359eafff968 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:12.560037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28592bfe-69b4-4b54-aaa3-6f83a5543f37 req-d8a85167-a9c1-437e-ba00-b359eafff968 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:12.584028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:12.585266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:12.605495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:12.606052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:12.606544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:12.614877 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-28592bfe-69b4-4b54-aaa3-6f83a5543f37 req-d8a85167-a9c1-437e-ba00-b359eafff968 service nova] Creating event network-changed:cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:38:12.618988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:12.619679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:12.620159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:12.646371 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-28592bfe-69b4-4b54-aaa3-6f83a5543f37 req-d8a85167-a9c1-437e-ba00-b359eafff968 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191941 Sep 08 10:38:12.647011 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2686/5154] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:13.370662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:13.371592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:13.389121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:13.394253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:13.396132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:13.399371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:13.401296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:13.406280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:14.166418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:14.196529 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31703522-5f3f-495f-b0a6-034c8e6c965e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.617878 Sep 08 10:38:14.200516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2469/5155] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:12 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:14.726184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:14.750352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-81b86d51-1973-49fc-b107-6da2a7038383 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 1.381641 Sep 08 10:38:14.769842 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2687/5156] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:13 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:15.133188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3b7cdbd6-d7bb-4d72-a272-041eb1e5b4cb req-0ba5ece8-393b-46ed-8afc-2bf7b4a1f4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71958974-984d-4158-830e-13745e965da1", "tag": "a63713b9-c171-4740-98ee-90fd72ce0abf"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:15.161540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3b7cdbd6-d7bb-4d72-a272-041eb1e5b4cb req-0ba5ece8-393b-46ed-8afc-2bf7b4a1f4b9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.162282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3b7cdbd6-d7bb-4d72-a272-041eb1e5b4cb req-0ba5ece8-393b-46ed-8afc-2bf7b4a1f4b9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.164342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3b7cdbd6-d7bb-4d72-a272-041eb1e5b4cb req-0ba5ece8-393b-46ed-8afc-2bf7b4a1f4b9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.204400 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3b7cdbd6-d7bb-4d72-a272-041eb1e5b4cb req-0ba5ece8-393b-46ed-8afc-2bf7b4a1f4b9 service nova] Creating event network-changed:a63713b9-c171-4740-98ee-90fd72ce0abf for instance 71958974-984d-4158-830e-13745e965da1 on n-h2-833090-19 Sep 08 10:38:15.221301 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3b7cdbd6-d7bb-4d72-a272-041eb1e5b4cb req-0ba5ece8-393b-46ed-8afc-2bf7b4a1f4b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090879 Sep 08 10:38:15.224071 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2470/5157] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:15.226066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:15.226885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:15.246231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.254366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.254366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.254366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.269154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.274397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.783925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:15.785079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:15.802942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.803454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.803924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:15.804645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:15.805101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:15.805523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:16.312400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:16.335530 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6732b475-85e0-4d40-b03e-c088a329cabe tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 1.102657 Sep 08 10:38:16.336969 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2688/5158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:15 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:16.614354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:16.629115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08641d3c-6438-491e-bc43-3b3f320099b3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.849200 Sep 08 10:38:16.646131 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2471/5159] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:15 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:17.365164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:17.366065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:17.374713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.375524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.377140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.378426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.379268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.380075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.650117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:17.661916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:17.663439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:17.680561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a082933-0b3c-42cb-99e2-fe6bccaddc96 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.317028 Sep 08 10:38:17.681674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.698584 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2689/5160] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:17 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:17.699093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.699739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:17.701234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:17.701714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:17.702145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.067272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:18.076589 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55bcd2c7-ef04-415a-a405-2da473ef9b51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.423094 Sep 08 10:38:18.077597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2472/5161] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:17 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:18.722973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:18.724094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:18.748166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.748676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.749135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:18.758813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:18.759487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:18.765043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.115349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:19.118627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:19.137647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.143198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.144377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.145370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:19.147247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:19.147736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:19.241137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.253647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5d52113-3603-4a29-8be6-e49b688e4bdd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.544796 Sep 08 10:38:19.259604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2690/5162] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:18 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:19.701739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:19.722232 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f4501df0-2356-4c01-b134-82addd718fb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.615014 Sep 08 10:38:19.737231 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2473/5163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:19 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:20.285926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:20.287645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:20.306865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.310294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.311821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.313921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.319262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.320231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.744509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:20.754936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:20.756353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:20.769943 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-772b5dd0-4584-41ed-9c23-a3cd96dd792a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.488802 Sep 08 10:38:20.771955 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2691/5164] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:20 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:20.774705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.775440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.776074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:20.776956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:20.780073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:20.780705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.080749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:21.090482 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f467c3a8-63f0-44b9-b67a-2c171d7c8d8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.339997 Sep 08 10:38:21.092691 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2474/5165] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:20 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:21.802518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:21.803150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:21.826077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.832901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.834093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:21.842913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:21.844526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:21.847570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.120409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:22.121446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:22.141556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.142065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.147057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.148854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:22.149350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:22.149852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:22.178646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:22.193623 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc14ebd5-1dd6-4fc0-a8db-c3c1b191a37b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1528 microversion: 2.1 time: 0.393751 Sep 08 10:38:22.195275 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2692/5166] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:21 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:22.501811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:22.517940 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98a8ac42-ee3d-412e-b94a-9d87c049fd6a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.402256 Sep 08 10:38:22.535651 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2475/5167] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:22 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:23.225323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:23.226529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:23.253753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.254254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.266789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.272163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.273483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.277236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.542882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:23.543519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:23.557451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.571381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.573525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.576311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.588146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.590166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.665821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:23.683638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecb0f13a-c7a1-4a35-864f-0bd2fa1b79b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1510 microversion: 2.1 time: 0.461655 Sep 08 10:38:23.685346 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2693/5168] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:23 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:23.769939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c0333694-406b-4f74-add3-1933d0cf97a6 req-dff2b544-8cc0-4cc3-94cd-90c4f6604f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71958974-984d-4158-830e-13745e965da1", "name": "network-vif-plugged", "status": "completed", "tag": "a63713b9-c171-4740-98ee-90fd72ce0abf"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:23.801417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0333694-406b-4f74-add3-1933d0cf97a6 req-dff2b544-8cc0-4cc3-94cd-90c4f6604f99 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:23.802932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0333694-406b-4f74-add3-1933d0cf97a6 req-dff2b544-8cc0-4cc3-94cd-90c4f6604f99 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:23.803384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0333694-406b-4f74-add3-1933d0cf97a6 req-dff2b544-8cc0-4cc3-94cd-90c4f6604f99 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:23.853746 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c0333694-406b-4f74-add3-1933d0cf97a6 req-dff2b544-8cc0-4cc3-94cd-90c4f6604f99 service nova] Creating event network-vif-plugged:a63713b9-c171-4740-98ee-90fd72ce0abf for instance 71958974-984d-4158-830e-13745e965da1 on n-h2-833090-19 Sep 08 10:38:23.867559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c0333694-406b-4f74-add3-1933d0cf97a6 req-dff2b544-8cc0-4cc3-94cd-90c4f6604f99 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104992 Sep 08 10:38:23.868225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2694/5169] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:23.994387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:24.004586 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ee3c89a-51bf-45f1-b282-7ada513c10db tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.465500 Sep 08 10:38:24.010884 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2476/5170] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:23 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:24.723452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:24.725040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:24.772441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.774858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.780734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.783400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:24.785212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:24.786432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:24.997079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:25.005052 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab3c7f60-c494-47d5-b880-9f1585a32139 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1510 microversion: 2.1 time: 0.301065 Sep 08 10:38:25.005889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2695/5171] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:24 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:25.037808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:25.039057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:25.048595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=44 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:25.053226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:25.056186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:25.057004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:25.058371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:25.067518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:25.068213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:25.305918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:25.322962 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd5718ad-ee3c-408f-ae97-6527c85653b5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1367 microversion: 2.1 time: 0.289089 Sep 08 10:38:25.326839 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2477/5172] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:25 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:26.031165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:26.032971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:26.043602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.045025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.045870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.046823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.047793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.048831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.245330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:26.255956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b13dab9-cc6c-495c-b658-dd46dc2a0718 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1510 microversion: 2.1 time: 0.230298 Sep 08 10:38:26.267490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2696/5173] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:26 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:26.354985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:26.357565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:26.370739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.373139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.374457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.375816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.376967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.377812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.739437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:26.756306 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-907a4ea8-a377-4950-a541-500a3af50632 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1556 microversion: 2.1 time: 0.405896 Sep 08 10:38:26.758108 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2478/5174] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:26 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1556 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:26.781022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:26.781534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:26.789472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.790459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.790974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.791777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:26.792401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:26.792861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:26.946294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af92ab97-afd6-442a-9d6b-91e2851dbc39 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169606 Sep 08 10:38:26.946908 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2697/5175] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:38:26 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:27.282031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:27.284081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:27.300247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.301980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.306599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.308662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.312980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.314415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.526245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-56b5c828-2d3e-4c69-ba56-fe42e8903183 req-c50eb5ab-bd76-42d8-ae7f-ff7354069548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "name": "network-vif-unplugged", "status": "completed", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:27.615558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-56b5c828-2d3e-4c69-ba56-fe42e8903183 req-c50eb5ab-bd76-42d8-ae7f-ff7354069548 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.625247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-56b5c828-2d3e-4c69-ba56-fe42e8903183 req-c50eb5ab-bd76-42d8-ae7f-ff7354069548 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.626219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-56b5c828-2d3e-4c69-ba56-fe42e8903183 req-c50eb5ab-bd76-42d8-ae7f-ff7354069548 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.653744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:27.675915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.server_external_events [req-56b5c828-2d3e-4c69-ba56-fe42e8903183 req-c50eb5ab-bd76-42d8-ae7f-ff7354069548 service nova] Unable to find a host for instance ab066901-fa02-4e6f-957c-65bc129387a6. Dropping event network-vif-unplugged {{(pid=122457) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 10:38:27.682839 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-56b5c828-2d3e-4c69-ba56-fe42e8903183 req-c50eb5ab-bd76-42d8-ae7f-ff7354069548 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.159053 Sep 08 10:38:27.686149 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2698/5176] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 166 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 10:38:27.869684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:27.884899 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffedf0a3-a702-4f66-a59a-bc53c0c3a648 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1513 microversion: 2.1 time: 0.607324 Sep 08 10:38:27.887195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2479/5177] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:27 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1513 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:27.941096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:27.942028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:27.955857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.956997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.958139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:27.959743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:27.960737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:27.961332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.334355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:28.342902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-348e0250-bf00-4b34-b2b9-5408b0554797 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1453 microversion: 2.1 time: 0.428849 Sep 08 10:38:28.346984 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2699/5178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:27 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1453 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:28.511706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:28.512808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:28.532582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.534947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.536217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.540824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.541843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.543502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.612968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lazy-loading 'flavor' on Instance uuid ab066901-fa02-4e6f-957c-65bc129387a6 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:38:28.631299 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'shelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state shelved_offloaded Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 14 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: {"shelve": {}} Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'shelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state shelved_offloaded Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'shelve': {}}} Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:38:28.633480 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state shelved_offloaded Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state shelved_offloaded Sep 08 10:38:28.638072 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:38:28.642017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'shelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state shelved_offloaded {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:38:28.646422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d7c3a1b-756e-4cd5-b4ad-7c0cfa8c3a59 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 155 microversion: 2.1 time: 0.139719 Sep 08 10:38:28.648932 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2480/5179] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:38:28 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 155 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:38:28.657156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:28.657815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:28.673482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.674063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.674524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.675349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:28.675805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:28.676235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:28.784539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122457) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 10:38:28.986974 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a578dac7-f058-4e56-9a8e-b61f17ad1560 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 202 len: 0 microversion: 2.1 time: 0.334134 Sep 08 10:38:28.987943 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2700/5180] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:38:28 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:38:28.997662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:28.998618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:29.011394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.013538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.014712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.017276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:29.018229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:29.021567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:29.915486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:29.919397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:29.933631 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8141b817-7bb8-4d67-8b79-79195ad2ee8d tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1461 microversion: 2.1 time: 0.940720 Sep 08 10:38:29.940664 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2481/5181] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:28 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1461 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:30.240822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e68eaa57-40a6-4b1c-b0f8-b7e15be0953f req-42c71f03-86ac-469d-89ff-658b478e94b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71958974-984d-4158-830e-13745e965da1", "tag": "a63713b9-c171-4740-98ee-90fd72ce0abf"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:30.254234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e68eaa57-40a6-4b1c-b0f8-b7e15be0953f req-42c71f03-86ac-469d-89ff-658b478e94b6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.255061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e68eaa57-40a6-4b1c-b0f8-b7e15be0953f req-42c71f03-86ac-469d-89ff-658b478e94b6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.255887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e68eaa57-40a6-4b1c-b0f8-b7e15be0953f req-42c71f03-86ac-469d-89ff-658b478e94b6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.272230 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e68eaa57-40a6-4b1c-b0f8-b7e15be0953f req-42c71f03-86ac-469d-89ff-658b478e94b6 service nova] Creating event network-changed:a63713b9-c171-4740-98ee-90fd72ce0abf for instance 71958974-984d-4158-830e-13745e965da1 on n-h2-833090-19 Sep 08 10:38:30.280373 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e68eaa57-40a6-4b1c-b0f8-b7e15be0953f req-42c71f03-86ac-469d-89ff-658b478e94b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044241 Sep 08 10:38:30.286318 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2701/5182] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:30.967363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:30.968069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:30.988556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.989147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.989666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:30.990475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:30.991026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:30.991517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:31.289009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:31.305219 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34aa89f8-88bb-4ca4-a816-b8b4497cd996 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.342820 Sep 08 10:38:31.308907 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2482/5183] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:30 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:32.339242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:32.341217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:32.361805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.362641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.363269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.365420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.366344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.366964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.634594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:32.643942 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6df8b2ff-b024-4fc8-85f3-c3d1848a0a24 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.309289 Sep 08 10:38:32.644540 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2702/5184] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:32 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:32.823092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a457fd58-ca92-499b-b7bf-d24594b4e025 req-f753a794-94ed-4b8c-b991-8c5aeae14f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:32.846176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a457fd58-ca92-499b-b7bf-d24594b4e025 req-f753a794-94ed-4b8c-b991-8c5aeae14f8d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:32.846662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a457fd58-ca92-499b-b7bf-d24594b4e025 req-f753a794-94ed-4b8c-b991-8c5aeae14f8d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:32.847094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a457fd58-ca92-499b-b7bf-d24594b4e025 req-f753a794-94ed-4b8c-b991-8c5aeae14f8d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:32.883780 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a457fd58-ca92-499b-b7bf-d24594b4e025 req-f753a794-94ed-4b8c-b991-8c5aeae14f8d service nova] Creating event network-changed:3711f68e-a7bd-4648-9f34-af0cc36d1f25 for instance ab066901-fa02-4e6f-957c-65bc129387a6 on n-h2-833090-19 Sep 08 10:38:32.916985 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a457fd58-ca92-499b-b7bf-d24594b4e025 req-f753a794-94ed-4b8c-b991-8c5aeae14f8d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100835 Sep 08 10:38:32.917963 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2483/5185] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:33.670255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:33.671454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:33.681730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.682564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.682989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.684794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:33.685998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:33.686802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:33.885452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:33.899024 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cdbcef2b-447a-49fb-b28f-5e17fcf4af7f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.234091 Sep 08 10:38:33.901018 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2703/5186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:33 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:34.925570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:34.927206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:34.937441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.938151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.939338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:34.941633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:34.943728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:34.944857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:35.718723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:35.753486 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80944a0a-bd12-40e4-9b4f-f4141a31240e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.827718 Sep 08 10:38:35.754122 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2484/5187] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:34 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:36.784142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:36.784961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:36.790343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:36.822224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.823052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.827742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:36.834172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:36.835030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:36.837258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:37.408375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:37.438681 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-340b235f-b4cc-4027-8b83-8e13d90f2f3e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.662264 Sep 08 10:38:37.459834 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2704/5188] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:36 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:38.466882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:38.467670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:38.487638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.488316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.488780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.489523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:38.489999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:38.495212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:38.935695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:38.958065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c6aca760-6756-4392-99b0-aa3daa92cebf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.495522 Sep 08 10:38:38.975173 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2485/5189] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:38 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:39.983728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:39.985304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:40.000071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.003308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.006853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:40.010292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:40.012647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:40.014236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:41.249916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:41.263952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e54495a1-3448-48c1-8963-c715236ab11a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 1.283130 Sep 08 10:38:41.283412 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2705/5190] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:39 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:42.300951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:42.304386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:42.324626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.327220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.328078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.332986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:42.333907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:42.334577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:42.720613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:42.720613 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c668342-62fc-4706-ae7f-ccfd2361d316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.398959 Sep 08 10:38:42.720613 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2486/5191] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:42 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:43.746404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:43.746404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:43.765933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.766796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.768634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:43.771477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:43.773449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:43.784010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:44.170331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:44.185058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f7c461e4-0a22-4716-ae8d-f950db981989 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.445812 Sep 08 10:38:44.202650 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2706/5192] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:43 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:45.207871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:45.208482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:45.223551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:45.224922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:45.227240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:45.228979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:45.232369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:45.234113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:45.633561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:45.657258 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7cb43d3-4056-4d2e-81ce-bd0cb7043964 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.453046 Sep 08 10:38:45.658478 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2487/5193] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:45 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:46.686763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:46.688159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:46.708579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.711086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.713633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:46.714569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:46.715514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:46.719788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:47.138966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:47.155032 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-936d6f33-50c9-44c3-b0a9-a2c00ad4ac9f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.470606 Sep 08 10:38:47.156453 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2707/5194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:46 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:48.184687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:48.186432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:48.207815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.208586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.209932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.211743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:48.212914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:48.215091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:48.532723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:48.543797 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7a7036f-e132-4f32-86f7-b2d5fa561a54 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.366327 Sep 08 10:38:48.545212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2488/5195] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:48 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:49.571902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:49.572592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:49.582234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.583002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.583741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.584708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:49.585417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:49.586694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:49.857128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:49.868717 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1dc9810e-a331-473e-826e-bf3b86f9a327 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.299817 Sep 08 10:38:49.885539 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2708/5196] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:49 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:50.897316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:50.898250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:50.911750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:50.912609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:50.913550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:50.914787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:50.916042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:50.917330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:51.141524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:51.155990 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6857c73b-69d6-42ff-a8e1-ac3046857d90 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.264717 Sep 08 10:38:51.157806 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2489/5197] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:50 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:52.184514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:52.185184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:52.197690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:52.198776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:52.199308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:52.200102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:52.200602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:52.201045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:52.458651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:52.478196 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-889c4146-5788-4f8c-ad7e-e64e899ba9b8 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.298688 Sep 08 10:38:52.484116 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2709/5198] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:52 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:38:53.049152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:53.050126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:53.063994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.064774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.065392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.066443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.067831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.068316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.511207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:53.512000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:53.527369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.539141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.539838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.540393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:53.542665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.544185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.544665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.558529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:53.564849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:53.568658 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63f9f159-7baa-45e1-aa95-688371bb3c1f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2946 microversion: 2.32 time: 0.522168 Sep 08 10:38:53.592965 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2490/5199] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:38:53 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2946 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:53.608230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:53.609610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:53.657320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.661348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.661831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:53.664062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:53.667435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:53.672571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:54.085740 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d69eb284-01db-418d-8ff3-7e384d0fe55d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.486278 Sep 08 10:38:54.096368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2491/5200] 10.222.0.59 () {60 vars in 1316 bytes} [Thu Sep 8 10:38:53 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6/os-interface => generated 1830 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:38:54.166077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:54.201792 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e73c2214-391f-4d81-96f7-9ed069ddf029 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.695107 Sep 08 10:38:54.206066 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2710/5201] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:53 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:55.233440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:55.234221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:55.243441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=30 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:55.253238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.254111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.254809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.255884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:55.256591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:55.257416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:55.502182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:55.514787 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f236992a-317a-4cf1-95f9-9e705a7b6410 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.286561 Sep 08 10:38:55.516224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2492/5202] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:55 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:56.542944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:56.543940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:56.559770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.560985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.561649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.565565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:56.568480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:56.569182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:56.858070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:56.874820 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9d6b42f-dfcd-4f7e-9fe2-74f137aff55a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.336691 Sep 08 10:38:56.877843 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2711/5203] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:56 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:57.914927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:57.920098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:57.948687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.952228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.952804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:57.954746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:57.957652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:57.958830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:58.409404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c1ab4c94-ea08-44c3-a80b-987072a9eff0 req-b692087c-0f21-4e60-ac8f-d110299b7017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "name": "network-vif-plugged", "status": "completed", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:38:58.440255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c1ab4c94-ea08-44c3-a80b-987072a9eff0 req-b692087c-0f21-4e60-ac8f-d110299b7017 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:58.441102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c1ab4c94-ea08-44c3-a80b-987072a9eff0 req-b692087c-0f21-4e60-ac8f-d110299b7017 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:58.445572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c1ab4c94-ea08-44c3-a80b-987072a9eff0 req-b692087c-0f21-4e60-ac8f-d110299b7017 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:58.476182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:38:58.527901 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c1ab4c94-ea08-44c3-a80b-987072a9eff0 req-b692087c-0f21-4e60-ac8f-d110299b7017 service nova] Creating event network-vif-plugged:3711f68e-a7bd-4648-9f34-af0cc36d1f25 for instance ab066901-fa02-4e6f-957c-65bc129387a6 on n-h2-833090-19 Sep 08 10:38:58.546855 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c1ab4c94-ea08-44c3-a80b-987072a9eff0 req-b692087c-0f21-4e60-ac8f-d110299b7017 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144013 Sep 08 10:38:58.552231 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2712/5204] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:38:58.579309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:58.591351 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f80503f-7cc4-43af-9930-fb5380c57ead tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.690767 Sep 08 10:38:58.593218 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2493/5205] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:57 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:38:59.629533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:38:59.630236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:38:59.643350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.649676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.651528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.653113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:38:59.653609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:38:59.656548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:38:59.905223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:38:59.915131 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aacc85c2-b914-4ca2-9179-de90ccc2270f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.298377 Sep 08 10:38:59.916341 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2713/5206] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:38:59 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:00.944336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:00.945597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:00.954019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:00.954914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:00.956388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:00.958103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:00.958827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:00.959640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:00.983114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=70 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:01.152763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:01.164290 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8535c8da-5776-4ec9-b3b3-c6f385dd3316 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.224166 Sep 08 10:39:01.167147 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2494/5207] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:00 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:02.196920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:02.198189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:02.215067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.217729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.220216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.221226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:02.221894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:02.230972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:02.580680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:02.590508 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ebd898c-6cc1-4618-9833-ca0894246aac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1519 microversion: 2.1 time: 0.403486 Sep 08 10:39:02.591046 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2714/5208] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:02 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:03.615322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.617432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:03.631167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.631861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.632485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.633519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.634150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.634921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.834566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:03.845273 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-705af514-a6ba-4940-8d9b-73021c6c4955 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.235412 Sep 08 10:39:03.845837 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2495/5209] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:03 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:03.876107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:03.877568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:03.886149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.886714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.887233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:03.888048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:03.888572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:03.889082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.142613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.156086 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d9bf9e0d-26db-416d-8acd-7630d11a3438 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.282719 Sep 08 10:39:04.171994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2715/5210] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:03 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:04.188442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:04.189757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:04.196189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.197129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.197746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.198959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.199634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.200261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.497712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.539446 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e2633f8-30c2-4b27-b315-2a3f9bb19fca tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.357615 Sep 08 10:39:04.540918 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2496/5211] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:04 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:04.568210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54fd738a-87b6-4d87-b66d-2354300cddc0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:04.579698 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-54fd738a-87b6-4d87-b66d-2354300cddc0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance e2f9d082-1140-4f7a-923d-a5399efbc8ca has no mapping to a cell. Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54fd738a-87b6-4d87-b66d-2354300cddc0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/e2f9d082-1140-4f7a-923d-a5399efbc8ca/action HTTP/1.1 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 15 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: {"os-stop": {}} Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance e2f9d082-1140-4f7a-923d-a5399efbc8ca has no mapping to a cell. Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'e2f9d082-1140-4f7a-923d-a5399efbc8ca', 'body': {'os-stop': {}}} Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e2f9d082-1140-4f7a-923d-a5399efbc8ca has no mapping to a cell. Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:04.613313 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f9d082-1140-4f7a-923d-a5399efbc8ca has no mapping to a cell. Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f9d082-1140-4f7a-923d-a5399efbc8ca has no mapping to a cell. Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54fd738a-87b6-4d87-b66d-2354300cddc0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance e2f9d082-1140-4f7a-923d-a5399efbc8ca has no mapping to a cell. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54fd738a-87b6-4d87-b66d-2354300cddc0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/e2f9d082-1140-4f7a-923d-a5399efbc8ca/action" status: 404 len: 117 microversion: 2.1 time: 0.052015 Sep 08 10:39:04.620010 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2716/5212] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:04 2022] POST /compute/v2.1/servers/e2f9d082-1140-4f7a-923d-a5399efbc8ca/action => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:04.629631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:04.631211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:04.642626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.644012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.644986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.645921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.647154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.647832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.888306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:04.899064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a78f3577-646f-4742-8402-539929e5d44b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.273648 Sep 08 10:39:04.916492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2497/5213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:04 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:04.926282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:04.927512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:04.939928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.975768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.976477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:04.984528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:04.985342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:04.986692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.185761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:05.195675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2404aaaa-607b-4f16-989f-a42770ed9b50 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.273876 Sep 08 10:39:05.196274 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2717/5214] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:04 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:05.222838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d4a6815-ec40-4ed5-bcc2-d612362d39a7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:05.223576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d4a6815-ec40-4ed5-bcc2-d612362d39a7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 873861e8-4d77-4d86-aeb2-81fb9d5172c9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.230214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1d4a6815-ec40-4ed5-bcc2-d612362d39a7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 873861e8-4d77-4d86-aeb2-81fb9d5172c9 could not be found. Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d4a6815-ec40-4ed5-bcc2-d612362d39a7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/873861e8-4d77-4d86-aeb2-81fb9d5172c9/action HTTP/1.1 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: {"suspend": {}} Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 873861e8-4d77-4d86-aeb2-81fb9d5172c9 could not be found. Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '873861e8-4d77-4d86-aeb2-81fb9d5172c9', 'body': {'suspend': {}}} Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873861e8-4d77-4d86-aeb2-81fb9d5172c9 could not be found. Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873861e8-4d77-4d86-aeb2-81fb9d5172c9 could not be found. Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:05.232156 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873861e8-4d77-4d86-aeb2-81fb9d5172c9 could not be found. Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d4a6815-ec40-4ed5-bcc2-d612362d39a7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 873861e8-4d77-4d86-aeb2-81fb9d5172c9 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d4a6815-ec40-4ed5-bcc2-d612362d39a7 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/873861e8-4d77-4d86-aeb2-81fb9d5172c9/action" status: 404 len: 111 microversion: 2.1 time: 0.016953 Sep 08 10:39:05.237213 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2498/5215] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:05 2022] POST /compute/v2.1/servers/873861e8-4d77-4d86-aeb2-81fb9d5172c9/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:05.246133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:05.246873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.253630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.254130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.254570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.255421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.256589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.257224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.435673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:05.446581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9aa87528-be04-471c-9936-c2eb2aa94bda tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.205405 Sep 08 10:39:05.447253 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2718/5216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:05 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:05.470859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:05.471911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.480856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.481467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.482083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.483013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.484064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.484503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.752852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:05.766101 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e32ec57-64d6-4762-b929-71ae13ad2dd0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.299170 Sep 08 10:39:05.789018 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2499/5217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:05 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:05.799267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:05.799826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.815957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.816714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.817154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.817858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.818312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.818782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.847071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lazy-loading 'flavor' on Instance uuid ab066901-fa02-4e6f-957c-65bc129387a6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:39:05.954388 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f6c6da4-92e5-4d6d-89ef-391be76ebcd9 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 202 len: 0 microversion: 2.1 time: 0.158864 Sep 08 10:39:05.981479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:05.982410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:05.987878 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2719/5218] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:05 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:05.993373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.995057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.995966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:05.997057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:05.997672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:05.998363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:06.183891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:06.192805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59610c87-b746-4a61-aa18-7d94c0a70f5b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1514 microversion: 2.1 time: 0.232046 Sep 08 10:39:06.194041 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2500/5219] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:05 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.222427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.225469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.257062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=32 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:07.262319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.265390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.266192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.267876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.272480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.273634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.487201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:07.496971 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-166d02db-181a-406d-9100-2bbf6aa000bf tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1497 microversion: 2.1 time: 0.282277 Sep 08 10:39:07.497409 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2720/5220] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:07.521410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:07.522120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.530912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.531414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.531896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.532661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.533121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.533550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.597125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lazy-loading 'flavor' on Instance uuid ab066901-fa02-4e6f-957c-65bc129387a6 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:39:07.618226 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'suspend' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state suspended Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: {"suspend": {}} Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: exception: Cannot 'suspend' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state suspended Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'suspend': {}}} Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 08 10:39:07.620304 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state suspended Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state suspended Sep 08 10:39:07.627015 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:07.631697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'suspend' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state suspended {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:07.633197 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b870ccc7-9b5f-46c8-9cb8-c3b50489f2bd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 148 microversion: 2.1 time: 0.116369 Sep 08 10:39:07.635059 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2501/5221] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:07 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 148 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:39:07.642953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:07.645609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.657352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.657848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.659426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.660213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.660667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.664105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.781008 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-203c918d-dbe9-4dd0-a4c7-92d43f0a7ab4 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 202 len: 0 microversion: 2.1 time: 0.141501 Sep 08 10:39:07.784684 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2721/5222] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:07 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:07.794391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:07.795320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:07.806553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.807811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.808488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:07.812839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:07.813670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:07.814517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:08.543959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:08.554654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ca189d7-1c62-49b7-ba7b-8cde338b4a99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1503 microversion: 2.1 time: 0.768516 Sep 08 10:39:08.559498 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2502/5223] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:07 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1503 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:09.579315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:09.580263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:09.593326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.594788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.595231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.595990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:09.596465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:09.596885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:09.964698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:09.981904 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afd1e85f-a51b-4258-b604-2f5092c35345 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1503 microversion: 2.1 time: 0.398544 Sep 08 10:39:09.984007 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2722/5224] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:09 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:11.007807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:11.008426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:11.018678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.019169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.019970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.022901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.024914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.028614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.631147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.640220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e5e54f56-67c1-46a7-85f6-23b3dcc17048 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.636796 Sep 08 10:39:11.642562 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2503/5225] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:11.670223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:11.671563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:11.682148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.688393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.688846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.689570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:11.690024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:11.690479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:11.907146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:11.918960 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c176572-312e-49d4-8ae8-4fee4d5bf856 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.253858 Sep 08 10:39:11.919819 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2723/5226] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:11.948932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8d75660d-f646-4275-92b1-973f3b17efeb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:11.949715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8d75660d-f646-4275-92b1-973f3b17efeb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: b3093eca-f61e-4db4-a3dc-ac0e6fb17060] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:11.960005 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8d75660d-f646-4275-92b1-973f3b17efeb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance b3093eca-f61e-4db4-a3dc-ac0e6fb17060 could not be found. Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8d75660d-f646-4275-92b1-973f3b17efeb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/b3093eca-f61e-4db4-a3dc-ac0e6fb17060/action HTTP/1.1 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: {"unpause": {}} Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b3093eca-f61e-4db4-a3dc-ac0e6fb17060 could not be found. Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b3093eca-f61e-4db4-a3dc-ac0e6fb17060', 'body': {'unpause': {}}} Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3093eca-f61e-4db4-a3dc-ac0e6fb17060 could not be found. Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3093eca-f61e-4db4-a3dc-ac0e6fb17060 could not be found. Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:11.963973 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:11.970472 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:11.970472 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:11.970472 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3093eca-f61e-4db4-a3dc-ac0e6fb17060 could not be found. Sep 08 10:39:11.970472 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:11.974615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8d75660d-f646-4275-92b1-973f3b17efeb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance b3093eca-f61e-4db4-a3dc-ac0e6fb17060 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:11.976408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8d75660d-f646-4275-92b1-973f3b17efeb tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/b3093eca-f61e-4db4-a3dc-ac0e6fb17060/action" status: 404 len: 111 microversion: 2.1 time: 0.034536 Sep 08 10:39:11.978009 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2504/5227] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:11 2022] POST /compute/v2.1/servers/b3093eca-f61e-4db4-a3dc-ac0e6fb17060/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:12.001606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.002659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:12.011727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.012428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.013058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.013945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.014396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.014823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.249192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:12.261868 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-012fe639-d56c-422c-bd50-f86c3c623dc2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.277845 Sep 08 10:39:12.263357 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2724/5228] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:11 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:12.292484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.293107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:12.322942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.322942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.322942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.322942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.325457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.325457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.678944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:12.691229 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16155837-223c-40f0-b9c2-50c69bf699d0 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.407688 Sep 08 10:39:12.692421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2505/5229] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:12 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:12.720168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:12.721274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:12.740406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.742072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.742749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.743869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.745099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.745754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.779234 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'unpause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 15 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: {"unpause": {}} Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot 'unpause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'unpause': {}}} Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state active. Cannot unpause while the instance is in this state. Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:12.781239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'unpause' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c42629b7-4025-4799-8848-bae1a4ca714b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 145 microversion: 2.1 time: 0.072258 Sep 08 10:39:12.786932 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2725/5230] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:12 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 145 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:39:12.794046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:12.795005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:12.804885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.806193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.806743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:12.807568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:12.808715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:12.809475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.021281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.030944 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-383dfab2-91ac-46a6-b9a6-467e319fa749 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.242310 Sep 08 10:39:13.035708 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2506/5231] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:12 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:13.055816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.056900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.063035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.063543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.064308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.065377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.065996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.066767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.288358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.304682 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5fea45c-d261-4578-a382-e17148e687d2 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.253269 Sep 08 10:39:13.320455 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2726/5232] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.329767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2fca0ed-b96a-4fe4-8591-9d838c9aceee tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:13.331212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2fca0ed-b96a-4fe4-8591-9d838c9aceee tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 0c060cdc-8f57-4861-979f-4192f2543f59] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.338925 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b2fca0ed-b96a-4fe4-8591-9d838c9aceee tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 0c060cdc-8f57-4861-979f-4192f2543f59 could not be found. Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2fca0ed-b96a-4fe4-8591-9d838c9aceee tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/0c060cdc-8f57-4861-979f-4192f2543f59/action HTTP/1.1 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 18 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: {"unshelve": null} Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 0c060cdc-8f57-4861-979f-4192f2543f59 could not be found. Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '0c060cdc-8f57-4861-979f-4192f2543f59', 'body': {'unshelve': None}} Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c060cdc-8f57-4861-979f-4192f2543f59 could not be found. Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c060cdc-8f57-4861-979f-4192f2543f59 could not be found. Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.340851 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c060cdc-8f57-4861-979f-4192f2543f59 could not be found. Sep 08 10:39:13.346234 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:13.348119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2fca0ed-b96a-4fe4-8591-9d838c9aceee tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 0c060cdc-8f57-4861-979f-4192f2543f59 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:13.349723 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2fca0ed-b96a-4fe4-8591-9d838c9aceee tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/0c060cdc-8f57-4861-979f-4192f2543f59/action" status: 404 len: 111 microversion: 2.1 time: 0.023843 Sep 08 10:39:13.350506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2507/5233] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:13 2022] POST /compute/v2.1/servers/0c060cdc-8f57-4861-979f-4192f2543f59/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:13.360039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.360673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.366910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.367922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.368535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.369398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.369860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.370288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.706629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:13.717917 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c9197cb-0c00-4bbb-91b2-c57cb02bb45e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.360043 Sep 08 10:39:13.718881 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2727/5234] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:13.745008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:13.745781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:13.760764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.762809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.764108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:13.773941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:13.777577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:13.780047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.063485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:14.084461 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f40f3186-f9ce-42c3-8a6d-71278d6c4a74 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.344685 Sep 08 10:39:14.085307 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2508/5235] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:13 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:14.115018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:14.115735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.123704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.124491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.125215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.125959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.126418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.126851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.130661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:14.165168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Cannot 'unshelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action HTTP/1.1 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 18 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: {"unshelve": null} Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: exception: Cannot 'unshelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'unshelve': None}} Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab066901-fa02-4e6f-957c-65bc129387a6 in vm_state active. Cannot unshelve while the instance is in this state. Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 10:39:14.167228 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active Sep 08 10:39:14.172647 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.175329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 409 to user: Cannot 'unshelve' instance ab066901-fa02-4e6f-957c-65bc129387a6 while it is in vm_state active {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:14.176394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8782a7c9-cf5c-4f9b-8985-cd146814182f tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action" status: 409 len: 146 microversion: 2.1 time: 0.067988 Sep 08 10:39:14.187324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:14.188177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.193735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2728/5236] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:39:14 2022] POST /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6/action => generated 146 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:39:14.197105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.197654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.198089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.199327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.200002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.200603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.407755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:14.425794 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27b35341-fb71-4f75-87c1-0f006d761cac tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.238722 Sep 08 10:39:14.426428 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2509/5237] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:14 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:14.462465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:14.463095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.473681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.474247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.474691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.475561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.476018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.476444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.643723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:14.652137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f06c3455-1248-4094-a4f3-fbc86065cffd tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.201769 Sep 08 10:39:14.661182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2729/5238] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:14 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:14.685954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee239003-e015-4869-a77b-f4352f5e7e85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-357562966_updated"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:14.689301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee239003-e015-4869-a77b-f4352f5e7e85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.706173 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-ee239003-e015-4869-a77b-f4352f5e7e85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 could not be found. Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee239003-e015-4869-a77b-f4352f5e7e85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/servers/d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 HTTP/1.1 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 80 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-357562966_updated"}} Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 could not be found. Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'd549b4e5-a71e-4fbe-aaa8-73ec0912a5e9', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-357562966_updated'}}} Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 could not be found. Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 08 10:39:14.713276 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 could not be found. Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 could not be found. Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee239003-e015-4869-a77b-f4352f5e7e85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee239003-e015-4869-a77b-f4352f5e7e85 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "PUT /compute/v2.1/servers/d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9" status: 404 len: 111 microversion: 2.1 time: 0.033477 Sep 08 10:39:14.717871 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2510/5239] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:39:14 2022] PUT /compute/v2.1/servers/d549b4e5-a71e-4fbe-aaa8-73ec0912a5e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:14.725144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:14.725762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.750671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.751251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.751893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.752617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.753217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.753648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:14.953120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:14.963209 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59b4a4e0-44f9-4fac-a20d-4ddaf833c227 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.241808 Sep 08 10:39:14.971569 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2730/5240] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:14 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:14.988186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:14.988799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:14.998059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:14.998547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:14.999523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.000673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.001564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.002302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.263004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.275294 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d781f586-407c-4341-b590-239c47d5fe01 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.289490 Sep 08 10:39:15.276166 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2511/5241] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:14 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:15.299696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab712a1a-576d-4321-a4bd-c19be406b319 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab712a1a-576d-4321-a4bd-c19be406b319 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: request: PUT /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 HTTP/1.1 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 280 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.306947 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:15.311666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab712a1a-576d-4321-a4bd-c19be406b319 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:15.314318 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab712a1a-576d-4321-a4bd-c19be406b319 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "PUT /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 400 len: 619 microversion: 2.1 time: 0.017715 Sep 08 10:39:15.317597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2731/5242] 10.222.0.59 () {60 vars in 1257 bytes} [Thu Sep 8 10:39:15 2022] PUT /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:39:15.322438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:15.323045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.329603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.330563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.331000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.332232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.332855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.333569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.551212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:15.563015 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2efc37c2-8f5f-4429-bd89-0cca00e6de1a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.245006 Sep 08 10:39:15.564447 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2512/5243] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:15 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:15.602191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:15.603206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:15.624749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.625365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.626479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:15.628632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:15.632419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:15.633177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.121273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.134661 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a367c1c8-1879-4737-8184-2c3293cabc99 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.546823 Sep 08 10:39:16.137756 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2732/5244] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:15 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:16.167707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86f346a9-c9f9-4bcd-8177-ed20c1219804 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86f346a9-c9f9-4bcd-8177-ed20c1219804 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: request: PUT /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 HTTP/1.1 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 24 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: {"server": {"name": ""}} Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6', 'body': {'server': {'name': ''}}} Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '' Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:39:16.177490 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 10:39:16.185375 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:16.189811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86f346a9-c9f9-4bcd-8177-ed20c1219804 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:16.191926 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86f346a9-c9f9-4bcd-8177-ed20c1219804 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "PUT /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 400 len: 108 microversion: 2.1 time: 0.031857 Sep 08 10:39:16.199208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2513/5245] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 10:39:16 2022] PUT /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:39:16.207176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:16.208194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:16.215304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.215823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.216311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.217288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:16.222035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:16.223303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:16.510132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:16.520650 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-957af4c2-eec7-47ed-b01d-d005e6f8998e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1506 microversion: 2.1 time: 0.319755 Sep 08 10:39:16.522206 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2733/5246] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:16 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:27.211520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:27.212296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:27.223666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=41 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:27.225205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=86 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:27.229269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.232752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.233349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.234368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.239756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.241538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.279649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea HTTP/1.1 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3d569c76-daca-4439-af2f-7ba6fd4a69ea'} Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:27.282264 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.287504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:27.307292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b3e0b096-9201-4020-9dd0-6e63fa9538db tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 404 len: 111 microversion: 2.1 time: 0.104132 Sep 08 10:39:27.314021 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2514/5247] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:39:27 2022] DELETE /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:27.319849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:27.321814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: 3d569c76-daca-4439-af2f-7ba6fd4a69ea] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:27.359620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=25 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:27.368230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=27 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:27.370511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.371180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.371595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.374957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.375557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.375999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.408674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea HTTP/1.1 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3d569c76-daca-4439-af2f-7ba6fd4a69ea'} Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:27.410631 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance 3d569c76-daca-4439-af2f-7ba6fd4a69ea could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:27.415256 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02b197bc-45ea-45ee-9bf2-a27871df848b tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea" status: 404 len: 111 microversion: 2.1 time: 0.097857 Sep 08 10:39:27.423771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:27.425349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:27.430276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2734/5248] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:27 2022] GET /compute/v2.1/servers/3d569c76-daca-4439-af2f-7ba6fd4a69ea => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:27.434021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.435045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.435586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.436304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.436807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.437593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.474392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:39:27.668966 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-638232c7-9cc8-4f23-9020-583edb5ee5b6 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 204 len: 0 microversion: 2.1 time: 0.250449 Sep 08 10:39:27.669735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2515/5249] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:39:27 2022] DELETE /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:39:27.684687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:27.685311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:27.697532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.698269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.700573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:27.701352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:27.701819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:27.702250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:28.051643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:28.083717 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e3e19b5-d803-4d03-a8f8-a26da80e2b3a tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.400314 Sep 08 10:39:28.088015 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2735/5250] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:27 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:29.112327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:29.113027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:29.120906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.121747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.122357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.123243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:29.124048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:29.124481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:29.391451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:29.400961 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-92e66392-dd08-43c4-a01f-fed9dfd77e5e tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.293435 Sep 08 10:39:29.402134 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2516/5251] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:29 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:29.669403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1569592042", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "ce66942c-01b8-4497-be75-f5c557b7451e"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:29.812271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] validate_networks() for [('ce66942c-01b8-4497-be75-f5c557b7451e', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:39:30.428707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:30.430599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:30.450737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.456828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.459790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:30.462219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:30.464079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:30.465285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.065532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4e0fa30b874e4f9ff56c000c48dc50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5515e18960864987b0c62d82ffc45897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.074905 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cac22573-af26-4852-ad32-70e1cfb950a3 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 200 len: 1512 microversion: 2.1 time: 0.649458 Sep 08 10:39:31.081847 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2517/5252] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:30 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 1512 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:31.203138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:39:31.204845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:39:31.205422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:39:31.205989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:39:31.206878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:39:31.237560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.241703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.243434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.254938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.257360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.258160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.300587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Getting quotas for project 9fe4f9b70c534d41bbe54d0b8f736395. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:39:31.316190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Getting quotas for user e4e98052d13648a7855c88dc03e71316 and project 9fe4f9b70c534d41bbe54d0b8f736395. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:39:31.354783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:39:31.357132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:39:31.412443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fe095c8e-bf9c-4c5e-b478-c7f70de67ffe req-10c4d9e7-9d5a-4226-82d2-ea0d2e6763f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab066901-fa02-4e6f-957c-65bc129387a6", "name": "network-vif-deleted", "tag": "3711f68e-a7bd-4648-9f34-af0cc36d1f25"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:31.438564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fe095c8e-bf9c-4c5e-b478-c7f70de67ffe req-10c4d9e7-9d5a-4226-82d2-ea0d2e6763f4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:31.439259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fe095c8e-bf9c-4c5e-b478-c7f70de67ffe req-10c4d9e7-9d5a-4226-82d2-ea0d2e6763f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:31.439728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fe095c8e-bf9c-4c5e-b478-c7f70de67ffe req-10c4d9e7-9d5a-4226-82d2-ea0d2e6763f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:31.478928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fe095c8e-bf9c-4c5e-b478-c7f70de67ffe req-10c4d9e7-9d5a-4226-82d2-ea0d2e6763f4 service nova] Creating event network-vif-deleted:3711f68e-a7bd-4648-9f34-af0cc36d1f25 for instance ab066901-fa02-4e6f-957c-65bc129387a6 on n-h2-833090-19 Sep 08 10:39:31.492832 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fe095c8e-bf9c-4c5e-b478-c7f70de67ffe req-10c4d9e7-9d5a-4226-82d2-ea0d2e6763f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407949 Sep 08 10:39:31.494158 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2518/5253] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:31.520502 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ff1b13d-3dd2-4d7c-825c-00ef97f1da35 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.857053 Sep 08 10:39:31.530557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2736/5254] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:39:31.533723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-015ab748-a1dc-49dd-a77b-d61f10f6e256 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:31.534676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-015ab748-a1dc-49dd-a77b-d61f10f6e256 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:31.615129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-015ab748-a1dc-49dd-a77b-d61f10f6e256 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:31.626115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-015ab748-a1dc-49dd-a77b-d61f10f6e256 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1219 microversion: 2.1 time: 0.094312 Sep 08 10:39:31.626933 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2519/5255] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:31 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:32.112491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:32.113030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] [instance: ab066901-fa02-4e6f-957c-65bc129387a6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:32.132555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.133202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.133666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.137338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.138309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.138776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.166608 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] HTTP exception thrown: Instance ab066901-fa02-4e6f-957c-65bc129387a6 could not be found. Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Request method failure captured: Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 HTTP/1.1 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVc9grCso0pBoRSulS2r1h7DJ80ygIsTu6H3fSir_hCClXb5kjPV4I1CtO5wsgI5S7BdoFNEMuPXDjh6ce6DOG0xUkncXMLqrsH2IogMb_bzNWVGxNVaXDU8EQfkI8VNqbNeyoxfOZ2Li9BHcgd6b5VKaTruihIZ58jetL70tpcMY0 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5515e18960864987b0c62d82ffc45897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5515e18960864987b0c62d82ffc45897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5515e18960864987b0c62d82ffc45897", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5515e18960864987b0c62d82ffc45897 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2085724793 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: db4e0fa30b874e4f9ff56c000c48dc50 Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-2085724793-project Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ab066901-fa02-4e6f-957c-65bc129387a6 could not be found. Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ab066901-fa02-4e6f-957c-65bc129387a6'} Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab066901-fa02-4e6f-957c-65bc129387a6 could not be found. Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab066901-fa02-4e6f-957c-65bc129387a6 could not be found. Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:32.168260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab066901-fa02-4e6f-957c-65bc129387a6 could not be found. Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] Returning 404 to user: Instance ab066901-fa02-4e6f-957c-65bc129387a6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a9ed2cf-45ed-4742-8d5f-0087a67f5a63 tempest-ServersNegativeTestJSON-2085724793 tempest-ServersNegativeTestJSON-2085724793-project] 10.222.0.59 "GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6" status: 404 len: 111 microversion: 2.1 time: 0.066481 Sep 08 10:39:32.176695 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2737/5256] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:32 2022] GET /compute/v2.1/servers/ab066901-fa02-4e6f-957c-65bc129387a6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:32.653581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:32.654592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:32.673510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.674439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.674975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.675831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:32.676616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:32.677105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:32.788414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:32.796452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29c64d4d-3255-44b7-96c7-b38566e085ae tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1223 microversion: 2.1 time: 0.148058 Sep 08 10:39:32.807813 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2520/5257] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:32 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:33.825868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:33.828401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:33.851895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:33.854654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:33.857336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:33.859098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:33.863823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:33.864704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:34.055625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:34.074501 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-79574a22-e39a-4783-85e8-bf1e91d81ffe tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1289 microversion: 2.1 time: 0.253659 Sep 08 10:39:34.075094 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2738/5258] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:33 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1289 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:35.130151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:35.130794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:35.144369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.144862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.145572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.146522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:35.147188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:35.147902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:35.259057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:35.268748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86166420-599c-42f4-8af0-178b42c07f5d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1277 microversion: 2.1 time: 0.170573 Sep 08 10:39:35.270663 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2521/5259] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:35 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:36.297457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:36.298080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:36.318030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.318727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.319127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:36.320375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:36.321041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:36.321476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:37.622209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:37.631988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4d255d79-3c28-4c87-8c78-859af0a01fdd tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 1.338145 Sep 08 10:39:37.666237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2739/5260] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:36 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:38.320242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b74eef9a-4735-4edd-bbe0-57c565285a34 req-3e873b05-c152-4bb9-9924-52dc92a315d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf76435-d793-44ea-9797-51bffd51ad50", "tag": "7e2c2660-e41b-4970-9943-253f31afa6ba"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:38.352626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b74eef9a-4735-4edd-bbe0-57c565285a34 req-3e873b05-c152-4bb9-9924-52dc92a315d9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.357743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b74eef9a-4735-4edd-bbe0-57c565285a34 req-3e873b05-c152-4bb9-9924-52dc92a315d9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.358563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b74eef9a-4735-4edd-bbe0-57c565285a34 req-3e873b05-c152-4bb9-9924-52dc92a315d9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.389541 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b74eef9a-4735-4edd-bbe0-57c565285a34 req-3e873b05-c152-4bb9-9924-52dc92a315d9 service nova] Creating event network-changed:7e2c2660-e41b-4970-9943-253f31afa6ba for instance acf76435-d793-44ea-9797-51bffd51ad50 on n-h1-833090-19 Sep 08 10:39:38.404373 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b74eef9a-4735-4edd-bbe0-57c565285a34 req-3e873b05-c152-4bb9-9924-52dc92a315d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.433751 Sep 08 10:39:38.407369 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2522/5261] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:38.660538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:38.661891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:38.695056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.698752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.700063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:38.706198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:38.707411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:38.711090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:39.057379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:39.075711 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-75c96bdc-e61e-4a36-96d9-0237c51f10b9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.416008 Sep 08 10:39:39.080382 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2740/5262] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:38 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:40.113305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:40.115699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:40.134574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.135896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.137732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.138934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:40.139756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:40.140413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:40.595283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:40.609974 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-321a0acb-190c-462d-8e79-474a210d54f0 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.504009 Sep 08 10:39:40.610532 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2523/5263] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:40 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:41.637807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:41.638654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:41.642890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:41.646507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:41.660059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:41.662190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:41.663588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:41.665636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:41.666247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:41.668437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:42.390209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:42.405662 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2fd43eeb-be93-4782-b647-c2a85a7a4af5 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.771886 Sep 08 10:39:42.421413 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2741/5264] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:41 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:43.432625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:43.433435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:43.436901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:43.461637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.464338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.466645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.469118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:43.472974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:43.476204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:43.824626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:43.836107 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5b10585c-97c1-4d95-a7aa-3d30aa4177e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.408204 Sep 08 10:39:43.853494 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2524/5265] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:43 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:44.867422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:44.869996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:44.897611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:44.899589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:44.900482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:44.901407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:44.905731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:44.906467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.025675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:45.026288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:45.038135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.041041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.041512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.042257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:45.042723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:45.043154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:45.112140 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-def70d5f-95bf-4e50-ad7e-e8a4cb867fe9 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/ips" status: 200 len: 149 microversion: 2.1 time: 0.091418 Sep 08 10:39:45.120542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2525/5266] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:39:45 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/ips => generated 149 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:45.174653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:45.189844 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5957e2f-0a9d-4e19-8490-57dd5d1e6a71 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.324815 Sep 08 10:39:45.221894 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2742/5267] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:44 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:45.486342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3c126db-c7b6-4d3b-899f-ae71832531d0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Action: 'create', calling method: .version_select at 0x7f23506bfaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1633321057"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:46.331368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b3c126db-c7b6-4d3b-899f-ae71832531d0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.209075 Sep 08 10:39:46.332959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2526/5268] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Sep 8 10:39:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1211 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 10:39:46.338483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:46.339108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:46.353740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.354244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.354734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.355398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.355889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.356324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.450230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a69fa2cd-6736-4e3c-a983-fea9a0d3f24c req-8f46e771-99d6-48ed-8901-41d91a57fc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf76435-d793-44ea-9797-51bffd51ad50", "name": "network-vif-plugged", "status": "completed", "tag": "7e2c2660-e41b-4970-9943-253f31afa6ba"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:46.477059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a69fa2cd-6736-4e3c-a983-fea9a0d3f24c req-8f46e771-99d6-48ed-8901-41d91a57fc71 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:46.477552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a69fa2cd-6736-4e3c-a983-fea9a0d3f24c req-8f46e771-99d6-48ed-8901-41d91a57fc71 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:46.479831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a69fa2cd-6736-4e3c-a983-fea9a0d3f24c req-8f46e771-99d6-48ed-8901-41d91a57fc71 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:46.515685 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a69fa2cd-6736-4e3c-a983-fea9a0d3f24c req-8f46e771-99d6-48ed-8901-41d91a57fc71 service nova] Creating event network-vif-plugged:7e2c2660-e41b-4970-9943-253f31afa6ba for instance acf76435-d793-44ea-9797-51bffd51ad50 on n-h1-833090-19 Sep 08 10:39:46.529706 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a69fa2cd-6736-4e3c-a983-fea9a0d3f24c req-8f46e771-99d6-48ed-8901-41d91a57fc71 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573703 Sep 08 10:39:46.530534 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2743/5269] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:39:46.565974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-74a87cce-160d-4888-b487-7071f760ac7b tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bdd23a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:46.793300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-74a87cce-160d-4888-b487-7071f760ac7b tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 345 microversion: 2.1 time: 0.259397 Sep 08 10:39:46.793887 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2744/5270] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:39:46 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 345 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:46.919793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:46.932643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08579c3b-7095-489e-8bb0-dbb2767bddc7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.598367 Sep 08 10:39:46.935055 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2527/5271] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:46 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:47.817333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-96a0043e-9d63-4905-a49a-046e99c23a3a tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd7d1f0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:47.939130 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-96a0043e-9d63-4905-a49a-046e99c23a3a tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 345 microversion: 2.1 time: 0.129447 Sep 08 10:39:47.940379 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2745/5272] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:39:47 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:47.963395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:47.966364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:47.978812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.979812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.980446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:47.981320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:47.982280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:47.984764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.035450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "437afe53-70cc-4dc7-bb07-b3fd41855199"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:48.044413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:48.073658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.080091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.080874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.085670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:48.088598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:48.089272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:48.397111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:48.405986 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99afe4ca-d97f-4950-9f62-15243d941249 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1319 microversion: 2.1 time: 0.449999 Sep 08 10:39:48.407214 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2528/5273] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:47 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:39:48.686541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-585658e6-de94-4168-9f74-1a3b3eb79a05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658688 Sep 08 10:39:48.689195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2746/5274] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:39:48 2022] POST /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:48.958729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e4f00275-3e49-452b-99fd-853f307d6d26 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f2355404ee0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:49.096109 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e4f00275-3e49-452b-99fd-853f307d6d26 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 346 microversion: 2.1 time: 0.145024 Sep 08 10:39:49.097331 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2529/5275] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:39:48 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:49.116513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3157eda5-3f91-4f7a-87c4-06d7e99bf498 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Action: 'create', calling method: .version_select at 0x7f2350a4f670>, body: {"snapshot": {"volume_id": "944d224e-13fe-4769-bd68-de289f8e1a02", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-900823184"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:39:49.432945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:49.433611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:39:49.453692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.455261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.455822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.460942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:39:49.461459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:39:49.463211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:39:49.473396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3157eda5-3f91-4f7a-87c4-06d7e99bf498 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.362412 Sep 08 10:39:49.476286 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2747/5276] 10.222.0.59 () {60 vars in 1162 bytes} [Thu Sep 8 10:39:49 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:49.486807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d16a04be-8813-4f19-b2e3-c371c1d740b5 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd38af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:49.803372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:39:49.821019 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be708d97-f79f-4fb2-8787-db784a969f7d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1509 microversion: 2.1 time: 0.393426 Sep 08 10:39:49.825382 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2530/5277] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:39:49 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:39:49.829190 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d16a04be-8813-4f19-b2e3-c371c1d740b5 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 286 microversion: 2.1 time: 0.347088 Sep 08 10:39:49.829765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2748/5278] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:49 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 286 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:39:49.854012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-894ffd77-e7f5-4368-9b37-3ec6b2ba8083 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f2350bd0160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:50.076289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-894ffd77-e7f5-4368-9b37-3ec6b2ba8083 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.227271 Sep 08 10:39:50.077557 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2531/5279] 10.222.0.59 () {58 vars in 1140 bytes} [Thu Sep 8 10:39:49 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:50.099775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a5e20fe-9e8f-42fc-a807-83968596f8f3 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bdb0820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:51.206044 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a5e20fe-9e8f-42fc-a807-83968596f8f3 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 286 microversion: 2.1 time: 1.117463 Sep 08 10:39:51.209735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2749/5280] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:50 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 286 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:52.239320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6ae6431-83b7-471f-8c62-f1f7d8932b66 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f23505cc550>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:52.391026 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6ae6431-83b7-471f-8c62-f1f7d8932b66 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 286 microversion: 2.1 time: 0.170082 Sep 08 10:39:52.392062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2532/5281] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:52 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:53.404896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1d3b5f4-1803-4535-93ea-86e5643fbe9e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bdd2940>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:53.460830 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1d3b5f4-1803-4535-93ea-86e5643fbe9e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 287 microversion: 2.1 time: 0.059717 Sep 08 10:39:53.461523 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2750/5282] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:53 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:53.476490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ebd324c-6b54-4c7a-b8a4-ec7787567586 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f23505ccb80>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:53.689050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ebd324c-6b54-4c7a-b8a4-ec7787567586 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 202 len: 0 microversion: 2.1 time: 0.219193 Sep 08 10:39:53.692518 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2533/5283] 10.222.0.59 () {58 vars in 1254 bytes} [Thu Sep 8 10:39:53 2022] DELETE /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:53.701430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e797efe2-fe77-47b0-8d24-c32df8e0b771 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd2bb80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:54.006270 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e797efe2-fe77-47b0-8d24-c32df8e0b771 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 286 microversion: 2.1 time: 0.308647 Sep 08 10:39:54.015779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2751/5284] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:53 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 286 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:55.023936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d775e370-f62d-43af-a482-fd5e1ae1d19f tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f23501eb9d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:55.165007 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d775e370-f62d-43af-a482-fd5e1ae1d19f tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 286 microversion: 2.1 time: 0.145491 Sep 08 10:39:55.183166 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2534/5285] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:55 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:56.192088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7dc89b0a-3006-40d1-81de-6405ffd251be tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd2b430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:56.368253 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7dc89b0a-3006-40d1-81de-6405ffd251be tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 200 len: 286 microversion: 2.1 time: 0.184759 Sep 08 10:39:56.370076 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2752/5286] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:56 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 286 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:39:57.387876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fe5be6b-91d7-4122-ba9d-a6f56d5affd7 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f2350b62d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:57.496353 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1fe5be6b-91d7-4122-ba9d-a6f56d5affd7 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] HTTP exception thrown: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fe5be6b-91d7-4122-ba9d-a6f56d5affd7 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Request method failure captured: Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 HTTP/1.1 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcZwcoWha2guMuZ5DL6fjyUY_7ssCQmIH98MFO791pDqp7_l8Vy1XrXNz7gEkb8A1sE-dXfKRADGEka1Lt9EmxgUfpd3HMKenShcGQpdiqM2SeDXW34k6jqtv_6S8nXJUpIB1YeKrOf_a5T3uTLCe7guSaxTvBnzZK6JORCXlQxN7OY Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1650ebe482924c3487b80efa08befa1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 16a15b70580a425fa987ce889808a542 Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: exception: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1ae35fde-d2e6-404d-a1f5-081ace9ab9e6'} Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. (HTTP 404) (Request-ID: req-b9ff13e1-bdd5-46ad-971f-2a06d62daa9e) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:39:57.507533 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. Sep 08 10:39:57.514390 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:39:57.523429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1fe5be6b-91d7-4122-ba9d-a6f56d5affd7 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Returning 404 to user: Snapshot 1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:39:57.523956 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1fe5be6b-91d7-4122-ba9d-a6f56d5affd7 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6" status: 404 len: 111 microversion: 2.1 time: 0.136557 Sep 08 10:39:57.525132 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2535/5287] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 10:39:57 2022] GET /compute/v2.1/os-snapshots/1ae35fde-d2e6-404d-a1f5-081ace9ab9e6 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:39:57.534678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-67392e65-8e50-451c-83f8-e89b3171359d tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd3e3a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:57.711313 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-67392e65-8e50-451c-83f8-e89b3171359d tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 202 len: 0 microversion: 2.1 time: 0.182007 Sep 08 10:39:57.713077 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2753/5288] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:39:57 2022] DELETE /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:39:57.722683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03c88c6f-adf6-4f87-86d8-0d1d2b717f33 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f23554c41f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:57.985195 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03c88c6f-adf6-4f87-86d8-0d1d2b717f33 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 345 microversion: 2.1 time: 0.267531 Sep 08 10:39:57.986115 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2536/5289] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:39:57 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 345 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:39:58.998674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:59.006277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:39:59.016310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c276c08-516d-48af-8573-d7e1035e213e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd65430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:39:59.243780 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c276c08-516d-48af-8573-d7e1035e213e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 345 microversion: 2.1 time: 0.244615 Sep 08 10:39:59.245281 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2754/5290] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:39:58 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:00.279801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c30f086-59be-4c5d-b928-3d3bcbcf03bc tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f23507ee700>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:00.308538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:00.311204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:00.368270 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c30f086-59be-4c5d-b928-3d3bcbcf03bc tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 345 microversion: 2.1 time: 0.108334 Sep 08 10:40:00.369045 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2537/5291] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:00 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:01.385359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f8e91ce-8f12-457b-99c5-81f0ddbc12dc tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd3f820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:01.513955 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f8e91ce-8f12-457b-99c5-81f0ddbc12dc tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 200 len: 345 microversion: 2.1 time: 0.134790 Sep 08 10:40:01.514888 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2755/5292] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:01 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:02.563214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57a2ddf4-addd-4149-92ed-d04b160406e0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f2350784dc0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:02.660931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-57a2ddf4-addd-4149-92ed-d04b160406e0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] HTTP exception thrown: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57a2ddf4-addd-4149-92ed-d04b160406e0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Request method failure captured: Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 HTTP/1.1 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcZwcoWha2guMuZ5DL6fjyUY_7ssCQmIH98MFO791pDqp7_l8Vy1XrXNz7gEkb8A1sE-dXfKRADGEka1Lt9EmxgUfpd3HMKenShcGQpdiqM2SeDXW34k6jqtv_6S8nXJUpIB1YeKrOf_a5T3uTLCe7guSaxTvBnzZK6JORCXlQxN7OY Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1650ebe482924c3487b80efa08befa1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 16a15b70580a425fa987ce889808a542 Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: exception: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '944d224e-13fe-4769-bd68-de289f8e1a02'} Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. (HTTP 404) (Request-ID: req-09e0759c-c1ba-4e03-8230-4f125a9d8d5d) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:40:02.665386 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57a2ddf4-addd-4149-92ed-d04b160406e0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Returning 404 to user: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:02.671285 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-57a2ddf4-addd-4149-92ed-d04b160406e0 tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 404 len: 109 microversion: 2.1 time: 0.124821 Sep 08 10:40:02.681692 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2538/5293] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:02 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:02.686979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-213ad5d3-0779-439f-a858-f21c2c2a160e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f234bd65f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:02.769248 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-213ad5d3-0779-439f-a858-f21c2c2a160e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] HTTP exception thrown: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-213ad5d3-0779-439f-a858-f21c2c2a160e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Request method failure captured: Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 HTTP/1.1 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcZwcoWha2guMuZ5DL6fjyUY_7ssCQmIH98MFO791pDqp7_l8Vy1XrXNz7gEkb8A1sE-dXfKRADGEka1Lt9EmxgUfpd3HMKenShcGQpdiqM2SeDXW34k6jqtv_6S8nXJUpIB1YeKrOf_a5T3uTLCe7guSaxTvBnzZK6JORCXlQxN7OY Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1650ebe482924c3487b80efa08befa1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 16a15b70580a425fa987ce889808a542 Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: exception: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '944d224e-13fe-4769-bd68-de289f8e1a02'} Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. (HTTP 404) (Request-ID: req-da0de6bb-f779-42d2-ad31-9aaaf58dcbb1) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:40:02.794323 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.800386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-213ad5d3-0779-439f-a858-f21c2c2a160e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Returning 404 to user: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:02.808906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-213ad5d3-0779-439f-a858-f21c2c2a160e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 404 len: 109 microversion: 2.1 time: 0.122926 Sep 08 10:40:02.808906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2756/5294] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:40:02 2022] DELETE /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:02.822388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c92e6556-2722-4575-b08b-0b317ce8261e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Calling method '.version_select at 0x7f23506dc5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:02.885925 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c92e6556-2722-4575-b08b-0b317ce8261e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] HTTP exception thrown: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c92e6556-2722-4575-b08b-0b317ce8261e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Request method failure captured: Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 HTTP/1.1 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcZwcoWha2guMuZ5DL6fjyUY_7ssCQmIH98MFO791pDqp7_l8Vy1XrXNz7gEkb8A1sE-dXfKRADGEka1Lt9EmxgUfpd3HMKenShcGQpdiqM2SeDXW34k6jqtv_6S8nXJUpIB1YeKrOf_a5T3uTLCe7guSaxTvBnzZK6JORCXlQxN7OY Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1650ebe482924c3487b80efa08befa1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1650ebe482924c3487b80efa08befa1b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1650ebe482924c3487b80efa08befa1b Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-235901280 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 16a15b70580a425fa987ce889808a542 Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesSnapshotsTestJSON-235901280-project Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: exception: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '944d224e-13fe-4769-bd68-de289f8e1a02'} Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. (HTTP 404) (Request-ID: req-625aecac-2b66-4693-bfb0-ae2d2a352356) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:40:02.890552 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. Sep 08 10:40:02.896254 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:40:02.901217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c92e6556-2722-4575-b08b-0b317ce8261e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] Returning 404 to user: Volume 944d224e-13fe-4769-bd68-de289f8e1a02 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:02.909525 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c92e6556-2722-4575-b08b-0b317ce8261e tempest-VolumesSnapshotsTestJSON-235901280 tempest-VolumesSnapshotsTestJSON-235901280-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02" status: 404 len: 109 microversion: 2.1 time: 0.086447 Sep 08 10:40:02.920651 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2539/5295] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:02 2022] GET /compute/v2.1/os-volumes/944d224e-13fe-4769-bd68-de289f8e1a02 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:40:07.285121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c9d7653-ae69-4693-9874-b64a1912b39f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: .version_select at 0x7f23506dcf70>, body: {"keypair": {"name": "tempest-keypair-1027610082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHYVq6mDootsDOMPlao+vDH0f9O69aIgKmC/EpNz3vX2SMMxsSauQ6AXT8ypJ6/6qgtWBhpNvNOErNm4QGfYebr37RfmyF97mZGHIpcCL0l8iKtRfimAss3sCbAKe5VyQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:07.300810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-beb7855b-5d4d-4ea2-8acc-df4e7d24af80 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Action: 'create', calling method: .version_select at 0x7f234bd3a670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1373108730", "metadata": {"Type": "work"}}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:07.383571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-4c9d7653-ae69-4693-9874-b64a1912b39f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:07.406314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-4c9d7653-ae69-4693-9874-b64a1912b39f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:07.430277 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c9d7653-ae69-4693-9874-b64a1912b39f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 10:40:07.971988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-beb7855b-5d4d-4ea2-8acc-df4e7d24af80 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.944961 Sep 08 10:40:07.972637 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2757/5296] 10.222.0.59 () {60 vars in 1156 bytes} [Thu Sep 8 10:40:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 946 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 10:40:07.988025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61bf99a2-555a-4e29-979e-7aa1dcd45120 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bcfb310>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:08.110849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61bf99a2-555a-4e29-979e-7aa1dcd45120 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.127419 Sep 08 10:40:08.111600 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2758/5297] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:07 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:08.439734 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c9d7653-ae69-4693-9874-b64a1912b39f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45422. Sep 08 10:40:08.466025 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c9d7653-ae69-4693-9874-b64a1912b39f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.204880 Sep 08 10:40:08.466648 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2540/5298] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:40:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:09.127398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-422d6fcd-d2d8-4b79-8238-b0623a56da82 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bcff790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:09.309592 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-422d6fcd-d2d8-4b79-8238-b0623a56da82 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.186646 Sep 08 10:40:09.317370 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2759/5299] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:09 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:40:10.326027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b5bc247-c3b8-4351-8083-7e33688ddf78 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f23553df5e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.461391 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b5bc247-c3b8-4351-8083-7e33688ddf78 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 354 microversion: 2.1 time: 0.140286 Sep 08 10:40:10.462171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2541/5300] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:10.476563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7bda534-00c8-4d11-bdc9-9a26577b1197 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bd3eca0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.590248 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7bda534-00c8-4d11-bdc9-9a26577b1197 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 354 microversion: 2.1 time: 0.118771 Sep 08 10:40:10.591116 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2760/5301] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:10.604499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8321df62-84e4-40bb-b86b-777291509d48 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f2350aec790>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.717742 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8321df62-84e4-40bb-b86b-777291509d48 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 202 len: 0 microversion: 2.1 time: 0.116819 Sep 08 10:40:10.718555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2542/5302] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:40:10 2022] DELETE /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:40:10.727777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-641486ad-8672-434c-ad1b-14a2d0e7e046 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bd3e820>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:10.834326 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-641486ad-8672-434c-ad1b-14a2d0e7e046 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.111104 Sep 08 10:40:10.835718 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2761/5303] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:10 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:11.847028 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:40:11.847749 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 10:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a (ip 10.222.0.59) !!! Sep 08 10:40:11.874904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ea65b72-81e6-4b76-90be-aaccd5b28943 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f23505b9160>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:12.050142 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ea65b72-81e6-4b76-90be-aaccd5b28943 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.204655 Sep 08 10:40:12.051066 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2543/5304] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:11 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:12.181269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907374786", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04c0b3e9-1a56-4979-8ca2-71d86eb54d89"}], "security_groups": [{"name": "tempest-securitygroup--1028370197"}], "key_name": "tempest-keypair-1027610082", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:12.369601 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:40:12.369801 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 10:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Sep 08 10:40:12.494904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] validate_networks() for [('04c0b3e9-1a56-4979-8ca2-71d86eb54d89', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:40:13.064919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f5e7cd4-cd67-4751-b2b5-4bfe87be3639 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f2350aec8b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:13.183128 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f5e7cd4-cd67-4751-b2b5-4bfe87be3639 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.121392 Sep 08 10:40:13.190488 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2544/5305] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:13 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Sep 08 10:40:13.386043 n-d-833090-19 devstack@n-api.service[122457]: ERROR sqlalchemy.pool.impl.QueuePool Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: Exception ignored in: . at 0x7f234bd3f040> Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: Traceback (most recent call last): Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: connection_record.checkin() Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: pool.dispatch.checkin(connection, self) Sep 08 10:40:13.389031 n-d-833090-19 devstack@n-api.service[122457]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 08 10:40:13.390122 n-d-833090-19 devstack@n-api.service[122457]: fn(*args, **kw) Sep 08 10:40:13.390402 n-d-833090-19 devstack@n-api.service[122457]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 08 10:40:13.401573 n-d-833090-19 devstack@n-api.service[122457]: time.sleep(0) Sep 08 10:40:13.403741 n-d-833090-19 devstack@n-api.service[122457]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 08 10:40:13.411328 n-d-833090-19 devstack@n-api.service[122457]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 08 10:40:13.411598 n-d-833090-19 devstack@n-api.service[122457]: AssertionError: do not call blocking functions from the mainloop Sep 08 10:40:13.415295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:40:13.416397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:40:13.417214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:40:13.417930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:40:13.418782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:40:13.438839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.445617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.446543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.447740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:13.448615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:13.450604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:13.501757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:40:13.512869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:40:13.531688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:40:13.535062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:40:13.637376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0efe0d5f-fcc2-40eb-b4b4-4a0557f9d88b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.462186 Sep 08 10:40:13.638915 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2762/5306] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:40:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:40:13.651751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4775f15d-039f-496a-8b48-8e345fb95573 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:13.652649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4775f15d-039f-496a-8b48-8e345fb95573 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:13.854498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4775f15d-039f-496a-8b48-8e345fb95573 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:13.870702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4775f15d-039f-496a-8b48-8e345fb95573 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1242 microversion: 2.1 time: 0.223254 Sep 08 10:40:13.871333 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2545/5307] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:13 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:14.208414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1971fd03-06d5-4d89-9f24-d11c2d935729 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bd3f040>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:14.315960 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1971fd03-06d5-4d89-9f24-d11c2d935729 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.122885 Sep 08 10:40:14.317176 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2763/5308] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:14 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:14.896072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:14.896813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:14.914597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.915257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.916922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:14.917728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:14.919056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:14.919552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:15.136587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:15.151743 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-929c553c-3324-4f58-ba44-5bd04fab119a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1238 microversion: 2.1 time: 0.260248 Sep 08 10:40:15.153482 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2546/5309] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:14 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1238 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:15.331354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc97613e-8672-4061-848e-d7bb7d6d09f8 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bd18e50>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:15.468460 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc97613e-8672-4061-848e-d7bb7d6d09f8 tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 200 len: 353 microversion: 2.1 time: 0.140973 Sep 08 10:40:15.471096 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2764/5310] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:15 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:16.182515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:16.184575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:16.195855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.197926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.199983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.204013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:16.205232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:16.206100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:16.485401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18817e37-011e-4fb5-99bf-d0836339fa1d tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Calling method '.version_select at 0x7f234bda3d30>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:16.540024 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-18817e37-011e-4fb5-99bf-d0836339fa1d tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] HTTP exception thrown: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18817e37-011e-4fb5-99bf-d0836339fa1d tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Request method failure captured: Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a HTTP/1.1 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcaG7sKFyM418N6edqH-pWsThQSSDYlIy69bkk7Rd8ed2oWIHomqx9KCyQAi_G7A29hBhbC_SWDk8gJgeahJDS0Il62FP3lCUGcm9dmSgCW4CP-RnWiP_5laXD-bcvKevR7RSaEtiqeKq8CXD52cojHcqocIRj1OLylLO24PnbglHwU Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: db972feaf2944249b55e0159442283d5 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesGetTestJSON-595488380 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db972feaf2944249b55e0159442283d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/db972feaf2944249b55e0159442283d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/db972feaf2944249b55e0159442283d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_db972feaf2944249b55e0159442283d5", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesGetTestJSON-595488380 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: db972feaf2944249b55e0159442283d5 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesGetTestJSON-595488380 Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesGetTestJSON-595488380-project Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: e98e28def0f048f59930aa53080b502b Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesGetTestJSON-595488380-project Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: exception: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '43a10710-3ddb-491e-b8b0-9a3e6c94b11a'} Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. (HTTP 404) (Request-ID: req-69e95c2e-5b5b-432f-9664-f92729572f35) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:40:16.542449 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. Sep 08 10:40:16.547720 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:40:16.553244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18817e37-011e-4fb5-99bf-d0836339fa1d tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] Returning 404 to user: Volume 43a10710-3ddb-491e-b8b0-9a3e6c94b11a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:40:16.554717 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18817e37-011e-4fb5-99bf-d0836339fa1d tempest-VolumesGetTestJSON-595488380 tempest-VolumesGetTestJSON-595488380-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a" status: 404 len: 109 microversion: 2.1 time: 0.073712 Sep 08 10:40:16.566897 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2765/5311] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:40:16 2022] GET /compute/v2.1/os-volumes/43a10710-3ddb-491e-b8b0-9a3e6c94b11a => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:40:16.590265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:16.598584 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8b63449-0205-45bf-b2ac-70d1642bf428 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1300 microversion: 2.1 time: 0.420939 Sep 08 10:40:16.616220 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2547/5312] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:16 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1300 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:17.632590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:17.633210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:17.641823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.643225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.643900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:17.644961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:17.645605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:17.646372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:18.384033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:18.397165 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-878ac8e9-c693-41d3-ad7a-aa77216f4431 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.768731 Sep 08 10:40:18.411324 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2766/5313] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:17 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:19.428835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:19.430198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:19.437412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.438234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.439056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.440028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.440910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.441569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:19.683979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:19.709843 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-afca3a05-b97a-4500-8f22-d2957ca19f0a tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.285408 Sep 08 10:40:19.710581 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2548/5314] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:19 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:19.939418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-69f49505-9526-424d-af44-ee27037af273 req-dfbf0453-1bcc-495f-8f75-1c993a4bf403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7356a674-ed81-44ba-ac7c-ce3841e6a67e", "tag": "4116f937-69d2-44e2-966c-0d6d529b793e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:19.979408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-69f49505-9526-424d-af44-ee27037af273 req-dfbf0453-1bcc-495f-8f75-1c993a4bf403 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:19.980403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-69f49505-9526-424d-af44-ee27037af273 req-dfbf0453-1bcc-495f-8f75-1c993a4bf403 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:19.984417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-69f49505-9526-424d-af44-ee27037af273 req-dfbf0453-1bcc-495f-8f75-1c993a4bf403 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.025071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-69f49505-9526-424d-af44-ee27037af273 req-dfbf0453-1bcc-495f-8f75-1c993a4bf403 service nova] Creating event network-changed:4116f937-69d2-44e2-966c-0d6d529b793e for instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e on n-h2-833090-19 Sep 08 10:40:20.046491 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-69f49505-9526-424d-af44-ee27037af273 req-dfbf0453-1bcc-495f-8f75-1c993a4bf403 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139205 Sep 08 10:40:20.052167 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2767/5315] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:20.740629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:20.744946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:20.780204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.780700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.781144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:20.781863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:20.789884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:20.790148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:21.361629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:21.372665 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55b8072e-51eb-4a8e-adc4-c365b9e3d9ee tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.640815 Sep 08 10:40:21.376540 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2549/5316] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:20 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:22.399294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:22.400139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:22.423444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.424110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.427124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:22.428047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:22.428941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:22.432163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:23.184645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:23.202975 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a36b0a03-5278-4c88-948c-dbb40797eeb3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.805570 Sep 08 10:40:23.208936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2768/5317] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:22 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:24.228090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:24.228794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:24.257125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:24.260626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.261134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.261584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.272257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:24.272852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:24.273305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:24.671413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:24.685827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a9c0ca0-8eba-495c-94be-451c6738714c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.460925 Sep 08 10:40:24.699353 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2550/5318] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:24 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:25.742217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:25.748710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:25.770858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:25.774008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:25.781247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.786117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.791071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:25.796387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:25.797155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:25.797675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:26.327227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:26.338569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2309a714-d3f3-4ffb-8b78-e93717059828 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.618159 Sep 08 10:40:26.346784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2769/5319] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:25 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:27.381668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:27.383289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:27.404862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.406712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.407184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:27.410465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:27.413453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:27.413913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:28.111649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:28.123420 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-673ec0d0-f687-4148-8cb5-d299da5ef91f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.750174 Sep 08 10:40:28.141403 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2551/5320] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:27 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:29.147361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:29.148015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:29.164372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.164873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.165308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.166033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.166488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.166917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.524679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:29.538369 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba1311e5-75be-473e-8b13-9aa9848ae31e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.392952 Sep 08 10:40:29.539781 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2770/5321] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:29 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:29.623820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c7724977-4e7d-4f6f-93e9-f0c352503aca req-0ab59606-4cee-4865-9da3-3ffd15505ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7356a674-ed81-44ba-ac7c-ce3841e6a67e", "name": "network-vif-plugged", "status": "completed", "tag": "4116f937-69d2-44e2-966c-0d6d529b793e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:29.655201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c7724977-4e7d-4f6f-93e9-f0c352503aca req-0ab59606-4cee-4865-9da3-3ffd15505ff4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:29.656307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c7724977-4e7d-4f6f-93e9-f0c352503aca req-0ab59606-4cee-4865-9da3-3ffd15505ff4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:29.657133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c7724977-4e7d-4f6f-93e9-f0c352503aca req-0ab59606-4cee-4865-9da3-3ffd15505ff4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:29.707451 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c7724977-4e7d-4f6f-93e9-f0c352503aca req-0ab59606-4cee-4865-9da3-3ffd15505ff4 service nova] Creating event network-vif-plugged:4116f937-69d2-44e2-966c-0d6d529b793e for instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e on n-h2-833090-19 Sep 08 10:40:29.731365 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c7724977-4e7d-4f6f-93e9-f0c352503aca req-0ab59606-4cee-4865-9da3-3ffd15505ff4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107172 Sep 08 10:40:29.732084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2552/5322] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:30.580991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:30.584652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:30.608122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:30.614000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:30.616864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:30.620723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:30.622734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:30.623414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:31.539357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:31.550690 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1982a5d-b082-46d2-8301-2775f83bee70 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.988878 Sep 08 10:40:31.553997 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2771/5323] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:30 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:32.575356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:32.579374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:32.584911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:32.616588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.617617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.618967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.621255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:32.621943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:32.623306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:32.884859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:32.905111 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f223f21d-bfd5-418f-8791-d6dee570906d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1368 microversion: 2.1 time: 0.334488 Sep 08 10:40:32.920886 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2553/5324] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:32 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:33.929889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:33.931059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:33.945958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.946600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.947184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:33.954210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:33.955662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:33.956314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.611165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:40:34.626134 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-093658f8-930b-44ec-9a22-63c4156ba5ff tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1558 microversion: 2.1 time: 0.699404 Sep 08 10:40:34.627199 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2772/5325] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:40:33 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1558 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:40:34.652184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:34.652853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:34.663634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.664149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.664593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.665314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:34.665767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:34.666538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:34.821366 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88b2396e-7d0b-4dca-8205-df48c9efa79b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174120 Sep 08 10:40:34.822088 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2554/5326] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:40:34 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:35.806566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb24281d-0a1f-4cf3-8430-091907994da9", "device": "/dev/sdb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:35.813858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:35.829703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.830253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.830706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:35.835873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:35.838294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:35.844327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:36.450641 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d5adef6-9376-493a-a682-cb68386f8688 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "POST /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654014 Sep 08 10:40:36.453878 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2773/5327] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:40:35 2022] POST /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:38.307619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-200fa689-7fca-41e5-bc16-0816b72affb0 req-ab41bf1a-1813-402d-bc7c-87478c215ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7356a674-ed81-44ba-ac7c-ce3841e6a67e", "tag": "4116f937-69d2-44e2-966c-0d6d529b793e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:40:38.357757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-200fa689-7fca-41e5-bc16-0816b72affb0 req-ab41bf1a-1813-402d-bc7c-87478c215ad2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:38.369859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-200fa689-7fca-41e5-bc16-0816b72affb0 req-ab41bf1a-1813-402d-bc7c-87478c215ad2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:38.373701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-200fa689-7fca-41e5-bc16-0816b72affb0 req-ab41bf1a-1813-402d-bc7c-87478c215ad2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:38.391776 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-200fa689-7fca-41e5-bc16-0816b72affb0 req-ab41bf1a-1813-402d-bc7c-87478c215ad2 service nova] Creating event network-changed:4116f937-69d2-44e2-966c-0d6d529b793e for instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e on n-h2-833090-19 Sep 08 10:40:38.411915 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-200fa689-7fca-41e5-bc16-0816b72affb0 req-ab41bf1a-1813-402d-bc7c-87478c215ad2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109031 Sep 08 10:40:38.415260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2555/5328] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:40:58.746980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:58.748563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:59.405412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:59.407446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:59.438215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.439652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.441186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.442421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.443504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.444177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.507753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:40:59.722279 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba34ff71-3a76-4925-81f2-4a7e32ee63fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 204 len: 0 microversion: 2.32 time: 0.976775 Sep 08 10:40:59.726394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2774/5329] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:40:58 2022] DELETE /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 0 bytes in 982 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:40:59.738915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:40:59.739874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:40:59.768219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=5 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:59.769517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=50 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:40:59.776489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.777000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.777868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:40:59.782309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:40:59.783755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:40:59.785939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:00.242478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:00.255517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:00.257435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:00.260308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03c60e8e-57cd-4151-9ac1-0e28ac8f7b33 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2952 microversion: 2.32 time: 0.529053 Sep 08 10:41:00.261481 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2556/5330] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:40:59 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2952 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:01.295547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:01.297001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:01.310378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:01.311971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:01.314245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:01.323503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:01.326421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:01.326977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:01.791283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:01.814506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:01.816677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:01.825042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a2df1bed-72c4-4ef5-a392-de6dcf8898f0 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2952 microversion: 2.32 time: 0.534818 Sep 08 10:41:01.829791 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2775/5331] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:01 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2952 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:02.876797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:02.877504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:02.903244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:02.904451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:02.905072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:02.907621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:02.908409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:02.909070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:03.488576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:03.508696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:03.514777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:03.516749 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93edd414-b100-4c89-b9b1-06c376865e37 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2952 microversion: 2.32 time: 0.658971 Sep 08 10:41:03.517865 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2557/5332] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:02 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2952 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:04.550546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:04.551164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:04.560965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:04.569060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:04.574312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:04.576221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:04.576892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:04.577503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:05.435830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:05.475113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:05.501063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:05.506839 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0a7c243a-7623-4fac-af7f-b839fe0fd16c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2931 microversion: 2.32 time: 0.962076 Sep 08 10:41:05.524426 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2776/5333] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:04 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2931 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:06.553520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:06.555849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:06.588716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:06.589393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:06.589956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:06.591116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:06.591733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:06.592276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:06.621421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-90b21203-0089-4407-9199-ab139f9cdbf8 req-33880e47-9574-487b-897a-6840703ab919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-deleted", "tag": "b81e79ba-50d4-4a9b-910e-ff60e991b1a9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:06.655319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-90b21203-0089-4407-9199-ab139f9cdbf8 req-33880e47-9574-487b-897a-6840703ab919 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:06.664149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-90b21203-0089-4407-9199-ab139f9cdbf8 req-33880e47-9574-487b-897a-6840703ab919 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:06.664618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-90b21203-0089-4407-9199-ab139f9cdbf8 req-33880e47-9574-487b-897a-6840703ab919 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:06.697380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-90b21203-0089-4407-9199-ab139f9cdbf8 req-33880e47-9574-487b-897a-6840703ab919 service nova] Creating event network-vif-deleted:b81e79ba-50d4-4a9b-910e-ff60e991b1a9 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:06.716819 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-90b21203-0089-4407-9199-ab139f9cdbf8 req-33880e47-9574-487b-897a-6840703ab919 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099158 Sep 08 10:41:06.725128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2777/5334] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:41:07.506011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f8ab1c01-7af2-45b9-a88e-1e7aa0aafa1c req-5523eef2-7372-4c38-bc59-205975ff0b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "5b35b0d3-db83-4920-a2b2-2380f917b7a2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:07.530810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f8ab1c01-7af2-45b9-a88e-1e7aa0aafa1c req-5523eef2-7372-4c38-bc59-205975ff0b5e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:07.531632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f8ab1c01-7af2-45b9-a88e-1e7aa0aafa1c req-5523eef2-7372-4c38-bc59-205975ff0b5e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:07.532629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f8ab1c01-7af2-45b9-a88e-1e7aa0aafa1c req-5523eef2-7372-4c38-bc59-205975ff0b5e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:07.555888 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f8ab1c01-7af2-45b9-a88e-1e7aa0aafa1c req-5523eef2-7372-4c38-bc59-205975ff0b5e service nova] Creating event network-vif-unplugged:5b35b0d3-db83-4920-a2b2-2380f917b7a2 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:07.571310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f8ab1c01-7af2-45b9-a88e-1e7aa0aafa1c req-5523eef2-7372-4c38-bc59-205975ff0b5e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070036 Sep 08 10:41:07.574866 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2778/5335] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:41:08.190606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:08.209231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:08.214164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:08.217338 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-43770b91-1839-4bd6-a1f1-7452843cd73b tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2863 microversion: 2.32 time: 1.676064 Sep 08 10:41:08.222011 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2558/5336] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:06 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2863 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:09.258597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:09.259305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:09.297242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:09.299251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:09.305402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:09.307748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:09.310534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:09.313464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:09.624414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b11820d8-c8a3-41a6-8a72-46c7549d998d req-78b21f2f-63a8-4e76-a463-b6310c4dbf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:09.650423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b11820d8-c8a3-41a6-8a72-46c7549d998d req-78b21f2f-63a8-4e76-a463-b6310c4dbf3b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:09.650973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b11820d8-c8a3-41a6-8a72-46c7549d998d req-78b21f2f-63a8-4e76-a463-b6310c4dbf3b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:09.653719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b11820d8-c8a3-41a6-8a72-46c7549d998d req-78b21f2f-63a8-4e76-a463-b6310c4dbf3b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:09.683930 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b11820d8-c8a3-41a6-8a72-46c7549d998d req-78b21f2f-63a8-4e76-a463-b6310c4dbf3b service nova] Creating event network-vif-unplugged:cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:09.698080 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b11820d8-c8a3-41a6-8a72-46c7549d998d req-78b21f2f-63a8-4e76-a463-b6310c4dbf3b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077194 Sep 08 10:41:09.700436 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2559/5337] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 10:41:10.004736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:10.024976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:10.042091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:10.043526 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45449fa2-84e1-4e9e-96a3-7d768238d0ff tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2703 microversion: 2.32 time: 0.790161 Sep 08 10:41:10.069396 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2779/5338] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:09 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2703 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:10.521012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5bf99ed6-3226-42ff-ac55-e9c0fe5dd53a req-e2375123-1881-4d75-a67a-1cadc59c80c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-deleted", "tag": "cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:10.558035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5bf99ed6-3226-42ff-ac55-e9c0fe5dd53a req-e2375123-1881-4d75-a67a-1cadc59c80c4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:10.558712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5bf99ed6-3226-42ff-ac55-e9c0fe5dd53a req-e2375123-1881-4d75-a67a-1cadc59c80c4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:10.559941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5bf99ed6-3226-42ff-ac55-e9c0fe5dd53a req-e2375123-1881-4d75-a67a-1cadc59c80c4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:10.600472 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5bf99ed6-3226-42ff-ac55-e9c0fe5dd53a req-e2375123-1881-4d75-a67a-1cadc59c80c4 service nova] Creating event network-vif-deleted:cf6fbbb4-b83b-49ca-b2f9-a782c731b3e3 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:10.610279 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5bf99ed6-3226-42ff-ac55-e9c0fe5dd53a req-e2375123-1881-4d75-a67a-1cadc59c80c4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094650 Sep 08 10:41:10.611832 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2560/5339] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:11.074655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:11.076165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:11.090480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:11.091984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:11.094175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:11.096477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:11.099944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:11.100629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:12.296298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "445a89cf-7bb9-413b-bc07-2c9a3d19d168"}, {"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "34569af1-d152-412e-a374-fb9ebc4707e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:12.332780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:12.339641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:12.362781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:12.446625 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] Creating event network-vif-unplugged:445a89cf-7bb9-413b-bc07-2c9a3d19d168 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:12.447172 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] Creating event network-vif-unplugged:34569af1-d152-412e-a374-fb9ebc4707e1 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:12.487126 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fd587e7c-1689-4a80-bbc9-048ec92faeab req-3d728ed6-1ae3-4f10-9e8f-a78a9db5f36c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.198627 Sep 08 10:41:12.494532 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2561/5340] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:12.973075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f78fd878-22c4-4a02-bf4d-f5504cb9b631 req-91172b3e-d7a2-422e-8149-f89411286f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-deleted", "tag": "445a89cf-7bb9-413b-bc07-2c9a3d19d168"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:13.025161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f78fd878-22c4-4a02-bf4d-f5504cb9b631 req-91172b3e-d7a2-422e-8149-f89411286f0a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:13.029814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f78fd878-22c4-4a02-bf4d-f5504cb9b631 req-91172b3e-d7a2-422e-8149-f89411286f0a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:13.034559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f78fd878-22c4-4a02-bf4d-f5504cb9b631 req-91172b3e-d7a2-422e-8149-f89411286f0a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:13.112290 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f78fd878-22c4-4a02-bf4d-f5504cb9b631 req-91172b3e-d7a2-422e-8149-f89411286f0a service nova] Creating event network-vif-deleted:445a89cf-7bb9-413b-bc07-2c9a3d19d168 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:13.131809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f78fd878-22c4-4a02-bf4d-f5504cb9b631 req-91172b3e-d7a2-422e-8149-f89411286f0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160904 Sep 08 10:41:13.132521 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2562/5341] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:13.368460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:13.399215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:13.400724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:13.402005 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6cd39a37-73a0-4799-8d5c-234a69fa2df9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2416 microversion: 2.32 time: 2.332714 Sep 08 10:41:13.419645 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2780/5342] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:11 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2416 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:14.457453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:14.460450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:14.486693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:14.490277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:14.494099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:14.495499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:14.496009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:14.498805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:15.404564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:15.457032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:15.461866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:15.471310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-52d4cbbd-c59a-4ff5-bb58-de8c57750dba req-878dff0d-7d11-412b-84e8-e6ea26c11323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-deleted", "tag": "5b35b0d3-db83-4920-a2b2-2380f917b7a2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:15.479020 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b54893e9-527c-4e4f-ab81-3ca93b43a8f4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 2208 microversion: 2.32 time: 1.033263 Sep 08 10:41:15.484069 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2563/5343] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:14 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 2208 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:15.536556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-52d4cbbd-c59a-4ff5-bb58-de8c57750dba req-878dff0d-7d11-412b-84e8-e6ea26c11323 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:15.539917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-52d4cbbd-c59a-4ff5-bb58-de8c57750dba req-878dff0d-7d11-412b-84e8-e6ea26c11323 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:15.542255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-52d4cbbd-c59a-4ff5-bb58-de8c57750dba req-878dff0d-7d11-412b-84e8-e6ea26c11323 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:15.619427 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-52d4cbbd-c59a-4ff5-bb58-de8c57750dba req-878dff0d-7d11-412b-84e8-e6ea26c11323 service nova] Creating event network-vif-deleted:5b35b0d3-db83-4920-a2b2-2380f917b7a2 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:15.638659 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-52d4cbbd-c59a-4ff5-bb58-de8c57750dba req-878dff0d-7d11-412b-84e8-e6ea26c11323 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177244 Sep 08 10:41:15.643759 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2781/5344] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:41:16.517857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:16.520240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:16.541757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:16.543411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:16.544594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:16.549474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:16.550213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:16.550675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:16.774645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:16.811165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:16.818126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:16.829714 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-53070733-613c-4d3f-b494-285dc729c358 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.317275 Sep 08 10:41:16.837472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2564/5345] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:16 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:17.718430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c1c43c20-3641-488b-8d3d-1242816d6c07 req-46e84c42-e939-4fd8-929a-c49d014d24d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e307fd2-18c6-4537-864b-d513cd61c8f6", "name": "network-vif-deleted", "tag": "34569af1-d152-412e-a374-fb9ebc4707e1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:17.764115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c1c43c20-3641-488b-8d3d-1242816d6c07 req-46e84c42-e939-4fd8-929a-c49d014d24d9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:17.768662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c1c43c20-3641-488b-8d3d-1242816d6c07 req-46e84c42-e939-4fd8-929a-c49d014d24d9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:17.769443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c1c43c20-3641-488b-8d3d-1242816d6c07 req-46e84c42-e939-4fd8-929a-c49d014d24d9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:17.849769 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c1c43c20-3641-488b-8d3d-1242816d6c07 req-46e84c42-e939-4fd8-929a-c49d014d24d9 service nova] Creating event network-vif-deleted:34569af1-d152-412e-a374-fb9ebc4707e1 for instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 on n-h1-833090-19 Sep 08 10:41:17.866843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:17.868454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:17.896654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:17.897070 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c1c43c20-3641-488b-8d3d-1242816d6c07 req-46e84c42-e939-4fd8-929a-c49d014d24d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192754 Sep 08 10:41:17.898667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:17.900077 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2782/5346] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:17.900895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:17.904219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:17.906934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:17.907984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:18.306743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:18.329323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:18.330858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:18.351889 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c89f781-d942-4a72-8210-726e96b03f5e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.489956 Sep 08 10:41:18.353506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2565/5347] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:17 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:41:19.384002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:19.384666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:19.401231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:19.401745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:19.402185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:19.402901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:19.406242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d809eb16-2ecf-4bbf-baeb-7463b1b3536f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: .version_select at 0x7f234bd2b3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1337480537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+50LcHV6xuwArqPhSIjSo6ZZwbvQqBqfZAxWVNNVIW0WlCKkNhvHiw3nd+PP52RCkBbHGD0AQz8Uq0n1F1odxYPyAC0s252ZQ2xXrEXoTITstQtlBSTzFEuxwwwtLGHQ=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:19.407969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:19.408537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:19.460543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d809eb16-2ecf-4bbf-baeb-7463b1b3536f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:41:19.476105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d809eb16-2ecf-4bbf-baeb-7463b1b3536f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:41:19.571693 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d809eb16-2ecf-4bbf-baeb-7463b1b3536f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.711381 Sep 08 10:41:19.572421 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2783/5348] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:41:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:19.642749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:19.659239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:19.661140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:19.666385 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d4be6fb-5a10-4798-8793-3ea5f3fad64f tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.285068 Sep 08 10:41:19.670898 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2566/5349] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:19 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:20.700753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:20.702166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:20.713616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:20.714571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:20.715214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:20.716150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:20.716966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:20.718192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:20.858205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:20.859027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:20.883181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:20.884792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:20.886079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:20.887605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:20.890430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:20.891114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:21.110206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lazy-loading 'services' on Instance uuid acf76435-d793-44ea-9797-51bffd51ad50 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:21.124591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:21.134936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:21.146770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:21.151976 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f2a4e82-ab77-41b9-863f-1933a431e29e tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.456102 Sep 08 10:41:21.155718 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2784/5350] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:20 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:41:21.278562 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ed46e7de-87b8-45c2-b21b-b1e19289835c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "DELETE /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50/os-volume_attachments/bb24281d-0a1f-4cf3-8430-091907994da9" status: 202 len: 0 microversion: 2.1 time: 0.425308 Sep 08 10:41:21.279236 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2567/5351] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:41:20 2022] DELETE /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50/os-volume_attachments/bb24281d-0a1f-4cf3-8430-091907994da9 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:41:22.189566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:22.190904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:22.202356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:22.205411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:22.208055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:22.209296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:22.212667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:22.214439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:22.397170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:22.415949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:22.417510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:22.418814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19868f19-1fd4-4bbb-b39e-e4c93833abdc tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.234169 Sep 08 10:41:22.420134 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2785/5352] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:22 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:23.449916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:23.450803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:23.468419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.469080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.471918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:23.472775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:23.476727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:23.482796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:24.458387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:24.475356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:24.477281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:24.481208 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5d14fbf-c134-44ee-a50c-8b409ded171a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 1.036337 Sep 08 10:41:24.481904 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2568/5353] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:23 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:25.518280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:25.519379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:25.556835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:25.557972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:25.558969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:25.561009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:25.565928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:25.566985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:25.917910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:25.951209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:25.968840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:25.975043 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1c934bb-c461-43f8-a4ef-c7387266a0de tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.462504 Sep 08 10:41:25.977372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2786/5354] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:25 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:27.010644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:27.017937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:27.033044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:27.034981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:27.035653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:27.038634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:27.040953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:27.041901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:27.301113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:27.324665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:27.334380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:27.335846 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-649395c6-f5dd-421e-a72d-5b1d96e2566d tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.333976 Sep 08 10:41:27.336459 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2569/5355] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:27 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:28.367825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:28.369039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:28.382151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:28.382871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:28.386077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:28.386979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:28.387636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:28.404295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:28.551343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:28.566623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:28.568161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:28.573115 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-edd5099f-82b3-410e-b820-00bb78829ebf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.209317 Sep 08 10:41:28.605355 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2787/5356] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:28 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:29.612741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:29.613345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:29.630308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.631072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.631708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:29.632585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:29.633187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:29.633945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:30.186290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:30.189743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:30.203079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:30.204506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:30.206169 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-efd5372d-a8b2-428c-bef9-0f91e4356115 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.597352 Sep 08 10:41:30.220905 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2570/5357] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:29 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:31.234871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:31.235504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:31.242397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:31.243166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:31.245164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:31.245902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:31.246449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:31.247280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:31.248315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:31.248746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:31.278656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:31.339769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:31.353952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:31.356069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:31.357876 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6fc593de-88c9-4c86-950c-6b9186cd3c99 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.127598 Sep 08 10:41:31.359209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2788/5358] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:31 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:32.389366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:32.390553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:32.393645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=31 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:32.399674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:32.400186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:32.400723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.401432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:32.401883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:32.402297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:32.526165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:32.538228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:32.539981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:32.541528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09f5ef89-ffb6-4000-9a60-9c3c624346b9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.156904 Sep 08 10:41:32.552188 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2571/5359] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:32 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:33.538886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:33.539792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:33.563931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.564579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.565721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.566501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.567006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.567597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.573773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:33.574401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:33.582143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.582898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.583525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.584925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.588402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.589061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.599641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:41:33.693432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:33.708111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:33.710107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:33.711673 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-301ab311-8efe-4f3c-9e53-dbf751c5f2fe tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.141754 Sep 08 10:41:33.725779 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1fada473-369e-4698-acba-f249b3e3431b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "DELETE /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 204 len: 0 microversion: 2.1 time: 0.186266 Sep 08 10:41:33.725779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2789/5360] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:33 2022] DELETE /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:33.730665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2572/5361] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:33 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:33.749535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:33.750527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:33.759353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.760431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.762270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.763493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:33.764122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:33.764716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:33.963030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:33.974731 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af122223-3cae-4958-8b9e-59fc7e39074d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1515 microversion: 2.1 time: 0.236143 Sep 08 10:41:33.976210 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2790/5362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:33 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:34.751863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:34.752871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:34.777811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.779491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.781036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:34.785878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:34.786617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:34.787673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.000251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:35.000779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:35.014238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.018929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.019842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.020778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:35.025333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:35.028106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:35.036143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:35.047518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:35.053835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:35.062745 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ec78f98-cfa2-4345-be9c-7879edcb4955 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.316328 Sep 08 10:41:35.065326 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2573/5363] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:34 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:35.435646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:35.445727 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28b3a8a0-bdc9-4365-92f0-e001ce0391cc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1515 microversion: 2.1 time: 0.450697 Sep 08 10:41:35.448498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2791/5364] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:34 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1515 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:36.095613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:36.097254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:36.110430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.114693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.115984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.117257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.119129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.121660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.472723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:36.473926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:36.485031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.489347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.490072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.490988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:36.492240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:36.492849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:36.714859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:36.725622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:36.733275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:36.734978 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac7fd8a2-fe2d-4efa-aa92-a671286c4513 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.644565 Sep 08 10:41:36.736427 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2574/5365] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:36 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:37.762979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:37.764554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:37.776343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.779089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.779919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.782843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:37.783974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:37.785053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:37.992926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.002333 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4dd561d-9e88-4e2f-952d-f3bc051b339b tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1515 microversion: 2.1 time: 1.535192 Sep 08 10:41:38.002926 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2792/5366] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:36 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1515 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:38.091235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.111690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.114912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:38.116450 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09367cc7-2811-4d7a-a14d-86e02e7567d4 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.358194 Sep 08 10:41:38.119627 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2575/5367] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:37 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:41:38.491098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-16b30820-036a-4698-b8e3-81df52ec83fb req-16794833-6bad-4e61-a68e-a47e238ba532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf76435-d793-44ea-9797-51bffd51ad50", "name": "network-vif-unplugged", "status": "completed", "tag": "7e2c2660-e41b-4970-9943-253f31afa6ba"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:38.519873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-16b30820-036a-4698-b8e3-81df52ec83fb req-16794833-6bad-4e61-a68e-a47e238ba532 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:38.520680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-16b30820-036a-4698-b8e3-81df52ec83fb req-16794833-6bad-4e61-a68e-a47e238ba532 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:38.521349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-16b30820-036a-4698-b8e3-81df52ec83fb req-16794833-6bad-4e61-a68e-a47e238ba532 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:38.545042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-16b30820-036a-4698-b8e3-81df52ec83fb req-16794833-6bad-4e61-a68e-a47e238ba532 service nova] Creating event network-vif-unplugged:7e2c2660-e41b-4970-9943-253f31afa6ba for instance acf76435-d793-44ea-9797-51bffd51ad50 on n-h1-833090-19 Sep 08 10:41:38.564155 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-16b30820-036a-4698-b8e3-81df52ec83fb req-16794833-6bad-4e61-a68e-a47e238ba532 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076647 Sep 08 10:41:38.566127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2793/5368] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:39.029786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.031222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:39.041017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.041865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.042543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.043520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.055907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.057616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.154710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:39.155422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:39.179455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.179979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.180601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.181329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.181787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.182220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.290622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:39.309426 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5df87aa0-1d08-48f3-bdcc-648cc2b108d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1473 microversion: 2.1 time: 0.282240 Sep 08 10:41:39.330422 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2576/5369] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:39 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:39.422047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7e138fd5-fff2-4877-9a64-8f28ff874af5 req-00c49e05-f312-4af5-b406-84f55b87458b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf76435-d793-44ea-9797-51bffd51ad50", "name": "network-vif-deleted", "tag": "7e2c2660-e41b-4970-9943-253f31afa6ba"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:39.457385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:39.475036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:39.482191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e138fd5-fff2-4877-9a64-8f28ff874af5 req-00c49e05-f312-4af5-b406-84f55b87458b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:39.482766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e138fd5-fff2-4877-9a64-8f28ff874af5 req-00c49e05-f312-4af5-b406-84f55b87458b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:39.483417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e138fd5-fff2-4877-9a64-8f28ff874af5 req-00c49e05-f312-4af5-b406-84f55b87458b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:39.489555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:39.490812 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b5ccc4a-33d1-45cc-be8b-745063b178a1 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.340609 Sep 08 10:41:39.503889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2794/5370] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:39 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 10:41:39.538644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7e138fd5-fff2-4877-9a64-8f28ff874af5 req-00c49e05-f312-4af5-b406-84f55b87458b service nova] Creating event network-vif-deleted:7e2c2660-e41b-4970-9943-253f31afa6ba for instance acf76435-d793-44ea-9797-51bffd51ad50 on n-h1-833090-19 Sep 08 10:41:39.550479 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7e138fd5-fff2-4877-9a64-8f28ff874af5 req-00c49e05-f312-4af5-b406-84f55b87458b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135880 Sep 08 10:41:39.553460 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2577/5371] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:41:40.342773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:40.344143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:40.355088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.360802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.361980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.363018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.363785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.364421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.428935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.429805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.430483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.431174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lazy-loading 'fault' on Instance uuid acf76435-d793-44ea-9797-51bffd51ad50 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:40.522587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:40.523997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:40.540694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:40.552070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.552892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.554504 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1baa4159-cce5-4064-bd73-63d5e335330c tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 200 len: 1309 microversion: 2.1 time: 0.216693 Sep 08 10:41:40.556148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.558428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:40.559389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2795/5372] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:40 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 1309 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:40.560092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:40.562799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:40.807775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:40.819737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:40.821582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:40.822991 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db577847-09a6-4974-9165-f990679a3f03 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.306638 Sep 08 10:41:40.840581 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2578/5373] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:40 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:41.587233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:41.589896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: acf76435-d793-44ea-9797-51bffd51ad50] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:41.612558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.613354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.615242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.616829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.620020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.624589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.671362 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] HTTP exception thrown: Instance acf76435-d793-44ea-9797-51bffd51ad50 could not be found. Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Request method failure captured: Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 HTTP/1.1 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcXzb6rDA3Owz6QgaWmQgw3yWSubqKTadP0HtwgATTuyCDiap1Q_eCZhIaq0aKM-i9n3XXYUoqkkA2ijr2c0kCPioevxZC6KzNCz9pW2ZmqbkCQZwNtESUP3Kfxq9NJIiZuRVgbDyRTuSc0iNLsrQhi9nboVLkBfvHZUpSqTh6DYBik Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 9fe4f9b70c534d41bbe54d0b8f736395 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1265578189 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9fe4f9b70c534d41bbe54d0b8f736395"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9fe4f9b70c534d41bbe54d0b8f736395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9fe4f9b70c534d41bbe54d0b8f736395"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9fe4f9b70c534d41bbe54d0b8f736395", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesSnapshotTestJSON-1265578189 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 9fe4f9b70c534d41bbe54d0b8f736395 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1265578189 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesSnapshotTestJSON-1265578189-project Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: e4e98052d13648a7855c88dc03e71316 Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesSnapshotTestJSON-1265578189-project Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance acf76435-d793-44ea-9797-51bffd51ad50 could not be found. Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'acf76435-d793-44ea-9797-51bffd51ad50'} Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf76435-d793-44ea-9797-51bffd51ad50 could not be found. Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf76435-d793-44ea-9797-51bffd51ad50 could not be found. Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:41.673083 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf76435-d793-44ea-9797-51bffd51ad50 could not be found. Sep 08 10:41:41.676543 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:41.678090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Returning 404 to user: Instance acf76435-d793-44ea-9797-51bffd51ad50 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:41.679453 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9feed351-5bb8-4808-b921-3c8084c27cc4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50" status: 404 len: 111 microversion: 2.1 time: 0.104577 Sep 08 10:41:41.682053 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2796/5374] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:41 2022] GET /compute/v2.1/servers/acf76435-d793-44ea-9797-51bffd51ad50 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:41:41.855647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:41.857571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:41.869816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.872392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.876352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.877406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:41.879536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:41.880215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:41.997421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:42.011517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:42.024752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:42.027007 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94a2af64-478c-4bb6-944a-e95b623ef4c9 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.176003 Sep 08 10:41:42.033972 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2579/5375] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:41 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:43.068562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:43.069729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:43.083277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:43.083724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:43.084167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:43.084906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:43.085303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:43.091917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:43.264308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:43.278569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:43.283340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:43.284643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e403e671-61f3-47c6-af6a-a14a1dd57411 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.220041 Sep 08 10:41:43.285217 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2797/5376] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:43 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:44.318969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:44.321103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:44.354526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:44.368020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:44.368509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:44.382807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:44.384169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:44.388358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:44.892772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:44.913095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:44.915028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:44.916903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da5b4c0e-bc5a-4649-b2d4-f2aa94e26561 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.605312 Sep 08 10:41:44.917665 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2580/5377] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:44 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:45.952825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:45.953442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:45.972122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:45.972122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:45.972122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:45.972507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:45.977651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:45.979178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:46.222496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1922302952", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "d2c6629b-76ce-42c6-9668-aec0b4ccfadc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1337480537", "security_groups": [{"name": "tempest-secgroup-smoke-353796808"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:46.230321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:46.280131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:46.287724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:46.291881 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d2ff566-7283-42df-865e-8a60407aa2cf tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.341954 Sep 08 10:41:46.299241 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2798/5378] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:45 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:46.714799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] validate_networks() for [('d2c6629b-76ce-42c6-9668-aec0b4ccfadc', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:41:47.321676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:47.323092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:47.343931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:47.344545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:47.346512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:47.363419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:47.373591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:47.374646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:47.657744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:47.684922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:47.689939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:47.694280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-902183c5-e644-4bc7-9fa0-49b663c3a431 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.378157 Sep 08 10:41:47.701963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2799/5379] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:47 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:48.586351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:41:48.587817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:41:48.588535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:41:48.589214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:41:48.589842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:41:48.608352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.609111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.609967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.611922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.613434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.614645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.652261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:41:48.668141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:41:48.700661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:41:48.703338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:41:48.737185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:48.738457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:48.749514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.754650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.755354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.757256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:48.758942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:48.760352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:48.830498 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1a96da95-d34b-46ca-93aa-58eb2f8b32c9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.618842 Sep 08 10:41:48.838941 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2581/5380] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:41:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:41:48.852057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bbf6adb5-8539-4415-a823-4b6bf16c00b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:48.853691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bbf6adb5-8539-4415-a823-4b6bf16c00b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:49.139566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bbf6adb5-8539-4415-a823-4b6bf16c00b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.140155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.167431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bbf6adb5-8539-4415-a823-4b6bf16c00b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1267 microversion: 2.1 time: 0.317188 Sep 08 10:41:49.170139 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2582/5381] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:48 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:41:49.211083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.216480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:49.220419 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0ea8e11-e0e5-428f-ba5a-2d5402a3eb12 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.487991 Sep 08 10:41:49.222023 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2800/5382] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:48 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:50.192977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee1eafff-61c4-494e-bc8c-a8a97a407ed5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.194199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee1eafff-61c4-494e-bc8c-a8a97a407ed5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.251561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:50.252749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:50.271906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.275131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.276180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:50.277107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:50.278769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:50.280310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.065008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee1eafff-61c4-494e-bc8c-a8a97a407ed5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.075892 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee1eafff-61c4-494e-bc8c-a8a97a407ed5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1267 microversion: 2.1 time: 0.887066 Sep 08 10:41:51.081142 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2583/5383] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:50 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1267 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:51.111444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.127293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.133034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:51.134831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b407189-d6c4-4ba8-931b-a72dbd23f292 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.888883 Sep 08 10:41:51.142558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2801/5384] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:50 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:51.864288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:51.865755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:51.882637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.883154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.883645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.884377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.884839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.885266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.942325 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c083ab93-7bd8-415c-a6e5-e4c1e563c2da tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/ips" status: 200 len: 149 microversion: 2.1 time: 0.082574 Sep 08 10:41:51.945193 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2584/5385] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:41:51 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/ips => generated 149 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:51.956476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "437afe53-70cc-4dc7-bb07-b3fd41855199"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:51.959100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:51.975328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.975815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.976310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:51.977031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:51.977603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:51.978040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.109486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-291256af-f916-4a75-a8bc-aa4d92c78f02 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:52.114063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-291256af-f916-4a75-a8bc-aa4d92c78f02 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:52.197900 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Invalid volume: volume 437afe53-70cc-4dc7-bb07-b3fd41855199 is already attached to instances: 71958974-984d-4158-830e-13745e965da1 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/os-volume_attachments HTTP/1.1 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 74 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: {"volumeAttachment": {"volumeId": "437afe53-70cc-4dc7-bb07-b3fd41855199"}} Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid volume: volume 437afe53-70cc-4dc7-bb07-b3fd41855199 is already attached to instances: 71958974-984d-4158-830e-13745e965da1 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '7356a674-ed81-44ba-ac7c-ce3841e6a67e', 'body': {'volumeAttachment': {'volumeId': '437afe53-70cc-4dc7-bb07-b3fd41855199'}}} Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 437afe53-70cc-4dc7-bb07-b3fd41855199 is already attached to instances: 71958974-984d-4158-830e-13745e965da1 Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:41:52.201853 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 437afe53-70cc-4dc7-bb07-b3fd41855199 is already attached to instances: 71958974-984d-4158-830e-13745e965da1 Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 437afe53-70cc-4dc7-bb07-b3fd41855199 is already attached to instances: 71958974-984d-4158-830e-13745e965da1 Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 400 to user: Invalid volume: volume 437afe53-70cc-4dc7-bb07-b3fd41855199 is already attached to instances: 71958974-984d-4158-830e-13745e965da1 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:52.206751 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d313f7f-9c52-49fa-8ffc-27888038071b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.252847 Sep 08 10:41:52.208058 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2802/5386] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:41:51 2022] POST /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e/os-volume_attachments => generated 174 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:41:52.219604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:52.222108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:52.238362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.238893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.240496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.242435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.242892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.246972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.506771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.531050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.533288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.534767 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4b280718-9139-4a1b-aee1-bfde74cced90 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1601 microversion: 2.32 time: 0.324615 Sep 08 10:41:52.536307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2803/5387] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:52 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1601 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:52.543818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:52.544574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:52.552584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.552781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-291256af-f916-4a75-a8bc-aa4d92c78f02 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:52.554381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.555683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.573824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:52.574580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:52.575189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:52.578602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:52.585600 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-291256af-f916-4a75-a8bc-aa4d92c78f02 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1267 microversion: 2.1 time: 0.469968 Sep 08 10:41:52.586292 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2585/5388] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:52 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1267 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:52.719047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:41:53.030013 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-482b2d1a-1d6b-4484-a600-0b4eb64c8589 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 204 len: 0 microversion: 2.1 time: 0.492219 Sep 08 10:41:53.030692 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2804/5389] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:41:52 2022] DELETE /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:41:53.057298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:53.058054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:53.078748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.079253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.079720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.080460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.080917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.081552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.581185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:53.583272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:53.591441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.593023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.593779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.595482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.596552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.597138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.659366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.660401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.661110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.661758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lazy-loading 'fault' on Instance uuid 9e307fd2-18c6-4537-864b-d513cd61c8f6 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:41:53.679016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:53.686933 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09ef4546-ab59-48dc-97b6-ad0ad57af148 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1682 microversion: 2.1 time: 0.651823 Sep 08 10:41:53.689893 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2586/5390] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:53 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1682 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:53.702630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:53.719413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:53.742169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.742942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.744462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.746888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:53.748497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:53.750422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:53.777702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:53.794693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:53.801430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '638f7b6e991f41ae827f36a3f599987c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069cf433a0a845c5847ef39874a8d04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:53.812604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-32d04f2f-1cbd-46c7-93d0-4d2ec12d3e7a tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 200 len: 1606 microversion: 2.32 time: 0.246721 Sep 08 10:41:53.815325 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2805/5391] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:53 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 1606 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 10:41:53.884574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-655523696", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "ce66942c-01b8-4497-be75-f5c557b7451e"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:53.958573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] validate_networks() for [('ce66942c-01b8-4497-be75-f5c557b7451e', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:41:54.136380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:54.149668 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-885f49d9-7209-436e-bc21-fbae373a7b0a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1271 microversion: 2.1 time: 0.456216 Sep 08 10:41:54.152150 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2587/5392] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:53 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1271 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:54.723045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:54.729034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:54.759370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:54.760963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:54.762237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:54.767042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:54.770205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:54.771965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.671930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:55.682301 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29776ce1-c6ad-4f4c-8d2c-c4a44c411140 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1682 microversion: 2.1 time: 0.971985 Sep 08 10:41:55.683905 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2588/5393] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:54 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1682 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:55.701110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:55.701991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:55.708195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.709306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.709911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.710780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.711369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.712045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.733265 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] HTTP exception thrown: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Request method failure captured: Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 HTTP/1.1 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVXUeq4xy_MVlQFhNRqfAVKgd20gyWQoYYGMUg5VmmXH5gOzmkDTPUunir7C5Z3nbN7OW7nQfva_Mg4_9fL0SSgJey8l6DcJQYwE2xsOKZXsCyrfbENxz8XPLmLSv8hGQuOHOBzo4Y3qQVBBsVfGk3U2q3t5qhCdraAIGa9qNk8KTQ Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 069cf433a0a845c5847ef39874a8d04d Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_069cf433a0a845c5847ef39874a8d04d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 069cf433a0a845c5847ef39874a8d04d Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TaggedBootDevicesTest-172436830-project Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 638f7b6e991f41ae827f36a3f599987c Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TaggedBootDevicesTest-172436830-project Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9e307fd2-18c6-4537-864b-d513cd61c8f6'} Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:41:55.735002 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:41:55.738385 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:41:55.740674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Returning 404 to user: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:41:55.747005 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b25656f-e03b-4dc1-b24e-9b099bcc0ae5 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 404 len: 111 microversion: 2.32 time: 0.061894 Sep 08 10:41:55.748398 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2589/5394] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:41:55 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:41:55.758932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:55.759643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:55.769765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.770267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.770714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.771428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:55.771921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:55.772357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:55.940150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:55.972099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7620cec9-63b5-44f5-bc25-6d156b490ece tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1325 microversion: 2.1 time: 0.217800 Sep 08 10:41:55.974491 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2590/5395] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:55 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:55.981480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a0e06a7-3aed-4778-a1d1-cbb5d6ff2f8c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '.version_select at 0x7f23500abf70>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:56.010358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a0e06a7-3aed-4778-a1d1-cbb5d6ff2f8c tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274459" status: 204 len: 0 microversion: 2.32 time: 0.033051 Sep 08 10:41:56.011842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2591/5396] 10.222.0.59 () {60 vars in 1253 bytes} [Thu Sep 8 10:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274459 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 10:41:56.078242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:41:56.079435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:41:56.080189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:41:56.080808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:41:56.081550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:41:56.102644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.104931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.105723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.113501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.114559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.115300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.165854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Getting quotas for project 9fe4f9b70c534d41bbe54d0b8f736395. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:41:56.179020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Getting quotas for user e4e98052d13648a7855c88dc03e71316 and project 9fe4f9b70c534d41bbe54d0b8f736395. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:41:56.223719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:41:56.226162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:41:56.332770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80b85846-44b2-492c-b032-53eb6f12d0d8 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452530 Sep 08 10:41:56.334306 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2806/5397] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:41:56.345348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-131dc443-e857-4f7a-8bc0-688668a3cba3 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:56.346154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-131dc443-e857-4f7a-8bc0-688668a3cba3 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:56.707620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:56.708554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:56.722360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.723250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.725038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.728790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:56.729656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:56.731432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:56.911735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-131dc443-e857-4f7a-8bc0-688668a3cba3 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:56.925227 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-131dc443-e857-4f7a-8bc0-688668a3cba3 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1218 microversion: 2.1 time: 0.582179 Sep 08 10:41:56.943859 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2592/5398] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:56 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1218 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:57.001217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:57.002096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:57.010128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.010686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.011275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.012434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.013230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.013934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.186232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:57.198443 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62b4aece-d8ef-45b5-ab1d-6277b7b169bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1325 microversion: 2.1 time: 0.201130 Sep 08 10:41:57.217408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2593/5399] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:56 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:57.315482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:57.358601 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e84694aa-9838-4278-b9b2-382c0f123623 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1682 microversion: 2.1 time: 0.652754 Sep 08 10:41:57.359765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2807/5400] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:56 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1682 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:57.948460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:57.950069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:57.964416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.964835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.965273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:57.965979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:57.966430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:57.981452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.231293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:58.232000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:58.249249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.249742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.250179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.255140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.257411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.258015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.631592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:58.646728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:58.649095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:41:58.665196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-daf6f880-e70d-4337-ba0d-c3ee84091923 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1270 microversion: 2.1 time: 0.720532 Sep 08 10:41:58.668433 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2594/5401] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:57 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1270 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:58.689758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:58.700654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:58.718961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.726508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.727329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.732912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.733913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.736624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.744794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:58.753920 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5797fbea-8339-4032-9cf6-4db9eec683bf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1325 microversion: 2.1 time: 0.529661 Sep 08 10:41:58.765944 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2808/5402] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:58 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:58.779493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9f446690-578d-4121-a1e3-457457147c54 req-fc89a81e-044c-44cd-8c51-22f92a348b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7356a674-ed81-44ba-ac7c-ce3841e6a67e", "name": "network-vif-deleted", "tag": "4116f937-69d2-44e2-966c-0d6d529b793e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:41:58.828659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9f446690-578d-4121-a1e3-457457147c54 req-fc89a81e-044c-44cd-8c51-22f92a348b94 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:58.829151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9f446690-578d-4121-a1e3-457457147c54 req-fc89a81e-044c-44cd-8c51-22f92a348b94 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:58.829584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9f446690-578d-4121-a1e3-457457147c54 req-fc89a81e-044c-44cd-8c51-22f92a348b94 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:58.868637 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9f446690-578d-4121-a1e3-457457147c54 req-fc89a81e-044c-44cd-8c51-22f92a348b94 service nova] Creating event network-vif-deleted:4116f937-69d2-44e2-966c-0d6d529b793e for instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e on n-h2-833090-19 Sep 08 10:41:58.884172 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9f446690-578d-4121-a1e3-457457147c54 req-fc89a81e-044c-44cd-8c51-22f92a348b94 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116505 Sep 08 10:41:58.886810 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2809/5403] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:41:59.093500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:41:59.103507 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b89d0ab-1956-4bd5-b6a4-438804b8f470 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 200 len: 1327 microversion: 2.1 time: 0.421036 Sep 08 10:41:59.110594 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2595/5404] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:58 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 1327 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:41:59.709444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:59.710534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:59.724759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.733883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.734814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.736010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.736712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.737517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.794868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:41:59.795652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:41:59.806497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.815588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.816204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:41:59.817087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:41:59.817683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:41:59.818230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.212009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.227402 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca2c515d-0b8a-4a54-9d48-8327257f81d1 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1276 microversion: 2.1 time: 0.538736 Sep 08 10:42:00.230436 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2810/5405] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:59 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1276 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:00.245258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:00.246178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:00.278996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.279543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.282774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.284048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:00.284937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:00.285635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:00.357299 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e HTTP/1.1 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7356a674-ed81-44ba-ac7c-ce3841e6a67e'} Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:00.360222 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:42:00.364325 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:00.372935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:00.375255 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8f7cc72-ead5-4103-9f6b-6ceac532a3f5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 404 len: 111 microversion: 2.1 time: 0.142685 Sep 08 10:42:00.419026 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2811/5406] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:00 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:42:00.441436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad0b6a3b-0242-47d9-828a-515ade4cec62 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '.version_select at 0x7f234bd3a4c0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:00.569058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad0b6a3b-0242-47d9-828a-515ade4cec62 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027610082" status: 202 len: 0 microversion: 2.1 time: 0.128761 Sep 08 10:42:00.571310 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2812/5407] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027610082 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:00.935695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:00.952483 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2744cd6-5557-485d-b27b-11a651d626b1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 1.162567 Sep 08 10:42:00.970989 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2596/5408] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:41:59 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:01.256789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:01.258625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:01.276667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.277782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.278632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.279724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.281358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.285087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.499845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-acf9effe-dbf4-4c2c-a0cb-60b59e31d4fd req-4df9ecf2-fb88-4c5c-9e49-3681fa549a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:01.545829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-acf9effe-dbf4-4c2c-a0cb-60b59e31d4fd req-4df9ecf2-fb88-4c5c-9e49-3681fa549a44 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.550829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-acf9effe-dbf4-4c2c-a0cb-60b59e31d4fd req-4df9ecf2-fb88-4c5c-9e49-3681fa549a44 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.551592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-acf9effe-dbf4-4c2c-a0cb-60b59e31d4fd req-4df9ecf2-fb88-4c5c-9e49-3681fa549a44 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:01.576946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:01.592160 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2408d7cb-4ed0-4728-98e1-71441b3c79e9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1276 microversion: 2.1 time: 0.343032 Sep 08 10:42:01.594005 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-acf9effe-dbf4-4c2c-a0cb-60b59e31d4fd req-4df9ecf2-fb88-4c5c-9e49-3681fa549a44 service nova] Creating event network-changed:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h1-833090-19 Sep 08 10:42:01.600039 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2813/5409] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:01 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1276 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:01.628231 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-acf9effe-dbf4-4c2c-a0cb-60b59e31d4fd req-4df9ecf2-fb88-4c5c-9e49-3681fa549a44 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155766 Sep 08 10:42:01.629650 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2597/5410] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:01.976804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:01.977676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:01.981133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:01.995854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:01.997592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:01.999070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.001869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.003011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.004747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.630295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:02.632451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:02.644790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:02.647580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.648535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.649358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.650570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:02.652114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:02.653720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:02.871592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:02.884658 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6b5a611-eba8-41fb-b5e3-d64889000cdc tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1276 microversion: 2.1 time: 0.261210 Sep 08 10:42:02.899980 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2598/5411] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:02 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:03.086357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:03.097686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-794f7b6f-6a44-4885-a1b4-775a79b2aa47 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 1.125022 Sep 08 10:42:03.099123 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2814/5412] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:01 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:03.891064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:03.892041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:03.905580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.907254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.908762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.909459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.914128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.921106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.929704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:03.930430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:03.949331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.950141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.950837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:03.952845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:03.953839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:03.955698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.111600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lazy-loading 'services' on Instance uuid 71958974-984d-4158-830e-13745e965da1 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:42:04.243990 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f392611-587f-41cf-ad26-8ef78d15b8ec tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments/437afe53-70cc-4dc7-bb07-b3fd41855199" status: 202 len: 0 microversion: 2.1 time: 0.356703 Sep 08 10:42:04.244934 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2599/5413] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:42:03 2022] DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments/437afe53-70cc-4dc7-bb07-b3fd41855199 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:04.261344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:04.262060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:04.273583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.275011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.275508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.276312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.276794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.277227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.366467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:04.379500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7726230-4a9e-449e-9c5b-810c9a3eef0d tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.452627 Sep 08 10:42:04.382549 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2815/5414] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:03 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:04.402029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:04.404755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:04.416116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.423826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.424298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.426682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:04.427336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:04.429152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:04.520933 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7f89524-052f-40c8-a9a6-c36d52861456 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137205 Sep 08 10:42:04.530452 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2816/5415] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:04 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:04.855122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:04.870555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31de0f3f-eb68-48f8-a47b-3032aa4b823e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 0.623112 Sep 08 10:42:04.876972 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2600/5416] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:04 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:05.413662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:05.414843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:05.426943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.428461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.429285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.430246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.430859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.432228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.537323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:05.540353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:05.565517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.566235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.567017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.567962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.568585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.569173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.679148 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e85582d-3dc1-444d-82e4-e6d6bbde149f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131637 Sep 08 10:42:05.680771 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2601/5417] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:05 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:05.893752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:05.894645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:05.909612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.910429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.911073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:05.912014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:05.912660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:05.913297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:06.135009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:06.200186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:06.207324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:06.232880 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2516fe42-cb14-4b9c-bfc9-1bb451c99f04 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.827528 Sep 08 10:42:06.233517 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2817/5418] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:05 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:06.696880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:06.701022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:06.711245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:06.712363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:06.712976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:06.715739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:06.716847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:06.717527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:06.778829 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6ea3ddd-6acd-4581-b89e-bf86c22142dd tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089485 Sep 08 10:42:06.795728 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2818/5419] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:06 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:06.918587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:07.094572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:07.105453 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a00ecf7a-c71f-4a85-88e0-e95212ee8435 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 1.214224 Sep 08 10:42:07.108961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-37e80b3b-cbd5-4c1b-bf56-0368616075e4 req-424964b7-65b5-4aea-9d9d-9430ee6e6b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc601a3-b200-4950-93aa-ae0dfffe4f51", "tag": "e74b4ea2-1119-4d53-a6c0-80768e7d8c84"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:07.110080 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2602/5420] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:05 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:07.126591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-37e80b3b-cbd5-4c1b-bf56-0368616075e4 req-424964b7-65b5-4aea-9d9d-9430ee6e6b5b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.127348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-37e80b3b-cbd5-4c1b-bf56-0368616075e4 req-424964b7-65b5-4aea-9d9d-9430ee6e6b5b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.129591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-37e80b3b-cbd5-4c1b-bf56-0368616075e4 req-424964b7-65b5-4aea-9d9d-9430ee6e6b5b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.151536 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-37e80b3b-cbd5-4c1b-bf56-0368616075e4 req-424964b7-65b5-4aea-9d9d-9430ee6e6b5b service nova] Creating event network-changed:e74b4ea2-1119-4d53-a6c0-80768e7d8c84 for instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 on n-h2-833090-19 Sep 08 10:42:07.166596 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-37e80b3b-cbd5-4c1b-bf56-0368616075e4 req-424964b7-65b5-4aea-9d9d-9430ee6e6b5b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061757 Sep 08 10:42:07.171796 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2819/5421] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:07.263069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:07.263982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:07.276116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.276871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.277654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.278527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.279773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.280539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.809922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:07.813091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:07.831587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.832080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.836108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.837032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:07.839866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:07.841006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:07.908465 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-daadb8b8-2b92-408f-a931-a6ccf19652c8 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104268 Sep 08 10:42:07.912737 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2820/5422] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:07 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:08.134615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:08.135616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:08.135736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:08.144627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.150615 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-453feb9d-41b9-459c-b03f-3b3b4847f1e6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.889136 Sep 08 10:42:08.153246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.154562 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2603/5423] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:07 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:08.155244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.157046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.158141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.159514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.925642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:08.928316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:08.944077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.944862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.945492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:08.948261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:08.948937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:08.949542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.037663 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eeb65667-0340-40fb-94ab-c3bbd6d6cfb0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116403 Sep 08 10:42:09.044377 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2604/5424] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:08 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:09.178068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:09.179199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:09.237673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:09.248171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:09.249797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.258089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:09.259874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:09.265254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.645287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:09.724893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95204763-22b2-4b5b-a55b-7a0e1cb5f71d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 1.589602 Sep 08 10:42:09.726434 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2821/5425] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:08 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:09.768073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:09.772253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:09.874573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:09.888962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:09.892617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.897135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:09.899436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:09.903256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:09.904212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:09.911994 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82861877-0131-48bb-bf64-0d1cee321ded tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.741147 Sep 08 10:42:09.912943 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2605/5426] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:09 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:09.991729 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] HTTP exception thrown: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Request method failure captured: Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 HTTP/1.1 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcVXUeq4xy_MVlQFhNRqfAVKgd20gyWQoYYGMUg5VmmXH5gOzmkDTPUunir7C5Z3nbN7OW7nQfva_Mg4_9fL0SSgJey8l6DcJQYwE2xsOKZXsCyrfbENxz8XPLmLSv8hGQuOHOBzo4Y3qQVBBsVfGk3U2q3t5qhCdraAIGa9qNk8KTQ Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 069cf433a0a845c5847ef39874a8d04d Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_069cf433a0a845c5847ef39874a8d04d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 069cf433a0a845c5847ef39874a8d04d Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TaggedBootDevicesTest-172436830-project Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 638f7b6e991f41ae827f36a3f599987c Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TaggedBootDevicesTest-172436830-project Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '9e307fd2-18c6-4537-864b-d513cd61c8f6'} Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:42:09.998905 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.002718 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.005405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Returning 404 to user: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:10.006301 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-717b2d29-b72b-4bc9-be4f-f08736c04e65 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 404 len: 111 microversion: 2.32 time: 0.274674 Sep 08 10:42:10.006881 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2822/5427] 10.222.0.59 () {60 vars in 1280 bytes} [Thu Sep 8 10:42:09 2022] DELETE /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 111 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:42:10.017150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.017984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] [instance: 9e307fd2-18c6-4537-864b-d513cd61c8f6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.028547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.032147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.032881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.034055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.036579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.037243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.059277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.062036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.089753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.094509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.095684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.099153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.101530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.102222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.114194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:10.131893 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] HTTP exception thrown: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Request method failure captured: Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 HTTP/1.1 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcVXUeq4xy_MVlQFhNRqfAVKgd20gyWQoYYGMUg5VmmXH5gOzmkDTPUunir7C5Z3nbN7OW7nQfva_Mg4_9fL0SSgJey8l6DcJQYwE2xsOKZXsCyrfbENxz8XPLmLSv8hGQuOHOBzo4Y3qQVBBsVfGk3U2q3t5qhCdraAIGa9qNk8KTQ Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 069cf433a0a845c5847ef39874a8d04d Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/069cf433a0a845c5847ef39874a8d04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_069cf433a0a845c5847ef39874a8d04d", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 069cf433a0a845c5847ef39874a8d04d Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TaggedBootDevicesTest-172436830 Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TaggedBootDevicesTest-172436830-project Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 638f7b6e991f41ae827f36a3f599987c Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TaggedBootDevicesTest-172436830-project Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '9e307fd2-18c6-4537-864b-d513cd61c8f6'} Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:10.134376 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. Sep 08 10:42:10.138689 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:42:10.142267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] Returning 404 to user: Instance 9e307fd2-18c6-4537-864b-d513cd61c8f6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:10.147123 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d499e62-7d09-4db5-87f9-9050eca048e3 tempest-TaggedBootDevicesTest-172436830 tempest-TaggedBootDevicesTest-172436830-project] 10.222.0.59 "GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6" status: 404 len: 111 microversion: 2.32 time: 0.132219 Sep 08 10:42:10.149075 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2606/5428] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/9e307fd2-18c6-4537-864b-d513cd61c8f6 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:42:10.212114 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1bfdcf2c-3154-445b-a99b-64c1d598ac99 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159340 Sep 08 10:42:10.217282 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2823/5429] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:10.765193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.766469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.779756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.782059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.782525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.783275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.786664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.787191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.970803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:10.972287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:10.991204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.992075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:10.992698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:10.997859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:10.998585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.001014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.173899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.182548 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e6c6ef21-e68a-479d-989b-a6f69a789e2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 0.421708 Sep 08 10:42:11.183154 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2607/5430] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:11.199700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-8293aae6-9d02-42e3-b4d4-24a3a51e3151 req-1dddfe74-f627-407d-886d-452a6145750a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "name": "network-vif-plugged", "status": "completed", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:11.219251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8293aae6-9d02-42e3-b4d4-24a3a51e3151 req-1dddfe74-f627-407d-886d-452a6145750a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.223052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8293aae6-9d02-42e3-b4d4-24a3a51e3151 req-1dddfe74-f627-407d-886d-452a6145750a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.223725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8293aae6-9d02-42e3-b4d4-24a3a51e3151 req-1dddfe74-f627-407d-886d-452a6145750a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.257434 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-8293aae6-9d02-42e3-b4d4-24a3a51e3151 req-1dddfe74-f627-407d-886d-452a6145750a service nova] Creating event network-vif-plugged:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h1-833090-19 Sep 08 10:42:11.285812 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-8293aae6-9d02-42e3-b4d4-24a3a51e3151 req-1dddfe74-f627-407d-886d-452a6145750a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080877 Sep 08 10:42:11.287083 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2608/5431] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:11.316248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:11.318729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:11.341364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.343581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.345873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.348481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:11.350911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:11.352334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:11.426683 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-724f9b1c-c3f0-4a84-af67-ac57abf8abd5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135963 Sep 08 10:42:11.436697 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2609/5432] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:11 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:11.461383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:11.472506 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90b98c55-bffe-476c-9bf1-6ea13fc025e2 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.506482 Sep 08 10:42:11.475307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2824/5433] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:10 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:12.210062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:12.210690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:12.227059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.227591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.228040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.228747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.229982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.230593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.450804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:12.454468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:12.471983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.472813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.473430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.474344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.474957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.475581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.559747 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-13be74d4-6099-4d6e-8f2b-7c692fd6bd24 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113487 Sep 08 10:42:12.560559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2825/5434] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:12 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:12.571374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:12.585870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:12.609339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.609876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.610310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.611032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:12.611509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:12.611982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:12.786075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:12.799165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16d73289-f47c-4029-96b0-3ea7fa420a24 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1392 microversion: 2.1 time: 0.593675 Sep 08 10:42:12.813252 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2610/5435] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:12 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1392 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:13.076441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:13.090178 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d559f873-243d-4f2f-a9b1-58334453046f tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.522434 Sep 08 10:42:13.104432 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2826/5436] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:12 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:13.573147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:13.575369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:13.592364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.592868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.593312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.594035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.594488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.594917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.675023 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ff895a8-aa63-485e-804c-4a5fdc7e164b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106353 Sep 08 10:42:13.676365 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2611/5437] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:42:13 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:42:13.828497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:13.829117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:13.849373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.849876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.850328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.851123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.859340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.860278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:13.860784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.860981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:13.869654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.873773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.876657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.879115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:13.879782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:13.884065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:13.996133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:42:14.000237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:14.232959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0dcba263-0b1a-4fa4-8eac-83c77b02b9e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 204 len: 0 microversion: 2.1 time: 0.376495 Sep 08 10:42:14.234421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2612/5438] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:42:13 2022] DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:42:14.251200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:14.259600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:14.274164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.276168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.282796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.284476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.286300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.287996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.704416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:14.718031 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7d4f786e-0829-4c3f-90fe-792a02269b44 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1564 microversion: 2.1 time: 0.893567 Sep 08 10:42:14.718985 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2827/5439] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:13 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1564 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:14.793532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:14.794146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:14.827140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.827687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.828622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:14.829360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:14.829818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:14.830247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:15.189986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:15.201935 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1cdf0d6-fc53-47b4-bd88-667de67a4255 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.960661 Sep 08 10:42:15.202838 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2613/5440] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:14 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:15.214189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:15.215387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:15.229364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:15.230119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:15.231267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:15.232330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:15.236088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:15.236898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:15.614830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:15.629957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf569ad9-8065-4128-998a-f5b2456991a4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1681 microversion: 2.1 time: 0.869452 Sep 08 10:42:15.634446 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2828/5441] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:14 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1681 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:15.969066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:15.977462 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-445cc608-ed3d-49e4-9fbe-d86ec3a7f732 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1564 microversion: 2.1 time: 0.773556 Sep 08 10:42:15.984341 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2614/5442] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:15 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1564 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:16.226259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:16.227492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:16.247713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.249291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.250021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.250923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.251558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.252134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.663246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:16.664619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:16.685346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.687125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.698349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:16.699565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:16.700323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:16.700936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:17.161599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:17.172908 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6ebd44a6-95ac-4ebb-93d4-bbb205bbedc6 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.951894 Sep 08 10:42:17.192163 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2829/5443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:16 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:17.603980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-10fcf76f-7e91-459e-8e3c-8100b4be9c16 req-bd1592ca-c466-4fb8-8054-38c7a18d2990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71958974-984d-4158-830e-13745e965da1", "name": "network-vif-deleted", "tag": "a63713b9-c171-4740-98ee-90fd72ce0abf"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:17.650452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-10fcf76f-7e91-459e-8e3c-8100b4be9c16 req-bd1592ca-c466-4fb8-8054-38c7a18d2990 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:17.651252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-10fcf76f-7e91-459e-8e3c-8100b4be9c16 req-bd1592ca-c466-4fb8-8054-38c7a18d2990 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:17.653154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-10fcf76f-7e91-459e-8e3c-8100b4be9c16 req-bd1592ca-c466-4fb8-8054-38c7a18d2990 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:17.687567 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-10fcf76f-7e91-459e-8e3c-8100b4be9c16 req-bd1592ca-c466-4fb8-8054-38c7a18d2990 service nova] Creating event network-vif-deleted:a63713b9-c171-4740-98ee-90fd72ce0abf for instance 71958974-984d-4158-830e-13745e965da1 on n-h2-833090-19 Sep 08 10:42:17.706865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-10fcf76f-7e91-459e-8e3c-8100b4be9c16 req-bd1592ca-c466-4fb8-8054-38c7a18d2990 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107985 Sep 08 10:42:17.707817 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2830/5444] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:18.198292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b16ef8df-8e8d-4bfe-b7cd-f57df04f5c8a req-77b85cbe-deee-46a3-b341-fd0a0ebe34ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc601a3-b200-4950-93aa-ae0dfffe4f51", "name": "network-vif-plugged", "status": "completed", "tag": "e74b4ea2-1119-4d53-a6c0-80768e7d8c84"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:18.243683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b16ef8df-8e8d-4bfe-b7cd-f57df04f5c8a req-77b85cbe-deee-46a3-b341-fd0a0ebe34ab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.246627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b16ef8df-8e8d-4bfe-b7cd-f57df04f5c8a req-77b85cbe-deee-46a3-b341-fd0a0ebe34ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.249551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b16ef8df-8e8d-4bfe-b7cd-f57df04f5c8a req-77b85cbe-deee-46a3-b341-fd0a0ebe34ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.310207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:18.312666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b16ef8df-8e8d-4bfe-b7cd-f57df04f5c8a req-77b85cbe-deee-46a3-b341-fd0a0ebe34ab service nova] Creating event network-vif-plugged:e74b4ea2-1119-4d53-a6c0-80768e7d8c84 for instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 on n-h2-833090-19 Sep 08 10:42:18.326296 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-241e4063-f6bf-4ca9-99a8-2f8b42d9fb76 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 200 len: 1681 microversion: 2.1 time: 1.663231 Sep 08 10:42:18.327149 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2615/5445] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:16 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 1681 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:18.335346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:18.345630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b16ef8df-8e8d-4bfe-b7cd-f57df04f5c8a req-77b85cbe-deee-46a3-b341-fd0a0ebe34ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155630 Sep 08 10:42:18.346510 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2831/5446] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:18.347218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:18.354150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.354669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.355102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.355873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:18.356335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:18.356767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:18.986353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:19.015654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b4f2a6d-e7fe-467e-bfcb-e65e37d63a2e tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1318 microversion: 2.1 time: 0.680856 Sep 08 10:42:19.019280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2616/5447] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:18 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:19.354142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:19.355491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:19.373281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.373795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.374240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.374960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:19.375420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:19.375879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:19.403349 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 HTTP/1.1 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '71958974-984d-4158-830e-13745e965da1'} Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:42:19.406044 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:42:19.410368 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:42:19.419410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:42:19.420937 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7b5a710-86af-47ed-8f31-93b55e8419a5 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 404 len: 111 microversion: 2.1 time: 0.073371 Sep 08 10:42:19.422097 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2832/5448] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:19 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:42:19.431052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01b743dc-9779-418c-b267-5939bb326a34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '.version_select at 0x7f2350119940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:19.487821 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01b743dc-9779-418c-b267-5939bb326a34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569896712" status: 202 len: 0 microversion: 2.1 time: 0.061147 Sep 08 10:42:19.494960 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2617/5449] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1569896712 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:42:20.057558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:20.058521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:20.074389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:20.075232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:20.077968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:20.081529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:20.086146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:20.087356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:21.287070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:21.303556 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-59b30db8-9464-4a31-8e65-3520708fe9a9 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1507 microversion: 2.1 time: 1.263621 Sep 08 10:42:21.324145 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2833/5450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:20 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1507 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:21.335588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dd44fee-0cfd-4950-ad29-90bf285a1aee", "device": "/dev/sdb"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:21.343558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:21.366775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:21.374365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:21.375734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:21.377217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:21.378467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:21.379774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:21.948592 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5542380-4ed7-4e86-a894-5546e23c38a7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "POST /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616954 Sep 08 10:42:21.975265 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2618/5451] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:42:21 2022] POST /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51/os-volume_attachments => generated 194 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:23.233304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d21dca5e-b79c-44de-83d3-018165aca408 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: .version_select at 0x7f234bc38430>, body: {"keypair": {"name": "tempest-keypair-797007011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrd5EZARtU2eoNuLcQLN4GvFrXD3XzbKW7bt3KgG+VFjj6zpHc6jmsnA2AqI6CA9puEITI+r3X3VOJJG45cHI1fUEYghLTgbbrMPL9+L0JgYQMtbigCuMRI9ajc1UycHg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:23.288910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d21dca5e-b79c-44de-83d3-018165aca408 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:23.303106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d21dca5e-b79c-44de-83d3-018165aca408 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:23.399226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d21dca5e-b79c-44de-83d3-018165aca408 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170394 Sep 08 10:42:23.400042 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2834/5452] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:42:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:27.981578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:27.983345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:28.003915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.005503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.007693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.010171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.011504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.013401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.029793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-183e67b2-33f1-4da7-ad2c-0d6e8a94eacd req-0003c930-8393-47cf-9990-62a88ef10f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:28.058415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-183e67b2-33f1-4da7-ad2c-0d6e8a94eacd req-0003c930-8393-47cf-9990-62a88ef10f7e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:28.064346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-183e67b2-33f1-4da7-ad2c-0d6e8a94eacd req-0003c930-8393-47cf-9990-62a88ef10f7e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:28.066944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-183e67b2-33f1-4da7-ad2c-0d6e8a94eacd req-0003c930-8393-47cf-9990-62a88ef10f7e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:28.125095 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-183e67b2-33f1-4da7-ad2c-0d6e8a94eacd req-0003c930-8393-47cf-9990-62a88ef10f7e service nova] Creating event network-changed:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h1-833090-19 Sep 08 10:42:28.140073 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-183e67b2-33f1-4da7-ad2c-0d6e8a94eacd req-0003c930-8393-47cf-9990-62a88ef10f7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117775 Sep 08 10:42:28.143275 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2835/5453] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:42:28.819834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:28.852018 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91fc82f5-720f-471e-a2c4-3b10df44ab45 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1564 microversion: 2.1 time: 0.875183 Sep 08 10:42:28.853186 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2619/5454] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:27 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1564 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:31.546925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1082836592", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04c0b3e9-1a56-4979-8ca2-71d86eb54d89"}], "security_groups": [{"name": "tempest-securitygroup--1679857506"}], "key_name": "tempest-keypair-797007011", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:32.300665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] validate_networks() for [('04c0b3e9-1a56-4979-8ca2-71d86eb54d89', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:42:32.858405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:33.332980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:33.540157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:42:33.540577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:42:33.541053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:42:33.541461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:42:33.541874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:42:33.580899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.581389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.581826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.582558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:33.583006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:33.583432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:33.640410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:42:33.652052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:42:33.685318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:42:33.690703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:42:33.837400 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7d64357-6596-4a24-a058-cbe99462ac4b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.298198 Sep 08 10:42:33.842270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2836/5455] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:42:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:42:33.854811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cf10652-66a6-481c-b009-17268fa9a002 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:33.856631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cf10652-66a6-481c-b009-17268fa9a002 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:33.860758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:33.972093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cf10652-66a6-481c-b009-17268fa9a002 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:33.983099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cf10652-66a6-481c-b009-17268fa9a002 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1241 microversion: 2.1 time: 0.132994 Sep 08 10:42:33.988537 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2620/5456] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:33 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:35.014801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:35.015359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:35.038082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.038591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.039048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.045724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:35.046264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:35.055148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:35.319345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:35.346504 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05f7d8fd-4b1e-4826-a27e-5e696ecd3d44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1237 microversion: 2.1 time: 0.335668 Sep 08 10:42:35.347799 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2837/5457] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:35 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1237 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:36.090132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:36.092607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:36.119802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.125162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.125915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.126708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.127186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.133254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.281688 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c42b5914-3803-42d0-ba08-e71d572e87cf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action" status: 200 len: 24572 microversion: 2.1 time: 0.196522 Sep 08 10:42:36.282892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2621/5458] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:42:36 2022] POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action => generated 24572 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:36.374385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:36.375087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:36.396491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.396992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.401409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:36.412295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:36.413004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:36.415089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:37.104320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:37.121304 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b56f5f6d-70d0-4a82-9c19-e1f8c09e9066 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1299 microversion: 2.1 time: 0.748799 Sep 08 10:42:37.122135 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2838/5459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:36 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1299 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:38.145649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:38.147542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:38.178085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.178451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.178907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.179949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:38.180934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:38.184750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:38.385185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:38.400462 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ddb6d1b-d0ba-41d2-b9ba-c139899d7b1d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1299 microversion: 2.1 time: 0.258927 Sep 08 10:42:38.401071 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2622/5460] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:38 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:39.425429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:39.426088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:39.450390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:39.453688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:39.454703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:39.457971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:39.458656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:39.461819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:40.125021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:40.154380 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19b43613-fe6f-416e-b74b-302ba07ef6ba tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1367 microversion: 2.1 time: 0.733132 Sep 08 10:42:40.158446 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2839/5461] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:39 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1367 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:41.178392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:41.179018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:41.191714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:41.192498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:41.193103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:41.195114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:41.196276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:41.197210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:41.548663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:41.556592 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7980674-d90f-43c4-b0ff-dc824ad41706 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1367 microversion: 2.1 time: 0.382081 Sep 08 10:42:41.578383 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2623/5462] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:41 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:41.783418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7a895c90-a412-415d-a919-984c73b99e28 req-f8d19dd2-ceb6-4aa0-83ca-4f02a887fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5c3a3e-cc41-425f-b0a1-2811c3063cf9", "tag": "bcb09304-187b-4ff7-9d72-5275c8303183"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:41.804173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a895c90-a412-415d-a919-984c73b99e28 req-f8d19dd2-ceb6-4aa0-83ca-4f02a887fa4a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:41.807077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a895c90-a412-415d-a919-984c73b99e28 req-f8d19dd2-ceb6-4aa0-83ca-4f02a887fa4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:41.811126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a895c90-a412-415d-a919-984c73b99e28 req-f8d19dd2-ceb6-4aa0-83ca-4f02a887fa4a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:41.816762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=76 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:41.826569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7a895c90-a412-415d-a919-984c73b99e28 req-f8d19dd2-ceb6-4aa0-83ca-4f02a887fa4a service nova] Creating event network-changed:bcb09304-187b-4ff7-9d72-5275c8303183 for instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 on n-h1-833090-19 Sep 08 10:42:41.842108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7a895c90-a412-415d-a919-984c73b99e28 req-f8d19dd2-ceb6-4aa0-83ca-4f02a887fa4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061650 Sep 08 10:42:41.843784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2840/5463] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:42.582174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:42.582908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:42.602517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.603296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.603932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:42.604813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.605472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.606151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:42.645147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:42.645869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:42.658875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.659381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.659852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:42.660566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:42.661066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:42.661497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:43.089517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:43.118670 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2a181ad1-34fd-4708-a1ab-f9d2ecd5a344 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1367 microversion: 2.1 time: 0.538896 Sep 08 10:42:43.122323 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2624/5464] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:42 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:43.295661 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0137f5ff-8155-48b2-a9a6-03d194868a21 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1836 microversion: 2.1 time: 0.653293 Sep 08 10:42:43.297844 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2841/5465] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:42 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1836 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:43.320944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:43.322567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:43.335956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:43.336749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:43.337587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:43.339899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:43.341772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:43.342404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:43.767846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:43.779233 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b172dea9-aa08-49ee-8820-6b8d1a05e488 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1683 microversion: 2.1 time: 0.463232 Sep 08 10:42:43.780114 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2625/5466] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:43 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1683 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:43.998065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:44.001313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:44.019584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:44.023753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:44.040913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.045746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.046211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.047817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.049174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.049621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.146951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:44.147802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:44.190643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:44.205608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.206093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.206533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.207251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.207752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.208166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.272432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:42:44.292458 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4acbd841-31ab-4e8f-9e8c-216f4e52a65b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action" status: 200 len: 32647 microversion: 2.1 time: 0.298556 Sep 08 10:42:44.313821 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2842/5467] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:42:43 2022] POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action => generated 32647 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:42:44.536068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:44.536995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:44.557515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.558020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.558470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.559355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:44.567961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:44.570095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:44.900056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '59c7760cbd8145078eca59e5f0edc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725757a3f886474dbeece60e9c3fc049', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:44.901155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] flavor_id is None. Assuming migration. {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 10:42:44.901850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:42:45.517469 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-874b4d46-efb2-45d8-91fb-46012e17ca40 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action" status: 202 len: 0 microversion: 2.1 time: 0.983741 Sep 08 10:42:45.518124 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2843/5468] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:42:44 2022] POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:42:45.543528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:45.544184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:45.575516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:45.582774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:45.586547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:45.590186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:45.592561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:45.598385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:46.529890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:46.545919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1954975-0334-4e40-8793-b2cf1377a9fe tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1692 microversion: 2.1 time: 1.023309 Sep 08 10:42:46.566467 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2844/5469] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:45 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1692 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:46.749600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:46.788145 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af3d5428-4f76-4d09-8a24-b55544b9a6ca tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1367 microversion: 2.1 time: 2.645601 Sep 08 10:42:46.798955 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2626/5470] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:44 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1367 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:47.576159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:47.576786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:47.599521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:47.600024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:47.600480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:47.601265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:47.608551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:47.609010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:47.821186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:47.822474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:47.839343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:47.840355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:47.841032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:47.842125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:47.856140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:47.857213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:48.760147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:48.770694 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7dc9127b-e865-46e3-974b-8dddd9de1a40 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1692 microversion: 2.1 time: 1.201430 Sep 08 10:42:48.779063 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2845/5471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:47 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1692 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:48.803985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:48.813808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08d8b5c3-4e1c-4e3f-b1b0-63160a616622 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1367 microversion: 2.1 time: 0.997770 Sep 08 10:42:48.825915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2627/5472] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:47 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1367 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:49.493204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a819b3dc-3458-4604-bcb5-d378452501ad req-4c4c2255-1119-4edd-a4f4-9814ec90347a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5c3a3e-cc41-425f-b0a1-2811c3063cf9", "name": "network-vif-plugged", "status": "completed", "tag": "bcb09304-187b-4ff7-9d72-5275c8303183"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:49.542584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a819b3dc-3458-4604-bcb5-d378452501ad req-4c4c2255-1119-4edd-a4f4-9814ec90347a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.544731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a819b3dc-3458-4604-bcb5-d378452501ad req-4c4c2255-1119-4edd-a4f4-9814ec90347a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.548350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a819b3dc-3458-4604-bcb5-d378452501ad req-4c4c2255-1119-4edd-a4f4-9814ec90347a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.598612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a819b3dc-3458-4604-bcb5-d378452501ad req-4c4c2255-1119-4edd-a4f4-9814ec90347a service nova] Creating event network-vif-plugged:bcb09304-187b-4ff7-9d72-5275c8303183 for instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 on n-h1-833090-19 Sep 08 10:42:49.623358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a819b3dc-3458-4604-bcb5-d378452501ad req-4c4c2255-1119-4edd-a4f4-9814ec90347a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133944 Sep 08 10:42:49.639190 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2846/5473] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:49.806000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:49.806620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:49.827073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.827765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.828125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.828842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.829532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.844257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:49.845243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:49.859712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.870017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.884967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.885422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:49.886333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:49.891043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:49.891579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:50.350497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:50.359932 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9c89a1a-eeea-4713-bbae-ebe169a77a16 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1692 microversion: 2.1 time: 0.559226 Sep 08 10:42:50.384440 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2628/5474] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:49 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1692 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:51.396521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:51.398797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:51.422136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.424125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.426146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:51.432662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:51.433329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:51.433896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:52.795826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:52.818813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecde75d5-35df-477f-a361-0eacbc103b25 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1367 microversion: 2.1 time: 2.982105 Sep 08 10:42:52.821094 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2847/5475] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:49 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1367 bytes in 2986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:42:53.261348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:53.273075 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f76f47d-3f73-4c47-b42c-1aa0a20e64f8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1692 microversion: 2.1 time: 1.882300 Sep 08 10:42:53.275820 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2629/5476] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:51 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1692 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:53.846200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:53.847598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:53.860946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:53.862809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:53.864659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:53.867295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:53.869005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:53.870486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.300657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:54.302024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:54.325754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.326738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.327379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.328335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.328872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.329996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.637314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:54.653631 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd293306-fbbc-47a9-98eb-d298b2d2c87f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1556 microversion: 2.1 time: 0.810712 Sep 08 10:42:54.657974 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2848/5477] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:53 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1556 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:54.684257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:54.685631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:54.698700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.701766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.702640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.704350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:54.706892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:54.707550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:54.926712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:54.951748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68137f05-ae6c-4416-b205-d6265c143c21 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1692 microversion: 2.1 time: 0.654874 Sep 08 10:42:54.976379 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2630/5478] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:54 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1692 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:55.118806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f40911e-4fd5-4029-abfb-fe4da5ed241c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.440563 Sep 08 10:42:55.128355 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2849/5479] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:42:54 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-interface => generated 284 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:56.000283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:56.001015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:56.014464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:56.014957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:56.015396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:56.024157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:56.024654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:56.025097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:58.096651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:58.108817 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee0d6ab2-3e95-4eb2-abca-e251f432ca96 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1697 microversion: 2.1 time: 2.112194 Sep 08 10:42:58.109943 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2631/5480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:55 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1697 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:42:59.139087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:42:59.140419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:42:59.163094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.163735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.164186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:59.164927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.165388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.165812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:59.763676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-219def73-7e91-46d9-bf7a-10f334601f82 req-ba93b948-a467-4506-8754-e2ff71a6b47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5c3a3e-cc41-425f-b0a1-2811c3063cf9", "tag": "bcb09304-187b-4ff7-9d72-5275c8303183"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:42:59.789260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-219def73-7e91-46d9-bf7a-10f334601f82 req-ba93b948-a467-4506-8754-e2ff71a6b47a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:42:59.790000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-219def73-7e91-46d9-bf7a-10f334601f82 req-ba93b948-a467-4506-8754-e2ff71a6b47a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:42:59.791809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-219def73-7e91-46d9-bf7a-10f334601f82 req-ba93b948-a467-4506-8754-e2ff71a6b47a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:42:59.820467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-219def73-7e91-46d9-bf7a-10f334601f82 req-ba93b948-a467-4506-8754-e2ff71a6b47a service nova] Creating event network-changed:bcb09304-187b-4ff7-9d72-5275c8303183 for instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 on n-h1-833090-19 Sep 08 10:42:59.834397 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-219def73-7e91-46d9-bf7a-10f334601f82 req-ba93b948-a467-4506-8754-e2ff71a6b47a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071960 Sep 08 10:42:59.836302 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2632/5481] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:42:59.861117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:42:59.870774 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-769c9ae1-b4b8-4914-a519-d0944bd8581b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1697 microversion: 2.1 time: 0.736829 Sep 08 10:42:59.900795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2850/5482] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:42:59 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1697 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:00.902406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:00.903950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:00.937092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:00.941052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:00.942819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:00.950396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:00.953964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:00.955959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:02.190035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:02.199880 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-78fb09a4-75a3-4c0e-abe5-54568c7c714e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1697 microversion: 2.1 time: 1.305238 Sep 08 10:43:02.224145 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2633/5483] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:00 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1697 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:03.235798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:03.236436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:03.241282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:03.277053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:03.277580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:03.281894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:03.282741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:03.292483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:03.299666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:04.612380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:04.630247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a5768cc-d815-4415-a55b-1d3fb64bd20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1697 microversion: 2.1 time: 1.398971 Sep 08 10:43:04.653234 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2851/5484] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:03 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1697 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:05.597039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:05.597610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:05.607130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=30 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:05.623684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:05.626521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:05.627156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:05.632992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:05.633701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:05.634406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:05.656210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:05.657441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:05.682911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:05.685752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:05.687598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:05.688589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:05.689229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:05.689843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:05.869157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lazy-loading 'services' on Instance uuid 8cc601a3-b200-4950-93aa-ae0dfffe4f51 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:06.097470 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd732e64-527b-471d-948d-349f82e839f7 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51/os-volume_attachments/0dd44fee-0cfd-4950-ad29-90bf285a1aee" status: 202 len: 0 microversion: 2.1 time: 0.504260 Sep 08 10:43:06.098753 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2634/5485] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:43:05 2022] DELETE /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51/os-volume_attachments/0dd44fee-0cfd-4950-ad29-90bf285a1aee => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:43:06.858418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:06.882978 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fefe1a9-bd77-4713-8d9f-fa173e8c36fa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1697 microversion: 2.1 time: 1.220509 Sep 08 10:43:06.884069 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2852/5486] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:05 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1697 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:07.907536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:07.909105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:07.922397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.923165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.926675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:07.928219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:07.933104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:07.936122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:08.415133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:08.433619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5ed787f-f891-4df0-82c1-715ec90bf89c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1696 microversion: 2.1 time: 0.530783 Sep 08 10:43:08.437115 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2635/5487] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:07 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1696 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:09.444204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "name": "network-vif-unplugged", "status": "completed", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:09.462847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:09.463598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:09.473363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.473853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.474287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.486622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.487131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.493034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.494231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:09.494860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:09.495449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:09.515289 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] Creating event network-vif-unplugged:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h2-833090-19 Sep 08 10:43:09.537962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] Instance 419071bb-bb3b-4292-9443-efc91596b2a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:43:09.580970 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-846d61b7-a9c0-4464-bda0-29cf02cf0049 req-76917e04-bebe-4178-a4a8-f212dbe7309e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140780 Sep 08 10:43:09.581626 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2853/5488] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:10.783486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:10.800906 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-60ed3230-cdca-4f95-9ead-1eab29b52238 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1696 microversion: 2.1 time: 1.342800 Sep 08 10:43:10.814966 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2636/5489] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:09 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1696 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:11.674897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:11.698191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.701778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.702551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.735697 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] Creating event network-changed:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h2-833090-19 Sep 08 10:43:11.745924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] Instance 419071bb-bb3b-4292-9443-efc91596b2a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:43:11.768054 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-99154aaf-411e-41fa-965d-8ba88047739e req-38979a36-3720-40d3-89be-a73eaa7262b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099612 Sep 08 10:43:11.784538 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2854/5490] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:11.830131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:11.830997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:11.840529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.843381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.843934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:11.845204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:11.848853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:11.850238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:13.634660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:13.648228 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce9ef80f-331e-4c5b-88f3-5f45761cb3ca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1696 microversion: 2.1 time: 1.822100 Sep 08 10:43:13.649336 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2637/5491] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:11 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1696 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:14.677833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:14.678415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:14.688610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.689110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.689554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.690277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:14.694826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:14.695597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:14.702885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:15.427248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:15.428740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:15.435851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.436344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.437040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.437968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.438620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.439241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.466929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:15.472652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:43:15.627413 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5816d64e-a897-45bd-94e5-d677e781c6ee tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 204 len: 0 microversion: 2.1 time: 0.204061 Sep 08 10:43:15.628620 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2638/5492] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:43:15 2022] DELETE /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:43:15.637708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:15.638815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:15.647105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.647963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.648596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.651852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:15.652494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:15.653253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:15.660192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:15.671827 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f87453e-565c-4097-8ae1-65bc72e24782 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1694 microversion: 2.1 time: 1.000027 Sep 08 10:43:15.672436 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2855/5493] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:14 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1694 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:16.548242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:16.576085 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-781da013-3aeb-4c60-bc72-f11a2f0e551a tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1559 microversion: 2.1 time: 0.939706 Sep 08 10:43:16.580589 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2639/5494] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:15 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1559 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:16.700370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:16.701069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:16.714984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:16.715505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:16.715948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:16.716668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:16.717129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:16.717561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.499836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:17.511381 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-23c3d247-4bab-4863-89c2-85c1314cdce1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1694 microversion: 2.1 time: 0.814903 Sep 08 10:43:17.513469 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2856/5495] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:16 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1694 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:17.607046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:17.607852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:17.619788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.620884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.621567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:17.623129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:17.624227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:17.634904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.040680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:18.064100 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d345f205-1a29-45ef-b2a7-0f3f6ce6e609 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1513 microversion: 2.1 time: 0.454519 Sep 08 10:43:18.070126 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2640/5496] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:17 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:18.541993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:18.543301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:18.554143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.564032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.564892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:18.570860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:18.572663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:18.573378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.085790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:19.086558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:19.101787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.111597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.113472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.114994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.115835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.116579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.492931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:19.509625 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7f7a0f8-a79a-49c3-b0a8-bd99c7d286bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1691 microversion: 2.1 time: 0.969473 Sep 08 10:43:19.511254 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2857/5497] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:18 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1691 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:19.537853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:19.538827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:19.550027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.556769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.558185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.559183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.560612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.561789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.748249 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4519f688-d6d4-47a8-bb6a-d735ba124ca0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action" status: 204 len: 0 microversion: 2.1 time: 0.214291 Sep 08 10:43:19.754067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2858/5498] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:43:19 2022] POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:43:19.775138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:19.777448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:19.811592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.812340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.813256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:19.816995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:19.818783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:19.821710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:21.027238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:21.039868 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f3b736e-d586-4eb9-8f6b-29468a5c37a4 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1513 microversion: 2.1 time: 1.960087 Sep 08 10:43:21.041133 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2641/5499] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:19 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1513 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:21.537817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:21.556007 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c185557d-268a-4d03-baa8-6a352e98e3eb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1691 microversion: 2.1 time: 1.793481 Sep 08 10:43:21.557057 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2859/5500] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:19 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1691 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:21.613426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f3c97e52-48ac-4c76-8f55-f2ded6a34d67 req-f1da29bd-d6a9-4aca-998d-eae885c4e161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc601a3-b200-4950-93aa-ae0dfffe4f51", "name": "network-vif-deleted", "tag": "e74b4ea2-1119-4d53-a6c0-80768e7d8c84"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:21.640928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f3c97e52-48ac-4c76-8f55-f2ded6a34d67 req-f1da29bd-d6a9-4aca-998d-eae885c4e161 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:21.641674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f3c97e52-48ac-4c76-8f55-f2ded6a34d67 req-f1da29bd-d6a9-4aca-998d-eae885c4e161 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:21.643244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f3c97e52-48ac-4c76-8f55-f2ded6a34d67 req-f1da29bd-d6a9-4aca-998d-eae885c4e161 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:21.671847 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f3c97e52-48ac-4c76-8f55-f2ded6a34d67 req-f1da29bd-d6a9-4aca-998d-eae885c4e161 service nova] Creating event network-vif-deleted:e74b4ea2-1119-4d53-a6c0-80768e7d8c84 for instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 on n-h2-833090-19 Sep 08 10:43:21.687141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f3c97e52-48ac-4c76-8f55-f2ded6a34d67 req-f1da29bd-d6a9-4aca-998d-eae885c4e161 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077100 Sep 08 10:43:21.689453 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2642/5501] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:22.068535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.069320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.087392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.088234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.088847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.090185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.090613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.091216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.147441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.147626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.148084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.148553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lazy-loading 'fault' on Instance uuid 8cc601a3-b200-4950-93aa-ae0dfffe4f51 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:22.242378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e98052d13648a7855c88dc03e71316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe4f9b70c534d41bbe54d0b8f736395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.251280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6fdeb1d5-b967-4722-a092-8b9dd9a53438 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 200 len: 1308 microversion: 2.1 time: 0.187133 Sep 08 10:43:22.271883 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2860/5502] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:22.584866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:22.585572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:22.606025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.606529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.606972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.607725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:22.608188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:22.608630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:22.982047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:22.995186 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0366a3fc-4cbf-408e-b0a0-0d4ff994b07f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1691 microversion: 2.1 time: 0.414133 Sep 08 10:43:22.997166 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2643/5503] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:22 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1691 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:23.280110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:23.281668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] [instance: 8cc601a3-b200-4950-93aa-ae0dfffe4f51] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:23.298095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.300655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.302317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.303430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.304171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.305209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.358443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] HTTP exception thrown: Instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 could not be found. Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Request method failure captured: Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 HTTP/1.1 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcXzb6rDA3Owz6QgaWmQgw3yWSubqKTadP0HtwgATTuyCDiap1Q_eCZhIaq0aKM-i9n3XXYUoqkkA2ijr2c0kCPioevxZC6KzNCz9pW2ZmqbkCQZwNtESUP3Kfxq9NJIiZuRVgbDyRTuSc0iNLsrQhi9nboVLkBfvHZUpSqTh6DYBik Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 9fe4f9b70c534d41bbe54d0b8f736395 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1265578189 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9fe4f9b70c534d41bbe54d0b8f736395"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9fe4f9b70c534d41bbe54d0b8f736395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9fe4f9b70c534d41bbe54d0b8f736395"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9fe4f9b70c534d41bbe54d0b8f736395", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesSnapshotTestJSON-1265578189 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 9fe4f9b70c534d41bbe54d0b8f736395 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1265578189 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesSnapshotTestJSON-1265578189-project Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: e4e98052d13648a7855c88dc03e71316 Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesSnapshotTestJSON-1265578189-project Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 could not be found. Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '8cc601a3-b200-4950-93aa-ae0dfffe4f51'} Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 could not be found. Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 could not be found. Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:23.360640 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 could not be found. Sep 08 10:43:23.364541 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:43:23.370032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] Returning 404 to user: Instance 8cc601a3-b200-4950-93aa-ae0dfffe4f51 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:43:23.371768 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-055b2268-179a-4977-917a-cf8e12f4d063 tempest-VolumesSnapshotTestJSON-1265578189 tempest-VolumesSnapshotTestJSON-1265578189-project] 10.222.0.59 "GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51" status: 404 len: 111 microversion: 2.1 time: 0.097510 Sep 08 10:43:23.372920 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2861/5504] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:23 2022] GET /compute/v2.1/servers/8cc601a3-b200-4950-93aa-ae0dfffe4f51 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:43:23.454641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "name": "network-vif-plugged", "status": "completed", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:23.474143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:23.474708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:23.477824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:23.504885 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] Creating event network-vif-plugged:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h2-833090-19 Sep 08 10:43:23.525575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] Instance 419071bb-bb3b-4292-9443-efc91596b2a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:43:23.550967 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-496f33d8-eb50-489c-b2cd-f170ba50ada9 req-d7b5ceb6-ca5f-4494-971f-60d51f528c29 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097633 Sep 08 10:43:23.552154 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2644/5505] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:43:24.025172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:24.025881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:24.036944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.037456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.037900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.043526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:24.044306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:24.047235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:24.648836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:24.671744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6a447e8-2f3f-47f8-a024-abb898ea560d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1691 microversion: 2.1 time: 0.655828 Sep 08 10:43:24.685098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2862/5506] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:24 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1691 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:25.479521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.480994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.507686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.509103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.509798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.510814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.511645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.512308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.559753 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-024603e7-59dc-467d-a08f-1e8fecbd5a87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/ips" status: 200 len: 149 microversion: 2.1 time: 0.086621 Sep 08 10:43:25.561733 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2645/5507] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/ips => generated 149 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:25.698653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:25.699548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:25.714317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.714812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.715251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:25.724206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:25.724768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:25.725219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:26.268590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:26.295772 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25ea410b-abe4-437b-b5f0-411a647403d1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1683 microversion: 2.1 time: 0.601448 Sep 08 10:43:26.298521 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2863/5508] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:25 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1683 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:28.439318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52b1d0c-4b5f-472b-9edd-58b9b131b68c"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:28.442049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:28.472187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.472698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.473141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.474515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:28.474982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:28.475480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:28.985828 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b05bfa3d-b812-4c49-87aa-d53dde5a270f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549613 Sep 08 10:43:28.990157 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2646/5509] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:43:28 2022] POST /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:30.912951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2062169721", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8c1bf5b9-81e2-42ba-889e-06dfebf552da"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:31.007681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] validate_networks() for [('8c1bf5b9-81e2-42ba-889e-06dfebf552da', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:43:32.389922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:43:32.390421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:43:32.390803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:43:32.391229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:43:32.391813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:43:32.405754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.406244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.406681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.407398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.408043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.408635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.449261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Getting quotas for project 4578e57d5bec4c35a9421ac29bae16a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:43:32.456010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Getting quotas for user 49b2d771cc4043c4a3579e19c9394051 and project 4578e57d5bec4c35a9421ac29bae16a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:43:32.472480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Going to run 2 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:43:32.475628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:32.520393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:43:32.629237 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64c2c5a0-92db-46d4-b0bc-9e460378a6e7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001385 Sep 08 10:43:32.636286 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2864/5510] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:43:32.642065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.647174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.651879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Searching by: {'deleted': False, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:43:32.690145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.690638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.691076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.703530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:32.703716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:32.704165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:32.752311 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aedda419-f7c2-4166-9969-c1213b0ebdcd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.112816 Sep 08 10:43:32.753627 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2647/5511] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers => generated 677 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:32.765824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e9bf670-4cff-4867-95c8-13e7ff0d31c8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:32.766491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e9bf670-4cff-4867-95c8-13e7ff0d31c8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:32.918641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2e9bf670-4cff-4867-95c8-13e7ff0d31c8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:32.925720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e9bf670-4cff-4867-95c8-13e7ff0d31c8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1220 microversion: 2.1 time: 0.163846 Sep 08 10:43:32.944135 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2865/5512] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:32 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1220 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:33.949464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70e20c8a-220e-4740-a776-3bd20b0a147e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:33.950371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70e20c8a-220e-4740-a776-3bd20b0a147e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:34.437736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70e20c8a-220e-4740-a776-3bd20b0a147e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:34.445503 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70e20c8a-220e-4740-a776-3bd20b0a147e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1220 microversion: 2.1 time: 0.500059 Sep 08 10:43:34.448924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2648/5513] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:33 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1220 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:35.474948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:35.478065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:35.497848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:35.503839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.506383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.507792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.511974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:35.514262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:35.516189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:35.863134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:35.898694 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a50e2e86-16c5-46f9-9469-38a5c9a7896c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1280 microversion: 2.1 time: 0.430309 Sep 08 10:43:35.905307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2866/5514] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:35 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1280 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:36.924237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:36.924856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:36.938601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:36.946423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.948050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.948507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:36.949249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:36.949709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:36.950141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:37.641469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:37.658263 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-79619fea-7328-4f42-9c94-6463e8b0e2b4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1278 microversion: 2.1 time: 0.733812 Sep 08 10:43:37.659606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2649/5515] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:36 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1278 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:38.690429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:38.696401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:38.728382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.736078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.736855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:38.737772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:38.752100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:38.758225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:39.059979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:39.075358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1dfbbd0b-95ff-4c83-bc4e-5d1530d062aa tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1278 microversion: 2.1 time: 0.388752 Sep 08 10:43:39.084799 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2867/5516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:38 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1278 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:40.131780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:40.132403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:40.150782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:40.151283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:40.151942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:40.157058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:40.157058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:40.157058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:41.150516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:41.173833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-64acb735-5972-4d91-9d24-5b859ed1f35d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 1.045848 Sep 08 10:43:41.185338 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2650/5517] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:40 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:42.211496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:42.212137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:42.231401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.231910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.233280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.233280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:42.233605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:42.233993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:42.435286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:42.925910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:43.237891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:43.254390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1145bf6c-5c67-455c-9faf-bb6c297ee999 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 1.046042 Sep 08 10:43:43.263884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2868/5518] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:42 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:44.319044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:44.320296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:44.330017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:44.331695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:44.337134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:44.337626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:44.340863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:44.342687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:44.343360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:44.402521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b93ea42b-70b0-4e85-a068-b35c7508c370 req-a6bb695c-845a-4d67-83cd-2b353cfcfe90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5c7169-f9ec-4f43-9ead-267602145827", "tag": "7b5eae09-8a4c-496c-964c-ba419e7aec24"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:44.452356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:44.490399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b93ea42b-70b0-4e85-a068-b35c7508c370 req-a6bb695c-845a-4d67-83cd-2b353cfcfe90 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:44.490893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b93ea42b-70b0-4e85-a068-b35c7508c370 req-a6bb695c-845a-4d67-83cd-2b353cfcfe90 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:44.506656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b93ea42b-70b0-4e85-a068-b35c7508c370 req-a6bb695c-845a-4d67-83cd-2b353cfcfe90 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:44.535743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b93ea42b-70b0-4e85-a068-b35c7508c370 req-a6bb695c-845a-4d67-83cd-2b353cfcfe90 service nova] Creating event network-changed:7b5eae09-8a4c-496c-964c-ba419e7aec24 for instance ca5c7169-f9ec-4f43-9ead-267602145827 on n-h1-833090-19 Sep 08 10:43:44.545254 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b93ea42b-70b0-4e85-a068-b35c7508c370 req-a6bb695c-845a-4d67-83cd-2b353cfcfe90 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152711 Sep 08 10:43:44.546217 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2869/5519] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:45.526546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:45.529804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:45.553329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-95247b71-69c4-446f-ad36-903c9aabcdc9 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 1.238463 Sep 08 10:43:45.570393 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2651/5520] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:44 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:46.588507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:46.589282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:46.608260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:46.611023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:46.622447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:46.624528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:46.627217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:46.629233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:46.715617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:43:46.719063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52b1d0c-4b5f-472b-9edd-58b9b131b68c"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:46.722654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:46.742966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:46.743483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:46.744240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:46.745122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:46.745917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:46.747096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:46.971055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Invalid volume: volume d52b1d0c-4b5f-472b-9edd-58b9b131b68c is already attached to instances: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments HTTP/1.1 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 74 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: {"volumeAttachment": {"volumeId": "d52b1d0c-4b5f-472b-9edd-58b9b131b68c"}} Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid volume: volume d52b1d0c-4b5f-472b-9edd-58b9b131b68c is already attached to instances: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': 'aa5c3a3e-cc41-425f-b0a1-2811c3063cf9', 'body': {'volumeAttachment': {'volumeId': 'd52b1d0c-4b5f-472b-9edd-58b9b131b68c'}}} Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d52b1d0c-4b5f-472b-9edd-58b9b131b68c is already attached to instances: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:43:46.984640 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d52b1d0c-4b5f-472b-9edd-58b9b131b68c is already attached to instances: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d52b1d0c-4b5f-472b-9edd-58b9b131b68c is already attached to instances: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 Sep 08 10:43:46.988945 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:43:46.994026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 400 to user: Invalid volume: volume d52b1d0c-4b5f-472b-9edd-58b9b131b68c is already attached to instances: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:43:46.996111 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5f2ad0b-e762-4b64-ab9b-5212ccba1dad tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.284248 Sep 08 10:43:46.997299 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2652/5521] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:43:46 2022] POST /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 174 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 10:43:47.144458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:47.145121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:47.166305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.166810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.167241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.168577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.169096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.169556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.306810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lazy-loading 'services' on Instance uuid aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:43:47.444587 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-77e8eb09-7477-4945-8a8a-ffe546808df1 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments/d52b1d0c-4b5f-472b-9edd-58b9b131b68c" status: 202 len: 0 microversion: 2.1 time: 0.304066 Sep 08 10:43:47.447997 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2653/5522] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:43:47 2022] DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments/d52b1d0c-4b5f-472b-9edd-58b9b131b68c => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:43:47.494382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:47.502456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:47.512762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:47.526874 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1011b624-06e9-4649-8b21-48ff0ee0bfc6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 0.945235 Sep 08 10:43:47.527696 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2870/5523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:46 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:47.532452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.533239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.533901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.535903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.536623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.537303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.539825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1afbbae1-7779-49c4-a24f-39d2743783e6 req-10a192f5-4d62-44a4-8030-68e1dc0778a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad", "tag": "3c7f4079-6b0d-45dc-8674-98a6df7d409f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:47.555168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1afbbae1-7779-49c4-a24f-39d2743783e6 req-10a192f5-4d62-44a4-8030-68e1dc0778a3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:47.555684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1afbbae1-7779-49c4-a24f-39d2743783e6 req-10a192f5-4d62-44a4-8030-68e1dc0778a3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:47.560113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1afbbae1-7779-49c4-a24f-39d2743783e6 req-10a192f5-4d62-44a4-8030-68e1dc0778a3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:47.588799 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1afbbae1-7779-49c4-a24f-39d2743783e6 req-10a192f5-4d62-44a4-8030-68e1dc0778a3 service nova] Creating event network-changed:3c7f4079-6b0d-45dc-8674-98a6df7d409f for instance 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad on n-h2-833090-19 Sep 08 10:43:47.603751 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cba91a9e-5da1-45ce-a43e-09196a432a96 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149683 Sep 08 10:43:47.604196 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1afbbae1-7779-49c4-a24f-39d2743783e6 req-10a192f5-4d62-44a4-8030-68e1dc0778a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073370 Sep 08 10:43:47.605579 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2654/5524] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:47 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:47.606021 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2871/5525] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:48.557354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:48.559971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:48.570949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:48.571688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:48.572315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:48.573274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:48.573909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:48.574566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:48.618973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:48.622727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:48.636047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:48.636940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:48.637730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:48.638730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:48.639608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:48.640720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:48.691176 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c1825a2-b239-4829-afb3-6219489a760e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076783 Sep 08 10:43:48.692162 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2872/5526] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:48 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:43:49.425705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:49.455003 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7bafd8e-2b95-409c-83fe-a81102f8f784 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 0.898599 Sep 08 10:43:49.457109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2655/5527] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:48 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:49.707918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:49.712293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:49.759027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:49.759663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:49.760114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:49.760850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:49.764579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:49.765134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:49.861979 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11600fb6-1a02-4d61-97b0-e3e72adf8db7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161163 Sep 08 10:43:49.866602 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2873/5528] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:49 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:50.482402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:50.483934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:50.498741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:50.504075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:50.506977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:50.508111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:50.508699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:50.512031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:50.881828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:50.886400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:50.902821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:50.909210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:50.910638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:50.911611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:50.912319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:50.912935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:51.031739 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01ec1529-eb28-421d-8494-41c21b7acaa7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161602 Sep 08 10:43:51.052562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2874/5529] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:50 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:43:52.052214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:52.055400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:52.069214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:52.080285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:52.082070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:52.086984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:52.088060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:52.088598 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8839dadc-509a-4b04-99d3-088b5bf31b81 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 1.610404 Sep 08 10:43:52.088898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:52.089501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:52.111909 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2656/5530] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:50 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:52.225622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7568dbc8-cb32-4d92-aead-648e02445c72 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184364 Sep 08 10:43:52.234648 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2875/5531] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:52 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:43:53.120263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:53.121203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:53.139898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:53.143107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:53.143901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:53.145433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:53.147229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:53.148720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:53.197724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:53.202832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:53.226209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:53.229420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:53.232146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:53.232604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:53.233047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:53.241330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:53.342944 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b389462f-0c4b-435d-b881-b5b7467ef7c7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action" status: 200 len: 24573 microversion: 2.1 time: 0.154328 Sep 08 10:43:53.348493 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2876/5532] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:43:53 2022] POST /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3/action => generated 24573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:43:53.354423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:53.358915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:53.368358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:53.369260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:53.372143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:53.373113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:53.373754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:53.376622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:53.481845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80f00fa1-2628-4bcc-a5fc-b8e1ba71a2ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131705 Sep 08 10:43:53.484513 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2877/5533] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:53 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:54.127382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:54.135619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e6df20dc-8a93-4b12-b1fb-b27509af8b0f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 1.019785 Sep 08 10:43:54.136211 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2657/5534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:53 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:54.497491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:54.500178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:54.517009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:54.517760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:54.519141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:54.524421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:54.525365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:54.525991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:54.601300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-990c58af-cdaf-4ea6-87ef-8b46b21e1962 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107870 Sep 08 10:43:54.607742 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2878/5535] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:54 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:55.160268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:55.161169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:55.168982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:55.169953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:55.170605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:55.171697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:55.172373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:55.173200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:55.182065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-be7c2917-e16e-4bfb-ae7c-12efeeafd96f req-cdce159e-d677-425d-a194-8d7160c979d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5c7169-f9ec-4f43-9ead-267602145827", "name": "network-vif-plugged", "status": "completed", "tag": "7b5eae09-8a4c-496c-964c-ba419e7aec24"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:55.198873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-be7c2917-e16e-4bfb-ae7c-12efeeafd96f req-cdce159e-d677-425d-a194-8d7160c979d6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:55.202849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-be7c2917-e16e-4bfb-ae7c-12efeeafd96f req-cdce159e-d677-425d-a194-8d7160c979d6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:55.203560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-be7c2917-e16e-4bfb-ae7c-12efeeafd96f req-cdce159e-d677-425d-a194-8d7160c979d6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:55.250036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-be7c2917-e16e-4bfb-ae7c-12efeeafd96f req-cdce159e-d677-425d-a194-8d7160c979d6 service nova] Creating event network-vif-plugged:7b5eae09-8a4c-496c-964c-ba419e7aec24 for instance ca5c7169-f9ec-4f43-9ead-267602145827 on n-h1-833090-19 Sep 08 10:43:55.262763 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-be7c2917-e16e-4bfb-ae7c-12efeeafd96f req-cdce159e-d677-425d-a194-8d7160c979d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085079 Sep 08 10:43:55.264074 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2879/5536] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:43:55.616667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:55.621923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:55.634083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:55.636354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:55.637967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:55.638770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:55.639197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:55.639660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:55.671289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:55.680577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cac91c40-b142-4d77-9323-284cc9fec548 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 0.525151 Sep 08 10:43:55.715406 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2658/5537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:55 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:55.718137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ee87562-6f87-4bef-b270-102bd7374dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107539 Sep 08 10:43:55.718720 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2880/5538] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:55 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:43:56.717730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:56.718339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:56.730920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:56.732949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:56.733448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:56.733722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:56.733879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:56.738123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:56.738813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:56.740978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:56.751371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:56.753213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:56.753948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:56.756673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:56.758449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:56.759509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:56.862175 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-33711ac5-33c8-4261-9f21-801fd19cadaa tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134182 Sep 08 10:43:56.865923 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2881/5539] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:56 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:57.707330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7a0d2aab-a8d0-4037-80d6-e699f7f59e3f req-3be50014-6af5-423e-9630-6db4eca093bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad", "name": "network-vif-plugged", "status": "completed", "tag": "3c7f4079-6b0d-45dc-8674-98a6df7d409f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:43:57.723630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a0d2aab-a8d0-4037-80d6-e699f7f59e3f req-3be50014-6af5-423e-9630-6db4eca093bb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:57.725265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a0d2aab-a8d0-4037-80d6-e699f7f59e3f req-3be50014-6af5-423e-9630-6db4eca093bb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:57.726889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a0d2aab-a8d0-4037-80d6-e699f7f59e3f req-3be50014-6af5-423e-9630-6db4eca093bb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:57.762000 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7a0d2aab-a8d0-4037-80d6-e699f7f59e3f req-3be50014-6af5-423e-9630-6db4eca093bb service nova] Creating event network-vif-plugged:3c7f4079-6b0d-45dc-8674-98a6df7d409f for instance 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad on n-h2-833090-19 Sep 08 10:43:57.772467 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7a0d2aab-a8d0-4037-80d6-e699f7f59e3f req-3be50014-6af5-423e-9630-6db4eca093bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069428 Sep 08 10:43:57.775972 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2882/5540] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:43:57.868252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:57.882072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:57.886812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:57.894934 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-069b1cc0-8b2c-4306-93cf-7c7caa9a24b7 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1320 microversion: 2.1 time: 1.180788 Sep 08 10:43:57.905301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:57.906092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:57.906748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:57.910329 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2659/5541] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:56 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1320 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:57.918840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:57.921940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:57.922421 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:58.008238 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea8a50d2-0c89-40ae-9dbd-3d331305a1e4 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137341 Sep 08 10:43:58.015687 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2883/5542] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:43:57 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:43:58.100542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:58.101367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:58.107736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:58.108612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:58.109258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:58.110207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:58.110870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:58.111557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:58.143176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:43:58.243012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a54378c-9cb6-4a2b-a934-99daa525a04d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 204 len: 0 microversion: 2.1 time: 0.148233 Sep 08 10:43:58.243803 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2660/5543] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:43:58 2022] DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:43:58.256905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:58.257708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:58.270825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:58.272993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:58.273682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:58.275167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:58.275901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:58.276805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:58.535486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:58.553948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61fe8389-af08-4062-8856-478035c7330f tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1681 microversion: 2.1 time: 0.303413 Sep 08 10:43:58.554606 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2884/5544] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:58 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:43:58.922606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:58.924045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:58.932113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:58.933033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:58.933724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:58.934661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:58.935352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:58.936022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:59.461073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:43:59.476307 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f05e2d56-2575-4c2b-aa06-b2cea303627f tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 200 len: 1509 microversion: 2.1 time: 0.554107 Sep 08 10:43:59.476861 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2661/5545] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:58 2022] GET /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:43:59.503792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:59.505220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:59.514061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:59.514930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:59.516611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:59.517586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:59.518305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:59.518958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:59.582831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:43:59.584293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:43:59.605717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:59.607538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:59.609440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:43:59.614383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:43:59.615306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:43:59.618225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:00.134254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:00.142519 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e05ae7be-7802-48e0-9e53-94931bdf19d6 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad" status: 200 len: 1320 microversion: 2.1 time: 0.642976 Sep 08 10:44:00.147681 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2885/5546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:59 2022] GET /compute/v2.1/servers/7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad => generated 1320 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:00.183685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:00.208570 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1db09c3-ae4f-4c14-8ebb-710917579011 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1681 microversion: 2.1 time: 0.631503 Sep 08 10:44:00.209853 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2662/5547] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:43:59 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1681 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:01.176936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:01.177554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:01.193309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:01.194141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:01.194828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:01.195842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:01.196540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:01.197205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:01.233979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:01.236626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:01.252611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:01.265430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:01.269180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:01.272659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:01.273516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:01.274485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:01.993147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:02.007143 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82dd96f7-c967-4ab8-9b4b-2a83b2a11872 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad" status: 200 len: 1508 microversion: 2.1 time: 0.835457 Sep 08 10:44:02.008045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2886/5548] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:01 2022] GET /compute/v2.1/servers/7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad => generated 1508 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:02.038237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:02.039310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:02.047573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.048426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.049792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.051232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.052018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.052905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.091500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:02.200365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:02.271926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54515112-fb29-4bb1-bbba-4e5442d862c4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad" status: 204 len: 0 microversion: 2.1 time: 0.238847 Sep 08 10:44:02.278905 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2887/5549] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:02 2022] DELETE /compute/v2.1/servers/7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:02.297397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:02.298420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:02.313383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.314903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.316552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.317453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:02.318378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:02.319096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:02.372570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: ca5c7169-f9ec-4f43-9ead-267602145827] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:02.459918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:02.554202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fdf324ab-a395-4eb1-9352-417d9998817d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827" status: 204 len: 0 microversion: 2.1 time: 0.269872 Sep 08 10:44:02.554911 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2888/5550] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:02 2022] DELETE /compute/v2.1/servers/ca5c7169-f9ec-4f43-9ead-267602145827 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:44:02.591250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca6530ba-3e07-4c48-80b7-fe8bbe2019d3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1681 microversion: 2.1 time: 1.349187 Sep 08 10:44:02.608073 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2663/5551] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:01 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1681 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:44:02.704730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-438985869", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8c1bf5b9-81e2-42ba-889e-06dfebf552da"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:02.778031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] validate_networks() for [('8c1bf5b9-81e2-42ba-889e-06dfebf552da', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:44:03.627860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:03.629077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:03.645199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.645972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.646591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.647506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:03.648210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:03.648825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:03.978494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:04.013342 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8f33828-f029-4d18-8bf4-86a33290b957 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1613 microversion: 2.1 time: 0.389111 Sep 08 10:44:04.078458 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2664/5552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:03 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1613 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:05.120328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:44:05.121736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:44:05.127017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:44:05.131387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:44:05.132048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:05.139486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:44:05.144425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:05.164264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.165061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.165665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.167309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.168476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.170773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.173934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.174451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.175075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.204190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.204993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Getting quotas for project 4578e57d5bec4c35a9421ac29bae16a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:05.206612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.209283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.244937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Getting quotas for user 49b2d771cc4043c4a3579e19c9394051 and project 4578e57d5bec4c35a9421ac29bae16a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:05.301944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Going to run 2 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:44:05.314215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:44:05.393833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=79776701-9c99-4ae6-ab51-534690ae2854,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:44:05.468573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:05.493398 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-865fda56-97c8-4bfd-bb24-6fcbbe3a172d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 200 len: 1613 microversion: 2.1 time: 0.398396 Sep 08 10:44:05.496390 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2665/5553] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:05 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 1613 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:05.501568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-450dcc1d-99ae-41c8-8862-d328a70da4f6 req-9e795e13-a5e1-4f06-b505-b2ed56f8c614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5c3a3e-cc41-425f-b0a1-2811c3063cf9", "name": "network-vif-deleted", "tag": "bcb09304-187b-4ff7-9d72-5275c8303183"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:05.534776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-450dcc1d-99ae-41c8-8862-d328a70da4f6 req-9e795e13-a5e1-4f06-b505-b2ed56f8c614 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.537901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-450dcc1d-99ae-41c8-8862-d328a70da4f6 req-9e795e13-a5e1-4f06-b505-b2ed56f8c614 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.541069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-450dcc1d-99ae-41c8-8862-d328a70da4f6 req-9e795e13-a5e1-4f06-b505-b2ed56f8c614 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.548272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:05.581340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28ca3c45-0b41-4e0c-bf15-fdee2fe53e98 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.883621 Sep 08 10:44:05.586580 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2889/5554] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:44:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 2890 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 10:44:05.594098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:05.600791 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-450dcc1d-99ae-41c8-8862-d328a70da4f6 req-9e795e13-a5e1-4f06-b505-b2ed56f8c614 service nova] Creating event network-vif-deleted:bcb09304-187b-4ff7-9d72-5275c8303183 for instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 on n-h1-833090-19 Sep 08 10:44:05.607777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:05.612149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Searching by: {'deleted': False, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6'} {{(pid=122457) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 10:44:05.626292 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-450dcc1d-99ae-41c8-8862-d328a70da4f6 req-9e795e13-a5e1-4f06-b505-b2ed56f8c614 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127409 Sep 08 10:44:05.629316 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2666/5555] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:05.633981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:05.672426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.673007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.673635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.675128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:05.675797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:05.676406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:05.729126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.multi_cell_list [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 10:44:05.809430 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-429b2e88-7dc4-42c1-8428-5f5973cf0150 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.218855 Sep 08 10:44:05.810445 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2890/5556] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 10:44:05 2022] GET /compute/v2.1/servers => generated 1335 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:44:05.838261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2fc72c05-f68a-4820-bb45-2c3889282d11 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:05.839335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2fc72c05-f68a-4820-bb45-2c3889282d11 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:06.008276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2fc72c05-f68a-4820-bb45-2c3889282d11 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:06.039528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2fc72c05-f68a-4820-bb45-2c3889282d11 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1217 microversion: 2.1 time: 0.219741 Sep 08 10:44:06.047652 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2667/5557] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:05 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:06.535126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:06.535762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:06.553260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.553898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.555703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.557705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.558999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.560805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.593857 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 HTTP/1.1 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'aa5c3a3e-cc41-425f-b0a1-2811c3063cf9'} Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:06.597876 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:44:06.601757 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:06.617467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:06.618359 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-acb66426-013d-41d2-8e0d-bcfd74f33e58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 404 len: 111 microversion: 2.1 time: 0.087687 Sep 08 10:44:06.618947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2891/5558] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:06 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:06.628818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ebe77150-593d-416a-8c79-447c6c503b2d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '.version_select at 0x7f23500995e0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:06.666905 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ebe77150-593d-416a-8c79-447c6c503b2d tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-797007011" status: 202 len: 0 microversion: 2.1 time: 0.043095 Sep 08 10:44:06.667851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2668/5559] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-797007011 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:06.863894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7fe3c09f-cd37-4da1-a12a-64adb8ac72ec req-9ed9e9f0-69e8-47cb-bf4a-8424d0e42b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5c7169-f9ec-4f43-9ead-267602145827", "name": "network-vif-deleted", "tag": "7b5eae09-8a4c-496c-964c-ba419e7aec24"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:06.892901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7fe3c09f-cd37-4da1-a12a-64adb8ac72ec req-9ed9e9f0-69e8-47cb-bf4a-8424d0e42b2b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:06.899440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7fe3c09f-cd37-4da1-a12a-64adb8ac72ec req-9ed9e9f0-69e8-47cb-bf4a-8424d0e42b2b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:06.902234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7fe3c09f-cd37-4da1-a12a-64adb8ac72ec req-9ed9e9f0-69e8-47cb-bf4a-8424d0e42b2b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:06.968627 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7fe3c09f-cd37-4da1-a12a-64adb8ac72ec req-9ed9e9f0-69e8-47cb-bf4a-8424d0e42b2b service nova] Creating event network-vif-deleted:7b5eae09-8a4c-496c-964c-ba419e7aec24 for instance ca5c7169-f9ec-4f43-9ead-267602145827 on n-h1-833090-19 Sep 08 10:44:06.985831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7fe3c09f-cd37-4da1-a12a-64adb8ac72ec req-9ed9e9f0-69e8-47cb-bf4a-8424d0e42b2b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123328 Sep 08 10:44:06.987358 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2892/5560] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:07.112644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:07.113878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:07.127986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:07.133624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.136220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.137244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:07.140258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:07.143172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:07.144542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:08.033981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:08.058224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9d540fc-5f1d-4525-b036-f481b45388c0 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1221 microversion: 2.1 time: 0.983206 Sep 08 10:44:08.058877 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2669/5561] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:07 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1221 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:09.088478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-60d3dc60-2803-4ee0-bfb4-eb610c2cf15f req-b9860c9e-82e1-4c62-b9c6-8801bddb57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad", "name": "network-vif-deleted", "tag": "3c7f4079-6b0d-45dc-8674-98a6df7d409f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:09.094932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:09.097574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:09.131084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.132682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.135867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.136458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60d3dc60-2803-4ee0-bfb4-eb610c2cf15f req-b9860c9e-82e1-4c62-b9c6-8801bddb57d1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.139267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60d3dc60-2803-4ee0-bfb4-eb610c2cf15f req-b9860c9e-82e1-4c62-b9c6-8801bddb57d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.147101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60d3dc60-2803-4ee0-bfb4-eb610c2cf15f req-b9860c9e-82e1-4c62-b9c6-8801bddb57d1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.147907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:09.148665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:09.152097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:09.189126 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-60d3dc60-2803-4ee0-bfb4-eb610c2cf15f req-b9860c9e-82e1-4c62-b9c6-8801bddb57d1 service nova] Creating event network-vif-deleted:3c7f4079-6b0d-45dc-8674-98a6df7d409f for instance 7f9cde1c-0fe2-44dd-8cda-6f855c61b2ad on n-h2-833090-19 Sep 08 10:44:09.224715 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-60d3dc60-2803-4ee0-bfb4-eb610c2cf15f req-b9860c9e-82e1-4c62-b9c6-8801bddb57d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137586 Sep 08 10:44:09.228331 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2670/5562] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:09.388597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:09.402581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8233c0a-7de9-499c-8b93-4f4e1302933a tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1287 microversion: 2.1 time: 0.321022 Sep 08 10:44:09.419359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2893/5563] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:09 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1287 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:10.436453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:10.438927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:10.460888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:10.462341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:10.463653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.466319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:10.466809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:10.467249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:10.599163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42b1e2c1-2000-4f5f-b0f6-b9dd83868dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: .version_select at 0x7f234bd185e0>, body: {"keypair": {"name": "tempest-keypair-1302495951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeJBskTs5Erjl9Zawqa54lOWDzXh1RVO0e6A1Kafdof6nW4iwZu9F7ah0ODR6FJZ5P+kbTQd2ADb1Cs/Sx1bmf/maBEVGjthQUyKE35TJ0lrfU+F5wGMkKsVDM7v9lo/w=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:10.624621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-42b1e2c1-2000-4f5f-b0f6-b9dd83868dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:10.645501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-42b1e2c1-2000-4f5f-b0f6-b9dd83868dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:10.699569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42b1e2c1-2000-4f5f-b0f6-b9dd83868dd0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105209 Sep 08 10:44:10.701054 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2894/5564] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:44:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:44:10.702901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:10.725831 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cd7122bb-2a75-44f7-a0d2-6040b5f56f0c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1275 microversion: 2.1 time: 0.302062 Sep 08 10:44:10.727541 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2671/5565] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:10 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:11.758364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:11.760766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:11.783110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.783657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.784109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:11.785223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:11.785705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:11.786136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:12.422021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:12.435218 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4dac9709-7443-40e2-a7a4-d3352fa792dc tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 0.681803 Sep 08 10:44:12.444629 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2895/5566] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:11 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:13.462606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:13.464156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:13.474473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.480608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.488329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.489473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.490206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.490810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.781008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-97b13398-73c6-41c7-8f0b-bce1451d08d7 req-e011ddf1-2030-44b9-87b1-29f969a103bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79776701-9c99-4ae6-ab51-534690ae2854", "tag": "bf10a777-971f-4ca2-8799-05620db7f892"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:13.804872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-97b13398-73c6-41c7-8f0b-bce1451d08d7 req-e011ddf1-2030-44b9-87b1-29f969a103bf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:13.806497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-97b13398-73c6-41c7-8f0b-bce1451d08d7 req-e011ddf1-2030-44b9-87b1-29f969a103bf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:13.810595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-97b13398-73c6-41c7-8f0b-bce1451d08d7 req-e011ddf1-2030-44b9-87b1-29f969a103bf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:13.838748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-97b13398-73c6-41c7-8f0b-bce1451d08d7 req-e011ddf1-2030-44b9-87b1-29f969a103bf service nova] Creating event network-changed:bf10a777-971f-4ca2-8799-05620db7f892 for instance 79776701-9c99-4ae6-ab51-534690ae2854 on n-h1-833090-19 Sep 08 10:44:13.849476 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-97b13398-73c6-41c7-8f0b-bce1451d08d7 req-e011ddf1-2030-44b9-87b1-29f969a103bf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071623 Sep 08 10:44:13.850719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2896/5567] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:14.521179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:14.548917 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-76bd4c0a-3ffa-4411-8422-c28d07940081 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 1.090975 Sep 08 10:44:14.549867 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2672/5568] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:13 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:15.577794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:15.579294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:15.590459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.592451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.593649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.594668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.597139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.597830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:15.701893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:15.960291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-22eca814-3788-44fe-84cc-c92a63a78ee3 req-d3a99a22-5b45-44fa-a6df-747ec9800a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86641eea-8d7c-4c7d-b063-ba5dc35092f7", "tag": "a5916e56-ba09-4eeb-8575-4f5c7e0714fd"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:15.981864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22eca814-3788-44fe-84cc-c92a63a78ee3 req-d3a99a22-5b45-44fa-a6df-747ec9800a28 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:15.982340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22eca814-3788-44fe-84cc-c92a63a78ee3 req-d3a99a22-5b45-44fa-a6df-747ec9800a28 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:15.982762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22eca814-3788-44fe-84cc-c92a63a78ee3 req-d3a99a22-5b45-44fa-a6df-747ec9800a28 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:16.000534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:16.010516 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-22eca814-3788-44fe-84cc-c92a63a78ee3 req-d3a99a22-5b45-44fa-a6df-747ec9800a28 service nova] Creating event network-changed:a5916e56-ba09-4eeb-8575-4f5c7e0714fd for instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 on n-h2-833090-19 Sep 08 10:44:16.015714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5069c31-e4df-42f9-b389-892a6705d00c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 0.444011 Sep 08 10:44:16.023446 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-22eca814-3788-44fe-84cc-c92a63a78ee3 req-d3a99a22-5b45-44fa-a6df-747ec9800a28 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066859 Sep 08 10:44:16.024333 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2673/5569] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:44:16.031825 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2897/5570] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:15 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:16.223808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:16.227825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:16.229315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:16.236663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:16.237477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:16.238148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:16.239889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:16.240702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:16.241574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:16.457559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1836387143", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04c0b3e9-1a56-4979-8ca2-71d86eb54d89"}], "security_groups": [{"name": "tempest-securitygroup--1717340612"}], "key_name": "tempest-keypair-1302495951", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:16.536302 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ad7f927-583d-4262-8dc9-7014338508d9 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1836 microversion: 2.1 time: 0.298518 Sep 08 10:44:16.564923 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2674/5571] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:16 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1836 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:16.932300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] validate_networks() for [('04c0b3e9-1a56-4979-8ca2-71d86eb54d89', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:44:17.040732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:17.042012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:17.072493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.084345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.085069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.086155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:17.086777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:17.087395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:17.997509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:18.014496 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e682afdf-4a74-4169-804e-1c24efe3230d tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 0.971954 Sep 08 10:44:18.014496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2675/5572] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:17 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:44:18.624284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:44:18.625501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:44:18.626860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:44:18.627526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:44:18.628712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:44:18.643856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:18.645047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:18.646461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:18.647434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:18.648774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:18.649479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:18.683112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:18.692565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Getting quotas for user 44827b22c79841d385cb094a30911a80 and project 50fae812e76e4a298ea19a9e3d1d017b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:18.720513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:44:18.726538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:44:18.869116 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efd34cb2-fd97-4d1a-b19f-9bac04f0fe65 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.412283 Sep 08 10:44:18.870244 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2898/5573] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:44:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:44:18.885262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-52fcc34b-f83e-4593-bc78-3fb16be36b87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:18.903230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-52fcc34b-f83e-4593-bc78-3fb16be36b87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:19.041379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:19.042021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:19.061206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.061722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.062161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.066526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:19.068811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:19.073867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:19.257977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-52fcc34b-f83e-4593-bc78-3fb16be36b87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:19.275930 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-52fcc34b-f83e-4593-bc78-3fb16be36b87 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1242 microversion: 2.1 time: 0.397634 Sep 08 10:44:19.279888 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2676/5574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:18 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1242 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:19.575240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:19.588565 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d80ce339-2cf1-4b3f-84e1-5f77f095f5be tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 0.551459 Sep 08 10:44:19.618312 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2899/5575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:19 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:19.960378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-200d0a12-2be2-46b8-aaa3-918bd26921b7 req-2dd893c5-8179-44f0-aa19-105032936e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79776701-9c99-4ae6-ab51-534690ae2854", "name": "network-vif-plugged", "status": "completed", "tag": "bf10a777-971f-4ca2-8799-05620db7f892"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:20.009803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-200d0a12-2be2-46b8-aaa3-918bd26921b7 req-2dd893c5-8179-44f0-aa19-105032936e74 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.011065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-200d0a12-2be2-46b8-aaa3-918bd26921b7 req-2dd893c5-8179-44f0-aa19-105032936e74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.016446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-200d0a12-2be2-46b8-aaa3-918bd26921b7 req-2dd893c5-8179-44f0-aa19-105032936e74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.065614 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-200d0a12-2be2-46b8-aaa3-918bd26921b7 req-2dd893c5-8179-44f0-aa19-105032936e74 service nova] Creating event network-vif-plugged:bf10a777-971f-4ca2-8799-05620db7f892 for instance 79776701-9c99-4ae6-ab51-534690ae2854 on n-h1-833090-19 Sep 08 10:44:20.081421 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-200d0a12-2be2-46b8-aaa3-918bd26921b7 req-2dd893c5-8179-44f0-aa19-105032936e74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124955 Sep 08 10:44:20.086702 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2677/5576] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:20.143793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:20.145561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:20.164479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.165482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.166962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.168028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.168655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.169274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.199285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-65c8a99b-5f32-4a05-bcaa-fbe338cf57ea req-1880d4a3-5950-4345-92da-f87a2cd11a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:20.236594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-65c8a99b-5f32-4a05-bcaa-fbe338cf57ea req-1880d4a3-5950-4345-92da-f87a2cd11a1b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.237559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-65c8a99b-5f32-4a05-bcaa-fbe338cf57ea req-1880d4a3-5950-4345-92da-f87a2cd11a1b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.239754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-65c8a99b-5f32-4a05-bcaa-fbe338cf57ea req-1880d4a3-5950-4345-92da-f87a2cd11a1b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.270670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:20.287017 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-65c8a99b-5f32-4a05-bcaa-fbe338cf57ea req-1880d4a3-5950-4345-92da-f87a2cd11a1b service nova] Creating event network-changed:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h2-833090-19 Sep 08 10:44:20.307306 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-65c8a99b-5f32-4a05-bcaa-fbe338cf57ea req-1880d4a3-5950-4345-92da-f87a2cd11a1b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113034 Sep 08 10:44:20.315827 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2678/5577] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:44:20.334605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:20.338851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:20.359275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.362866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.363751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.366161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.366814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.370690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.564780 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-232fcd11-8af6-4286-b011-823551c8e21a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 204 len: 0 microversion: 2.1 time: 0.423945 Sep 08 10:44:20.564780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2900/5578] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:20 2022] DELETE /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:20.576156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:20.577033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:20.591877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.594400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.595975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.597018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.598676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.600146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.930109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:20.942752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a41c51f8-8bb9-47cc-be4c-ec6f42869327 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1294 microversion: 2.1 time: 0.624910 Sep 08 10:44:20.943348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2679/5579] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:20 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1294 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:20.978314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:20.980466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:20.988560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.991340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.995924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:20.997278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:20.997922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:20.998521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.049352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:22.088921 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-013e7323-28be-4e5e-98ed-ca7cccb3c635 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1689 microversion: 2.1 time: 1.520024 Sep 08 10:44:22.089880 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2901/5580] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:20 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1689 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:22.098296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:22.100314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:22.124798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.125722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.126898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.129409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:22.130106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:22.131063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:22.602798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:22.621476 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e42221e-fbe5-4ed9-821d-780fe8f573bb tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 1.656422 Sep 08 10:44:22.622684 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2680/5581] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:20 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:22.669960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:22.678399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2201db9-a66f-444b-a6bf-33356f7d8f82 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1300 microversion: 2.1 time: 0.587410 Sep 08 10:44:22.685273 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2902/5582] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:22 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1300 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:23.129803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:23.131469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:23.148681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.150907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.151960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.153385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.168130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.169570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.400872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7179d265-cc66-4518-a7c0-10a6f63b527d req-af59dbf7-df8b-444c-8e7b-f874101c6841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86641eea-8d7c-4c7d-b063-ba5dc35092f7", "name": "network-vif-plugged", "status": "completed", "tag": "a5916e56-ba09-4eeb-8575-4f5c7e0714fd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:23.420376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7179d265-cc66-4518-a7c0-10a6f63b527d req-af59dbf7-df8b-444c-8e7b-f874101c6841 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.420875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7179d265-cc66-4518-a7c0-10a6f63b527d req-af59dbf7-df8b-444c-8e7b-f874101c6841 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.421320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7179d265-cc66-4518-a7c0-10a6f63b527d req-af59dbf7-df8b-444c-8e7b-f874101c6841 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.460253 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7179d265-cc66-4518-a7c0-10a6f63b527d req-af59dbf7-df8b-444c-8e7b-f874101c6841 service nova] Creating event network-vif-plugged:a5916e56-ba09-4eeb-8575-4f5c7e0714fd for instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 on n-h2-833090-19 Sep 08 10:44:23.477419 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7179d265-cc66-4518-a7c0-10a6f63b527d req-af59dbf7-df8b-444c-8e7b-f874101c6841 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079978 Sep 08 10:44:23.478348 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2903/5583] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:23.652345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:23.653112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:23.666380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.667145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.667907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.670303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.670948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.672035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.896033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:23.909488 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d772592b-afeb-414e-b0b5-03b7067b0e71 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1689 microversion: 2.1 time: 0.798823 Sep 08 10:44:23.910123 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2681/5584] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:23 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1689 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:23.917402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:23.921998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:23.937758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.938554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.939832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:23.940729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:23.944107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:23.944747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.372149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:24.386089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-954e43fb-9124-4cf5-930e-b69dea4fa0cd tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 0.740352 Sep 08 10:44:24.387055 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2904/5585] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:23 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:24.400145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-46368e1f-318b-4efe-a5c6-d7da03454d4a req-cf7bbb42-8d65-4bf6-a872-c16c83d7a8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "name": "network-vif-deleted", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:24.428102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-46368e1f-318b-4efe-a5c6-d7da03454d4a req-cf7bbb42-8d65-4bf6-a872-c16c83d7a8b1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.429193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-46368e1f-318b-4efe-a5c6-d7da03454d4a req-cf7bbb42-8d65-4bf6-a872-c16c83d7a8b1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.429842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-46368e1f-318b-4efe-a5c6-d7da03454d4a req-cf7bbb42-8d65-4bf6-a872-c16c83d7a8b1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.448736 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-46368e1f-318b-4efe-a5c6-d7da03454d4a req-cf7bbb42-8d65-4bf6-a872-c16c83d7a8b1 service nova] Creating event network-vif-deleted:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h2-833090-19 Sep 08 10:44:24.455621 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-46368e1f-318b-4efe-a5c6-d7da03454d4a req-cf7bbb42-8d65-4bf6-a872-c16c83d7a8b1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063870 Sep 08 10:44:24.457132 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2905/5586] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:24.471901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:24.489940 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-afd3c66b-d250-40c2-bd32-f47ae760e714 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1368 microversion: 2.1 time: 0.578531 Sep 08 10:44:24.491070 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2682/5587] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:23 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:24.943424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:24.944177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:24.953667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.955195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.955946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:24.958393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:24.959185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:24.960238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.007875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:25.032063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.032685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.033143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.033619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lazy-loading 'fault' on Instance uuid 419071bb-bb3b-4292-9443-efc91596b2a3 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:44:25.162424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:25.177247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6cf0a502-d203-4176-9709-2e96148d0504 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 200 len: 1357 microversion: 2.1 time: 0.241647 Sep 08 10:44:25.180826 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2906/5588] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:24 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:25.415816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:25.416374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:25.430018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.431962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.432961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.437770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.438489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.439639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.520356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:25.521791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:25.542407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.544769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.545457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:25.550090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:25.550784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:25.551422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.402164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:26.415315 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-129c4bcf-a16f-4473-b0ca-222bbde3898c tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1317 microversion: 2.1 time: 1.004558 Sep 08 10:44:26.416199 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2683/5589] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:25 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:26.451321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-fb373660-01ee-4946-a917-ceba713a217f req-29d74c5f-b6e6-4b25-875c-1a1294cb6fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419071bb-bb3b-4292-9443-efc91596b2a3", "name": "network-vif-unplugged", "status": "completed", "tag": "99a9f470-db2e-46e6-9c30-08385bc80f07"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:26.476043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fb373660-01ee-4946-a917-ceba713a217f req-29d74c5f-b6e6-4b25-875c-1a1294cb6fbe service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.477142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fb373660-01ee-4946-a917-ceba713a217f req-29d74c5f-b6e6-4b25-875c-1a1294cb6fbe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.477853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-fb373660-01ee-4946-a917-ceba713a217f req-29d74c5f-b6e6-4b25-875c-1a1294cb6fbe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.512667 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-fb373660-01ee-4946-a917-ceba713a217f req-29d74c5f-b6e6-4b25-875c-1a1294cb6fbe service nova] Creating event network-vif-unplugged:99a9f470-db2e-46e6-9c30-08385bc80f07 for instance 419071bb-bb3b-4292-9443-efc91596b2a3 on n-h2-833090-19 Sep 08 10:44:26.518336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:26.529404 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-fb373660-01ee-4946-a917-ceba713a217f req-29d74c5f-b6e6-4b25-875c-1a1294cb6fbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093712 Sep 08 10:44:26.539915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2684/5590] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:26.551048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:26.560337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 419071bb-bb3b-4292-9443-efc91596b2a3] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:26.565965 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d60df069-5e1d-46aa-b458-62534cafeb88 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1368 microversion: 2.1 time: 1.043320 Sep 08 10:44:26.569703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2907/5591] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:25 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1368 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:26.598936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.601440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.604228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.604394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4a012eb9-03e1-4736-bf02-6220de6c80d8 req-bafd04b1-77a3-46a3-a693-a692c199caea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4624e2b9-29d1-45bc-9933-2306f160c321", "tag": "858ab2e1-2fb6-4656-93c6-84dc77d1031d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:26.607849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.608495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.611586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.626613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4a012eb9-03e1-4736-bf02-6220de6c80d8 req-bafd04b1-77a3-46a3-a693-a692c199caea service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:26.630292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4a012eb9-03e1-4736-bf02-6220de6c80d8 req-bafd04b1-77a3-46a3-a693-a692c199caea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:26.635287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4a012eb9-03e1-4736-bf02-6220de6c80d8 req-bafd04b1-77a3-46a3-a693-a692c199caea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:26.653839 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] HTTP exception thrown: Instance 419071bb-bb3b-4292-9443-efc91596b2a3 could not be found. Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Request method failure captured: Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 HTTP/1.1 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcbN7kVDbl2d9xWhQy9sas5ikS1r-wCjGuPvswVLKWW2eYrng081shN3QWLbsrgaqFbv4vkbON5vRl0d7co-dabrh0Zvt1MKDrEfki9ULYJrKU76dsoP9djIO8eKWw8yfgTEjhveMjDLXpNKFMlO1wcWo1CYm8sYRUmIXxhanJzr3_U Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6a37c5b0349d45558389e7e8a15b5f85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c7c9cc09a7b144e69cdf342c8f94680a Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 419071bb-bb3b-4292-9443-efc91596b2a3 could not be found. Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '419071bb-bb3b-4292-9443-efc91596b2a3'} Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419071bb-bb3b-4292-9443-efc91596b2a3 could not be found. Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419071bb-bb3b-4292-9443-efc91596b2a3 could not be found. Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:44:26.656210 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419071bb-bb3b-4292-9443-efc91596b2a3 could not be found. Sep 08 10:44:26.661691 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:44:26.662772 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4a012eb9-03e1-4736-bf02-6220de6c80d8 req-bafd04b1-77a3-46a3-a693-a692c199caea service nova] Creating event network-changed:858ab2e1-2fb6-4656-93c6-84dc77d1031d for instance 4624e2b9-29d1-45bc-9933-2306f160c321 on n-h1-833090-19 Sep 08 10:44:26.672338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Returning 404 to user: Instance 419071bb-bb3b-4292-9443-efc91596b2a3 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:26.673616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c753a4ba-6f84-4f3a-8468-94b9b7cafa9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3" status: 404 len: 111 microversion: 2.1 time: 0.132560 Sep 08 10:44:26.674443 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2685/5592] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:26 2022] GET /compute/v2.1/servers/419071bb-bb3b-4292-9443-efc91596b2a3 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:26.683868 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4a012eb9-03e1-4736-bf02-6220de6c80d8 req-bafd04b1-77a3-46a3-a693-a692c199caea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112560 Sep 08 10:44:26.684491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2908/5593] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:27.438330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:27.439104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:27.452966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.456187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.456921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.457918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.468215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.468851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.600251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:27.602428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:27.624334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.625670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.626274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:27.627661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:27.629299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:27.632035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.038572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:28.049198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-117a380d-8082-457b-b475-fa53f131c914 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1506 microversion: 2.1 time: 0.614785 Sep 08 10:44:28.067010 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2686/5594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:27 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:28.080782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:28.081664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:28.090826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.091611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.092275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.093150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.094539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.095134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.256481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:28.269010 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18b46ee3-cbd9-47e4-aca1-38e070f6ddd3 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1368 microversion: 2.1 time: 0.675149 Sep 08 10:44:28.269734 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2909/5595] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:27 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1368 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:28.659719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:28.673598 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3257141d-bce8-4226-aba0-9f1767779622 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854" status: 200 len: 1505 microversion: 2.1 time: 0.598140 Sep 08 10:44:28.673894 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2687/5596] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:28 2022] GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854 => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:28.698790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:28.699343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:28.706315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:28.707568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:28.709302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.710338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.711440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.712490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.713153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.713744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.751982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:28.935652 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4d16fe6-f8c8-4889-8de4-9a746276daf8 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "DELETE /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854" status: 204 len: 0 microversion: 2.1 time: 0.240274 Sep 08 10:44:28.938683 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2910/5597] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:28 2022] DELETE /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:28.950566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:28.952197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:28.974069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.975580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.977238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:28.978891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:28.981554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:28.982025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.068358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:44:29.195260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:29.273698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:29.298342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:29.298992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:29.308010 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5d0586a-344c-49ed-8d62-f19249a7441b tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "DELETE /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 204 len: 0 microversion: 2.1 time: 0.360586 Sep 08 10:44:29.310378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:29.313752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2688/5598] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:44:28 2022] DELETE /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:44:29.316018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:29.316521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.317281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:29.324029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:29.324691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.336132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:29.339827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:29.372564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:29.373807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:29.374259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.374993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:29.379728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:29.380428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:29.829701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:29.842629 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d1df18f-9896-46bb-9c4d-0be46e67d186 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854" status: 200 len: 1511 microversion: 2.1 time: 0.527492 Sep 08 10:44:29.845018 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2689/5599] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:29 2022] GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854 => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:29.966277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:29.974277 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69cfa5f6-81da-4469-80c2-604504bf8e05 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1368 microversion: 2.1 time: 0.683475 Sep 08 10:44:29.974888 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2911/5600] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:29 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1368 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:30.872011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:30.872730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:30.885143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:30.885664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:30.886129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:30.888392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:30.888877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:30.892062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.003555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:31.004183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:31.014546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.021346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.022082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.023008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.025818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.026481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.610545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:31.618985 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b377cde5-a8be-4454-bf1a-02e56119497e tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854" status: 200 len: 1511 microversion: 2.1 time: 0.751442 Sep 08 10:44:31.623752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2690/5601] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:30 2022] GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854 => generated 1511 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:31.653671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2d0d3607-06a2-4032-8bd5-692f6ff8a84c req-e3ed988a-48b0-4021-82b1-eab2082da2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4624e2b9-29d1-45bc-9933-2306f160c321", "name": "network-vif-plugged", "status": "completed", "tag": "858ab2e1-2fb6-4656-93c6-84dc77d1031d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:31.697457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2d0d3607-06a2-4032-8bd5-692f6ff8a84c req-e3ed988a-48b0-4021-82b1-eab2082da2d8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:31.697974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2d0d3607-06a2-4032-8bd5-692f6ff8a84c req-e3ed988a-48b0-4021-82b1-eab2082da2d8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:31.698419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2d0d3607-06a2-4032-8bd5-692f6ff8a84c req-e3ed988a-48b0-4021-82b1-eab2082da2d8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:31.722409 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2d0d3607-06a2-4032-8bd5-692f6ff8a84c req-e3ed988a-48b0-4021-82b1-eab2082da2d8 service nova] Creating event network-vif-plugged:858ab2e1-2fb6-4656-93c6-84dc77d1031d for instance 4624e2b9-29d1-45bc-9933-2306f160c321 on n-h1-833090-19 Sep 08 10:44:31.733016 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2d0d3607-06a2-4032-8bd5-692f6ff8a84c req-e3ed988a-48b0-4021-82b1-eab2082da2d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107685 Sep 08 10:44:31.735779 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2691/5602] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:31.790965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:31.840589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58488eba-6369-41f4-929b-cd1db8207c58 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1368 microversion: 2.1 time: 0.809827 Sep 08 10:44:31.876304 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2912/5603] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:30 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1368 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:44:32.217546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9cd49be2-32ea-4e12-89ef-1238016cfde7 req-9124b304-9116-4e94-9e4b-e0df452e55fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79776701-9c99-4ae6-ab51-534690ae2854", "name": "network-vif-deleted", "tag": "bf10a777-971f-4ca2-8799-05620db7f892"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:32.239803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9cd49be2-32ea-4e12-89ef-1238016cfde7 req-9124b304-9116-4e94-9e4b-e0df452e55fa service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.240548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9cd49be2-32ea-4e12-89ef-1238016cfde7 req-9124b304-9116-4e94-9e4b-e0df452e55fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.242731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9cd49be2-32ea-4e12-89ef-1238016cfde7 req-9124b304-9116-4e94-9e4b-e0df452e55fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.272308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9cd49be2-32ea-4e12-89ef-1238016cfde7 req-9124b304-9116-4e94-9e4b-e0df452e55fa service nova] Creating event network-vif-deleted:bf10a777-971f-4ca2-8799-05620db7f892 for instance 79776701-9c99-4ae6-ab51-534690ae2854 on n-h1-833090-19 Sep 08 10:44:32.281203 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9cd49be2-32ea-4e12-89ef-1238016cfde7 req-9124b304-9116-4e94-9e4b-e0df452e55fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.537847 Sep 08 10:44:32.284873 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2692/5604] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:32.654787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:32.656032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 79776701-9c99-4ae6-ab51-534690ae2854] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:32.672473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.675797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.678706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.682373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.685344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.686453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.731190 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] HTTP exception thrown: Instance 79776701-9c99-4ae6-ab51-534690ae2854 could not be found. Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Request method failure captured: Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854 HTTP/1.1 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcdSdlHKF9HWdThP2i5KfB3BW1clX8pE6cNuTvGRI7ITQArwGlMTgQr5pPPNOYxY0rcSS3-9VuuVhvmDW2CxrgemlNu2uCK-yTAQ71b-F0EWcY3W12lcn4_V-hLJBTrgEqIHirSqZzU-S4DsZTWgJbqkw5qEW85CtJcfzNGPnwysKWI Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 4578e57d5bec4c35a9421ac29bae16a6 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-MultipleCreateTestJSON-1105694501 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4578e57d5bec4c35a9421ac29bae16a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4578e57d5bec4c35a9421ac29bae16a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4578e57d5bec4c35a9421ac29bae16a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4578e57d5bec4c35a9421ac29bae16a6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-MultipleCreateTestJSON-1105694501 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 4578e57d5bec4c35a9421ac29bae16a6 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1105694501 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-MultipleCreateTestJSON-1105694501-project Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 49b2d771cc4043c4a3579e19c9394051 Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-MultipleCreateTestJSON-1105694501-project Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 79776701-9c99-4ae6-ab51-534690ae2854 could not be found. Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '79776701-9c99-4ae6-ab51-534690ae2854'} Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79776701-9c99-4ae6-ab51-534690ae2854 could not be found. Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79776701-9c99-4ae6-ab51-534690ae2854 could not be found. Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:32.736610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79776701-9c99-4ae6-ab51-534690ae2854 could not be found. Sep 08 10:44:32.741314 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:32.745144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Returning 404 to user: Instance 79776701-9c99-4ae6-ab51-534690ae2854 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:32.748361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee59f3ae-6880-449b-ad19-456e64a41321 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854" status: 404 len: 111 microversion: 2.1 time: 0.101591 Sep 08 10:44:32.756106 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2913/5605] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:32 2022] GET /compute/v2.1/servers/79776701-9c99-4ae6-ab51-534690ae2854 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:44:32.761561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:32.762274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:32.775052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.779422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.780203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.785657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.786360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.786968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.871285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:32.872327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:32.888108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.891324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.894104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:32.895215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:32.899630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:32.901566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.347287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.394553 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-16f70a03-cecf-4fca-b1fa-c0bcd39fc183 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1368 microversion: 2.1 time: 1.531956 Sep 08 10:44:34.407747 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2914/5606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:32 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1368 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:44:34.413930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c6202b3c-fe96-4639-96ac-99c23a997356 req-cd090bcb-2f5b-4949-9deb-ad5ca10a4f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86641eea-8d7c-4c7d-b063-ba5dc35092f7", "name": "network-vif-deleted", "tag": "a5916e56-ba09-4eeb-8575-4f5c7e0714fd"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:34.429435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b2d771cc4043c4a3579e19c9394051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4578e57d5bec4c35a9421ac29bae16a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:34.434369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c6202b3c-fe96-4639-96ac-99c23a997356 req-cd090bcb-2f5b-4949-9deb-ad5ca10a4f36 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:34.434874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c6202b3c-fe96-4639-96ac-99c23a997356 req-cd090bcb-2f5b-4949-9deb-ad5ca10a4f36 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:34.435361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c6202b3c-fe96-4639-96ac-99c23a997356 req-cd090bcb-2f5b-4949-9deb-ad5ca10a4f36 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:34.441463 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9b6b356e-0f2e-4614-956d-e2dc4fcbc070 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 200 len: 1512 microversion: 2.1 time: 1.685629 Sep 08 10:44:34.449406 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2693/5607] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:32 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 1512 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:34.488590 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c6202b3c-fe96-4639-96ac-99c23a997356 req-cd090bcb-2f5b-4949-9deb-ad5ca10a4f36 service nova] Creating event network-vif-deleted:a5916e56-ba09-4eeb-8575-4f5c7e0714fd for instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 on n-h2-833090-19 Sep 08 10:44:34.511759 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c6202b3c-fe96-4639-96ac-99c23a997356 req-cd090bcb-2f5b-4949-9deb-ad5ca10a4f36 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103025 Sep 08 10:44:34.522390 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2915/5608] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:44:35.420646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:35.421241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:35.438792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.440686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.441454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.442461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.443147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.443860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.471353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:35.472752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] [instance: 86641eea-8d7c-4c7d-b063-ba5dc35092f7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:35.489597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.490198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.490711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.491432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.496143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.496668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.526533 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] HTTP exception thrown: Instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 could not be found. Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Request method failure captured: Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 HTTP/1.1 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcdSdlHKF9HWdThP2i5KfB3BW1clX8pE6cNuTvGRI7ITQArwGlMTgQr5pPPNOYxY0rcSS3-9VuuVhvmDW2CxrgemlNu2uCK-yTAQ71b-F0EWcY3W12lcn4_V-hLJBTrgEqIHirSqZzU-S4DsZTWgJbqkw5qEW85CtJcfzNGPnwysKWI Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 4578e57d5bec4c35a9421ac29bae16a6 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-MultipleCreateTestJSON-1105694501 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4578e57d5bec4c35a9421ac29bae16a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4578e57d5bec4c35a9421ac29bae16a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4578e57d5bec4c35a9421ac29bae16a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4578e57d5bec4c35a9421ac29bae16a6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-MultipleCreateTestJSON-1105694501 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 4578e57d5bec4c35a9421ac29bae16a6 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1105694501 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-MultipleCreateTestJSON-1105694501-project Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 49b2d771cc4043c4a3579e19c9394051 Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-MultipleCreateTestJSON-1105694501-project Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 could not be found. Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '86641eea-8d7c-4c7d-b063-ba5dc35092f7'} Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 could not be found. Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 could not be found. Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:44:35.535654 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 could not be found. Sep 08 10:44:35.540577 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:44:35.542867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] Returning 404 to user: Instance 86641eea-8d7c-4c7d-b063-ba5dc35092f7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:44:35.544018 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9dba21a3-d649-4f20-a8f9-62e64a9a6ce4 tempest-MultipleCreateTestJSON-1105694501 tempest-MultipleCreateTestJSON-1105694501-project] 10.222.0.59 "GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7" status: 404 len: 111 microversion: 2.1 time: 0.077921 Sep 08 10:44:35.553261 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2916/5609] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:35 2022] GET /compute/v2.1/servers/86641eea-8d7c-4c7d-b063-ba5dc35092f7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:44:35.811804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:44:35.830955 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c45f8a0-9fe3-47b5-b7b5-7974888f5c51 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1558 microversion: 2.1 time: 0.414242 Sep 08 10:44:35.831795 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2694/5610] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:44:35 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1558 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:44:35.856775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:35.857807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:44:35.865751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.866674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.867338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:35.868386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:35.869292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:35.870299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:36.057038 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0310352e-ae8c-4678-ae00-563c18fc6ee6 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204286 Sep 08 10:44:36.057615 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2917/5611] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:44:35 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:44:39.576515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cf3e62dd-4096-4882-a154-64393a6e3055 req-82532b10-150c-4e45-b9f8-8ab9f81c41cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4624e2b9-29d1-45bc-9933-2306f160c321", "tag": "858ab2e1-2fb6-4656-93c6-84dc77d1031d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:39.639564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9df81bfd-7ae6-4972-8a8d-c45b3a59d3ee tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '.version_select at 0x7f234bd7d160>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:44:39.654449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:39.660024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:44:39.667248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cf3e62dd-4096-4882-a154-64393a6e3055 req-82532b10-150c-4e45-b9f8-8ab9f81c41cf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:44:39.667781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cf3e62dd-4096-4882-a154-64393a6e3055 req-82532b10-150c-4e45-b9f8-8ab9f81c41cf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:44:39.668216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cf3e62dd-4096-4882-a154-64393a6e3055 req-82532b10-150c-4e45-b9f8-8ab9f81c41cf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:44:39.691388 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9df81bfd-7ae6-4972-8a8d-c45b3a59d3ee tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1337480537" status: 202 len: 0 microversion: 2.1 time: 0.062835 Sep 08 10:44:39.692376 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2918/5612] 10.222.0.59 () {58 vars in 1284 bytes} [Thu Sep 8 10:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1337480537 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:44:39.713685 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cf3e62dd-4096-4882-a154-64393a6e3055 req-82532b10-150c-4e45-b9f8-8ab9f81c41cf service nova] Creating event network-changed:858ab2e1-2fb6-4656-93c6-84dc77d1031d for instance 4624e2b9-29d1-45bc-9933-2306f160c321 on n-h1-833090-19 Sep 08 10:44:39.720581 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cf3e62dd-4096-4882-a154-64393a6e3055 req-82532b10-150c-4e45-b9f8-8ab9f81c41cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152480 Sep 08 10:44:39.724957 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2695/5613] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:44:39.731522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21966e55-6f05-42e3-832a-2b76908bf7a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: .version_select at 0x7f23504a0dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-289456905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3YYPiYmGdezczFhn+2THTBSJJxshwTsa6EV7u/V7YP+yliLzEIC7jlm0krJwmfXGNijhTb6UDubLw0doEw8Ea9G0RHcGuJ0zPQKQonUex3ETX5lpAwAGr7ZnyVEZV06g=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:44:39.753487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-21966e55-6f05-42e3-832a-2b76908bf7a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:44:39.760535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-21966e55-6f05-42e3-832a-2b76908bf7a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:44:39.815888 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-21966e55-6f05-42e3-832a-2b76908bf7a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.088943 Sep 08 10:44:39.816441 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2919/5614] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:44:39 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:01.793285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2049367499", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6bd4c8cc-9802-4588-aad7-029e1ea1a6b2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-289456905", "security_groups": [{"name": "tempest-secgroup-smoke-1328409359"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:01.837019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=30 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:01.838065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:02.160354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] validate_networks() for [('6bd4c8cc-9802-4588-aad7-029e1ea1a6b2', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:45:03.242843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:45:03.243509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:45:03.244105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:45:03.244625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:45:03.245213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:45:03.271036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.271845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.273530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.274442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:03.277187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:03.278103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:03.361891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:45:03.393238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:45:03.424200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:45:03.429458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:45:03.587374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec2730a6-e4be-4b8a-8323-350087540bdc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.798546 Sep 08 10:45:03.601156 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2696/5615] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:45:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:45:03.602011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:03.602961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:03.604252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:03.613785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ffd2a688-b2fb-4d02-aa33-a89d32df35ab tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:03.621162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ffd2a688-b2fb-4d02-aa33-a89d32df35ab tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:03.864859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ffd2a688-b2fb-4d02-aa33-a89d32df35ab tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:03.872432 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ffd2a688-b2fb-4d02-aa33-a89d32df35ab tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1266 microversion: 2.1 time: 0.272038 Sep 08 10:45:03.883633 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2920/5616] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:03 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:04.901511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-941da7cc-8f34-4234-b1b5-48a62f18a563 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:04.901511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-941da7cc-8f34-4234-b1b5-48a62f18a563 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:05.161682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-941da7cc-8f34-4234-b1b5-48a62f18a563 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:05.174546 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-941da7cc-8f34-4234-b1b5-48a62f18a563 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1266 microversion: 2.1 time: 0.279815 Sep 08 10:45:05.195760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2697/5617] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:04 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:06.210747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:06.212665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:06.251487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:06.251487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:06.251487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:06.253972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:06.256437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:06.258942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:06.471743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8fbddae-0bbc-4896-a100-81022137d0ef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'create', calling method: .version_select at 0x7f234bbc59d0>, body: {"keypair": {"name": "tempest-keypair-1835092664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw0J9rObr2L87NZxL2c1hoSN5trDmhEsg9Xj6+MY6rQcRGsBtxOtZ6AImtypO3u6XT5+STs/uJlqxiRD1q8bHeEe/95lmD0Lv7ATd+Qj/V/MEGeuoDdSvqW4x+M6O34QQ=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:06.528818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c8fbddae-0bbc-4896-a100-81022137d0ef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:45:06.544476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c8fbddae-0bbc-4896-a100-81022137d0ef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for user dfc0dd22092d4110b24c5fa4efd5d9f2 and project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:45:06.550309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:06.561030 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8c709f9-8444-4665-8637-919bfc847028 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1326 microversion: 2.1 time: 0.353693 Sep 08 10:45:06.562942 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2698/5618] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:06 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1326 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:06.637186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8fbddae-0bbc-4896-a100-81022137d0ef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.436507 Sep 08 10:45:06.644934 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2921/5619] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:45:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:07.590829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:07.593574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:07.605002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.605831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.606557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.608805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:07.609556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:07.610498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:07.743197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:07.755207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a84a4910-be0d-4904-9d10-c1303b46a511 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1324 microversion: 2.1 time: 0.167763 Sep 08 10:45:07.767500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2699/5620] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:07 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:08.781806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:08.783019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:08.791159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:08.798053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:08.798743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:08.799734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:08.800365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:08.800997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:09.069211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:09.083205 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-be86684a-c13e-4d7a-bbea-23cadead57b4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1324 microversion: 2.1 time: 0.306643 Sep 08 10:45:09.087034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2922/5621] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:08 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:10.109918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:10.110626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:10.125517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.128931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.129638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.131055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:10.133377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:10.133911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:10.596455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1757366460", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f75c36b-02be-41ce-8aa0-0baf209b7e24"}], "security_groups": [{"name": "tempest-securitygroup--408941480"}], "key_name": "tempest-keypair-1835092664", "user_data": "}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:10.863032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:10.878757 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-741959da-4530-4ab3-bf0f-de40e15f6dc1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.773489 Sep 08 10:45:10.881037 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2700/5622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:10 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:11.038112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] validate_networks() for [('4f75c36b-02be-41ce-8aa0-0baf209b7e24', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:45:11.225898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:11.226670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:11.238717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.239766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.241152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.243243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.244955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.245414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.273913 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c754d509-dfa7-46d4-a44a-43c139127ab7 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/ips" status: 200 len: 150 microversion: 2.1 time: 0.051186 Sep 08 10:45:11.282551 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2701/5623] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:45:11 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/ips => generated 150 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:11.903973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:11.904863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:11.921708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.923891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.925533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:11.926504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:11.928314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:11.930809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.190097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.206771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7adfabad-a1a2-456f-926a-9e18ac3abdda tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 1.307531 Sep 08 10:45:13.222471 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2702/5624] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:11 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:13.527041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:45:13.528279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:45:13.529757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:45:13.530694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:45:13.531290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:45:13.545784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.547063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.547779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.548708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.549352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.550278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.576806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:45:13.588834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for user dfc0dd22092d4110b24c5fa4efd5d9f2 and project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:45:13.629345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:45:13.632274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:45:13.702773 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07f5ea44-5351-4d4e-830e-42f25f946212 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.117422 Sep 08 10:45:13.716898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1633cc2-0ad1-43b3-ba87-dba7c907292a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:13.717840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d1633cc2-0ad1-43b3-ba87-dba7c907292a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:13.721662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:13.723640 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2923/5625] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:45:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:45:13.811323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-646f61da-9205-4616-a061-1a59ab9a1544 req-f9d95ecf-3eb2-462a-b8bb-aa6709526c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:13.833418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-646f61da-9205-4616-a061-1a59ab9a1544 req-f9d95ecf-3eb2-462a-b8bb-aa6709526c6a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:13.833907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-646f61da-9205-4616-a061-1a59ab9a1544 req-f9d95ecf-3eb2-462a-b8bb-aa6709526c6a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:13.834341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-646f61da-9205-4616-a061-1a59ab9a1544 req-f9d95ecf-3eb2-462a-b8bb-aa6709526c6a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:13.850390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d1633cc2-0ad1-43b3-ba87-dba7c907292a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:13.863242 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1633cc2-0ad1-43b3-ba87-dba7c907292a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1239 microversion: 2.1 time: 0.151458 Sep 08 10:45:13.866286 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2703/5626] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:13 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1239 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:13.879910 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-646f61da-9205-4616-a061-1a59ab9a1544 req-f9d95ecf-3eb2-462a-b8bb-aa6709526c6a service nova] Creating event network-changed:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:45:13.885142 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-646f61da-9205-4616-a061-1a59ab9a1544 req-f9d95ecf-3eb2-462a-b8bb-aa6709526c6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081037 Sep 08 10:45:13.886209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2924/5627] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:14.192656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2c06e22-5f10-4c23-8c7a-850bd34c8854"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:14.199843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:14.233994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:14.235121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:14.249667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.249822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.250166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.250282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.250599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.250711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.251301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.252982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.255286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.255807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.259233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.259787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.682359 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17f48a54-4d4a-4dcd-84ed-8ba5c356d061 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "POST /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496102 Sep 08 10:45:14.683485 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2704/5628] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:45:14 2022] POST /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:14.690533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:14.720922 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad680ffc-579d-4fdd-a032-199df49536fd tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.490883 Sep 08 10:45:14.739291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2925/5629] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:14 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:14.906470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:14.908741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:14.931151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.932028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.932661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:14.933566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:14.937191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:14.937859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:15.104943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:15.117682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f559a2e-2bc0-407b-b2fd-9df140d4c4be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1291 microversion: 2.1 time: 0.229401 Sep 08 10:45:15.118298 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2705/5630] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:14 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1291 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:15.746276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:15.747732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:15.761433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:15.775405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:15.776772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:15.781749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:15.783226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:15.786287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.136950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.147634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:16.148269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:16.149660 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa5cba79-a2de-4342-bb05-a23fe7bd1221 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.407706 Sep 08 10:45:16.150269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2926/5631] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:15 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:16.156100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:16.156586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:16.157205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.158075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:16.158675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:16.159256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:16.382375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:16.390894 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9c4f5e4-a848-43c3-a06f-5cb9177d472c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1297 microversion: 2.1 time: 0.249941 Sep 08 10:45:16.411761 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2706/5632] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:16 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1297 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:17.178868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:17.179838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:17.194337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:17.195221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:17.196032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:17.206987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:17.208679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:17.209804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:17.415957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:17.417220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:17.432545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:17.433056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:17.433503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:17.434237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:17.435247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:17.435695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:17.488036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:17.503493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea6400d9-d1be-4a77-90c2-a3fc9760256b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.325610 Sep 08 10:45:17.504560 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2927/5633] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:17 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:17.665833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:17.676190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a8da1b9-ecf2-43d1-bf59-e4e5eb6b007f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1297 microversion: 2.1 time: 0.264626 Sep 08 10:45:17.676990 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2707/5634] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:17 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1297 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:18.533559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:18.535672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:18.548597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.549346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.549978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.550882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.551685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.552345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.702863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:18.703805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:18.733664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.734182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.734632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:18.735370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:18.735868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:18.736307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:19.074530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:19.089581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d00c9c8c-6ec5-4e1c-8897-638585089d84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.559255 Sep 08 10:45:19.092403 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2928/5635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:18 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:19.223363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:19.235308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f9c3c6a5-f57a-449a-ab8b-3fc452d14e8a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 0.536294 Sep 08 10:45:19.239038 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2708/5636] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:18 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:20.116398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:20.117647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:20.139948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:20.140693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:20.141333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:20.143296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:20.143954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:20.144560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:20.262298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:20.262958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:20.296494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:20.296998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:20.297765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:20.300149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:20.308243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:20.308937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.413628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:21.429035 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aeb23bf9-97f5-4df1-bee1-8004adbdc29d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 1.318629 Sep 08 10:45:21.431592 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2929/5637] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:20 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:21.606918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-89734e28-d43a-475b-978c-6a3352a73f0e req-c9849d1e-1ce4-4307-9187-d85a0f2b0c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:21.618752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89734e28-d43a-475b-978c-6a3352a73f0e req-c9849d1e-1ce4-4307-9187-d85a0f2b0c62 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:21.619237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89734e28-d43a-475b-978c-6a3352a73f0e req-c9849d1e-1ce4-4307-9187-d85a0f2b0c62 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:21.620183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89734e28-d43a-475b-978c-6a3352a73f0e req-c9849d1e-1ce4-4307-9187-d85a0f2b0c62 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:21.635994 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-89734e28-d43a-475b-978c-6a3352a73f0e req-c9849d1e-1ce4-4307-9187-d85a0f2b0c62 service nova] Creating event network-changed:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:45:21.642876 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-89734e28-d43a-475b-978c-6a3352a73f0e req-c9849d1e-1ce4-4307-9187-d85a0f2b0c62 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204895 Sep 08 10:45:21.643848 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2930/5638] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:21.679918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:21.690577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-40bac54e-e871-428f-b00f-d08cb1b0b058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 1.432122 Sep 08 10:45:21.695962 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2709/5639] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:20 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:22.455172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:22.455907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:22.484586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.485619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.502237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.507865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.513756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.515568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.732592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:22.733363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:22.746173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.749092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.750408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.754763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:22.756180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:22.758303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:22.872338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:22.883346 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d74f2ed-7bb5-4416-bdf6-7f7e445570b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.433079 Sep 08 10:45:22.884938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2931/5640] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:22 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:23.069455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:23.081790 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a1afcb6-8994-41e0-b71b-d73699c9e9e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 0.366316 Sep 08 10:45:23.082982 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2710/5641] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:22 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:23.567299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:23.616300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:23.670848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4e21990a-8857-49de-b7da-1bb54cfff9e4 req-efee336e-4db1-41cf-b322-8701fa7c1b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "name": "network-vif-plugged", "status": "completed", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:23.689035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4e21990a-8857-49de-b7da-1bb54cfff9e4 req-efee336e-4db1-41cf-b322-8701fa7c1b15 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.691717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4e21990a-8857-49de-b7da-1bb54cfff9e4 req-efee336e-4db1-41cf-b322-8701fa7c1b15 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.692353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4e21990a-8857-49de-b7da-1bb54cfff9e4 req-efee336e-4db1-41cf-b322-8701fa7c1b15 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.725137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4e21990a-8857-49de-b7da-1bb54cfff9e4 req-efee336e-4db1-41cf-b322-8701fa7c1b15 service nova] Creating event network-vif-plugged:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:45:23.743322 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4e21990a-8857-49de-b7da-1bb54cfff9e4 req-efee336e-4db1-41cf-b322-8701fa7c1b15 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313791 Sep 08 10:45:23.744322 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2932/5642] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:23.908432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:23.909649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:23.921114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:23.923601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.924413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.925336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:23.926227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:23.927037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:23.927803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.106357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:24.107073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:24.113850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.114832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.115725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.116636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:24.117282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:24.117912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:24.208772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:24.217360 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9f6d32d-0107-4474-8c26-e6e142c2fc65 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.312778 Sep 08 10:45:24.229351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2711/5643] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:23 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:24.414853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:24.426978 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6dc05ba4-3956-4625-9aec-7b75c02a9e0b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 0.324359 Sep 08 10:45:24.428416 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2933/5644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:24 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:25.252503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:25.253204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:25.261084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:25.261580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:25.262361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:25.263122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:25.263610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:25.264047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:25.450909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:25.451709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:25.464009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:25.466702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:25.470180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:25.474844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:25.476191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:25.476835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:25.763098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:25.777217 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54687196-827b-440f-b96d-9b2844dfe9e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1392 microversion: 2.1 time: 0.538661 Sep 08 10:45:25.777832 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2712/5645] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:25 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1392 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:25.860254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:25.878450 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aa9e8cde-dc6e-4a75-acae-f059b3ee918c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 0.431910 Sep 08 10:45:25.879547 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2934/5646] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:25 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:45:26.801277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:26.801895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:26.810070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.813704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.814362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.816290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.816937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.817563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.904058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:26.904939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:26.926220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.926995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.927693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:26.928663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:26.929428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:26.930099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.129999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:27.144127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ab4da95-c3ef-49f3-94f0-5157c7406f7e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1564 microversion: 2.1 time: 0.346594 Sep 08 10:45:27.145529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2713/5647] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:26 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1564 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:27.163726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1214bfcc-2a66-46d5-bdd4-9d32ad0bdd13 req-bb7ada98-c4e3-4a6f-b878-641ed44debb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-plugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:27.181634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1214bfcc-2a66-46d5-bdd4-9d32ad0bdd13 req-bb7ada98-c4e3-4a6f-b878-641ed44debb7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.182490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1214bfcc-2a66-46d5-bdd4-9d32ad0bdd13 req-bb7ada98-c4e3-4a6f-b878-641ed44debb7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.186149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1214bfcc-2a66-46d5-bdd4-9d32ad0bdd13 req-bb7ada98-c4e3-4a6f-b878-641ed44debb7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.213899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:27.223254 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1214bfcc-2a66-46d5-bdd4-9d32ad0bdd13 req-bb7ada98-c4e3-4a6f-b878-641ed44debb7 service nova] Creating event network-vif-plugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:45:27.231209 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1214bfcc-2a66-46d5-bdd4-9d32ad0bdd13 req-bb7ada98-c4e3-4a6f-b878-641ed44debb7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084072 Sep 08 10:45:27.232263 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2714/5648] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:27.238121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:27.239058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:27.294855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.295359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.295899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.296617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:27.297079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:27.297660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:27.297785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:27.311758 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aaad61ce-7c7f-4ff4-94b0-549a368eefb0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 0.413750 Sep 08 10:45:27.313304 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2935/5649] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:26 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:27.533077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:27.546517 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e022838-1542-44b8-b3fc-3c25c54b1e11 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1564 microversion: 2.1 time: 0.312818 Sep 08 10:45:27.547452 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2715/5650] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:27 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1564 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:28.334636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:28.335897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:28.346633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:28.349648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:28.350119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:28.350873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:28.351341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:28.355116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:28.761523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:28.781874 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d902996-ac1f-4aea-83d6-bb5114e84032 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1364 microversion: 2.1 time: 0.450634 Sep 08 10:45:28.782979 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2936/5651] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:28 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1364 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:29.808231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:29.809523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:29.818470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:29.819332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:29.820146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:29.821284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:29.821953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:29.822539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.051853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:30.068206 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8196576-8593-4eb9-b917-b7e16d98ee4e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1551 microversion: 2.1 time: 0.265670 Sep 08 10:45:30.070202 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2716/5652] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:29 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1551 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:30.092776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.093894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:30.102131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.102959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.103632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.104554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.105244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.105933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.214246 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17d6ba69-8229-4914-acbb-33897d6f8563 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125915 Sep 08 10:45:30.216272 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2937/5653] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:45:30 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:30.627431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.628088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:30.635162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.635941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.636574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.637471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.638220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.648772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.785786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lazy-loading 'services' on Instance uuid 4624e2b9-29d1-45bc-9933-2306f160c321 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:45:30.908479 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-32f172c1-e341-4047-ac6b-f5ee54233912 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments/d2c06e22-5f10-4c23-8c7a-850bd34c8854" status: 202 len: 0 microversion: 2.1 time: 0.284835 Sep 08 10:45:30.912903 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2717/5654] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:45:30 2022] DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments/d2c06e22-5f10-4c23-8c7a-850bd34c8854 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:45:30.922835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:30.926015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:30.939364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.940428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.942651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:30.944087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:30.945068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:30.946038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.025224 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22563cb8-856b-4b57-9a2f-a643602612b0 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111359 Sep 08 10:45:31.025837 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2938/5655] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:30 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:31.405971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:31.406793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:31.432218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:31.432745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:31.436724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.437681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:31.439862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:31.441675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.521128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d63360ae-8714-4e10-a701-9cb1af0a8f33 req-63ade09a-d6b4-4dca-83e5-93d6e743ca05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:31.549158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d63360ae-8714-4e10-a701-9cb1af0a8f33 req-63ade09a-d6b4-4dca-83e5-93d6e743ca05 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:31.549999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d63360ae-8714-4e10-a701-9cb1af0a8f33 req-63ade09a-d6b4-4dca-83e5-93d6e743ca05 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:31.550677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d63360ae-8714-4e10-a701-9cb1af0a8f33 req-63ade09a-d6b4-4dca-83e5-93d6e743ca05 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:31.586316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d63360ae-8714-4e10-a701-9cb1af0a8f33 req-63ade09a-d6b4-4dca-83e5-93d6e743ca05 service nova] Creating event network-changed:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:45:31.601287 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d63360ae-8714-4e10-a701-9cb1af0a8f33 req-63ade09a-d6b4-4dca-83e5-93d6e743ca05 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085599 Sep 08 10:45:31.604528 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2939/5656] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:32.044040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:32.049020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:32.072530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:32.073438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:32.077187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:32.081654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:32.086215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:32.087099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:32.158297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-952e682e-26cc-4e53-9740-d0e140b7cb2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122925 Sep 08 10:45:32.159358 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2940/5657] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:32 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:32.902630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:32.927713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-feeb79c2-e0c7-4919-afd4-6b774ced5978 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1564 microversion: 2.1 time: 1.535444 Sep 08 10:45:32.934805 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2718/5658] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:31 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1564 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:33.176285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:33.183091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:33.192736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.193709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.194878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.196623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.197287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.197924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.264908 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e549dfb-b310-4f85-b82b-0a3d39763a68 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095260 Sep 08 10:45:33.270653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2941/5659] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:33 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:33.686482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ab8cfd55-3884-4456-b04c-22fcd290c6c2 req-0baf6cdd-3b52-4783-ad62-fb58755a0ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:33.709691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:33.712710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ab8cfd55-3884-4456-b04c-22fcd290c6c2 req-0baf6cdd-3b52-4783-ad62-fb58755a0ace service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:33.713332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ab8cfd55-3884-4456-b04c-22fcd290c6c2 req-0baf6cdd-3b52-4783-ad62-fb58755a0ace service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:33.713871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ab8cfd55-3884-4456-b04c-22fcd290c6c2 req-0baf6cdd-3b52-4783-ad62-fb58755a0ace service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:33.752384 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ab8cfd55-3884-4456-b04c-22fcd290c6c2 req-0baf6cdd-3b52-4783-ad62-fb58755a0ace service nova] Creating event network-changed:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:45:33.765343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ab8cfd55-3884-4456-b04c-22fcd290c6c2 req-0baf6cdd-3b52-4783-ad62-fb58755a0ace service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085464 Sep 08 10:45:33.779922 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2719/5660] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:34.280115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:34.283239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:34.302499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:34.306861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:34.308398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:34.309248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:34.312618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:34.313314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:34.313956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:34.323864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:45:34.365598 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad7e639e-0922-45f6-a9b2-ee9427ed9017 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090938 Sep 08 10:45:34.370667 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2942/5661] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:34 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:35.379335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:35.383250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:35.394746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:35.395394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:35.395963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:35.396778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:35.397490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:35.398038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:35.443511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-558f61f5-4f88-4b08-93c0-4b7c85f2b845 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068558 Sep 08 10:45:35.450576 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2720/5662] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:35 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:36.457911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:36.460094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:36.473939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:36.474447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:36.476095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:36.478721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:36.479376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:36.480011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:36.543937 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c696a904-0487-4c07-915b-3514e48cab52 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090231 Sep 08 10:45:36.551041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2943/5663] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:36 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:37.557932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:37.563199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:37.577460 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:37.578511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:37.579556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:37.580654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:37.581367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:37.582019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:37.622542 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-156ee2a2-5718-421e-a161-f6b37ab91a44 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067990 Sep 08 10:45:37.630973 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2721/5664] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:37 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:45:38.638034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:38.643191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:38.651648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:38.652133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:38.652848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:38.653730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:38.654352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:38.654980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:38.695845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba9db8ee-5639-4fc1-b2d2-58fa014f01fc tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062869 Sep 08 10:45:38.697147 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2944/5665] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 10:45:38 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:45:38.774536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:38.775100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:38.782814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:38.783320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:38.783833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:38.784915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:38.785485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:38.785954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:38.839214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:45:38.967428 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2baf5a1-935d-4a77-8fd4-841f5132868b tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 204 len: 0 microversion: 2.1 time: 0.196753 Sep 08 10:45:38.968752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2722/5666] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:38 2022] DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:45:38.978707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:38.979828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:38.988428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:38.989387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:38.990632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:38.991778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:38.992417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:38.993077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:39.757099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:39.766803 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11558115-5189-4f48-942d-a1393ff2016c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1683 microversion: 2.1 time: 0.793892 Sep 08 10:45:39.767763 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2945/5667] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:38 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1683 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:40.797623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:40.798652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:40.806227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:40.806725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:40.807200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:40.808142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:40.809978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:40.810293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:41.098138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:41.109944 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ba26da69-6631-4487-ab2a-3a8bbb38c1ef tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1683 microversion: 2.1 time: 0.317743 Sep 08 10:45:41.112387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2723/5668] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:40 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1683 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:42.138669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:42.139960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:42.161048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:42.162047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:42.162984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:42.165318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:42.170544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:42.171911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:42.298018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-60b88c8a-33e5-4664-87e1-ad28e27a7dce req-57181928-8d04-451f-80b2-dad0e20cce2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4624e2b9-29d1-45bc-9933-2306f160c321", "name": "network-vif-deleted", "tag": "858ab2e1-2fb6-4656-93c6-84dc77d1031d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:45:42.338886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60b88c8a-33e5-4664-87e1-ad28e27a7dce req-57181928-8d04-451f-80b2-dad0e20cce2d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:42.340366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60b88c8a-33e5-4664-87e1-ad28e27a7dce req-57181928-8d04-451f-80b2-dad0e20cce2d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:42.340817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-60b88c8a-33e5-4664-87e1-ad28e27a7dce req-57181928-8d04-451f-80b2-dad0e20cce2d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:42.373414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-60b88c8a-33e5-4664-87e1-ad28e27a7dce req-57181928-8d04-451f-80b2-dad0e20cce2d service nova] Creating event network-vif-deleted:858ab2e1-2fb6-4656-93c6-84dc77d1031d for instance 4624e2b9-29d1-45bc-9933-2306f160c321 on n-h1-833090-19 Sep 08 10:45:42.388115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-60b88c8a-33e5-4664-87e1-ad28e27a7dce req-57181928-8d04-451f-80b2-dad0e20cce2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094086 Sep 08 10:45:42.390125 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2724/5669] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:45:42.414433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44827b22c79841d385cb094a30911a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fae812e76e4a298ea19a9e3d1d017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:45:42.424057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-24500f99-ae28-4c62-92c9-efada7c66e34 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 200 len: 1615 microversion: 2.1 time: 0.291479 Sep 08 10:45:42.444832 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2946/5670] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:42 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 1615 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:45:43.457771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:43.458498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:43.471665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:43.472895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:43.475255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:43.476220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:43.480574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:43.481367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:43.516075 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 HTTP/1.1 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '4624e2b9-29d1-45bc-9933-2306f160c321'} Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:43.517771 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:43.522715 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8c95c94-d084-4df0-8ead-49e85a96767e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 404 len: 111 microversion: 2.1 time: 0.067002 Sep 08 10:45:43.523959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2725/5671] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:43 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:43.531087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80676d92-dad6-4f4f-8247-4874d9a72c7e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '.version_select at 0x7f234be9dca0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:43.586198 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80676d92-dad6-4f4f-8247-4874d9a72c7e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302495951" status: 202 len: 0 microversion: 2.1 time: 0.060176 Sep 08 10:45:43.586715 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2947/5672] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:45:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302495951 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:45:50.564379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:50.565787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:50.582057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:50.583099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:50.583794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:50.585513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:50.586187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:50.587888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:50.610419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 HTTP/1.1 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '4624e2b9-29d1-45bc-9933-2306f160c321'} Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:50.612644 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.618151 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.634486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:50.635601 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c223284e-bbb4-4172-a1ad-5a12221ff1fe tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 404 len: 111 microversion: 2.1 time: 0.077945 Sep 08 10:45:50.636840 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2726/5673] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:50 2022] DELETE /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:50.645633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:50.646415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 4624e2b9-29d1-45bc-9933-2306f160c321] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:50.663713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:50.664443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:50.665608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:50.666992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:50.670980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:50.671779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:50.711911 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 HTTP/1.1 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '4624e2b9-29d1-45bc-9933-2306f160c321'} Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:50.719717 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 4624e2b9-29d1-45bc-9933-2306f160c321 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2d39d126-ff42-44f7-9f5a-7f88de3ca790 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321" status: 404 len: 111 microversion: 2.1 time: 0.075759 Sep 08 10:45:50.723572 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2948/5674] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:50 2022] GET /compute/v2.1/servers/4624e2b9-29d1-45bc-9933-2306f160c321 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:55.292595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:55.296342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:55.313834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.314522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.315343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.316690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.317486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.318121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.345889 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 HTTP/1.1 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'aa5c3a3e-cc41-425f-b0a1-2811c3063cf9'} Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:55.349474 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.353460 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.358355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:55.361537 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd582ff2-7523-4bb7-87c5-702df3afcf28 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 404 len: 111 microversion: 2.1 time: 0.073464 Sep 08 10:45:55.372006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:55.373313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: aa5c3a3e-cc41-425f-b0a1-2811c3063cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:55.379624 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2727/5675] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:55 2022] DELETE /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:55.385126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.388219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.389607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.390603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.392157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.394754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.420174 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 HTTP/1.1 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'aa5c3a3e-cc41-425f-b0a1-2811c3063cf9'} Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.422158 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.426094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:55.434907 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7230466d-e337-41c7-afa4-f57fcbf36981 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9" status: 404 len: 111 microversion: 2.1 time: 0.067238 Sep 08 10:45:55.435889 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2949/5676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:55 2022] GET /compute/v2.1/servers/aa5c3a3e-cc41-425f-b0a1-2811c3063cf9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:45:55.443802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:55.445495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:55.456158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.457029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.458098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.462441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.463334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.465791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.515713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e HTTP/1.1 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7356a674-ed81-44ba-ac7c-ce3841e6a67e'} Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:55.517281 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.522160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:55.550148 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34e3f66d-462b-46b3-b691-0ce5b17580c2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 404 len: 111 microversion: 2.1 time: 0.078981 Sep 08 10:45:55.554048 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2728/5677] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:45:55 2022] DELETE /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:45:55.611848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:45:55.613062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 7356a674-ed81-44ba-ac7c-ce3841e6a67e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:45:55.637096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.640009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.641572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.643670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:45:55.646486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:45:55.647292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:45:55.707084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e HTTP/1.1 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7356a674-ed81-44ba-ac7c-ce3841e6a67e'} Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:45:55.711167 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. Sep 08 10:45:55.716405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:45:55.717694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 7356a674-ed81-44ba-ac7c-ce3841e6a67e could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:45:55.718919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5b4ff05-9d0f-498b-81fa-905a6348a9f2 tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e" status: 404 len: 111 microversion: 2.1 time: 0.161918 Sep 08 10:45:55.741229 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2950/5678] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:45:55 2022] GET /compute/v2.1/servers/7356a674-ed81-44ba-ac7c-ce3841e6a67e => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:00.414000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:00.415882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:00.437676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.438620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.440422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.446642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.448584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.452593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.464967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:00.492458 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 HTTP/1.1 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '71958974-984d-4158-830e-13745e965da1'} Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:00.497672 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.502706 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.505904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:00.506996 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c59699a9-ef26-43f8-8fcc-45eaa0d30f2e tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 404 len: 111 microversion: 2.1 time: 0.098293 Sep 08 10:46:00.511210 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2729/5679] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:46:00 2022] DELETE /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:00.522901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:00.524193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] [instance: 71958974-984d-4158-830e-13745e965da1] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:00.542080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.543764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.544437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.545545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:00.546493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:00.548866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:00.582701 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] HTTP exception thrown: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Request method failure captured: Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 HTTP/1.1 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcX5mX2IPQ5f_ghF6bsQKP9ItlxCAo1AHRKI-qkhzcr2CmbwUn5VT9-W2v0X6TfdjkHZmGJ4gnF6ZEsxwkvY-FrWdV_vOBfjCymg3lrXoQqgnMsZSRvKWzi4j6GcaNDQ1lo3c1D95pZhDjkfbs20Lllrtyy114utM3M0jbiE5L3ZbSQ Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/50fae812e76e4a298ea19a9e3d1d017b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_50fae812e76e4a298ea19a9e3d1d017b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 50fae812e76e4a298ea19a9e3d1d017b Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48917107 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 44827b22c79841d385cb094a30911a80 Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-AttachVolumeNegativeTest-48917107-project Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '71958974-984d-4158-830e-13745e965da1'} Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:00.584006 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] Returning 404 to user: Instance 71958974-984d-4158-830e-13745e965da1 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:00.588036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d17e38cc-0c97-4816-bd09-d51b08ddbd8c tempest-AttachVolumeNegativeTest-48917107 tempest-AttachVolumeNegativeTest-48917107-project] 10.222.0.59 "GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1" status: 404 len: 111 microversion: 2.1 time: 0.068254 Sep 08 10:46:00.590554 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2951/5680] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:00 2022] GET /compute/v2.1/servers/71958974-984d-4158-830e-13745e965da1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:02.423148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:02.435220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:02.459367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.459939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.460393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.461132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:02.461588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:02.462014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:02.601918 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a39740ec-f93c-4085-a9fa-c8f5cfe484b0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action" status: 200 len: 24567 microversion: 2.1 time: 0.185091 Sep 08 10:46:02.602701 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2730/5681] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:02 2022] POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action => generated 24567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:46:05.313088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:05.313705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:05.316852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:05.335413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.336168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.341826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.343066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.343822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.344384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.390008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=38 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:05.609653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:05.639193 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e31e944d-ab54-492f-8cf6-cbcd7a406c65 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.330088 Sep 08 10:46:05.645667 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2952/5682] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:05 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:05.678608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:05.679342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:05.683581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:05.726202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.727024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.731827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:05.732957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:05.733546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:05.738823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.232425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.254344 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cdd43e8-6dd7-4b00-b901-eeb659b6c960 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.581729 Sep 08 10:46:06.263869 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2731/5683] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:05 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:06.284037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:06.285382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:06.302462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.303094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.303593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.308217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.308945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.309418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.823250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:06.839847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c72f58e-b818-42bc-9956-731c080ba91e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.560339 Sep 08 10:46:06.843349 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2953/5684] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:06 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:06.867177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2055695976"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:06.870569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:06.878448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.879497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.880175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:06.881179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:06.881840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:06.882465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:07.140277 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ddb88763-ba08-4ad1-83e5-602252013ab1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.276828 Sep 08 10:46:07.170335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2732/5685] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:06 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 10:46:10.417197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a227e8c-9164-4c66-b0cd-77c81bbce541 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Action: 'create', calling method: .version_select at 0x7f234be9d940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-239575201", "metadata": {"Type": "work"}}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a227e8c-9164-4c66-b0cd-77c81bbce541 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Request method failure captured: Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 121 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcfyGSkobJlZK8dpXy4CBcBN6G4jyULUiyL5-tPgVyX8HM96fm5WHRM9FvIfRACyv7MteDz0xJFyoJkAJKlhNhBe27cI3hYGFxg6FRzpKPGtlNyFB2uwDY-ZiuuFxoTFVQXKRemO16dJYPOoyq0qHn6BKqZkQIdoG4blwSLiYVq3R28 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6bfab645a0ac4fcf84caa02faa171dba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 19c55772953646cd8b34201cbb4c5f02 Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-239575201", "metadata": {"Type": "work"}}} Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-239575201', 'metadata': {'Type': 'work'}}}} Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:46:10.426036 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 10:46:10.430176 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.433427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a227e8c-9164-4c66-b0cd-77c81bbce541 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:10.436449 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a227e8c-9164-4c66-b0cd-77c81bbce541 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.242877 Sep 08 10:46:10.437389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2954/5686] 10.222.0.59 () {60 vars in 1156 bytes} [Thu Sep 8 10:46:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:46:10.448806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f5e32cf-1876-4227-9ee4-6c605c261429 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Action: 'create', calling method: .version_select at 0x7f234bfeb700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1445553330", "metadata": {"Type": "work"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f5e32cf-1876-4227-9ee4-6c605c261429 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Request method failure captured: Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 120 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcfyGSkobJlZK8dpXy4CBcBN6G4jyULUiyL5-tPgVyX8HM96fm5WHRM9FvIfRACyv7MteDz0xJFyoJkAJKlhNhBe27cI3hYGFxg6FRzpKPGtlNyFB2uwDY-ZiuuFxoTFVQXKRemO16dJYPOoyq0qHn6BKqZkQIdoG4blwSLiYVq3R28 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6bfab645a0ac4fcf84caa02faa171dba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 19c55772953646cd8b34201cbb4c5f02 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1445553330", "metadata": {"Type": "work"}}} Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1445553330', 'metadata': {'Type': 'work'}}}} Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '0' Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:46:10.454104 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 10:46:10.458326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.459720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f5e32cf-1876-4227-9ee4-6c605c261429 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:10.460712 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f5e32cf-1876-4227-9ee4-6c605c261429 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018169 Sep 08 10:46:10.473174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc661783-60e7-4660-9f54-010c0f43158d tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Action: 'create', calling method: .version_select at 0x7f2350522b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-513554043", "metadata": {"Type": "work"}}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:10.475582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2733/5687] 10.222.0.59 () {60 vars in 1156 bytes} [Thu Sep 8 10:46:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc661783-60e7-4660-9f54-010c0f43158d tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Request method failure captured: Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 118 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcfyGSkobJlZK8dpXy4CBcBN6G4jyULUiyL5-tPgVyX8HM96fm5WHRM9FvIfRACyv7MteDz0xJFyoJkAJKlhNhBe27cI3hYGFxg6FRzpKPGtlNyFB2uwDY-ZiuuFxoTFVQXKRemO16dJYPOoyq0qHn6BKqZkQIdoG4blwSLiYVq3R28 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6bfab645a0ac4fcf84caa02faa171dba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 19c55772953646cd8b34201cbb4c5f02 Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-513554043", "metadata": {"Type": "work"}}} Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-513554043', 'metadata': {'Type': 'work'}}}} Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise error Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi '' Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 10:46:10.484286 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 10:46:10.488230 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.490527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc661783-60e7-4660-9f54-010c0f43158d tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:10.491421 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc661783-60e7-4660-9f54-010c0f43158d tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022433 Sep 08 10:46:10.492045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2955/5688] 10.222.0.59 () {60 vars in 1156 bytes} [Thu Sep 8 10:46:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 10:46:10.513086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3ea98f0-17c0-4e22-b48c-fd636506e961 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Calling method '.version_select at 0x7f234bfcc670>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:10.601037 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e3ea98f0-17c0-4e22-b48c-fd636506e961 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] HTTP exception thrown: Volume tempest-invalid-1179839488 could not be found. Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3ea98f0-17c0-4e22-b48c-fd636506e961 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Request method failure captured: Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1179839488 HTTP/1.1 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcfyGSkobJlZK8dpXy4CBcBN6G4jyULUiyL5-tPgVyX8HM96fm5WHRM9FvIfRACyv7MteDz0xJFyoJkAJKlhNhBe27cI3hYGFxg6FRzpKPGtlNyFB2uwDY-ZiuuFxoTFVQXKRemO16dJYPOoyq0qHn6BKqZkQIdoG4blwSLiYVq3R28 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6bfab645a0ac4fcf84caa02faa171dba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 19c55772953646cd8b34201cbb4c5f02 Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: exception: Volume tempest-invalid-1179839488 could not be found. Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'tempest-invalid-1179839488'} Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1179839488 could not be found. (HTTP 404) (Request-ID: req-1b89b38a-12c0-4c73-8f8e-29afe4d70336) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:46:10.604349 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1179839488 could not be found. Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1179839488 could not be found. Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1179839488 could not be found. Sep 08 10:46:10.608332 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.614790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3ea98f0-17c0-4e22-b48c-fd636506e961 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Returning 404 to user: Volume tempest-invalid-1179839488 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:10.614790 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3ea98f0-17c0-4e22-b48c-fd636506e961 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1179839488" status: 404 len: 99 microversion: 2.1 time: 0.101917 Sep 08 10:46:10.614790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2734/5689] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 10:46:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1179839488 => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:46:10.620815 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90e2066f-6a0e-44f1-b05f-4c846240e24c tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004612 Sep 08 10:46:10.622067 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2956/5690] 10.222.0.59 () {58 vars in 1140 bytes} [Thu Sep 8 10:46:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:46:10.668296 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-887df200-3186-469f-a0fd-211d3e8407a2 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011405 Sep 08 10:46:10.670656 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2735/5691] 10.222.0.59 () {58 vars in 1137 bytes} [Thu Sep 8 10:46:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 10:46:10.680301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20ec69ad-e840-436f-a819-4bd7063f63c1 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Calling method '.version_select at 0x7f234bdebb80>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:10.865629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-20ec69ad-e840-436f-a819-4bd7063f63c1 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] HTTP exception thrown: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20ec69ad-e840-436f-a819-4bd7063f63c1 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Request method failure captured: Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/os-volumes/c6368b1e-d996-45e0-a504-c527916cf8e7 HTTP/1.1 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcfyGSkobJlZK8dpXy4CBcBN6G4jyULUiyL5-tPgVyX8HM96fm5WHRM9FvIfRACyv7MteDz0xJFyoJkAJKlhNhBe27cI3hYGFxg6FRzpKPGtlNyFB2uwDY-ZiuuFxoTFVQXKRemO16dJYPOoyq0qHn6BKqZkQIdoG4blwSLiYVq3R28 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6bfab645a0ac4fcf84caa02faa171dba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 19c55772953646cd8b34201cbb4c5f02 Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: method: Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: exception: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'c6368b1e-d996-45e0-a504-c527916cf8e7'} Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. (HTTP 404) (Request-ID: req-be4702ce-529a-4793-9ef4-9c22b503dc5c) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:46:10.868348 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. Sep 08 10:46:10.872307 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:46:10.876311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20ec69ad-e840-436f-a819-4bd7063f63c1 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Returning 404 to user: Volume c6368b1e-d996-45e0-a504-c527916cf8e7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:10.877296 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20ec69ad-e840-436f-a819-4bd7063f63c1 tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/c6368b1e-d996-45e0-a504-c527916cf8e7" status: 404 len: 109 microversion: 2.1 time: 0.200941 Sep 08 10:46:10.877885 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2957/5692] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 10:46:10 2022] DELETE /compute/v2.1/os-volumes/c6368b1e-d996-45e0-a504-c527916cf8e7 => generated 109 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:46:10.890642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-758dce5f-2d61-4aa2-b394-c7d4c9fe95ae tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Calling method '.version_select at 0x7f2350813700>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:11.023536 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-758dce5f-2d61-4aa2-b394-c7d4c9fe95ae tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] HTTP exception thrown: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-758dce5f-2d61-4aa2-b394-c7d4c9fe95ae tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Request method failure captured: Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/os-volumes/3ac427ba-23cc-4406-a53c-d25674832fb0 HTTP/1.1 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcfyGSkobJlZK8dpXy4CBcBN6G4jyULUiyL5-tPgVyX8HM96fm5WHRM9FvIfRACyv7MteDz0xJFyoJkAJKlhNhBe27cI3hYGFxg6FRzpKPGtlNyFB2uwDY-ZiuuFxoTFVQXKRemO16dJYPOoyq0qHn6BKqZkQIdoG4blwSLiYVq3R28 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6bfab645a0ac4fcf84caa02faa171dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6bfab645a0ac4fcf84caa02faa171dba", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6bfab645a0ac4fcf84caa02faa171dba Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesNegativeTest-667751200 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 19c55772953646cd8b34201cbb4c5f02 Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesNegativeTest-667751200-project Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: method: Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: exception: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3ac427ba-23cc-4406-a53c-d25674832fb0'} Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. (HTTP 404) (Request-ID: req-da62df7d-c3ac-4e4b-aa29-c6dc12fc9ef2) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 10:46:11.026259 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-758dce5f-2d61-4aa2-b394-c7d4c9fe95ae tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] Returning 404 to user: Volume 3ac427ba-23cc-4406-a53c-d25674832fb0 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-758dce5f-2d61-4aa2-b394-c7d4c9fe95ae tempest-VolumesNegativeTest-667751200 tempest-VolumesNegativeTest-667751200-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3ac427ba-23cc-4406-a53c-d25674832fb0" status: 404 len: 109 microversion: 2.1 time: 0.141856 Sep 08 10:46:11.031987 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2736/5693] 10.222.0.59 () {58 vars in 1245 bytes} [Thu Sep 8 10:46:10 2022] GET /compute/v2.1/os-volumes/3ac427ba-23cc-4406-a53c-d25674832fb0 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:46:13.720250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3c27ee83-09a6-4fdf-8c73-037c3761abd7 req-32d1ab52-39c8-4fab-aa80-714734663d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-plugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:13.759851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c27ee83-09a6-4fdf-8c73-037c3761abd7 req-32d1ab52-39c8-4fab-aa80-714734663d75 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:13.761769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c27ee83-09a6-4fdf-8c73-037c3761abd7 req-32d1ab52-39c8-4fab-aa80-714734663d75 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:13.762636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c27ee83-09a6-4fdf-8c73-037c3761abd7 req-32d1ab52-39c8-4fab-aa80-714734663d75 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:13.803053 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3c27ee83-09a6-4fdf-8c73-037c3761abd7 req-32d1ab52-39c8-4fab-aa80-714734663d75 service nova] Creating event network-vif-plugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:46:13.813967 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3c27ee83-09a6-4fdf-8c73-037c3761abd7 req-32d1ab52-39c8-4fab-aa80-714734663d75 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099487 Sep 08 10:46:13.818367 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2958/5694] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:38.962886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5b756246-341c-4786-9fff-9d69cdf43e65 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'create', calling method: .version_select at 0x7f2350565670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-232049597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5GuDiYIeqEgdvJQksq+s8ODzmMi8n4gvfHqbVqhPlihaYkGuGtUDLlHxulOKmSAeQRStFjrVIx4li9PPdQGP636uckK81Kj2r3zShYjnyBcYylzVwsFh0xrbx6TtIgaw=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:38.997684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:39.001513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:39.034473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-5b756246-341c-4786-9fff-9d69cdf43e65 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:39.055440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-5b756246-341c-4786-9fff-9d69cdf43e65 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for user 4864b5d5cefa4fa593bb2adeb46c04d1 and project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:39.117813 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b756246-341c-4786-9fff-9d69cdf43e65 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 10:46:40.126046 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b756246-341c-4786-9fff-9d69cdf43e65 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 53660. Sep 08 10:46:40.164467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5b756246-341c-4786-9fff-9d69cdf43e65 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.209467 Sep 08 10:46:40.172393 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2737/5695] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:46:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:41.080054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=5 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:41.081087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=13 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:41.094086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:41.095869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:41.114022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.117604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.118109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.120044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.120528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.123204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.449392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:41.459030 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3526ce4-1dd8-4788-8563-6de971b9609d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.381094 Sep 08 10:46:41.481317 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2959/5696] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:41 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:41.506825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-452824236"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:41.524653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:41.546993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.547775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.548240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.549000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.549461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.550092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.789724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:41.797274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:41.812592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.813152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.813637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:41.814721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:41.815397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:41.816008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.043197 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-737c6993-a318-44b9-a853-3fd0d4a6ece7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.557980 Sep 08 10:46:42.047718 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2960/5697] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:41 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 10:46:42.288190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8bf9314b-c590-4454-ab4d-0f755a0af053 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1836 microversion: 2.1 time: 0.982061 Sep 08 10:46:42.289441 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2738/5698] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:41 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1836 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:42.554259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-799692334", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "f348c1ac-6e6d-4b3a-9206-24def8d8ab4f"}], "key_name": "tempest-TestNetworkBasicOps-232049597", "security_groups": [{"name": "tempest-secgroup-smoke-600216824"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:42.557845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:42.559244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:42.567801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.568711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.569339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.570857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:42.571556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:42.572177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:42.792490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] validate_networks() for [('f348c1ac-6e6d-4b3a-9206-24def8d8ab4f', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:46:42.856553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:42.871533 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dbe2b4c9-ef08-44ae-b6a3-2bc975209604 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1683 microversion: 2.1 time: 0.563124 Sep 08 10:46:42.872141 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2961/5699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:42 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1683 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:43.064439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:43.066834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:43.074439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.074835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.075147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.075942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.076407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.076839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.152696 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bef9770c-219d-4c96-b568-1b4b8152b2ec tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action" status: 200 len: 32639 microversion: 2.1 time: 0.092000 Sep 08 10:46:43.154151 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2962/5700] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:43 2022] POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action => generated 32639 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:46:43.299805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:43.300679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:43.318647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.320115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.323601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.324492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.325058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.329984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.391177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '59c7760cbd8145078eca59e5f0edc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725757a3f886474dbeece60e9c3fc049', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:43.394665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] flavor_id is None. Assuming migration. {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 10:46:43.395356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 10:46:43.638751 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd726380-f0a2-4286-9b6c-78c865bd5d7f tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action" status: 202 len: 0 microversion: 2.1 time: 0.344182 Sep 08 10:46:43.650484 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2963/5701] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:46:43 2022] POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:46:43.657461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:43.658108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:43.677188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.680263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.680814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.681568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.684293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.685653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.705365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:46:43.706207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:46:43.706850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:46:43.707422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:46:43.708079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:46:43.727575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.728260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.730152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.730932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:43.731397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:43.731857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:43.762485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:46:43.768601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for user 4864b5d5cefa4fa593bb2adeb46c04d1 and project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:46:43.783926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:46:43.786604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:46:43.891173 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ffdb477-008d-4214-9899-fe102b71c2cc tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.343636 Sep 08 10:46:43.899868 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2739/5702] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:46:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:46:43.905585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5761227-1eb0-4ab0-80f0-1c9b96417fb9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:43.907146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5761227-1eb0-4ab0-80f0-1c9b96417fb9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:44.062223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5761227-1eb0-4ab0-80f0-1c9b96417fb9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:44.080103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5761227-1eb0-4ab0-80f0-1c9b96417fb9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1247 microversion: 2.1 time: 0.178492 Sep 08 10:46:44.112721 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2740/5703] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:43 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1247 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:44.309089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:44.321670 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07a482cd-17f6-465a-a702-d41be2639fd1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1692 microversion: 2.1 time: 0.666907 Sep 08 10:46:44.322956 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2964/5704] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:43 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1692 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:45.112841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:45.113510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:45.131488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.131985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.132476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.136847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.137409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.137889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.338691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:45.347247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:45.348512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:45.349049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c725c48-6836-4749-aa55-1909cdf553a8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1251 microversion: 2.1 time: 0.242301 Sep 08 10:46:45.349644 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2741/5705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:45 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1251 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:45.356441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.356939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.357385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.358145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:45.358596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:45.359033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:45.847682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:45.856477 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87a3c8f1-a0a7-4998-affd-cd198e0e4df4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1692 microversion: 2.1 time: 0.513303 Sep 08 10:46:45.868172 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2965/5706] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:45 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1692 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:46.338012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6e2f83d7-caa7-48fd-bca4-60c401901dac req-e6fe77eb-7eac-4bd0-b859-d72f0272a232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-unplugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:46.364086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6e2f83d7-caa7-48fd-bca4-60c401901dac req-e6fe77eb-7eac-4bd0-b859-d72f0272a232 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.364589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6e2f83d7-caa7-48fd-bca4-60c401901dac req-e6fe77eb-7eac-4bd0-b859-d72f0272a232 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.374154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:46.374805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:46.384017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6e2f83d7-caa7-48fd-bca4-60c401901dac req-e6fe77eb-7eac-4bd0-b859-d72f0272a232 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.396534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.401377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.402087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.406275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.408328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.410446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.436619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6e2f83d7-caa7-48fd-bca4-60c401901dac req-e6fe77eb-7eac-4bd0-b859-d72f0272a232 service nova] Creating event network-vif-unplugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:46:46.459623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6e2f83d7-caa7-48fd-bca4-60c401901dac req-e6fe77eb-7eac-4bd0-b859-d72f0272a232 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124283 Sep 08 10:46:46.463425 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2742/5707] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:46.589937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:46.601888 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b349946-e8bd-41f9-b202-34d478f7ac29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1299 microversion: 2.1 time: 0.232585 Sep 08 10:46:46.603383 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2966/5708] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:46 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:46.895128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:46.896215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:46.909324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.913176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.917483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:46.919017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:46.919544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:46.920028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.340915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:47.353475 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2916461a-e57c-4a58-81d2-b1a7e0b9a639 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1692 microversion: 2.1 time: 0.462943 Sep 08 10:46:47.355299 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2743/5709] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:46 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1692 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:47.635730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:47.637014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:47.656601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:47.662601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:47.667152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:47.668228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:47.671682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:47.675020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.038453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:48.055129 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f618de5-45ae-4107-8696-014cf172b22f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1305 microversion: 2.1 time: 0.428705 Sep 08 10:46:48.072811 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2967/5710] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:47 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1305 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:48.378236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:48.378868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:48.387257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.387797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.388246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:48.388962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:48.389461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:48.389905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.087420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:49.088243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:49.121919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.123058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.123678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.125483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:49.127255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:49.127899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:49.162634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:49.180903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ed75d757-0c16-4db0-a96a-e7ffb0eef069 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1692 microversion: 2.1 time: 0.806465 Sep 08 10:46:49.192159 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2744/5711] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:48 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1692 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:49.340551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:49.367101 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e944919-9127-4bd3-af09-0f97f845d847 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1305 microversion: 2.1 time: 0.285116 Sep 08 10:46:49.380490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2968/5712] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:49 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1305 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:50.213791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:50.214312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:50.229915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.230414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.230861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.231592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.232053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.232482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.397520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:50.399141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:50.431133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.431679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.432126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.432854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:50.433310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:50.433736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:50.701875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:50.715167 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-497b04c1-c0e9-4b56-b157-30a670875c00 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1305 microversion: 2.1 time: 0.324023 Sep 08 10:46:50.716433 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2969/5713] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:50 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1305 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:50.854080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:50.874069 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ce18174-c2dd-4d47-98ee-b15424b2904e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1692 microversion: 2.1 time: 0.664501 Sep 08 10:46:50.874855 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2745/5714] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:50 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1692 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:51.079080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c541ee0d-875e-4768-bb8f-9a6607304764 req-c1c31536-d14a-4eda-b4e1-1fd260485798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-plugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:51.106577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c541ee0d-875e-4768-bb8f-9a6607304764 req-c1c31536-d14a-4eda-b4e1-1fd260485798 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.107064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c541ee0d-875e-4768-bb8f-9a6607304764 req-c1c31536-d14a-4eda-b4e1-1fd260485798 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.115877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c541ee0d-875e-4768-bb8f-9a6607304764 req-c1c31536-d14a-4eda-b4e1-1fd260485798 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.165928 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c541ee0d-875e-4768-bb8f-9a6607304764 req-c1c31536-d14a-4eda-b4e1-1fd260485798 service nova] Creating event network-vif-plugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:46:51.181337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c541ee0d-875e-4768-bb8f-9a6607304764 req-c1c31536-d14a-4eda-b4e1-1fd260485798 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106274 Sep 08 10:46:51.181993 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2970/5715] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:51.744690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:51.745300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:51.756036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.758444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.759944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.763138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.763887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.764881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.899254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:51.900052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:51.917408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.918765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.922319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:51.941430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:51.942275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:51.942900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.424271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:52.434249 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1aa9a63-d394-4f28-a124-67374ec0218d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1372 microversion: 2.1 time: 0.695628 Sep 08 10:46:52.435843 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2746/5716] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:51 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1372 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:52.634627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:52.655639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-06157733-9f3f-453b-a2a2-ced8b2a5d8d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.760653 Sep 08 10:46:52.673227 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2971/5717] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:51 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:52.868543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-74fb20b1-1fd8-4f1f-9fc6-5d0d3492ed9b req-3355f93d-e370-4738-84e6-713cd9792f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8677a3a-c040-4eb3-8547-2ff124a31214", "tag": "1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:52.898062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-74fb20b1-1fd8-4f1f-9fc6-5d0d3492ed9b req-3355f93d-e370-4738-84e6-713cd9792f7a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:52.899095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-74fb20b1-1fd8-4f1f-9fc6-5d0d3492ed9b req-3355f93d-e370-4738-84e6-713cd9792f7a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:52.899790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-74fb20b1-1fd8-4f1f-9fc6-5d0d3492ed9b req-3355f93d-e370-4738-84e6-713cd9792f7a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:52.948113 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-74fb20b1-1fd8-4f1f-9fc6-5d0d3492ed9b req-3355f93d-e370-4738-84e6-713cd9792f7a service nova] Creating event network-changed:1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5 for instance c8677a3a-c040-4eb3-8547-2ff124a31214 on n-h1-833090-19 Sep 08 10:46:52.965229 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-74fb20b1-1fd8-4f1f-9fc6-5d0d3492ed9b req-3355f93d-e370-4738-84e6-713cd9792f7a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101342 Sep 08 10:46:52.968009 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2747/5718] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:53.460928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:53.461734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:53.486506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.489012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.489599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.492823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.495485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.496246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.693352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:53.695220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:53.714602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.715042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.715526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.716236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:53.716833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:53.717113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:53.809977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:54.067335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:54.101641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:54.146298 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49f09938-7e81-494b-9452-77fcf199d6b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1372 microversion: 2.1 time: 0.691106 Sep 08 10:46:54.151747 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2972/5719] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:53 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1372 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:54.210327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:54.222956 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1849e134-533f-405e-b429-6178afb09e60 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.543067 Sep 08 10:46:54.224128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2748/5720] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:53 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:55.180399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:55.181676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:55.193732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.196807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.198637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.200548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.203220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.203910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.251802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:55.252480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:55.271270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.271896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.272885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.273206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:46:55.276652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:55.277127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:55.277559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:55.868280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:55.880391 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-22c82b72-7b80-4fca-8eb2-1a3fad129b32 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.632862 Sep 08 10:46:55.880995 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2749/5721] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:55 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:55.904560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:55.916795 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c97e0ed6-9406-4592-922f-20689aa05ccd tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1372 microversion: 2.1 time: 0.740562 Sep 08 10:46:55.940280 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2973/5722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:55 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1372 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:56.904888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:56.905511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:56.916135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.918024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.918684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.919794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.920443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.921096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.949196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:56.950774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:56.961022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.961792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.962558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:56.964167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:56.964843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:56.965747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:57.299229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:57.313001 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f7f2fe5-ae35-44d0-8559-1c02979c68ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.411471 Sep 08 10:46:57.319396 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2750/5723] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:56 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:57.419700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:57.432192 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03058fe4-ed10-48c0-a49d-046c4c400788 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1372 microversion: 2.1 time: 0.486273 Sep 08 10:46:57.435046 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2974/5724] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:56 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1372 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:58.346045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:58.347764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:58.364583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.366827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.367525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.370316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.371718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.372452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.466474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:58.467164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:58.489051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.492592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.493315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.494973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:58.495452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:58.504877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:58.850327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:58.883021 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ad16885-2365-470c-933f-362b7e528a46 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.539883 Sep 08 10:46:58.885806 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2751/5725] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:58 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:46:58.938202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:46:58.950906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f0e86133-5f7c-43e2-9e9d-60e9df0f80da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1372 microversion: 2.1 time: 0.494732 Sep 08 10:46:58.957631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2975/5726] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:58 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1372 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:46:59.727811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-22030240-32d0-4d68-b211-369f06c51f8b req-0f5beef4-c19f-45ff-8f49-3fa425015f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8677a3a-c040-4eb3-8547-2ff124a31214", "name": "network-vif-plugged", "status": "completed", "tag": "1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:46:59.747107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22030240-32d0-4d68-b211-369f06c51f8b req-0f5beef4-c19f-45ff-8f49-3fa425015f63 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.747486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22030240-32d0-4d68-b211-369f06c51f8b req-0f5beef4-c19f-45ff-8f49-3fa425015f63 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.748308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-22030240-32d0-4d68-b211-369f06c51f8b req-0f5beef4-c19f-45ff-8f49-3fa425015f63 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.768898 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-22030240-32d0-4d68-b211-369f06c51f8b req-0f5beef4-c19f-45ff-8f49-3fa425015f63 service nova] Creating event network-vif-plugged:1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5 for instance c8677a3a-c040-4eb3-8547-2ff124a31214 on n-h1-833090-19 Sep 08 10:46:59.778178 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-22030240-32d0-4d68-b211-369f06c51f8b req-0f5beef4-c19f-45ff-8f49-3fa425015f63 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054443 Sep 08 10:46:59.779502 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2752/5727] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:46:59.914329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:59.916016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:46:59.958101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.959136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.961040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.970837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:46:59.972748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:46:59.973636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:46:59.981643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:46:59.982993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:00.013947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.017819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.020034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:00.024917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:00.027246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:00.027996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:00.622849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:00.636235 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-732bae0c-4b4e-4261-97ab-6ac08bf00f18 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1372 microversion: 2.1 time: 0.659073 Sep 08 10:47:00.636835 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2753/5728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:59 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1372 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:00.651540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:00.666426 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87d1281c-36d5-45f9-91c2-ed42e178ab12 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.758201 Sep 08 10:47:00.668932 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2976/5729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:46:59 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:01.663256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:01.665320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:01.680219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.681094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.681767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.682869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.683829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.684487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.698935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:01.701948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:01.725446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.726230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.726876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:01.727967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:01.729234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:01.729938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:02.145163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:02.157686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:02.161389 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5c9ff523-f606-4e10-b4be-2d98b3261415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1697 microversion: 2.1 time: 0.471487 Sep 08 10:47:02.166761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2977/5730] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:01 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1697 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:02.167364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0c72d23a-a678-4eb2-bcb9-00b97b9e5881 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1542 microversion: 2.1 time: 0.508756 Sep 08 10:47:02.169166 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2754/5731] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:01 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1542 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:02.203088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:02.203893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:02.228184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:02.228695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:02.236644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:02.238829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:02.239331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:02.239834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:02.487851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:02.500105 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cfbd376b-c7c1-48de-8c7d-8359b1089b8d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1542 microversion: 2.1 time: 0.304509 Sep 08 10:47:02.532120 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2978/5732] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:02 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1542 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:03.188505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:03.189889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:03.211808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.214974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.216503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.219133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:03.223038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:03.226827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:03.843282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:03.881738 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f045541-9686-499d-8ec4-09fe80ae7b13 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1696 microversion: 2.1 time: 0.695827 Sep 08 10:47:03.886067 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2755/5733] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:03 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1696 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:04.914903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:04.916361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:04.931853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.932712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.933381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:04.935578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:04.936276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:04.937770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.169097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "name": "network-vif-unplugged", "status": "completed", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:05.202225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:05.205549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:05.206193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:05.244472 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] Creating event network-vif-unplugged:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h1-833090-19 Sep 08 10:47:05.263357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:47:05.299234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cde7d822-0e71-4a7e-b2d8-125a110312c5 req-12019b29-a94d-4b11-91b5-8e7276ccf118 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135252 Sep 08 10:47:05.304582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2756/5734] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:05.957868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:05.968569 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63401f03-eb81-470d-a829-0c2acd722849 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1696 microversion: 2.1 time: 1.061097 Sep 08 10:47:05.975107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2979/5735] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:04 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1696 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:07.003981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:07.005514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:07.022360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.024861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.027129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.030002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.030654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.032138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.391262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:07.403288 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81bb6bde-8b8c-41f4-b586-d498ee6ce0e5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1696 microversion: 2.1 time: 0.404395 Sep 08 10:47:07.405342 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2757/5736] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:06 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1696 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:07.657926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:07.716214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:07.721371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:07.721938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:07.750051 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] Creating event network-changed:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h1-833090-19 Sep 08 10:47:07.765649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:47:07.798682 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-bea48891-24ef-4541-be2d-41f2535da52f req-a90d0c4d-7e6f-435a-8cea-72f8e5dfd839 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146574 Sep 08 10:47:07.800218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2980/5737] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:08.312560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c698ca83-8cf5-434f-980d-1beda119fb79 req-ef92f865-4a37-4a59-87da-417e093eafb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8677a3a-c040-4eb3-8547-2ff124a31214", "tag": "1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:08.341668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c698ca83-8cf5-434f-980d-1beda119fb79 req-ef92f865-4a37-4a59-87da-417e093eafb1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.346420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c698ca83-8cf5-434f-980d-1beda119fb79 req-ef92f865-4a37-4a59-87da-417e093eafb1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.350019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c698ca83-8cf5-434f-980d-1beda119fb79 req-ef92f865-4a37-4a59-87da-417e093eafb1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.388652 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c698ca83-8cf5-434f-980d-1beda119fb79 req-ef92f865-4a37-4a59-87da-417e093eafb1 service nova] Creating event network-changed:1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5 for instance c8677a3a-c040-4eb3-8547-2ff124a31214 on n-h1-833090-19 Sep 08 10:47:08.406473 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c698ca83-8cf5-434f-980d-1beda119fb79 req-ef92f865-4a37-4a59-87da-417e093eafb1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097317 Sep 08 10:47:08.407911 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2758/5738] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:08.433722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:08.435180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:08.444766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.445920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.447137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:08.448143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:08.451726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:08.452499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:09.023607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:09.035303 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b1c5bda-19ee-4684-afde-34d8c7a1d582 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1696 microversion: 2.1 time: 0.605824 Sep 08 10:47:09.040912 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2981/5739] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:08 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1696 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:10.068284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:10.069804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:10.091965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:10.093858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.095785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.096455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.101336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:10.105190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:10.105851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:10.969672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:11.607715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:11.616833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad246a0c-7a7c-4f00-8dec-2b930e6ecf2d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1694 microversion: 2.1 time: 1.554318 Sep 08 10:47:11.617449 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2759/5740] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:10 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1694 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:12.652810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:12.654497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:12.666771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=49 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:12.669316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.670951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.672013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:12.673728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:12.674708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:12.676397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.062040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:13.076224 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-84c02370-5ada-4b91-b725-b56e061655ef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1691 microversion: 2.1 time: 0.436432 Sep 08 10:47:13.077241 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2982/5741] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:12 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1691 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:13.104325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:13.104888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:13.113546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.114476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.115062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.115871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.116632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.117270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.343071 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5aa58559-3280-4493-aee8-18b2512f13aa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action" status: 202 len: 0 microversion: 2.1 time: 0.243462 Sep 08 10:47:13.343719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2760/5742] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:13 2022] POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:13.354010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:13.354735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:13.368091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.374184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.376533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.378354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:13.381320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:13.382642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:13.742842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:13.757459 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2bb5869e-561e-457a-a25a-fd79b91c4538 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.408862 Sep 08 10:47:13.761299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2983/5743] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:13 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:14.787681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:14.789174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:14.815995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.820147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.820410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:14.821103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:14.821519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.822453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.823093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.823972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.834213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.838270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.839775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:14.840579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:14.842225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:14.842675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.310455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:15.321793 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cff4ee12-d549-4cf7-b23b-ffade1cebd84 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.505553 Sep 08 10:47:15.322463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:15.326372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2984/5744] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:14 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:15.333992 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3b71ad7f-b3b7-4b4e-aaf0-c05f821a581d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.551467 Sep 08 10:47:15.354117 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2761/5745] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:14 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:15.361932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1370587261"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:15.372980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:15.428213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.436376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.437077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.438198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.438662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.439102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.788547 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad334063-37b7-4d5a-b917-1aa720e3d2ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.440732 Sep 08 10:47:15.790054 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2985/5746] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:15 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 10:47:15.798030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:15.798640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:15.808594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.809014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.809591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:15.810342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:15.810928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:15.816314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.040549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:16.052224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67183853-0c01-40cd-879f-3468406c0b73 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.257948 Sep 08 10:47:16.070904 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2762/5747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:15 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:16.359508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:16.360809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:16.370236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.370730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.371189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.372078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:16.372661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:16.373087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:16.635648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:16.649108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39f54be1-341d-4bc0-b808-59731cf4624f tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.293577 Sep 08 10:47:16.649793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2986/5748] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:16 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:17.077866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:17.078464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:17.089139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.089547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.092320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.094638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.096001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.096809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.364864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:17.373331 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c430307c-daf3-41e0-84a6-111914e9875a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.299272 Sep 08 10:47:17.379557 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2763/5749] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:17 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:17.678415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "name": "network-vif-plugged", "status": "completed", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:17.678902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:17.679581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:17.690391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.690992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.691441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.693937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.696109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.698240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:17.698514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.698734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:17.699173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:17.748993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] Creating event network-vif-plugged:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h1-833090-19 Sep 08 10:47:17.771775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:47:17.797800 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f1a6ae2f-908d-411d-a3ee-abec836c7b5a req-d97d4a1d-8318-4359-a75f-19d4831c7914 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123681 Sep 08 10:47:17.798422 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2987/5750] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:18.147591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:18.165550 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-46674345-05fd-4352-b9f6-3a5182149c84 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.490827 Sep 08 10:47:18.170294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2764/5751] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:17 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:18.400309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:18.401030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:18.411372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.412783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.413657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.415243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:18.416281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:18.417606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:18.741960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:18.765265 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-666dc2d9-d2aa-4a34-a8f1-e04a35ed1676 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1688 microversion: 2.1 time: 0.371056 Sep 08 10:47:18.766480 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2988/5752] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:18 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1688 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:19.199035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:19.200437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:19.210538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.211837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.225222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.226450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.228332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.229646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.510856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:19.524334 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9484b1ba-f8fe-49c2-84cf-bce3150baaad tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.331850 Sep 08 10:47:19.539839 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2765/5753] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:19 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:19.801638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:19.802708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:19.813144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.813764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.814320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.816019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.816757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.817395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.859670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2a30c5cd-92a9-459a-b810-3d1532ad42d4 req-89584a73-64db-4cf0-aba1-9c92f516ba1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-unplugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:19.888440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:19.889098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a30c5cd-92a9-459a-b810-3d1532ad42d4 req-89584a73-64db-4cf0-aba1-9c92f516ba1a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:19.890471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a30c5cd-92a9-459a-b810-3d1532ad42d4 req-89584a73-64db-4cf0-aba1-9c92f516ba1a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:19.893058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2a30c5cd-92a9-459a-b810-3d1532ad42d4 req-89584a73-64db-4cf0-aba1-9c92f516ba1a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:19.950227 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2a30c5cd-92a9-459a-b810-3d1532ad42d4 req-89584a73-64db-4cf0-aba1-9c92f516ba1a service nova] Creating event network-vif-unplugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:47:19.982122 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2a30c5cd-92a9-459a-b810-3d1532ad42d4 req-89584a73-64db-4cf0-aba1-9c92f516ba1a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136873 Sep 08 10:47:19.984087 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2766/5754] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:20.127882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "name": "network-vif-unplugged", "status": "completed", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:20.145655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.146773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.147595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.162959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] Creating event network-vif-unplugged:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:47:20.172599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:47:20.185878 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4e377512-99c0-4679-8047-7f4fee9e60a0 req-9ac0d859-5c7d-4ebb-b7ab-5ca703e68cb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065385 Sep 08 10:47:20.187583 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2767/5755] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:20.309357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:20.320981 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b069823d-3677-4172-844e-2bb947ea77b7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1688 microversion: 2.1 time: 0.523293 Sep 08 10:47:20.324238 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2989/5756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:19 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1688 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:20.554929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:20.555678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:20.571199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.571854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.572312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:20.573207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:20.573680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:20.574117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:21.063855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:21.072988 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd5fd6a2-f6d4-4dd5-9aaa-6be1af9d8689 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.523819 Sep 08 10:47:21.075613 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2768/5757] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:20 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:21.353373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:21.354009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:21.363616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:21.374349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:21.375655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:21.380698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:21.382876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:21.384066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:21.902513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:21.918311 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a2fb208-c812-42d9-b437-287e40ea796c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.567212 Sep 08 10:47:21.934862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2990/5758] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:21 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:22.006285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-781a400b-49d7-4c2a-964b-834abd848bfc req-76d5bfce-5341-4545-9078-f41ea1338247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-plugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:22.036455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-781a400b-49d7-4c2a-964b-834abd848bfc req-76d5bfce-5341-4545-9078-f41ea1338247 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.037452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-781a400b-49d7-4c2a-964b-834abd848bfc req-76d5bfce-5341-4545-9078-f41ea1338247 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.037905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-781a400b-49d7-4c2a-964b-834abd848bfc req-76d5bfce-5341-4545-9078-f41ea1338247 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.069120 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-781a400b-49d7-4c2a-964b-834abd848bfc req-76d5bfce-5341-4545-9078-f41ea1338247 service nova] Creating event network-vif-plugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:47:22.085368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-781a400b-49d7-4c2a-964b-834abd848bfc req-76d5bfce-5341-4545-9078-f41ea1338247 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081766 Sep 08 10:47:22.086016 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2769/5759] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:22.103124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:22.104664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:22.138338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.139142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.140009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.141679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.143190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.143681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.262349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:22.282317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:22.284233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:22.286959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:22.341928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] Creating event network-changed:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:47:22.365934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 10:47:22.389998 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-faddf142-42d8-46a2-a91f-63a262ef7267 req-74bfa243-3dca-46eb-8dfb-b89d216624b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133108 Sep 08 10:47:22.391455 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2770/5760] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:22.455482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:22.467402 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9743835-3dcc-49be-9f2f-bc67f05ed93a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.369078 Sep 08 10:47:22.478121 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2991/5761] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:22 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:22.963907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:22.965104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.003335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.010985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.011661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.012292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.012742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.021216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.501952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:23.506165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:23.515733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.516495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.517115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.518433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:23.519083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:23.521025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:23.714273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:23.733381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fc0661d6-8250-42c8-bde5-30f322f3231d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.774629 Sep 08 10:47:23.745754 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2771/5762] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:22 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:23.822445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:23.836600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-773af26f-3f0b-41c3-8823-e2b7d1f61b58 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.338299 Sep 08 10:47:23.848630 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2992/5763] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:23 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:24.765694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:24.766304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:24.797403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.801082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.804684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.805516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.806006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.812314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.860711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:24.863967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:24.899074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.899719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.900189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:24.900942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:24.901352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:24.901827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:25.513339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:25.537944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:25.547453 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-100d322c-6898-482f-ac6c-2e734de488f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 0.690667 Sep 08 10:47:25.548830 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ad73ee7-ea33-48b3-b73a-340c6f55f71c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.785437 Sep 08 10:47:25.550067 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2772/5764] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:24 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:25.551153 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2993/5765] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:24 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:26.575209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:26.581344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:26.583446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:26.585111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:26.602357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.607183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.608525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.608934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.611743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.612559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.613579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.614588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:26.617443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.618272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:26.618975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:26.620136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:27.721848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:27.748441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0a340328-a7f9-43e3-b8f9-5810f2631d99 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 1.170871 Sep 08 10:47:27.749440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2994/5766] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:26 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:27.825113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:27.866346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6cdecb22-9c53-4950-a13b-6ff3c56f6de3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1690 microversion: 2.1 time: 1.288722 Sep 08 10:47:27.867422 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2773/5767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:26 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1690 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:28.780289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:28.780945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:28.816646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.817905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.820004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.821111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:28.822816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.823696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.824950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:28.825368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.874885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.876125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.880306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:28.882446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:28.884195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:28.886500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.027115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-33aaff3a-6290-4859-abee-de495d7296ed tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214/action" status: 200 len: 24568 microversion: 2.1 time: 0.211740 Sep 08 10:47:29.028340 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2774/5768] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:28 2022] POST /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214/action => generated 24568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:47:29.043496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:29.044312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:29.073784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.074295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.074742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.079196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:29.079723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:29.080165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:29.686089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.700041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af19b6bc-d7cb-4724-a50b-149529489092 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.928522 Sep 08 10:47:29.701535 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2995/5769] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:28 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:29.897261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:29.915124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-386f6d07-8a3a-4086-9837-c86e5080342c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1683 microversion: 2.1 time: 0.884811 Sep 08 10:47:29.927670 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2775/5770] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:29 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1683 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:30.528360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9a06fbc3-6259-47e7-b7bb-3a5d5db91082 req-6679e387-5f26-401e-83be-18883ef0a419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "name": "network-vif-plugged", "status": "completed", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:30.560260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a06fbc3-6259-47e7-b7bb-3a5d5db91082 req-6679e387-5f26-401e-83be-18883ef0a419 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.560992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a06fbc3-6259-47e7-b7bb-3a5d5db91082 req-6679e387-5f26-401e-83be-18883ef0a419 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.563081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a06fbc3-6259-47e7-b7bb-3a5d5db91082 req-6679e387-5f26-401e-83be-18883ef0a419 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.591394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9a06fbc3-6259-47e7-b7bb-3a5d5db91082 req-6679e387-5f26-401e-83be-18883ef0a419 service nova] Creating event network-vif-plugged:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:47:30.610520 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9a06fbc3-6259-47e7-b7bb-3a5d5db91082 req-6679e387-5f26-401e-83be-18883ef0a419 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086161 Sep 08 10:47:30.614377 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2996/5771] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:30.729282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:30.730447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:30.741797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.742215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.742662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.743378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:30.743895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:30.744332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:30.748896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:31.225287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:31.242357 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a649f6e1-b334-4144-8599-76cbe5e208e0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.513489 Sep 08 10:47:31.261074 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2776/5772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:30 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:32.268689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:32.269737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:32.284183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.290197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.290789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.291660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:32.292726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:32.294366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:32.610600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:32.622927 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-988601c9-2546-454a-912b-7243ac4226ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.360084 Sep 08 10:47:32.626451 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2997/5773] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:32 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:33.648005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:33.648763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:33.661256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.667343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.668113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:33.669067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:33.669748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:33.670396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:34.031068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:34.043578 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a264dbeb-4b4c-4c1f-9fa1-6c7ff12520c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.399293 Sep 08 10:47:34.065082 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2777/5774] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:33 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:35.073009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:35.074761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:35.086241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:35.091302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:35.091987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:35.094179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:35.095156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:35.096060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:35.369870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:35.381065 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f384d793-b99e-49c0-a785-f89351fce048 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.312242 Sep 08 10:47:35.393110 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2998/5775] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:35 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:36.409834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:36.410851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:36.432739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.433449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.434009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.434949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:36.435497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:36.436010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:36.743595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:36.761122 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e4fbcb9b-48ee-4fb6-b3a3-1056826f7fce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.357453 Sep 08 10:47:36.776400 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2778/5776] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:36 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:37.787272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:37.788059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:37.799992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.800504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.800992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:37.801718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:37.802195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:37.802634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:38.022082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:38.036919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ad5eedb-5837-4094-af13-dce37a54defe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.254640 Sep 08 10:47:38.038151 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 2999/5777] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:37 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:39.068303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:39.069524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:39.079877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:39.080382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:39.087924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:39.089131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:39.094060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:39.094680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.116874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:40.135561 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-60384187-8eaa-41a1-9dc2-5b34741a6db8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 1.075729 Sep 08 10:47:40.136564 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2779/5778] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:39 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:40.754977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Calling method '.version_select at 0x7f23504783a0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:40.757030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.757530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.757977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.773936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.774426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.775217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.787903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:40.788689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:40.789428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:40.800481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8110280-86df-42a9-a5d3-c66430e49f20 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1840933695-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.323368 Sep 08 10:47:40.802093 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3000/5779] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:47:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:41.166364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:41.167195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:41.174070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=46 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:41.181800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.182689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.183010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.183865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:41.184335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:41.184841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:41.649886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:41.666346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df3f08fa-921d-46e3-bd99-741e86692277 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1683 microversion: 2.1 time: 0.505776 Sep 08 10:47:41.674211 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2780/5780] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:41 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1683 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:42.698029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:42.698654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:42.715307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=40 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:42.725316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.727066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.728821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:42.729808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:42.746087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:42.746891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.165289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:43.173744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0549e712-857a-4555-aefa-fe4485fbc4b8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.479821 Sep 08 10:47:43.176735 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3001/5781] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:42 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:43.382511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:43.383154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:43.389857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.390369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.390807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.402593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:43.405365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:43.405830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:43.749045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:43.780676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d50787da-c167-4195-9e55-35dd11d10fbb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.402491 Sep 08 10:47:43.781751 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2781/5782] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:43 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:45.221210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:45.221775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:45.233306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.233816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.234271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.239617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.243591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.244079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.870794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:45.888109 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a425045-b9cc-444e-b3a4-05e9159f7632 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.677743 Sep 08 10:47:45.893237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3002/5783] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:45 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:45.904926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-440fb4a1-1eda-4899-bf3a-2086faf0a12a req-75dd89ec-0f1d-4fb1-85f1-9e08212c8e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-unplugged", "status": "completed", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:45.911626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:45.912516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:45.919382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.924047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.924849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.925989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.929234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.930017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.942823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-440fb4a1-1eda-4899-bf3a-2086faf0a12a req-75dd89ec-0f1d-4fb1-85f1-9e08212c8e0c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:45.945399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-440fb4a1-1eda-4899-bf3a-2086faf0a12a req-75dd89ec-0f1d-4fb1-85f1-9e08212c8e0c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:45.946393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-440fb4a1-1eda-4899-bf3a-2086faf0a12a req-75dd89ec-0f1d-4fb1-85f1-9e08212c8e0c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:45.984558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-440fb4a1-1eda-4899-bf3a-2086faf0a12a req-75dd89ec-0f1d-4fb1-85f1-9e08212c8e0c service nova] Creating event network-vif-unplugged:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:47:45.996712 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-440fb4a1-1eda-4899-bf3a-2086faf0a12a req-75dd89ec-0f1d-4fb1-85f1-9e08212c8e0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096798 Sep 08 10:47:45.997347 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2782/5784] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:46.381750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d7e130d-da3a-4e2b-abcf-796815deb832 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'create', calling method: .version_select at 0x7f23500e8430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-944459292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzboN7kdkLHfnVvA7BfNY2D3LGyfKsx2BhEN0nyi3qrBCUcwDfbDtydb+azWHf4JUTbWxTt9oB/eCXlau6r/4HXSpRSWeisjkZBePzG4ZtZhWebUDDQ8v5qirEeGvBpog=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:46.470900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0d7e130d-da3a-4e2b-abcf-796815deb832 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:46.485457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0d7e130d-da3a-4e2b-abcf-796815deb832 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for user 4864b5d5cefa4fa593bb2adeb46c04d1 and project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:46.571382 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d7e130d-da3a-4e2b-abcf-796815deb832 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.194716 Sep 08 10:47:46.579273 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2783/5785] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:47:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:46.703823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:46.719168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6f0526f-13b5-4765-9d25-32ee1223ac9b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.811512 Sep 08 10:47:46.738588 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3003/5786] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:45 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:46.751161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:46.751994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:46.764051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.764561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.765010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:46.765739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:46.776696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:46.777292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.152866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:47.162859 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c74dfde-b67a-4d5f-b803-a0e5e81f3edc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.417250 Sep 08 10:47:47.180566 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2784/5787] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:46 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:47.187582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:47.191733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:47.198927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.199995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.200715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.201927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.202517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.203005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.339512 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-602ea76b-7bfd-491f-8bc2-95be8b8a7336 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.154466 Sep 08 10:47:47.341263 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3004/5788] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:47 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:47:47.354047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:47.355056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:47.365054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.366047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.366923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:47.369692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:47.370775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:47.371544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:48.294933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:48.309477 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-744954aa-b642-4a97-927d-110248c8cafd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1672 microversion: 2.1 time: 0.964184 Sep 08 10:47:48.314881 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2785/5789] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:47 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1672 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:49.342704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:49.343597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:49.358387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.359484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.361276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.362273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:49.365298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:49.366052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:49.573233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1097498414", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "c2fa7569-d013-40ad-addb-c4372fb4d316"}], "key_name": "tempest-TestNetworkBasicOps-944459292", "security_groups": [{"name": "tempest-secgroup-smoke-1759888056"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:50.073365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] validate_networks() for [('c2fa7569-d013-40ad-addb-c4372fb4d316', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:50.086260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:50.089362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:47:50.098344 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0662db9c-d615-489f-9155-b31d980d1957 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.760706 Sep 08 10:47:50.099162 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3005/5790] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:49 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:50.131279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:50.133751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.153209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.154164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.155291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.156352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.157057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.157724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.316689 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-066b2ac4-5664-4147-b92c-87d00b75596e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 200 len: 322 microversion: 2.1 time: 0.197516 Sep 08 10:47:50.317731 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3006/5791] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:47:50 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:47:50.327502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:50.328482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:50.335676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.336168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.336806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:50.337550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:50.338004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:50.338430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.126950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:51.156098 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9906bf3b-d8b9-4ede-b2f1-4b5dfeb7826f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.832405 Sep 08 10:47:51.158910 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3007/5792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:50 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:51.184692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.185555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.194191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.194890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.195548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.196416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.197042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.197649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.806281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:51.842874 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0b4dfe7-f6fc-4507-9678-1e0288e35506 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.662297 Sep 08 10:47:51.845992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3008/5793] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:51.869319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:51.870386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:51.876957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.877604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.878631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.880885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.881642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.882314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.895859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:51.897019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:51.897748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:51.898176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:51.898645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:51.915101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.915732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.916386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.917218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:51.917737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:51.918573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:51.952681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:51.961497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for user 4864b5d5cefa4fa593bb2adeb46c04d1 and project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:51.978645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:51.981194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:52.038709 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6039345a-c5cd-4d3c-9db1-03e5f1aa1c79 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.469207 Sep 08 10:47:52.044154 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2786/5794] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:52.056406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-719cf097-bb92-4816-9772-bfaa9f6f50e2 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:52.057054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-719cf097-bb92-4816-9772-bfaa9f6f50e2 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:52.135520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:52.147378 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3763c15d-55c5-49d5-ad04-7b3f0de6144b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.281913 Sep 08 10:47:52.151940 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3009/5795] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:51 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:52.178288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:52.179304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:52.191768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.192465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.193323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.193723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-719cf097-bb92-4816-9772-bfaa9f6f50e2 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:52.194132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:52.194599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:52.195039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:52.203358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-719cf097-bb92-4816-9772-bfaa9f6f50e2 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1248 microversion: 2.1 time: 0.151183 Sep 08 10:47:52.204887 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2787/5796] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:52 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1248 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:52.438738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:52.450938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3deebb0-faed-447b-b4a1-bca5a09d9689 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.277969 Sep 08 10:47:52.454488 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3010/5797] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:52 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:52.678292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-713909223", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4f75c36b-02be-41ce-8aa0-0baf209b7e24"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:52.790084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] validate_networks() for [('4f75c36b-02be-41ce-8aa0-0baf209b7e24', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:47:53.230641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:53.232027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:53.262714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.264013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.265187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.267680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:53.270874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:53.272287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:53.478373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:53.488412 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-045fb1c7-2c64-4ba4-a371-16200be61848 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1300 microversion: 2.1 time: 0.261334 Sep 08 10:47:53.496826 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3011/5798] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:53 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1300 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:47:54.070266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:47:54.070864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:47:54.071241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:47:54.071818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:47:54.072235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:47:54.085654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.086377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.086985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.088587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.089704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.090448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.114375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:47:54.120512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for user dfc0dd22092d4110b24c5fa4efd5d9f2 and project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:47:54.137172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:47:54.141174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:47:54.209822 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f4bae141-166b-48fb-a4f4-401515fbfd33 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.536644 Sep 08 10:47:54.211112 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2788/5799] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:47:54.227027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db282237-2f59-46d6-a699-efbd2a24f372 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:54.227958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db282237-2f59-46d6-a699-efbd2a24f372 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:54.335257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-db282237-2f59-46d6-a699-efbd2a24f372 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:54.345496 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db282237-2f59-46d6-a699-efbd2a24f372 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1214 microversion: 2.1 time: 0.123252 Sep 08 10:47:54.348858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3012/5800] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:54 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:54.521323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:54.522636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:54.528996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.529626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.530154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.531238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:54.531864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:54.532538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:54.615797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:54.625939 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d084aa2b-5165-4f3f-9c62-17536b86a876 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1306 microversion: 2.1 time: 0.110046 Sep 08 10:47:54.627920 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2789/5801] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:54 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:55.379738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:55.381935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:55.423026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.424568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.425741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.429092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.430002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.430821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.557955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:55.568884 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cf8fbad-1f3a-4827-acb0-6583619b1361 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1266 microversion: 2.1 time: 0.199281 Sep 08 10:47:55.569505 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3013/5802] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:55 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:55.653800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:55.654622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:55.672654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.674234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.676085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.677345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:55.681305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:55.682048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:55.766568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:55.777138 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5de56d47-7f20-4d40-b5f7-112ecd51a062 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1306 microversion: 2.1 time: 0.129145 Sep 08 10:47:55.778687 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2790/5803] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:55 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:56.598850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.600593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:56.615176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.616106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.617920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:56.620804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.621372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.622994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:56.803233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:56.804373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:56.807288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:56.824419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.824838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.825282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:56.826049 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25800f0c-4e06-4fb9-a9d8-a09121ac9801 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1272 microversion: 2.1 time: 0.232150 Sep 08 10:47:56.843522 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3014/5804] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:56.844595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:56.844595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:56.844595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:57.583754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:57.615959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca9e63a2-6e2b-496f-a2bf-81591523e388 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 0.818096 Sep 08 10:47:57.621922 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2791/5805] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:56 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:57.863889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:57.866556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:57.906674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:57.908847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:57.910969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:57.921051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:57.923379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:57.925550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.464918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:58.482241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c20d8139-2d97-4ba4-b55d-e556ca10e81e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 0.625352 Sep 08 10:47:58.483011 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3015/5806] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:57 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:58.627196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-49ff158d-e949-4cd1-a84c-c9ca4a77ed78 req-67289478-50e2-4c8c-a965-35948de620e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0e9264-1359-4301-a48d-58ba27dc9c89", "tag": "81e68b08-61b6-46a9-aabb-2ab1f5b3651a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:47:58.644066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-49ff158d-e949-4cd1-a84c-c9ca4a77ed78 req-67289478-50e2-4c8c-a965-35948de620e9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.645107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-49ff158d-e949-4cd1-a84c-c9ca4a77ed78 req-67289478-50e2-4c8c-a965-35948de620e9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.645792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-49ff158d-e949-4cd1-a84c-c9ca4a77ed78 req-67289478-50e2-4c8c-a965-35948de620e9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.646628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:58.648801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:58.667023 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-49ff158d-e949-4cd1-a84c-c9ca4a77ed78 req-67289478-50e2-4c8c-a965-35948de620e9 service nova] Creating event network-changed:81e68b08-61b6-46a9-aabb-2ab1f5b3651a for instance df0e9264-1359-4301-a48d-58ba27dc9c89 on n-h2-833090-19 Sep 08 10:47:58.673716 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-49ff158d-e949-4cd1-a84c-c9ca4a77ed78 req-67289478-50e2-4c8c-a965-35948de620e9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050878 Sep 08 10:47:58.675334 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2792/5807] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:47:58.679303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.680533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.680982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:58.681712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:58.682167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:58.682598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:59.139648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:47:59.150857 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00cbe05f-08ec-47f9-83f4-232e31c0246b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 0.510119 Sep 08 10:47:59.153120 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3016/5808] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:58 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:47:59.510965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:47:59.511807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:47:59.521399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:59.523639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:59.524349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:47:59.533247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:47:59.535485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:47:59.536213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.152955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:00.165721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e07c9e23-bf8a-436b-a768-8accf82706d0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 0.660217 Sep 08 10:48:00.166506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2793/5809] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:47:59 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:00.183718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:00.184228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:00.197511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:00.198235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:00.198801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.200741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:00.202109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:00.219849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.575545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:00.594832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9380cb5e-e09f-4a98-85c4-26a19b1abd36 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 0.417088 Sep 08 10:48:00.601760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3017/5810] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:00 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:00.737470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1477cca3-7a57-4b3b-a088-c434c6228ed7 req-b755bc86-83de-42a9-b234-104b2895fbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448defd5-ead5-4944-be22-6932a12c695e", "tag": "1c1b8dfe-71bb-40ae-9003-90c4ecc78de4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:00.755797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1477cca3-7a57-4b3b-a088-c434c6228ed7 req-b755bc86-83de-42a9-b234-104b2895fbcd service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:00.756390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1477cca3-7a57-4b3b-a088-c434c6228ed7 req-b755bc86-83de-42a9-b234-104b2895fbcd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:00.756860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1477cca3-7a57-4b3b-a088-c434c6228ed7 req-b755bc86-83de-42a9-b234-104b2895fbcd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:00.791191 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1477cca3-7a57-4b3b-a088-c434c6228ed7 req-b755bc86-83de-42a9-b234-104b2895fbcd service nova] Creating event network-changed:1c1b8dfe-71bb-40ae-9003-90c4ecc78de4 for instance 448defd5-ead5-4944-be22-6932a12c695e on n-h1-833090-19 Sep 08 10:48:00.808949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1477cca3-7a57-4b3b-a088-c434c6228ed7 req-b755bc86-83de-42a9-b234-104b2895fbcd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071329 Sep 08 10:48:00.809868 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2794/5811] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:01.193681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:01.194981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:01.206291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.207117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.207824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.209068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.212163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.213228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.559554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:01.569443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-383437cb-94e1-4395-b5f7-29c4f1bb1cdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 0.381753 Sep 08 10:48:01.570391 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3018/5812] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:01 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:01.620751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:01.621576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:01.632220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.632712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.633240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.634177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:01.634797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:01.635403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:01.638727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=81 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:01.855853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:01.871433 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-21b1eb6c-b40f-4db4-97cb-6025c29a7ec6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 0.255510 Sep 08 10:48:01.872890 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2795/5813] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:01 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:02.235894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:02.239374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.248313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.249228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.249878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.250864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.251608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.252312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.376745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-761ff21a-29d3-45da-99c2-59637cb4a510 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action" status: 200 len: 63131 microversion: 2.1 time: 0.135175 Sep 08 10:48:02.385370 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3019/5814] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:02 2022] POST /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763/action => generated 63131 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:48:02.600632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.601288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.614229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.615060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.615756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.616685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.617323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.619440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.898779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:02.899538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:02.912958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.919644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.920402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:02.924329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:02.925183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:02.926220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:03.839013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:03.857721 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e2af331d-ca4a-4d6a-bd06-f1e6b54eaa52 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 1.265516 Sep 08 10:48:03.863741 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2796/5815] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:02 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:04.111944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:04.126058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-967b10cf-3fac-48fa-a399-35f8713eb324 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 1.233464 Sep 08 10:48:04.130062 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3020/5816] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:02 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:04.881358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:04.882885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=18 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:04.891144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:04.892629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:04.938435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:04.939059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:04.944616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:04.945965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:04.946450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:04.950893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.159713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:05.160406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:05.170615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:05.178059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.178589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.179040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.179838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:05.180304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:05.180740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:05.391619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:05.406906 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2536e682-2fdc-4a4e-93f9-fe2f62984ee6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 0.526450 Sep 08 10:48:05.419775 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2797/5817] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:04 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:05.465064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:05.476147 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-794b7807-9991-4fe9-9e62-1671a90cae0d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 0.327124 Sep 08 10:48:05.477243 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3021/5818] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:05 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:06.437642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:06.438911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:06.459072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.462041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.463670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.474509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.475264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.475975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.501457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:06.504818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:06.536169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.549219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.549897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:06.552771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:06.555714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:06.556410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.477630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:07.490476 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-290116a6-483f-4660-99b9-01fb923ba9cc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 1.057270 Sep 08 10:48:07.491090 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2798/5819] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:06 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:07.520415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-e6fc04e5-23d6-446c-b864-0240ac86a9db req-0e2aee6e-e7f1-48c4-91ca-69abdf945a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0e9264-1359-4301-a48d-58ba27dc9c89", "name": "network-vif-plugged", "status": "completed", "tag": "81e68b08-61b6-46a9-aabb-2ab1f5b3651a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:07.539513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:07.551597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e6fc04e5-23d6-446c-b864-0240ac86a9db req-0e2aee6e-e7f1-48c4-91ca-69abdf945a82 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:07.552088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e6fc04e5-23d6-446c-b864-0240ac86a9db req-0e2aee6e-e7f1-48c4-91ca-69abdf945a82 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:07.552520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e6fc04e5-23d6-446c-b864-0240ac86a9db req-0e2aee6e-e7f1-48c4-91ca-69abdf945a82 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:07.553942 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f3086b9-676e-44a4-a1f9-aa99c2bc3db6 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 1.056626 Sep 08 10:48:07.556207 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3022/5820] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:06 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:07.600714 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-e6fc04e5-23d6-446c-b864-0240ac86a9db req-0e2aee6e-e7f1-48c4-91ca-69abdf945a82 service nova] Creating event network-vif-plugged:81e68b08-61b6-46a9-aabb-2ab1f5b3651a for instance df0e9264-1359-4301-a48d-58ba27dc9c89 on n-h2-833090-19 Sep 08 10:48:07.610571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-e6fc04e5-23d6-446c-b864-0240ac86a9db req-0e2aee6e-e7f1-48c4-91ca-69abdf945a82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100516 Sep 08 10:48:07.613791 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2799/5821] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:08.520722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:08.521750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:08.530872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.532383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.533355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.534546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.535309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.536032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.587557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:08.588965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:08.605938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.611031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.612558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.615865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:08.617140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:08.617854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:08.893247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:08.907284 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c8d8c3c1-8e74-4241-840d-cc02ef9f1b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 0.392733 Sep 08 10:48:08.914212 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3023/5822] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:08 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:09.029617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:09.072930 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6c158a7-2fa4-4dac-83a2-812c2929e06b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1374 microversion: 2.1 time: 0.493471 Sep 08 10:48:09.073544 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2800/5823] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:08 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1374 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:09.641906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7b6c1a83-d466-4147-b4cc-191475122318 req-33253ae7-aafd-47f7-9843-f97e913cf14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448defd5-ead5-4944-be22-6932a12c695e", "name": "network-vif-plugged", "status": "completed", "tag": "1c1b8dfe-71bb-40ae-9003-90c4ecc78de4"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:09.664802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7b6c1a83-d466-4147-b4cc-191475122318 req-33253ae7-aafd-47f7-9843-f97e913cf14f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.672431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7b6c1a83-d466-4147-b4cc-191475122318 req-33253ae7-aafd-47f7-9843-f97e913cf14f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.673198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7b6c1a83-d466-4147-b4cc-191475122318 req-33253ae7-aafd-47f7-9843-f97e913cf14f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.677254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:09.695842 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7b6c1a83-d466-4147-b4cc-191475122318 req-33253ae7-aafd-47f7-9843-f97e913cf14f service nova] Creating event network-vif-plugged:1c1b8dfe-71bb-40ae-9003-90c4ecc78de4 for instance 448defd5-ead5-4944-be22-6932a12c695e on n-h1-833090-19 Sep 08 10:48:09.723305 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7b6c1a83-d466-4147-b4cc-191475122318 req-33253ae7-aafd-47f7-9843-f97e913cf14f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085166 Sep 08 10:48:09.724343 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3024/5824] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:48:09.942958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:09.946031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:09.960086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.962850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.966724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:09.968322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:09.969107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:09.969807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.098442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:10.099074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:10.111338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.112192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.112826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.118023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.118695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.119307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.409408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:10.423138 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0906dbbc-f3c7-495a-80f7-b696825219e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1314 microversion: 2.1 time: 0.488203 Sep 08 10:48:10.424114 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2801/5825] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:09 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:10.572135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:10.604204 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-74f14063-4b6d-4177-93b8-de7b198d6714 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1547 microversion: 2.1 time: 0.510753 Sep 08 10:48:10.622363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3025/5826] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1547 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:10.633111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:10.633758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:10.656829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.657348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.658059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.659335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:10.659833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:10.660269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:10.915776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:10.926454 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5fe0ddaa-065d-4bb9-aca7-1f7d8f1d5c0f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1547 microversion: 2.1 time: 0.297184 Sep 08 10:48:10.935374 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2802/5827] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:10 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1547 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:11.447618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.448849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.461315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.462333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.463082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.468587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.469346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.469991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.688662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:11.709289 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ef05ab2a-daa1-4973-b04b-cb28055c5ef1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1500 microversion: 2.1 time: 0.264917 Sep 08 10:48:11.711111 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3026/5828] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:11 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1500 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:11.741720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5ee5eac-cd41-481b-a84a-1ff52675f202 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:11.752396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:11.754839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5ee5eac-cd41-481b-a84a-1ff52675f202 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.755655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5ee5eac-cd41-481b-a84a-1ff52675f202 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.756348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5ee5eac-cd41-481b-a84a-1ff52675f202 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.792702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5ee5eac-cd41-481b-a84a-1ff52675f202 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:48:11.860827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5ee5eac-cd41-481b-a84a-1ff52675f202 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e/action" status: 202 len: 0 microversion: 2.1 time: 0.126887 Sep 08 10:48:11.862224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2803/5829] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:11 2022] POST /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:48:11.881090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:11.884584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:11.906114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.907158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.908159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:11.909282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:11.910487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:11.911112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:12.148507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:12.159168 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-861fc629-0c29-40df-9870-30b677bf85a3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.291817 Sep 08 10:48:12.160474 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3027/5830] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:11 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:13.186050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:13.187352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:13.200174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.201585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.202319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.204319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:13.205816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:13.206899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:13.613796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:13.624130 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f557e58-0113-41aa-88ea-9b652b9fcbac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.443184 Sep 08 10:48:13.627760 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2804/5831] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:13 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:14.653408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:14.654721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:14.666308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=56 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:14.668232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:14.670566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:14.672026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:14.680834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:14.681344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:14.681797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:15.678710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:15.709835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ccc74284-ffc6-4f83-82b7-d3095c1314ac tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 1.059710 Sep 08 10:48:15.713012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3028/5832] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:14 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:16.745732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:16.747017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:16.771065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.772808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.773713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:16.792153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:16.793776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:16.799572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:17.178112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:17.195374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7fdece90-8ea7-4dbd-8685-47d11bfa35de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.463226 Sep 08 10:48:17.199135 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2805/5833] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:16 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:18.228507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:18.229001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:18.245176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:18.245679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:18.248312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:18.249072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:18.249600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:18.252594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:18.620452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:18.634665 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80de9719-fd33-4e36-8882-5a4ac2960715 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.411066 Sep 08 10:48:18.635950 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3029/5834] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:18 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:19.665051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:19.665667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:19.680007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.680903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.684262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:19.686051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:19.687259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:19.688057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:20.206367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:20.216686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ffc4ebcb-8b86-459f-b477-478f488a440a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.555320 Sep 08 10:48:20.218008 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2806/5835] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:19 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:21.243825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:21.244488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:21.256947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:21.257448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:21.257894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:21.280171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:21.280980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:21.281915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:22.620643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:22.641848 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c4117fd-2f31-4f31-9268-ee5441714a0e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 1.401621 Sep 08 10:48:22.643617 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3030/5836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:21 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:23.669246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:23.669909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:23.695476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.695977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.696416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:23.697135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:23.697585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:23.698015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:24.195305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:24.224706 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0ed73b15-f981-4fec-804a-48c7a816f46a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.561951 Sep 08 10:48:24.241856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2807/5837] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:23 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:25.119872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:25.121039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:25.134846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.135336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.136030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.137582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.138226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.138770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.260362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:25.261617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:25.275659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.278815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.279915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.280839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:25.281474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:25.282152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:25.933651 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93098c5f-5ceb-49c7-91fc-cdf7de4b56b2 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1836 microversion: 2.1 time: 0.819245 Sep 08 10:48:25.936559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3031/5838] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:25 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1836 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:25.950964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:25.959779 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-edc7c77e-e60e-4705-b272-e964dfc017be tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.710067 Sep 08 10:48:25.967502 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2808/5839] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:25 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:26.994887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:26.995529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:27.008950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.009450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.009889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.010813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:27.012183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:27.013867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:27.314438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:27.340864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a72d2e0-f153-4076-b2cb-b9f6adc3f2f8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.349856 Sep 08 10:48:27.341496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3032/5840] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:26 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:28.345015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:28.345636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:28.365420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:28.366163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:28.368690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.369212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.369660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.370397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.370856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.371288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.394309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.395980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.396696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.399208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.401070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.401857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.479310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:28.635504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:28.710078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d87e48f-7d3c-43b8-81a2-5ca38ac54dc2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 204 len: 0 microversion: 2.1 time: 0.380032 Sep 08 10:48:28.714323 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2809/5841] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:28 2022] DELETE /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:48:28.726918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-87cb4d1c-120f-4352-a4d9-5a03a5125448 req-151eea41-94e3-49eb-a6b8-297b98e9c6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:28.756764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-87cb4d1c-120f-4352-a4d9-5a03a5125448 req-151eea41-94e3-49eb-a6b8-297b98e9c6c6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.757961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-87cb4d1c-120f-4352-a4d9-5a03a5125448 req-151eea41-94e3-49eb-a6b8-297b98e9c6c6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.758736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-87cb4d1c-120f-4352-a4d9-5a03a5125448 req-151eea41-94e3-49eb-a6b8-297b98e9c6c6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.796253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-87cb4d1c-120f-4352-a4d9-5a03a5125448 req-151eea41-94e3-49eb-a6b8-297b98e9c6c6 service nova] Creating event network-changed:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:48:28.803947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-87cb4d1c-120f-4352-a4d9-5a03a5125448 req-151eea41-94e3-49eb-a6b8-297b98e9c6c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087819 Sep 08 10:48:28.804950 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2810/5842] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:28.821528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:28.822850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:28.841066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.848605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.849593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:28.850614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:28.864281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:28.865222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:29.461043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:29.474767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:29.481133 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f26fb25-7fea-4ba6-b658-567a91e01d8e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1689 microversion: 2.1 time: 0.674704 Sep 08 10:48:29.481745 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2811/5843] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:28 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1689 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:29.484950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-118187ea-4105-4edc-b9f0-009c469d9dab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 1.124559 Sep 08 10:48:29.488654 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3033/5844] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:28 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:30.536494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:30.537991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:30.540005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:30.540688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:30.564424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.565483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.567639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.568110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.568830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.570121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.575666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.576470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.576693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:30.577405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:30.582028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:30.583509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.039436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:31.047936 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a5fc37d5-70b6-4842-abb2-2ece64442415 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.525385 Sep 08 10:48:31.048547 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2812/5845] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:30 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:31.061706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:31.078647 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4704b915-0fff-48b4-bfd1-a461fef3a20b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1689 microversion: 2.1 time: 0.553611 Sep 08 10:48:31.081937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3034/5846] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:30 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1689 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:31.351846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-efca88f5-39b5-42c9-87b4-7bb9f344fb62 req-6f6256ff-64fa-4a90-8229-8d6842f2a0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0e55b-8f18-4239-8423-5f45e05fb763", "name": "network-vif-deleted", "tag": "aee784ba-c220-4963-9f22-88f41fea3eae"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:31.375527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-efca88f5-39b5-42c9-87b4-7bb9f344fb62 req-6f6256ff-64fa-4a90-8229-8d6842f2a0dc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:31.377244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-efca88f5-39b5-42c9-87b4-7bb9f344fb62 req-6f6256ff-64fa-4a90-8229-8d6842f2a0dc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:31.377988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-efca88f5-39b5-42c9-87b4-7bb9f344fb62 req-6f6256ff-64fa-4a90-8229-8d6842f2a0dc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:31.403381 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-efca88f5-39b5-42c9-87b4-7bb9f344fb62 req-6f6256ff-64fa-4a90-8229-8d6842f2a0dc service nova] Creating event network-vif-deleted:aee784ba-c220-4963-9f22-88f41fea3eae for instance 06a0e55b-8f18-4239-8423-5f45e05fb763 on n-h2-833090-19 Sep 08 10:48:31.410387 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-efca88f5-39b5-42c9-87b4-7bb9f344fb62 req-6f6256ff-64fa-4a90-8229-8d6842f2a0dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061971 Sep 08 10:48:31.411508 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2813/5847] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:32.084656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:32.086729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:32.101733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.102330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.102809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.103564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.104102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.104775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.125475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:32.128509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:32.145955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.153074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.153812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.154762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.155401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.161795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.218755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:32.220345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:32.221014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:32.221817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lazy-loading 'fault' on Instance uuid 06a0e55b-8f18-4239-8423-5f45e05fb763 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:48:32.378276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:32.394620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b80a76c-87e7-4dff-96d8-214ad6895017 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 200 len: 1507 microversion: 2.1 time: 0.281865 Sep 08 10:48:32.396067 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:48:32.404980 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2814/5848] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:32 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:32.406009 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 10:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e (ip 10.222.0.59) !!! Sep 08 10:48:32.676739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:32.688147 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-979b186b-cc52-4366-a014-c3a82c3843c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.609176 Sep 08 10:48:32.689604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3035/5849] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:32 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:33.423933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:33.425623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 06a0e55b-8f18-4239-8423-5f45e05fb763] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:33.441896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.442448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.442979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.446465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.447944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.448475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.524597 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] HTTP exception thrown: Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 could not be found. Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Request method failure captured: Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 HTTP/1.1 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcbN7kVDbl2d9xWhQy9sas5ikS1r-wCjGuPvswVLKWW2eYrng081shN3QWLbsrgaqFbv4vkbON5vRl0d7co-dabrh0Zvt1MKDrEfki9ULYJrKU76dsoP9djIO8eKWw8yfgTEjhveMjDLXpNKFMlO1wcWo1CYm8sYRUmIXxhanJzr3_U Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6a37c5b0349d45558389e7e8a15b5f85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c7c9cc09a7b144e69cdf342c8f94680a Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 could not be found. Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '06a0e55b-8f18-4239-8423-5f45e05fb763'} Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 could not be found. Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 could not be found. Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.528237 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 could not be found. Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Returning 404 to user: Instance 06a0e55b-8f18-4239-8423-5f45e05fb763 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:48:33.535097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-519a5b4a-7a28-459b-9026-447c96d156a1 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763" status: 404 len: 111 microversion: 2.1 time: 0.112516 Sep 08 10:48:33.540291 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2815/5850] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:33 2022] GET /compute/v2.1/servers/06a0e55b-8f18-4239-8423-5f45e05fb763 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:48:33.722547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:33.723879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:33.737814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.740712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.741359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:33.744426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:33.745233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:33.745842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:34.142162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:34.155147 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-33a975aa-b825-42c0-8fec-713a730ccaa5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 0.437680 Sep 08 10:48:34.156379 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3036/5851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:33 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:35.183401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:35.196855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:35.224116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.232649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.236086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:35.238213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:35.239450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:35.252657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:36.296953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:36.311580 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bac4c832-7512-40ef-8039-5ed9d8a01954 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1510 microversion: 2.1 time: 1.131762 Sep 08 10:48:36.315098 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2816/5852] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:35 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1510 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:37.341931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:37.343245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:37.355363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.358914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.359389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.360217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.360694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.361133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.674942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:37.690298 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b424b6a4-14d2-4023-840f-6201de7356b5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1487 microversion: 2.1 time: 0.350014 Sep 08 10:48:37.692151 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3037/5853] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:37 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1487 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:37.720408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:37.722966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:37.735380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.740078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.740676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.741624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.742743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.745407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.814946 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1828652a-1876-4261-9a0a-07a7a18c82a5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 200 len: 130 microversion: 2.1 time: 0.097868 Sep 08 10:48:37.816209 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2817/5854] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:48:37 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 130 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:37.826552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:37.827562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:37.846486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.848504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.848993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:37.858212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:37.858757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:37.861665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.180744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:39.200521 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d34f70ab-49be-49c2-806c-b2189c8339c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 1.378733 Sep 08 10:48:39.201138 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3038/5855] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:37 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:39.231916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:39.241414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:39.258889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.261671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.263527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.268415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.271409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.272137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.704669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78088192-b955-47c9-9c06-1877b21280d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '.version_select at 0x7f23555690d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:39.709160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:39.730402 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2ad0ae20-259a-4af2-8084-6323fb923be0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.501213 Sep 08 10:48:39.732595 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2818/5856] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:39 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:39.754092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:39.755032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:39.770069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.773041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.775059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.776102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:39.779561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:39.781352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78088192-b955-47c9-9c06-1877b21280d9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-289456905" status: 202 len: 0 microversion: 2.1 time: 0.083821 Sep 08 10:48:39.785388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:39.785925 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3039/5857] 10.222.0.59 () {58 vars in 1281 bytes} [Thu Sep 8 10:48:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-289456905 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:48:39.834792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d54ccc12-6b5f-4514-a134-2d819c032074 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: .version_select at 0x7f2350a63160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1129632549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTLbBCOt1tg9YwTNDoQlAYwZlp1yKf/ydesliOCD6TBbPnSLg/ZeysvlSiYPZe9ImjmiQ8Gy0g+Ut3XlagfXQkXpVg3NOlQqNcZusmhW3nZHax2BnBdnoLqpLh84cocdA=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:39.889182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d54ccc12-6b5f-4514-a134-2d819c032074 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:39.908092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d54ccc12-6b5f-4514-a134-2d819c032074 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:39.975742 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d54ccc12-6b5f-4514-a134-2d819c032074 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.147418 Sep 08 10:48:39.977457 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3040/5858] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:48:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:40.479231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:40.498077 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce1ef3b4-a508-4163-bb3a-65471cf75a89 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.747063 Sep 08 10:48:40.501493 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2819/5859] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:39 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:40.542275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:40.542918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:40.551239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:40.552532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:40.553262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:40.554199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:40.555158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:40.556365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:40.563988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=86 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:41.217054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:41.228762 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c0c7371-d9f6-49ce-9f49-79bba11b6290 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.705264 Sep 08 10:48:41.229354 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3041/5860] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:40 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:41.596765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1028308171", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4f75c36b-02be-41ce-8aa0-0baf209b7e24"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:41.725997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] validate_networks() for [('4f75c36b-02be-41ce-8aa0-0baf209b7e24', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:42.787572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:42.788237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:42.788412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:42.789097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:42.789691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:42.804802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:42.817879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.818386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.818832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.819618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:42.820266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:42.820901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:42.842008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:42.848589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for user dfc0dd22092d4110b24c5fa4efd5d9f2 and project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:42.862708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:42.865723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:42.947752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3873eef5-a5b7-4d89-b55b-7e57cb576e8b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358632 Sep 08 10:48:42.950828 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2820/5861] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:48:42.959927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc3557ad-3faf-480a-9164-994cd11c15cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:42.961339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc3557ad-3faf-480a-9164-994cd11c15cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:43.591092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc3557ad-3faf-480a-9164-994cd11c15cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:43.608161 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc3557ad-3faf-480a-9164-994cd11c15cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1215 microversion: 2.1 time: 0.650528 Sep 08 10:48:43.624783 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3042/5862] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:42 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1215 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:44.633016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:44.634300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:44.649280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:44.650058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:44.652704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:44.653772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:44.655389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:44.656744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:44.950583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:44.961392 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-991c6bb3-c48a-43a0-ad58-c8a7ca3be1c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1275 microversion: 2.1 time: 0.333710 Sep 08 10:48:44.980752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2821/5863] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:44 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1275 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:45.991146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:45.991146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:45.992055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:46.008443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.010133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.010723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.013428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:46.014705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:46.015290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:46.176338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:46.192773 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1620a72-34e0-46f8-abf8-bf67f187082c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1273 microversion: 2.1 time: 0.208515 Sep 08 10:48:46.207877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3043/5864] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:45 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:47.222629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:47.226850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:47.248436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.248945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.249395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.251345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:47.251835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:47.252271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:47.974691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:47.985250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55833d17-1162-4971-84d7-77114343272a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.771380 Sep 08 10:48:47.985848 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2822/5865] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:47 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:49.010204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:49.010977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:49.024636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.025458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.027666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.029616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:49.033655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:49.034358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:49.780438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:49.803689 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba977509-ba72-4404-8ec6-2f40a5fa7d7f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.796118 Sep 08 10:48:49.805651 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3044/5866] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:49 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:50.184048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-75d4e6cf-6f64-48e1-8ad9-fe1e9f0d4045 req-fe2da686-690d-4229-8a37-9cb64df4ae7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a8d1386-72e0-4af2-b3e9-d08441f55430", "tag": "6f87fa15-c647-4ad1-993a-cad185328baa"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:50.201700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-75d4e6cf-6f64-48e1-8ad9-fe1e9f0d4045 req-fe2da686-690d-4229-8a37-9cb64df4ae7d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.202352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-75d4e6cf-6f64-48e1-8ad9-fe1e9f0d4045 req-fe2da686-690d-4229-8a37-9cb64df4ae7d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.203046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-75d4e6cf-6f64-48e1-8ad9-fe1e9f0d4045 req-fe2da686-690d-4229-8a37-9cb64df4ae7d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:50.222583 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-75d4e6cf-6f64-48e1-8ad9-fe1e9f0d4045 req-fe2da686-690d-4229-8a37-9cb64df4ae7d service nova] Creating event network-changed:6f87fa15-c647-4ad1-993a-cad185328baa for instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 on n-h2-833090-19 Sep 08 10:48:50.237067 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-75d4e6cf-6f64-48e1-8ad9-fe1e9f0d4045 req-fe2da686-690d-4229-8a37-9cb64df4ae7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056892 Sep 08 10:48:50.238323 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2823/5867] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:48:50.827032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:50.828552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:50.836655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.837721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.838223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:50.839013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:50.839507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:50.839948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:51.987636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:52.007497 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fb64e476-5d1e-4dd9-8b66-36e843722b03 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 1.179810 Sep 08 10:48:52.017948 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3045/5868] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:50 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:53.035420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:53.036974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:53.052592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.053176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.076778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.077297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.078290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.084975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.085501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.087431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.377241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.377738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.390761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.391269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.394756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.395843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.396505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.396926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.453093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:48:53.604251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:53.655406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:53.669845 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25b0aa35-76a5-4444-bd76-bce931cf69b4 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 204 len: 0 microversion: 2.1 time: 0.297018 Sep 08 10:48:53.671086 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-767ea4d0-ff80-469a-b490-8d1b489e9fb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.638786 Sep 08 10:48:53.672274 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2824/5869] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:53 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:53.673292 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3046/5870] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:48:53 2022] DELETE /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:48:53.696208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:53.704951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:53.723155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.723687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.724131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:53.724847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:53.725309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:53.725807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.025616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:54.038442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd9f446f-a3e7-475c-a504-ef6a2e03bd77 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1553 microversion: 2.1 time: 0.346387 Sep 08 10:48:54.063177 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2825/5871] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:53 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1553 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:54.698082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:54.699563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:54.717889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.720030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.720785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.721791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:54.722484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:54.723286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:54.828094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-554972759", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "7775a9d5-94e4-4fab-a048-22afbabaf082"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:54.908708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] validate_networks() for [('7775a9d5-94e4-4fab-a048-22afbabaf082', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:55.324678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:55.345147 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f79daf0-32ee-4478-af94-162a49b7f2de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.651925 Sep 08 10:48:55.372730 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3047/5872] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:54 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:55.380310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:55.380825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:55.394039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.394938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.396110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.397005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.397635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.398229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.739849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:55.748514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44dd3bc4-eb0f-40f3-956d-e5743c4d8293 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1553 microversion: 2.1 time: 0.373455 Sep 08 10:48:55.753015 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3048/5873] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:55 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:55.775332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1360580355", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "3209be84-d52d-444c-b5b0-842e85a2074b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1129632549", "security_groups": [{"name": "tempest-secgroup-smoke-988967441"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:55.851721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:55.852833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:55.853670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:55.854336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:55.855012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:55.879011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.881885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.883813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.885908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:55.888107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:55.888884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:55.929732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Getting quotas for project 1423224ecdf64a9f8fdac0515d27d88f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:55.938207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Getting quotas for user 55ea03b0232f4b0ebef40f226f331148 and project 1423224ecdf64a9f8fdac0515d27d88f. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:55.952830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] validate_networks() for [('3209be84-d52d-444c-b5b0-842e85a2074b', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:48:55.957089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:55.961693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:56.043370 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1ab7e3c-81c5-4609-b960-535860414331 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219704 Sep 08 10:48:56.044971 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2826/5874] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:48:56.059124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ecb0851e-0d36-4c34-9cc9-0c372f986a63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.060082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ecb0851e-0d36-4c34-9cc9-0c372f986a63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:56.255007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ecb0851e-0d36-4c34-9cc9-0c372f986a63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:56.266901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ecb0851e-0d36-4c34-9cc9-0c372f986a63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1213 microversion: 2.1 time: 0.214049 Sep 08 10:48:56.272658 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2827/5875] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:56 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:56.384897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:56.385939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:56.405571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:56.407015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:56.407550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:56.411266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:56.413403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:56.414468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.344011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:57.353997 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7f114fe-e879-4cd1-b71c-d4e6261c0552 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.984780 Sep 08 10:48:57.360359 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2828/5876] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:56 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:57.371058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:57.377165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:57.403535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.405742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.410613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.411493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:57.411983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:57.413990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:57.959628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:57.970350 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-917384f6-a7c1-4ec2-915b-0c72f0099e47 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1553 microversion: 2.1 time: 0.608620 Sep 08 10:48:57.977502 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2829/5877] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:57 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1553 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:58.021450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.031177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:58.058281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.061209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.062561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.064126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.064819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.065436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.283061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.299156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-05c89db7-be64-4af4-aac8-ab209428abee tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1265 microversion: 2.1 time: 0.293354 Sep 08 10:48:58.312863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2830/5878] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:58.387610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.388245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:58.404875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.409199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.410102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.413159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.413872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.415189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.453759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:48:58.455034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:48:58.456626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:48:58.457554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:48:58.458349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:48:58.479147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:48:58.492014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.494533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.498422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.500052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:58.500521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:58.500997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:58.535368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:48:58.547389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:48:58.566501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:48:58.570111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:48:58.665213 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a43e742f-d33e-424c-a84e-76694d04c0ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.910967 Sep 08 10:48:58.666628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3049/5879] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:48:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:48:58.678535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7a32c02e-94a2-43c5-a8e3-49fdbef41151 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:58.679173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7a32c02e-94a2-43c5-a8e3-49fdbef41151 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:58.954476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7a32c02e-94a2-43c5-a8e3-49fdbef41151 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.959251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:58.969628 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7a32c02e-94a2-43c5-a8e3-49fdbef41151 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1267 microversion: 2.1 time: 0.294849 Sep 08 10:48:58.983489 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2bf72ff6-2b4d-4716-808a-e8112210ed6a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.588728 Sep 08 10:48:58.983489 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2831/5880] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:58.983982 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3050/5881] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:58 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:48:59.012822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.017427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:59.033047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.034744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.035805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.037304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.040395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.041060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.335362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:48:59.336058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:48:59.346251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.347085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.347385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.348178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.348627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.350078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.435394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:59.456528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cd1cc1a-b022-43cb-a8ca-9986cac958a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1553 microversion: 2.1 time: 0.454462 Sep 08 10:48:59.459280 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2832/5882] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1553 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:59.492241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:48:59.503226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0afe4c39-71b4-4718-b177-42fcebf65486 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1271 microversion: 2.1 time: 0.180981 Sep 08 10:48:59.504922 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3051/5883] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:48:59 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:48:59.937777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-85ea5a7a-d4ba-4fe3-827b-8904d05a525d req-cc9b6b34-8349-404f-871d-89da8c9a092d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0e9264-1359-4301-a48d-58ba27dc9c89", "name": "network-vif-deleted", "tag": "81e68b08-61b6-46a9-aabb-2ab1f5b3651a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:59.962184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-85ea5a7a-d4ba-4fe3-827b-8904d05a525d req-cc9b6b34-8349-404f-871d-89da8c9a092d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:48:59.962781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-85ea5a7a-d4ba-4fe3-827b-8904d05a525d req-cc9b6b34-8349-404f-871d-89da8c9a092d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:48:59.963323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-85ea5a7a-d4ba-4fe3-827b-8904d05a525d req-cc9b6b34-8349-404f-871d-89da8c9a092d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:48:59.990516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-eb93c967-90c5-40a6-9146-502103515d8c req-e3ca52e1-b0eb-411b-961d-5b83a676b835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8d1386-72e0-4af2-b3e9-d08441f55430", "name": "network-vif-plugged", "status": "completed", "tag": "6f87fa15-c647-4ad1-993a-cad185328baa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:48:59.991853 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-85ea5a7a-d4ba-4fe3-827b-8904d05a525d req-cc9b6b34-8349-404f-871d-89da8c9a092d service nova] Creating event network-vif-deleted:81e68b08-61b6-46a9-aabb-2ab1f5b3651a for instance df0e9264-1359-4301-a48d-58ba27dc9c89 on n-h2-833090-19 Sep 08 10:49:00.008443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eb93c967-90c5-40a6-9146-502103515d8c req-e3ca52e1-b0eb-411b-961d-5b83a676b835 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.009405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eb93c967-90c5-40a6-9146-502103515d8c req-e3ca52e1-b0eb-411b-961d-5b83a676b835 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.010086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eb93c967-90c5-40a6-9146-502103515d8c req-e3ca52e1-b0eb-411b-961d-5b83a676b835 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.022527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-85ea5a7a-d4ba-4fe3-827b-8904d05a525d req-cc9b6b34-8349-404f-871d-89da8c9a092d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088257 Sep 08 10:49:00.024744 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2833/5884] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:00.040083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:00.051990 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-eb93c967-90c5-40a6-9146-502103515d8c req-e3ca52e1-b0eb-411b-961d-5b83a676b835 service nova] Creating event network-vif-plugged:6f87fa15-c647-4ad1-993a-cad185328baa for instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 on n-h2-833090-19 Sep 08 10:49:00.060465 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-eb93c967-90c5-40a6-9146-502103515d8c req-e3ca52e1-b0eb-411b-961d-5b83a676b835 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073731 Sep 08 10:49:00.062263 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3052/5885] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:00.066011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:00.075344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:00.077492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:00.085134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.089969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.091656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.097576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.099973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.103291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.104471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.105180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.106173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.107125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.107901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.109070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.378314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:00.390566 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2910e632-85df-4301-ab52-224d379ea874 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1319 microversion: 2.1 time: 0.359847 Sep 08 10:49:00.391850 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2834/5886] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:00 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:00.411394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:00.422367 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc37c22f-3ce8-4900-bc7c-0f46e80051c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.358482 Sep 08 10:49:00.423154 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3053/5887] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:00 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:00.484931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:00.486206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:00.495590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.500559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.501197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.504606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.505276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.505888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.530069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:00.532490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:00.544644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.545181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.545632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.546917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.547411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.562655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.584659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:00.585416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:00.586368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:00.586836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lazy-loading 'fault' on Instance uuid df0e9264-1359-4301-a48d-58ba27dc9c89 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:00.756909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:00.760311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:00.771329 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76467fc4-9900-48cf-90ad-04316498a1ec tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1271 microversion: 2.1 time: 0.246127 Sep 08 10:49:00.785024 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6016a1cf-7792-40d9-ba4e-2b201ae9afd9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 200 len: 1338 microversion: 2.1 time: 0.304353 Sep 08 10:49:00.786781 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2835/5888] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:00 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 1338 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:00.792852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3054/5889] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:00 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:01.417629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:01.418339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:01.427501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.428323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.428997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.429977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.430512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.431018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.446582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:01.447192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:01.458531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.460126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.462820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.463916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.464406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.465713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.563722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:01.584166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2c5a92a3-b043-4317-991d-72b1e49dd59d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1325 microversion: 2.1 time: 0.170186 Sep 08 10:49:01.599695 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2836/5890] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:01 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1325 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:01.805274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:01.814455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:01.826969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.828341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.829484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.831011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.832145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.833180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.863435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:01.886419 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb44a638-54d8-4945-8543-8b7179bec05d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1315 microversion: 2.1 time: 0.443346 Sep 08 10:49:01.894631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3055/5891] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:01 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:01.904994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:01.917005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: df0e9264-1359-4301-a48d-58ba27dc9c89] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:01.945826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.956774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.958019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.959495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:01.960509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:01.961480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:01.998357 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] HTTP exception thrown: Instance df0e9264-1359-4301-a48d-58ba27dc9c89 could not be found. Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Request method failure captured: Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 HTTP/1.1 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcf7Ulfo5otorE81-zSfRkEAOqx-m5I5BQYVZIt5o4P5ocbk7uxh6tlPe2H2wmV2w1XtH6w0Gvz6A0jycT9996JHqTpd2lW1oA35evw7oUrC8wBN7p-lEerh-6IAxxd_GOllOSlhtIi3aBlGZOGOiAUjbxQ3LSg3BCFfAsY0nd6mWac Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0b5f3a5e35a248b8b6c85535e4e59b7b Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5f3a5e35a248b8b6c85535e4e59b7b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0b5f3a5e35a248b8b6c85535e4e59b7b Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestNetworkBasicOps-1716732823-project Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4864b5d5cefa4fa593bb2adeb46c04d1 Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestNetworkBasicOps-1716732823-project Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance df0e9264-1359-4301-a48d-58ba27dc9c89 could not be found. Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'df0e9264-1359-4301-a48d-58ba27dc9c89'} Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0e9264-1359-4301-a48d-58ba27dc9c89 could not be found. Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0e9264-1359-4301-a48d-58ba27dc9c89 could not be found. Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:02.002157 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0e9264-1359-4301-a48d-58ba27dc9c89 could not be found. Sep 08 10:49:02.012967 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:02.016795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Returning 404 to user: Instance df0e9264-1359-4301-a48d-58ba27dc9c89 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:02.017366 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38dbcc4a-c54a-4524-92de-a250c8a009b5 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89" status: 404 len: 111 microversion: 2.1 time: 0.120209 Sep 08 10:49:02.018982 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3056/5892] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:01 2022] GET /compute/v2.1/servers/df0e9264-1359-4301-a48d-58ba27dc9c89 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:02.225671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:02.242673 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b05f4a7a-b909-44d2-86a8-53b09b5a8aae tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.444184 Sep 08 10:49:02.243946 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2837/5893] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:01 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:02.522858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b0ec965c-aecf-4665-8b14-755117b2ca94 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '.version_select at 0x7f2351cd9af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:02.567226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b0ec965c-aecf-4665-8b14-755117b2ca94 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-944459292" status: 202 len: 0 microversion: 2.1 time: 0.048199 Sep 08 10:49:02.568024 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3057/5894] 10.222.0.59 () {58 vars in 1254 bytes} [Thu Sep 8 10:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-944459292 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:02.612757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:02.614091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:02.628679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:02.636208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:02.636789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:02.637662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:02.638223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:02.638752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:02.916325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:02.916937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:02.934937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:02.935905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:02.936177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:02.937120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:02.937683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:02.938256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.323596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.361176 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cdf76642-827f-4573-b94f-19f3b27b0aaa tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.755565 Sep 08 10:49:03.363388 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2838/5895] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:02 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:03.379684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:03.380621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:03.389441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.392363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.393610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.394430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.395259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.396633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.598228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.609550 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7b1064d-f375-4734-8343-97b4c4739141 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1501 microversion: 2.1 time: 0.697168 Sep 08 10:49:03.622583 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3058/5896] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:02 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1501 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:03.647796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:03.650330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:03.659865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.660467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.660913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.661881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.662524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.663123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.766606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-28d170d9-5037-4264-85c7-0ab5f40854e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.116154 Sep 08 10:49:03.767453 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3059/5897] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:03 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:03.823634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8b101da0-645f-4e42-b8e0-0310423df0c6 req-f2d8a39a-54bd-4e1a-b1b6-5c6d37e055fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633b7b66-b5a6-4a95-8c58-6e98a7710eb7", "tag": "d695b5e7-28fb-4671-b455-15751c501240"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:03.869736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b101da0-645f-4e42-b8e0-0310423df0c6 req-f2d8a39a-54bd-4e1a-b1b6-5c6d37e055fa service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:03.870615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b101da0-645f-4e42-b8e0-0310423df0c6 req-f2d8a39a-54bd-4e1a-b1b6-5c6d37e055fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:03.871564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8b101da0-645f-4e42-b8e0-0310423df0c6 req-f2d8a39a-54bd-4e1a-b1b6-5c6d37e055fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:03.892510 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8b101da0-645f-4e42-b8e0-0310423df0c6 req-f2d8a39a-54bd-4e1a-b1b6-5c6d37e055fa service nova] Creating event network-changed:d695b5e7-28fb-4671-b455-15751c501240 for instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 on n-h1-833090-19 Sep 08 10:49:03.898366 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8b101da0-645f-4e42-b8e0-0310423df0c6 req-f2d8a39a-54bd-4e1a-b1b6-5c6d37e055fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089864 Sep 08 10:49:03.899349 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3060/5898] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:03.947391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:03.977996 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-537f5c75-70e6-4d66-9f3a-03b4adcee42b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.608897 Sep 08 10:49:03.982477 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2839/5899] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:03 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:04.393281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:04.394673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:04.414698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.415518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.417623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.418684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.419476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.422136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.783340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:04.789562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:04.809976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.810718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.812091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.813998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:04.814695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:04.815184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:04.925157 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dd6ce70-6d80-47ef-a304-292c1245686c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.150331 Sep 08 10:49:04.926062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2840/5900] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:04 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:49:05.021196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:05.024534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:05.028463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.036403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.049218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.053454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8fe993f3-0de8-419c-a412-c8196c0bf320 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.665727 Sep 08 10:49:05.053649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.057426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.059277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.062850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.070008 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3061/5901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:04 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:05.098638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8521bca8-bcf4-4c65-b6bb-59dfce4bc08d req-52dbecb4-87b1-48d3-8652-b321691a44e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:05.110627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8521bca8-bcf4-4c65-b6bb-59dfce4bc08d req-52dbecb4-87b1-48d3-8652-b321691a44e9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.111548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8521bca8-bcf4-4c65-b6bb-59dfce4bc08d req-52dbecb4-87b1-48d3-8652-b321691a44e9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.112144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8521bca8-bcf4-4c65-b6bb-59dfce4bc08d req-52dbecb4-87b1-48d3-8652-b321691a44e9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.132787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:05.135551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8521bca8-bcf4-4c65-b6bb-59dfce4bc08d req-52dbecb4-87b1-48d3-8652-b321691a44e9 service nova] Creating event network-changed:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h1-833090-19 Sep 08 10:49:05.141883 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8521bca8-bcf4-4c65-b6bb-59dfce4bc08d req-52dbecb4-87b1-48d3-8652-b321691a44e9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047645 Sep 08 10:49:05.142874 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3062/5902] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:05.331549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:05.342124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f8c33c4-991c-4726-987b-27a5985f438b tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.337890 Sep 08 10:49:05.342733 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2841/5903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:05 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:05.941236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:05.946454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:05.969343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.970006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.970697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:05.971538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:05.972092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:05.976614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.061229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-192ab27c-15a3-42cc-9c89-e83e6c299908 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.127849 Sep 08 10:49:06.062412 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3063/5904] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:05 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:06.086238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:06.086736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:06.097802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:06.101347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.103723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.104505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.105571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.106388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.106997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.259977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:06.383212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:06.384222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:06.398579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.402495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.402962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.403837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:06.404918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:06.407279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:06.550299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:06.587988 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b750370a-2bdd-4070-a1e9-915afc6c7082 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.505646 Sep 08 10:49:06.629284 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2842/5905] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:06 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:06.768092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:06.778883 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-095e628d-cca9-4516-ae3c-be3907f5baf5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.399064 Sep 08 10:49:06.787576 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3064/5906] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:06 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:07.081442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:07.090839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:07.109331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.110011 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.110387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.111249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.111903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.112282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.181168 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94e0c5b6-7bd8-4044-b416-ac0e9ec6f011 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.111248 Sep 08 10:49:07.182098 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2843/5907] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:07 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:49:07.618542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:07.620927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:07.631867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.632743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.633649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.634650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.635594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.636300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.814607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:07.815645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:07.826077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.827595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.830348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:07.841078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:07.842148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:07.844175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.337730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:08.349254 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1d933e48-4bb3-4bf4-9042-c9a27ef16cba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.737019 Sep 08 10:49:08.350146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3065/5908] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:07 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:08.355155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:08.357902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:08.364378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.365221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.365925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.366866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.367599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.368261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.442723 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e26f8dce-bc12-4c21-a99d-c6cd14e75893 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.090751 Sep 08 10:49:08.443552 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3066/5909] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:08 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:08.495761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:08.518454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:08.519780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:08.524600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:08.525082 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-828975e3-f6e6-468e-b5e8-d952335c8b40 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.705696 Sep 08 10:49:08.541298 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2844/5910] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:07 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:08.554980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.556388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-90872f6d-ec82-48a7-b687-7be1175896e6 req-dd6b9ec1-9764-4ca6-9bd0-515323bf79ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8677a3a-c040-4eb3-8547-2ff124a31214", "tag": "1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:08.559234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.560106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.562797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.570914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-90872f6d-ec82-48a7-b687-7be1175896e6 req-dd6b9ec1-9764-4ca6-9bd0-515323bf79ee service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.571712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-90872f6d-ec82-48a7-b687-7be1175896e6 req-dd6b9ec1-9764-4ca6-9bd0-515323bf79ee service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.572318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-90872f6d-ec82-48a7-b687-7be1175896e6 req-dd6b9ec1-9764-4ca6-9bd0-515323bf79ee service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.586202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.588377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.595857 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-90872f6d-ec82-48a7-b687-7be1175896e6 req-dd6b9ec1-9764-4ca6-9bd0-515323bf79ee service nova] Creating event network-changed:1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5 for instance c8677a3a-c040-4eb3-8547-2ff124a31214 on n-h1-833090-19 Sep 08 10:49:08.602900 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-90872f6d-ec82-48a7-b687-7be1175896e6 req-dd6b9ec1-9764-4ca6-9bd0-515323bf79ee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058648 Sep 08 10:49:08.604372 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2845/5911] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:08.680612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:08.913921 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e6ece49-1217-4051-a295-4cef5d0946da tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 204 len: 0 microversion: 2.1 time: 0.403125 Sep 08 10:49:08.917090 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3067/5912] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:49:08 2022] DELETE /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:08.927620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:08.928316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:08.937362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.938120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.938766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:08.939784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:08.940424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:08.941020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.378338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:09.385287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:09.399150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:09.403136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.405395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.406130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.407811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.408865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.409818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.566867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:09.580948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aaef20ad-4047-4065-b119-725775be7cbe tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1667 microversion: 2.1 time: 0.658786 Sep 08 10:49:09.582223 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2846/5913] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:08 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1667 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:09.603450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:09.607285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:09.614499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.615554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.616349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.617260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.617998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.619119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.681218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:09.692858 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b43e445-2453-44c0-b97a-dd215a6e1cec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.109100 Sep 08 10:49:09.693529 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2847/5914] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:09 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:09.694087 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-77d17783-1c84-4232-930a-0277d8363316 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.322501 Sep 08 10:49:09.703260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:09.706935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:09.712289 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3068/5915] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:09 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:09.715001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.715733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.716175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:09.716892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:09.718266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:09.718890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.037714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:10.060155 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16792dd7-913a-4a32-9e12-23d262363c99 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.361749 Sep 08 10:49:10.076570 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2848/5916] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:09 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:10.612363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:10.612994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:10.623553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.624946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.625619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.626620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.627308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.630890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.709435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:10.714215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:10.728849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.729348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.729785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.730804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.731484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.732183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.828056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-faa60c8c-18e5-4c23-ad7f-8ab9314d6e7d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.125940 Sep 08 10:49:10.834612 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2849/5917] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:10 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:49:10.850007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:10.851302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:10.864202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.865887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.866864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.868034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:10.868823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:10.870118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:10.913179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:11.104686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:11.117369 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecb83998-8987-4fa6-bf15-3d9e9090f2f7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1548 microversion: 2.1 time: 0.513863 Sep 08 10:49:11.119984 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3069/5918] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:10 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1548 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:11.126264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:11.127035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:11.135352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.136169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.136990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.138821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.140153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.142295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.210505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:11.234516 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e30115a4-437d-4df2-9445-973b370079b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.394948 Sep 08 10:49:11.236014 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2850/5919] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:10 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:11.472560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:11.494895 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1d4056c-247e-44bb-a9cc-e1de8fe3026f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.369608 Sep 08 10:49:11.499193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3070/5920] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:11 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:11.550321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2c5ae335-dba3-43ac-8cdc-0bbddb29e7f7 req-27604824-5954-4b0a-9cba-ea2c3395c94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8677a3a-c040-4eb3-8547-2ff124a31214", "name": "network-vif-deleted", "tag": "1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:11.569475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2c5ae335-dba3-43ac-8cdc-0bbddb29e7f7 req-27604824-5954-4b0a-9cba-ea2c3395c94c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.570316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2c5ae335-dba3-43ac-8cdc-0bbddb29e7f7 req-27604824-5954-4b0a-9cba-ea2c3395c94c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.570929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2c5ae335-dba3-43ac-8cdc-0bbddb29e7f7 req-27604824-5954-4b0a-9cba-ea2c3395c94c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.585758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2c5ae335-dba3-43ac-8cdc-0bbddb29e7f7 req-27604824-5954-4b0a-9cba-ea2c3395c94c service nova] Creating event network-vif-deleted:1e7dc75e-8a07-48b3-9f9b-03f78ac81dc5 for instance c8677a3a-c040-4eb3-8547-2ff124a31214 on n-h1-833090-19 Sep 08 10:49:11.594960 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2c5ae335-dba3-43ac-8cdc-0bbddb29e7f7 req-27604824-5954-4b0a-9cba-ea2c3395c94c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047822 Sep 08 10:49:11.596825 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2851/5921] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:11.846322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:11.850589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:11.860212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.861375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.862051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.863120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:11.863832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:11.864479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:11.959686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65b0643a-192b-4a18-ae7c-f3fba3aeafb1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.117320 Sep 08 10:49:11.963486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3071/5922] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:11 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 10:49:12.147888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:12.149604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:12.160430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.160934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.161377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.162181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.163029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.163878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.207328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.207849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.208291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.208748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lazy-loading 'fault' on Instance uuid c8677a3a-c040-4eb3-8547-2ff124a31214 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:12.273883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:12.275620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:12.287248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.289659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.290461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.291665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.292335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.293673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.296686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:12.312550 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bba6eb3d-b1cc-4592-bd33-80602f774294 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 200 len: 1337 microversion: 2.1 time: 0.169049 Sep 08 10:49:12.313163 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2852/5923] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:12 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 1337 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:12.521110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:12.521823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:12.529330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.530858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.531863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:12.533027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:12.534354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:12.535031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:13.117298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:13.151329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:13.163852 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fb6792c0-6676-4287-8d66-fda85aff63b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.905561 Sep 08 10:49:13.167083 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f6141fa-5795-4f5d-9798-bc193ae6c50f tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.650095 Sep 08 10:49:13.171368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2853/5924] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:12 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:13.179087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:13.181389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3072/5925] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:12 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:13.182146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:13.200479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:13.203054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:13.203674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:13.204216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:13.205036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:13.205629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:13.206347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:13.293277 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-089f291f-a29a-468d-88c9-35cdfc22b5e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.119399 Sep 08 10:49:13.294035 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2854/5926] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:13 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:13.343101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:13.345492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: c8677a3a-c040-4eb3-8547-2ff124a31214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:13.354378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:13.355498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:13.356230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:13.357387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:13.358608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:13.359298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:13.363892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2dd599a9-a749-4327-a2e9-c99065092d01 req-6e8c4ff7-6090-4900-bbef-92c5bb39ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633b7b66-b5a6-4a95-8c58-6e98a7710eb7", "name": "network-vif-plugged", "status": "completed", "tag": "d695b5e7-28fb-4671-b455-15751c501240"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:13.398761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] HTTP exception thrown: Instance c8677a3a-c040-4eb3-8547-2ff124a31214 could not be found. Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Request method failure captured: Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 HTTP/1.1 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcf7Ulfo5otorE81-zSfRkEAOqx-m5I5BQYVZIt5o4P5ocbk7uxh6tlPe2H2wmV2w1XtH6w0Gvz6A0jycT9996JHqTpd2lW1oA35evw7oUrC8wBN7p-lEerh-6IAxxd_GOllOSlhtIi3aBlGZOGOiAUjbxQ3LSg3BCFfAsY0nd6mWac Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0b5f3a5e35a248b8b6c85535e4e59b7b Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5f3a5e35a248b8b6c85535e4e59b7b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0b5f3a5e35a248b8b6c85535e4e59b7b Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestNetworkBasicOps-1716732823-project Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4864b5d5cefa4fa593bb2adeb46c04d1 Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestNetworkBasicOps-1716732823-project Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance c8677a3a-c040-4eb3-8547-2ff124a31214 could not be found. Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'c8677a3a-c040-4eb3-8547-2ff124a31214'} Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8677a3a-c040-4eb3-8547-2ff124a31214 could not be found. Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8677a3a-c040-4eb3-8547-2ff124a31214 could not be found. Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:13.404386 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8677a3a-c040-4eb3-8547-2ff124a31214 could not be found. Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:13.410565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Returning 404 to user: Instance c8677a3a-c040-4eb3-8547-2ff124a31214 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:13.412313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2dd599a9-a749-4327-a2e9-c99065092d01 req-6e8c4ff7-6090-4900-bbef-92c5bb39ad59 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:13.412907 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46a9d1b4-7663-43f7-b911-899ad4e3e72c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214" status: 404 len: 111 microversion: 2.1 time: 0.076988 Sep 08 10:49:13.413759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2dd599a9-a749-4327-a2e9-c99065092d01 req-6e8c4ff7-6090-4900-bbef-92c5bb39ad59 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:13.416448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2dd599a9-a749-4327-a2e9-c99065092d01 req-6e8c4ff7-6090-4900-bbef-92c5bb39ad59 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:13.423858 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3073/5927] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:13 2022] GET /compute/v2.1/servers/c8677a3a-c040-4eb3-8547-2ff124a31214 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:13.434323 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2dd599a9-a749-4327-a2e9-c99065092d01 req-6e8c4ff7-6090-4900-bbef-92c5bb39ad59 service nova] Creating event network-vif-plugged:d695b5e7-28fb-4671-b455-15751c501240 for instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 on n-h1-833090-19 Sep 08 10:49:13.445321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2dd599a9-a749-4327-a2e9-c99065092d01 req-6e8c4ff7-6090-4900-bbef-92c5bb39ad59 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085146 Sep 08 10:49:13.447793 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2855/5928] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:13.703549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-888860f3-db74-40c7-9b26-7b5505908c4e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '.version_select at 0x7f2351424af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:13.749210 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-888860f3-db74-40c7-9b26-7b5505908c4e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-232049597" status: 202 len: 0 microversion: 2.1 time: 0.049711 Sep 08 10:49:13.750427 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3074/5929] 10.222.0.59 () {58 vars in 1254 bytes} [Thu Sep 8 10:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-232049597 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:14.224772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:14.225486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:14.226632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:14.227443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:14.243226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.284751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.285578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.286214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.287257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.288447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.293675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.298059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.300627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.301349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.302043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.318463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.788492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:14.800313 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3e4d5566-6651-4787-9427-20a821b70c39 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1313 microversion: 2.1 time: 0.602036 Sep 08 10:49:14.800906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3075/5930] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:14 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:14.830690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:14.857396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:14.861553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:14.874294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.882426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.897086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:14.898195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:14.898913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:14.900863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.036815 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4368bf83-8662-4ca1-a49c-fc756b80427d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 14 microversion: 2.1 time: 0.213415 Sep 08 10:49:15.039673 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3076/5931] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:14 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 10:49:15.111672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:15.127687 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cdba63de-094b-4c40-b34a-bd6953aa7291 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.924690 Sep 08 10:49:15.129095 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2856/5932] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:14 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:15.526975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0724a71e-305f-49da-a574-945436c21302 req-54a55a45-1e27-4416-a961-92e0554b6090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "name": "network-vif-plugged", "status": "completed", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:15.555244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0724a71e-305f-49da-a574-945436c21302 req-54a55a45-1e27-4416-a961-92e0554b6090 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.557766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0724a71e-305f-49da-a574-945436c21302 req-54a55a45-1e27-4416-a961-92e0554b6090 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.558225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0724a71e-305f-49da-a574-945436c21302 req-54a55a45-1e27-4416-a961-92e0554b6090 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.603821 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0724a71e-305f-49da-a574-945436c21302 req-54a55a45-1e27-4416-a961-92e0554b6090 service nova] Creating event network-vif-plugged:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h1-833090-19 Sep 08 10:49:15.616745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0724a71e-305f-49da-a574-945436c21302 req-54a55a45-1e27-4416-a961-92e0554b6090 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094078 Sep 08 10:49:15.617245 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3077/5933] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:15.829553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:15.831194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:15.848565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.849472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.850152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:15.851114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:15.851869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:15.852533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:16.056777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:16.066124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:16.079094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:16.079634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:16.092137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:16.092953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:16.093438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:16.093881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:16.207360 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a131d796-eccb-434e-9f92-f36d8238cd72 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action" status: 200 len: 8208 microversion: 2.1 time: 0.154630 Sep 08 10:49:16.209182 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3078/5934] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:16 2022] POST /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430/action => generated 8208 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:16.219873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:16.221977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:16.242022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:16.242291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:16.242704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:16.255796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:16.256465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:16.256929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:16.962925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:16.976436 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ae2a2cf5-1bd6-4cd0-be8d-a46e1e9baed0 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1496 microversion: 2.1 time: 1.152037 Sep 08 10:49:16.991575 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2857/5935] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:15 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1496 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:16.991575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:16.991575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:17.000478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.001655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.002829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.005374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.006144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.006998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.028469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:17.042425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ebbc0b0c-4bfb-4218-8979-0e353c60a72e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1392 microversion: 2.1 time: 0.831532 Sep 08 10:49:17.062898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3079/5936] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:16 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1392 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:17.506417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:17.515903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39fa980d-90a8-4681-84c0-cfe28e26d2ee tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.536234 Sep 08 10:49:17.520260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2858/5937] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:16 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:17.549780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:17.550698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:17.570512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.571454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.572177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.576016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.577468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.578814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.670275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:17.671124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:17.679064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.680033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.680722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.681683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.682355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.683002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.724923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:17.823571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87975cb0-31a4-4b13-81d7-663bb598128c tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "DELETE /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 204 len: 0 microversion: 2.1 time: 0.149647 Sep 08 10:49:17.827885 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2859/5938] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:49:17 2022] DELETE /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:17.833967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:17.834669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:17.841822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.843592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.843592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:17.843889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:17.844346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:17.844771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.166456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.174799 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1543b69b-4dff-47ec-baf5-5ae8cf98fce2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.629200 Sep 08 10:49:18.176460 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3080/5939] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:17 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:18.182262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:18.183135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:18.190391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.191239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.191972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.192931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.193607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.194287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.323763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.340545 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35633d2e-dd85-42ed-96f8-8824b9c70c50 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1502 microversion: 2.1 time: 0.511059 Sep 08 10:49:18.341387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2860/5940] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:17 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1502 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:18.347021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:18.347966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:18.354219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.354997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.355726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.356699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.357452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.358611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.776424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.784341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:18.787080 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d76c9610-17b1-48b4-b308-9456aad01bc5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1563 microversion: 2.1 time: 0.609373 Sep 08 10:49:18.788076 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3081/5941] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:18 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1563 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:18.799788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:18.808341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9135130b-a2be-4b2e-88e1-c5522294034f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.462218 Sep 08 10:49:18.808341 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2861/5942] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:18 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:18.833259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:18.834406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:18.856273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.857141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.859037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.860969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:18.862050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.863015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.863439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:18.864356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.879686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.884422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.885013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:18.889962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:18.890914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:18.891734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.349757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:19.364569 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1da9ac40-1470-40ab-9789-6f18aaa4a592 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.535996 Sep 08 10:49:19.379617 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2862/5943] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:18 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:19.392500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:19.396325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:19.416286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.418976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.420036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.422077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.423376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.424104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.450838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:19.466227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ab17b70-e405-478f-8f64-01a58d256e2c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1563 microversion: 2.1 time: 0.627227 Sep 08 10:49:19.468457 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3082/5944] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:18 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1563 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:19.474794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:19.475759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:19.483292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.484726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.485595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.486529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.487134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.488005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.561116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Locking {{(pid=122457) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 08 10:49:19.642151 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2978a78-23c9-4f4f-898d-dca1652d98b0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.172073 Sep 08 10:49:19.644012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3083/5945] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:19 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:19.652065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:19.653114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:19.662213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.663150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.664083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:19.665284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:19.666113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:19.666756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:20.556036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:20.566253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-44770e1f-af49-43ae-b384-139373e5c031 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1502 microversion: 2.1 time: 1.182977 Sep 08 10:49:20.570292 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2863/5946] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:19 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1502 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:20.667614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:20.675715 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8172f93-0e47-4818-987f-d89b1c20bea8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 1.028189 Sep 08 10:49:20.676302 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3084/5947] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:19 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:20.705407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:20.711990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:20.712933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:20.713561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:20.751678 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] HTTP exception thrown: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 is locked Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Request method failure captured: Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action HTTP/1.1 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 15 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcext_l-x13rqAYE7pgy9joFU7N6RJ84cNZ1VfMsHvvhE7RPS_0_YJMxeqs1Hx5fIH8TyttqVjBB-jD4KB5Fc5TUMI-wqQZh6uKxQRT1YATeo1JQ9uJD_JkSt0ASyUtqjfE1r4wRtxf-1_7WeP4ok4WHAeBUfrqLYlP1uPiGPdpuOiM Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25af7888ff4a47bb9345d8274b0e61fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfc0dd22092d4110b24c5fa4efd5d9f2 Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: {"os-stop": {}} Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 is locked Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '34b2dae2-b6a3-4c39-baaf-a851b51c9e66', 'body': {'os-stop': {}}} Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 is locked Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 is locked Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 is locked Sep 08 10:49:20.753478 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:20.762872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Returning 409 to user: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 is locked {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:20.762872 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67b0e1d5-461b-4ecb-ac44-a9eb8e795ef6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 409 len: 107 microversion: 2.1 time: 0.056435 Sep 08 10:49:20.762872 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2864/5948] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:20 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 107 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 10:49:20.764556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:20.765228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:20.775719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:20.776214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:20.776658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:20.777368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:20.777818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:20.778241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:20.877647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Unlocking {{(pid=122457) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 08 10:49:20.977422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c50aaf28-fc87-4a7d-abce-a17505739e9a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.217626 Sep 08 10:49:20.988173 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3085/5949] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:20 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:20.994108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2873dbd2-1a52-46d2-a226-1c4e2b2c0616 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:21.012363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2873dbd2-1a52-46d2-a226-1c4e2b2c0616 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.014653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2873dbd2-1a52-46d2-a226-1c4e2b2c0616 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.015312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2873dbd2-1a52-46d2-a226-1c4e2b2c0616 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.082122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d086214d-8d06-4807-a90e-25b47852b28a req-d7ac851f-b45d-4894-b992-cbc94cef08a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633b7b66-b5a6-4a95-8c58-6e98a7710eb7", "name": "network-vif-deleted", "tag": "d695b5e7-28fb-4671-b455-15751c501240"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:21.095617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2873dbd2-1a52-46d2-a226-1c4e2b2c0616 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:49:21.112057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d086214d-8d06-4807-a90e-25b47852b28a req-d7ac851f-b45d-4894-b992-cbc94cef08a8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.113152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d086214d-8d06-4807-a90e-25b47852b28a req-d7ac851f-b45d-4894-b992-cbc94cef08a8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.117384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d086214d-8d06-4807-a90e-25b47852b28a req-d7ac851f-b45d-4894-b992-cbc94cef08a8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.150262 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d086214d-8d06-4807-a90e-25b47852b28a req-d7ac851f-b45d-4894-b992-cbc94cef08a8 service nova] Creating event network-vif-deleted:d695b5e7-28fb-4671-b455-15751c501240 for instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 on n-h1-833090-19 Sep 08 10:49:21.165749 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d086214d-8d06-4807-a90e-25b47852b28a req-d7ac851f-b45d-4894-b992-cbc94cef08a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088126 Sep 08 10:49:21.166960 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3086/5950] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:21.269558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2873dbd2-1a52-46d2-a226-1c4e2b2c0616 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.286749 Sep 08 10:49:21.291959 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2865/5951] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:20 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:21.304664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:21.306269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:21.319247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.319759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.323673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.325857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.328278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.330038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.603649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:21.604522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:21.622563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.622563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.624491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.626559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.630562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.631386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.664608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:21.707955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:21.708721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:21.709339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:21.709957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lazy-loading 'fault' on Instance uuid 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:21.798294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:21.802730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:21.811036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f0343762-7764-4cc3-a444-f2810ba5dc39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.513318 Sep 08 10:49:21.811271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3e44b14-05a4-466a-9729-73728616f947 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 200 len: 1303 microversion: 2.1 time: 0.220078 Sep 08 10:49:21.812595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3087/5952] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:21 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:21.857050 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2866/5953] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:21 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 1303 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:22.858663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:22.859294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 633b7b66-b5a6-4a95-8c58-6e98a7710eb7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:22.862481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:22.863115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:22.872380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:22.874604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:22.875384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:22.876418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:22.877136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:22.878513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:22.889478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:22.890260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:22.892087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:22.897443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:22.898669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:22.899341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:22.910724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] HTTP exception thrown: Instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 could not be found. Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Request method failure captured: Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 HTTP/1.1 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGciT9hvcWBMuhWj80KrNyVh_VG01zPIBHsqKEPeo_DzFpc-MRNGdsfjFhf4tov3_zQWbZayPTFwHWgi1etjh8usOQaKXy_wPM5vwJwJY7MONba47wnW4OpEsAwG_QkvEhlBRy9z-gxw7EnjnzE4WZ3mGKVEOeMvr8zPEiZAdS3oQFW0 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 1423224ecdf64a9f8fdac0515d27d88f Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesActionsTest-1739801924 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1423224ecdf64a9f8fdac0515d27d88f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1423224ecdf64a9f8fdac0515d27d88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1423224ecdf64a9f8fdac0515d27d88f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1423224ecdf64a9f8fdac0515d27d88f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesActionsTest-1739801924 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 1423224ecdf64a9f8fdac0515d27d88f Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesActionsTest-1739801924 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesActionsTest-1739801924-project Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 55ea03b0232f4b0ebef40f226f331148 Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesActionsTest-1739801924-project Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 could not be found. Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '633b7b66-b5a6-4a95-8c58-6e98a7710eb7'} Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 could not be found. Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 could not be found. Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:22.930684 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 could not be found. Sep 08 10:49:22.938100 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:49:22.940721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Returning 404 to user: Instance 633b7b66-b5a6-4a95-8c58-6e98a7710eb7 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:22.942370 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dbb2277c-55a5-4cfd-bf1a-0b611a1f8ee4 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7" status: 404 len: 111 microversion: 2.1 time: 0.088688 Sep 08 10:49:22.944126 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3088/5954] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:22 2022] GET /compute/v2.1/servers/633b7b66-b5a6-4a95-8c58-6e98a7710eb7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:23.144404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-582111988", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "7775a9d5-94e4-4fab-a048-22afbabaf082"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:23.231243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] validate_networks() for [('7775a9d5-94e4-4fab-a048-22afbabaf082', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:49:23.475195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:23.489483 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-384b9fdc-6fc3-4e3e-9a60-ace138cdcfec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.630811 Sep 08 10:49:23.489989 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2867/5955] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:22 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:24.514157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:24.515560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:24.522900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:24.523721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:24.524351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:24.525275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:24.525909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:24.526498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:25.137342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:25.152525 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dcd8128e-b4b2-404a-9978-54f5e7c3bad2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.639506 Sep 08 10:49:25.158787 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2868/5956] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:24 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:25.281540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:49:25.285370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:49:25.285900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:49:25.286323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:49:25.286738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:49:25.290968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:25.291637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:25.303722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:25.308142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:25.308818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:25.309776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:25.313361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:25.313640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:25.313864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:25.314309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:25.314692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:25.315057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:25.318948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:25.319534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:25.381744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Getting quotas for project 1423224ecdf64a9f8fdac0515d27d88f. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:25.391431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Getting quotas for user 55ea03b0232f4b0ebef40f226f331148 and project 1423224ecdf64a9f8fdac0515d27d88f. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:25.430034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:49:25.439445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:49:25.562445 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5ae3682-bebe-4290-841f-f45b31470444 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.421998 Sep 08 10:49:25.563119 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3089/5957] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:49:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:49:25.591348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-442fad02-4d7f-4b1c-904c-2f9c744c9017 req-e91fd6ed-b0c0-4fe4-9757-eb54c896b684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:25.615961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-442fad02-4d7f-4b1c-904c-2f9c744c9017 req-e91fd6ed-b0c0-4fe4-9757-eb54c896b684 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:25.616452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-442fad02-4d7f-4b1c-904c-2f9c744c9017 req-e91fd6ed-b0c0-4fe4-9757-eb54c896b684 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:25.616892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-442fad02-4d7f-4b1c-904c-2f9c744c9017 req-e91fd6ed-b0c0-4fe4-9757-eb54c896b684 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:25.648646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-442fad02-4d7f-4b1c-904c-2f9c744c9017 req-e91fd6ed-b0c0-4fe4-9757-eb54c896b684 service nova] Creating event network-changed:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h1-833090-19 Sep 08 10:49:25.663131 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-442fad02-4d7f-4b1c-904c-2f9c744c9017 req-e91fd6ed-b0c0-4fe4-9757-eb54c896b684 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098699 Sep 08 10:49:25.663897 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3090/5958] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:25.687052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0260ca5d-1883-49e1-9b96-8ce808ed920d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:25.690294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0260ca5d-1883-49e1-9b96-8ce808ed920d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:26.072960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0260ca5d-1883-49e1-9b96-8ce808ed920d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:26.081324 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0260ca5d-1883-49e1-9b96-8ce808ed920d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1213 microversion: 2.1 time: 0.415912 Sep 08 10:49:26.081927 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3091/5959] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:25 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1213 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:26.181550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:26.182501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:26.207708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:26.208436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:26.208902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:26.219692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:26.220921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:26.221574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:26.384645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:26.405115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d21d442-f9e1-4e45-a0d6-26d398356772 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1563 microversion: 2.1 time: 1.118126 Sep 08 10:49:26.406893 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2869/5960] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:25 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1563 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:26.676948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:26.697076 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a0f5a29-4d5f-455f-ade9-4b0de25a9323 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.507984 Sep 08 10:49:26.697760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3092/5961] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:26 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:27.107690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:27.108328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:27.125902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:27.126476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:27.126935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:27.127713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:27.128181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:27.128620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:27.240532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:27.252710 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ff5c5c93-fbdf-44de-b07e-fe0636b73fc8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1265 microversion: 2.1 time: 0.150157 Sep 08 10:49:27.254008 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2870/5962] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:27 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:27.724346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:27.725882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:27.734137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:27.734784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:27.735815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:27.736756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:27.737330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:27.737873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:28.102941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:28.117872 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dae51e9d-d5f5-483d-b284-ba3644462209 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.398009 Sep 08 10:49:28.118809 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3093/5963] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:27 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:28.277073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:28.278321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:28.307282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:28.308176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:28.308867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:28.309938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:28.310742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:28.311747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:28.412902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:28.421196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-beda49cd-3069-4591-9d4a-898a13f77aef tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1271 microversion: 2.1 time: 0.148362 Sep 08 10:49:28.422450 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2871/5964] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:28 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:29.142346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:29.143129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:29.166821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:29.167674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:29.168465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:29.170323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:29.171034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:29.171729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:29.413932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:29.424021 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85971769-282c-4ec3-88d8-b04b7b0f952f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.285726 Sep 08 10:49:29.424944 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3094/5965] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:29 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:29.445732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:29.446507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:29.454159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:29.455000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:29.455607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:29.456481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:29.456974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:29.457432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:29.611819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:29.621670 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b05c79e-adcc-47eb-85d9-e5e61e2f3a89 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.181041 Sep 08 10:49:29.623099 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2872/5966] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:29 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:30.451667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:30.452297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:30.467412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:30.467956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:30.468404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:30.469131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:30.469591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:30.470031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:30.646673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:30.647229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:30.675337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:30.676499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:30.677132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:30.678062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:30.678821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:30.679671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:30.941410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:30.960447 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0749eae6-ac60-45da-81b1-048df1f24ae4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.512887 Sep 08 10:49:30.962981 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3095/5967] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:30 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:31.021188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:31.039859 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b0274daa-dac9-41ac-8578-7d5e9b3b522e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.397905 Sep 08 10:49:31.041201 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2873/5968] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:30 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:31.986524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:31.987780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:32.000296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.004451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.005238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.006536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.007831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.011809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.069138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:32.069985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:32.079641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.088136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.091652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.092746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.093448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.094106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.539622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:32.556593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c47cb2ad-5a13-4806-bca2-b67360529fb8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1657 microversion: 2.1 time: 0.575588 Sep 08 10:49:32.576796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:32.582251 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3096/5969] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:31 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1657 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:32.587093 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-550c75db-79a0-406e-aeff-5d84bce2d0fc tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.524179 Sep 08 10:49:32.590084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b908795-8bba-4994-8c6c-fcd65c030fc4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:32.590805 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2874/5970] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:32 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:32.598668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b908795-8bba-4994-8c6c-fcd65c030fc4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.599785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b908795-8bba-4994-8c6c-fcd65c030fc4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.601638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b908795-8bba-4994-8c6c-fcd65c030fc4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.606191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:32.654329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b908795-8bba-4994-8c6c-fcd65c030fc4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Going to try to start instance {{(pid=122457) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:49:32.750154 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b908795-8bba-4994-8c6c-fcd65c030fc4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.163726 Sep 08 10:49:32.751579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3097/5971] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:32 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:32.761876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:32.762897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:32.776762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.777574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.778207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:32.789475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:32.795511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:32.799256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:33.186253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6225abe6-c329-4c29-a7c0-5ae3918e122f req-84c51252-6884-46ba-91e9-5151f479ea91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f3fd28-fc68-46a6-aaca-ac804c20c75a", "tag": "373b8c8a-4c7d-406e-9710-59a11cc15d22"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:33.206101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6225abe6-c329-4c29-a7c0-5ae3918e122f req-84c51252-6884-46ba-91e9-5151f479ea91 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:33.206879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6225abe6-c329-4c29-a7c0-5ae3918e122f req-84c51252-6884-46ba-91e9-5151f479ea91 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:33.207630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6225abe6-c329-4c29-a7c0-5ae3918e122f req-84c51252-6884-46ba-91e9-5151f479ea91 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:33.222460 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6225abe6-c329-4c29-a7c0-5ae3918e122f req-84c51252-6884-46ba-91e9-5151f479ea91 service nova] Creating event network-changed:373b8c8a-4c7d-406e-9710-59a11cc15d22 for instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a on n-h2-833090-19 Sep 08 10:49:33.228386 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6225abe6-c329-4c29-a7c0-5ae3918e122f req-84c51252-6884-46ba-91e9-5151f479ea91 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046798 Sep 08 10:49:33.229763 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3098/5972] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:33.620327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:33.621314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:33.630038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:33.631134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:33.631784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:33.632687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:33.633317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:33.636113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:33.990322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:34.000407 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d1f7f50-4f33-4a0e-b949-d5f03d2c4dec tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1666 microversion: 2.1 time: 1.244697 Sep 08 10:49:34.016094 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2875/5973] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:32 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1666 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:34.297358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:34.311715 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-adc30269-f7e9-47c6-b486-f28cfdcbda29 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.695601 Sep 08 10:49:34.323487 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3099/5974] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:33 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:35.026254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.026887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:35.041179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.041698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.042131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.042859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.043318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.048521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.340363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:35.341683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:35.352978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:35.364607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.365132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.365582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.366612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:35.367077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:35.367527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:35.806352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:35.819749 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7019aa4b-af0f-44d3-90ea-02bfc845d6de tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1666 microversion: 2.1 time: 0.797347 Sep 08 10:49:35.822491 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2876/5975] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1666 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:36.001041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:36.036709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cc48cc5-6184-4138-b075-0e6fea6113d8 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.698748 Sep 08 10:49:36.038243 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3100/5976] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:35 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:36.485392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a59ff071-3fb9-481c-bf1b-1837717565b1 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'create', calling method: .version_select at 0x7f2351734280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1672482600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw/ECrfDcd9QbqQPtRjskZloYGNZPkFIL5OgMZaAzBKHgr2wR9LPgYHvjWQtP/ENU1K7ZkOTreMGB+qSLf+Vw8CjhOSPt5VXiyl+dIYdkpnaAKYnQt0EzkI+veOXwKucw=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:36.503813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a59ff071-3fb9-481c-bf1b-1837717565b1 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:36.511543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-a59ff071-3fb9-481c-bf1b-1837717565b1 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for user 4864b5d5cefa4fa593bb2adeb46c04d1 and project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:36.543512 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a59ff071-3fb9-481c-bf1b-1837717565b1 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.061275 Sep 08 10:49:36.548351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2877/5977] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:49:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:36.851253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:36.852906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:36.865769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:36.869708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:36.870525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:36.871171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:36.872235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:36.873102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:36.873756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.061991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:37.062882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:37.072517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.078330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.081255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.086939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.087830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.088449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.405423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.415323 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-32838335-944c-4d77-92c2-e4e6acac7efd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.570393 Sep 08 10:49:37.430140 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3101/5978] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:36 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:37.446023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:37.446852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:37.454284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.455220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.455972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.456903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.457536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.458140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.491191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.516874 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7900978c-7048-4f59-b8b5-05ce0da3e7ca tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.458773 Sep 08 10:49:37.517509 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2878/5979] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:37 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:37.903913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:37.916843 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11bdd0a7-2b40-4f9f-9fdb-11877e9a0a93 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.478700 Sep 08 10:49:37.917700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3102/5980] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:37 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:37.945759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:37.946908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:37.955281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.956095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.956795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:37.957637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:37.957974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:37.958402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.024623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Unlocking {{(pid=122456) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 08 10:49:38.096088 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4714a51-595f-490e-999e-3d58aa2c3331 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.155550 Sep 08 10:49:38.111346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:38.113413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:38.113818 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2879/5981] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:37 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:38.126292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.127211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.127926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.129162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.129913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.130642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.402877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:38.417866 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2d7a70aa-c236-45cf-8d34-a658edc8813d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.314281 Sep 08 10:49:38.429852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3103/5982] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:38 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:38.442658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:38.443598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:38.449972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.450982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.451680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.452380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.453023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.453634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.546583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:38.547440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:38.561813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.563635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.565416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.567663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.568537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.569217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.812737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:38.817312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:38.828784 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-69412ce4-19fc-4c06-b9bf-bdd57094b1b6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.383911 Sep 08 10:49:38.830208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2880/5983] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:38 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:38.854229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:38.855508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:38.872887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.873582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.874042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.874766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:38.875224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:38.875714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:38.913484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:38.923384 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ea568cc8-67aa-4ff9-8adf-841cc59399a6 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.382022 Sep 08 10:49:38.927749 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3104/5984] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:38 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:39.173239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:39.204527 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-582756a6-f071-4cd1-826b-ce69bd0fa1d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.354918 Sep 08 10:49:39.206857 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2881/5985] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:38 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:39.231860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:39.232406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:39.250009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:39.250515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:39.251002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:39.251730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:39.252189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:39.252830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:39.359486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f3da22f-e1d9-4876-86e5-c0d591fb39f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.131382 Sep 08 10:49:39.360888 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3105/5986] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:39 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:39.378765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:39.382639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:39.402607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:39.403519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:39.418409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:39.421213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:39.422101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:39.425324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:39.783069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-781959439", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "7bc4a01a-17fd-4359-bd42-f03760997b85"}], "key_name": "tempest-TestNetworkBasicOps-1672482600", "security_groups": [{"name": "tempest-secgroup-smoke-1543680173"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:39.976806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:40.004287 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-295440a4-2ee0-43b6-a9f0-376550e7e06f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1675 microversion: 2.1 time: 0.636855 Sep 08 10:49:40.010723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2882/5987] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:39 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1675 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:40.026548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:40.027489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:40.052634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:40.053382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:40.053929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:40.054789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:40.055359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:40.058813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:40.214139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] validate_networks() for [('7bc4a01a-17fd-4359-bd42-f03760997b85', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:49:40.442663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:40.453584 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-312fa6ff-902b-4905-94e1-d9ae931ffb69 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.440432 Sep 08 10:49:40.455100 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2883/5988] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:40 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:40.989529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:49:40.989985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:49:40.990473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:49:40.990890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:49:40.991311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:49:41.006830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.010279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.010734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.011513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.012005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.013024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.037472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:41.040741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:41.043426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:49:41.051244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Getting quotas for user 4864b5d5cefa4fa593bb2adeb46c04d1 and project 0b5f3a5e35a248b8b6c85535e4e59b7b. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:49:41.062911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.063415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.063974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.064617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.065088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.070248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:49:41.074550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:49:41.078074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.149007 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a7b4cda-2412-412a-8253-887335be186f tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.370381 Sep 08 10:49:41.150053 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3106/5989] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:49:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:49:41.182522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07af3753-440a-4f0a-b8e2-6367c35c00a0 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:41.183959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07af3753-440a-4f0a-b8e2-6367c35c00a0 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:41.339717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07af3753-440a-4f0a-b8e2-6367c35c00a0 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:41.350251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07af3753-440a-4f0a-b8e2-6367c35c00a0 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1248 microversion: 2.1 time: 0.185105 Sep 08 10:49:41.353572 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3107/5990] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:41 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1248 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:41.401139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:41.420345 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d01f5588-fbf4-48e9-b265-a97580f41741 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1655 microversion: 2.1 time: 0.388445 Sep 08 10:49:41.421502 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2884/5991] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:41 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1655 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:41.433830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d1f97c91-328b-4178-9409-df8d34ce270a req-503f694d-8f65-4d2d-927f-a21d18100e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f3fd28-fc68-46a6-aaca-ac804c20c75a", "name": "network-vif-plugged", "status": "completed", "tag": "373b8c8a-4c7d-406e-9710-59a11cc15d22"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:41.445028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:41.446064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:41.455710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d1f97c91-328b-4178-9409-df8d34ce270a req-503f694d-8f65-4d2d-927f-a21d18100e3b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.456861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d1f97c91-328b-4178-9409-df8d34ce270a req-503f694d-8f65-4d2d-927f-a21d18100e3b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.457213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.457725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.458172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.458882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.460174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d1f97c91-328b-4178-9409-df8d34ce270a req-503f694d-8f65-4d2d-927f-a21d18100e3b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.462228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.462867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.495727 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d1f97c91-328b-4178-9409-df8d34ce270a req-503f694d-8f65-4d2d-927f-a21d18100e3b service nova] Creating event network-vif-plugged:373b8c8a-4c7d-406e-9710-59a11cc15d22 for instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a on n-h2-833090-19 Sep 08 10:49:41.512877 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d1f97c91-328b-4178-9409-df8d34ce270a req-503f694d-8f65-4d2d-927f-a21d18100e3b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087395 Sep 08 10:49:41.515810 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3108/5992] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:41.530207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:41.534259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:41.542370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:41.560493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.562026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.562688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.564233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.564923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.565778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.640697 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd33b5b1-29b1-476c-a2c2-aadaaa2a2b82 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.198956 Sep 08 10:49:41.641718 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2885/5993] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:41 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:49:41.655602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:41.659451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:41.670638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.671510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.672238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:41.673221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:41.674193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:41.674852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.060681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:42.072634 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c48e4081-43d9-4c54-ad34-5f05596a9988 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1662 microversion: 2.1 time: 0.423624 Sep 08 10:49:42.073161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2886/5994] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:41 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1662 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:42.110147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:42.124068 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cdeb7a11-6596-4cf9-8bf3-8bce24d0bf63 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.603763 Sep 08 10:49:42.126601 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3109/5995] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:41 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:42.332946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:42.335628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:42.346288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.346876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.348259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.349072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.349638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.350220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.378788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:42.381347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:42.391318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.392674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.393344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.394376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:42.395043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:42.395725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:42.433580 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a387d1b9-ee5e-4551-889c-6c76b41fba6d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action" status: 200 len: 24570 microversion: 2.1 time: 0.105264 Sep 08 10:49:42.435882 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2887/5996] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:42 2022] POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action => generated 24570 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:49:42.515361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:42.550268 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-629f95f4-87bc-44f2-9647-95478ecfbff9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1252 microversion: 2.1 time: 0.175936 Sep 08 10:49:42.553440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3110/5997] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:42 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1252 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:43.101614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.103020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.111144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.111960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.112663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.113582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.114223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.114835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.151923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.153273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.171920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.172666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.181271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.182472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.188622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.190901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.702488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:43.703677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:43.729468 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ec51e66-3f93-4106-81cf-8d4a8ce37f42 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.631457 Sep 08 10:49:43.730775 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2888/5998] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:43.741300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.741917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.744916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:43.751723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.751885 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e093f340-61fb-4f83-8971-7589b8cf8d2d tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1313 microversion: 2.1 time: 0.607278 Sep 08 10:49:43.752784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.753414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.754373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.755224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.756475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.764218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3111/5999] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:43.775083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:43.775732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:43.783787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.784868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.786278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.787255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:43.787989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:43.788813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:43.997111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.008917 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-274bab28-56d8-45de-bcb7-70b2bf99af48 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1300 microversion: 2.1 time: 0.276147 Sep 08 10:49:44.013109 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2889/6000] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1300 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:44.153785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.169381 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85b2326b-92d6-487d-97d7-494386bda729 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.403966 Sep 08 10:49:44.169989 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3112/6001] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:43 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:44.198925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:44.199572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:44.213028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.217081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.219449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.220498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.221187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.221858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.448480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.459245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-478d1eef-d44b-450f-bfa1-906d0d5cbdc7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.265226 Sep 08 10:49:44.461590 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2890/6002] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:44 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:44.484472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:44.485467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:44.493052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.494471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.495562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.497654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.498490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.499319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.754849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:44.764788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af47132c-edb6-412c-aef7-ed54f14c90c4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.284357 Sep 08 10:49:44.774953 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3113/6003] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:44 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:44.778471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:44.779096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:44.788134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.790501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.793021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.796706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.797420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.798045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.798461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:44.800473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:44.814315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.819861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.821032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:44.823153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:44.826161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:44.827668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.198632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:45.202499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:45.213417 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04405cb4-8f96-47fc-892d-588a0138748e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.420770 Sep 08 10:49:45.213924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:45.215424 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3114/6004] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:44 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:45.242778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:45.243729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:45.248441 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f21d0161-8f86-4bcd-ad35-473ccad009be tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1497 microversion: 2.1 time: 0.474004 Sep 08 10:49:45.249335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2891/6005] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:44 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1497 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:45.255801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.258369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.258673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:45.259118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.259731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:45.259887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.260337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.269767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.270166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.270860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.271507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.272434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:45.273734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:45.274347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:45.658234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:45.685466 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9af90ce5-5179-4097-9848-60d28639c33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.434741 Sep 08 10:49:45.686105 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2892/6006] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:45 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:45.767008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:45.781698 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a75375fb-c600-4572-9baa-13c0440711f8 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.562695 Sep 08 10:49:45.784933 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3115/6007] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:45 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:46.100052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.101600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:46.108917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.110476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.111121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.112193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.113521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.114141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.150845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:49:46.272326 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c555a976-96a2-4f92-a180-4d93534f9ac1 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "DELETE /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 204 len: 0 microversion: 2.1 time: 0.178252 Sep 08 10:49:46.274050 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2893/6008] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:49:46 2022] DELETE /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:49:46.284005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.285011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:46.292896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.294007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.295158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.296102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.296573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.297016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.818551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:46.820829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:46.821557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:46.824523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:46.840993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a87901b0-0d74-4c3c-8ac2-09ed4a8475eb tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1503 microversion: 2.1 time: 0.560468 Sep 08 10:49:46.842040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.842916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.845127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3116/6009] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:46 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1503 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:46.849449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:46.850829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:46.851787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:46.854392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.089610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:47.100440 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cc34137-23d5-417a-a486-a6583221f0a7 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.284007 Sep 08 10:49:47.102181 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2894/6010] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:46 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:47.271924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ff46e28c-c809-4b17-b041-047dea318b52 req-598834f9-9d8d-4628-aaa4-1f9bd4cd43db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b271e83d-7894-4671-8ca9-0736bc1b3cf9", "tag": "1dae152d-5a86-4c47-9fc6-9bcc5495ed01"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:47.281965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ff46e28c-c809-4b17-b041-047dea318b52 req-598834f9-9d8d-4628-aaa4-1f9bd4cd43db service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.282449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ff46e28c-c809-4b17-b041-047dea318b52 req-598834f9-9d8d-4628-aaa4-1f9bd4cd43db service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.282885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ff46e28c-c809-4b17-b041-047dea318b52 req-598834f9-9d8d-4628-aaa4-1f9bd4cd43db service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.296404 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ff46e28c-c809-4b17-b041-047dea318b52 req-598834f9-9d8d-4628-aaa4-1f9bd4cd43db service nova] Creating event network-changed:1dae152d-5a86-4c47-9fc6-9bcc5495ed01 for instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 on n-h2-833090-19 Sep 08 10:49:47.301466 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ff46e28c-c809-4b17-b041-047dea318b52 req-598834f9-9d8d-4628-aaa4-1f9bd4cd43db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Sep 08 10:49:47.302432 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3117/6011] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:49:47.867734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:47.868359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:47.875664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.876417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.877094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.877819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:47.878281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:47.878895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:47.896674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:48.127274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:48.130106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:48.143180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.143701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.144139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:48.144856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.145307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.145730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:48.475447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:48.485858 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-40c8372a-edc5-4616-ba48-e3ffe7c06bb5 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1503 microversion: 2.1 time: 0.622000 Sep 08 10:49:48.499721 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2895/6012] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:47 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:48.680644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:48.681688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:48.688860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.689363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.690021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:48.691111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:48.692025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:48.692783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:48.696131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:48.708720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-389dc57f-352a-490b-9da5-869c56515ca9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.586319 Sep 08 10:49:48.709990 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3118/6013] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:48 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:49.472599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:49.481811 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49b420e5-e3a6-42ad-b932-59c543b72c98 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1682 microversion: 2.1 time: 0.805115 Sep 08 10:49:49.500584 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2896/6014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:48 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1682 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:49.511342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:49.512532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.519725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.520470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.521015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.522109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.522674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.523517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.693687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:49.698730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.705170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.705665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.706315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.707032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.707523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.708164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.767758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8260ba0e-6def-4d06-9813-188b1f9b53a5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action" status: 200 len: 32644 microversion: 2.1 time: 0.077815 Sep 08 10:49:49.769259 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2897/6015] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:49 2022] POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:49:49.783762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:49.784676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:49.793557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.796191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.798372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.799523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:49.800578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:49.801366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:49.804803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:49.816741 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d898d40d-c4a8-44c7-b48b-0890dc680307 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1503 microversion: 2.1 time: 0.310071 Sep 08 10:49:49.817339 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3119/6016] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:49 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1503 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:50.053196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4d664e13-01b8-44f1-96a4-53edbb602fea req-5576eb05-0522-4f4f-b66f-a399fed87a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f3fd28-fc68-46a6-aaca-ac804c20c75a", "name": "network-vif-deleted", "tag": "373b8c8a-4c7d-406e-9710-59a11cc15d22"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:50.063820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4d664e13-01b8-44f1-96a4-53edbb602fea req-5576eb05-0522-4f4f-b66f-a399fed87a76 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.064304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4d664e13-01b8-44f1-96a4-53edbb602fea req-5576eb05-0522-4f4f-b66f-a399fed87a76 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.064956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4d664e13-01b8-44f1-96a4-53edbb602fea req-5576eb05-0522-4f4f-b66f-a399fed87a76 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.078724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4d664e13-01b8-44f1-96a4-53edbb602fea req-5576eb05-0522-4f4f-b66f-a399fed87a76 service nova] Creating event network-vif-deleted:373b8c8a-4c7d-406e-9710-59a11cc15d22 for instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a on n-h2-833090-19 Sep 08 10:49:50.080339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:50.088057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4d664e13-01b8-44f1-96a4-53edbb602fea req-5576eb05-0522-4f4f-b66f-a399fed87a76 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216165 Sep 08 10:49:50.089541 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3120/6017] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:50.099439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:50.100450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:50.109287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.110050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.110228 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34594cc8-6b7c-4b94-bccd-7dd67284a3ff tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.332589 Sep 08 10:49:50.110837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.111526 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2898/6018] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:49 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:50.112118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.112758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.113371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.381040 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dafd1baf-7800-4c99-a98a-950988daf1d5 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1835 microversion: 2.1 time: 0.288780 Sep 08 10:49:50.382323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3121/6019] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:50 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1835 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:50.419328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:50.422943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:50.431906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.432661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.433185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.435634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.436528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.437232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.479549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lazy-loading 'flavor' on Instance uuid 54208b9e-9e64-4d37-a2d5-74f345d0f2be {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:49:50.495815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Going to try to live migrate instance to another host {{(pid=122456) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 10:49:50.850479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:50.852200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:50.861681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.862410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.863074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.864196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:50.864929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:50.866108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:50.988584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:50.998956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac8a4844-55f1-455d-b267-dd40f6849130 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1461 microversion: 2.1 time: 0.158551 Sep 08 10:49:51.000143 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3122/6020] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:50 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1461 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:51.134470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:51.135437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:51.145505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:51.148461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.151888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.153528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.155623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:51.159091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:51.160892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:51.345118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:49:51.396244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:51.408848 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-60a91407-c6d1-4cc1-ad19-ef7953e8a750 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.277964 Sep 08 10:49:51.411572 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3123/6021] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:51 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:52.026310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:52.026310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:52.066668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.067166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.067633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.068508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.069225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.069662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.176116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ea03b0232f4b0ebef40f226f331148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423224ecdf64a9f8fdac0515d27d88f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.188297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17614ec0-5014-4844-8066-2d24a2c09c15 tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 200 len: 1298 microversion: 2.1 time: 0.166817 Sep 08 10:49:52.189751 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3124/6022] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:52 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:52.438348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:52.439136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:52.455853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.457927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.458450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.460517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:52.461347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:52.464199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:52.733102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:52.742865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4c78292-b3e3-4a28-bbd9-27b334168666 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.311186 Sep 08 10:49:52.746978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3125/6023] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:52 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:53.179620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59c96177-91e7-47cf-a5ec-436c246eab59 tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action" status: 202 len: 0 microversion: 2.1 time: 2.766546 Sep 08 10:49:53.189111 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2899/6024] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:49:50 2022] POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action => generated 0 bytes in 2778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:49:53.200550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:53.201484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:53.216367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:53.225434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] [instance: 44f3fd28-fc68-46a6-aaca-ac804c20c75a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:53.228840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.232458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.233181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.235398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.239823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.241613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.244866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.247805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.248516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.252493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.254899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.256509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.294756 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] HTTP exception thrown: Instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a could not be found. Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Request method failure captured: Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a HTTP/1.1 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGciT9hvcWBMuhWj80KrNyVh_VG01zPIBHsqKEPeo_DzFpc-MRNGdsfjFhf4tov3_zQWbZayPTFwHWgi1etjh8usOQaKXy_wPM5vwJwJY7MONba47wnW4OpEsAwG_QkvEhlBRy9z-gxw7EnjnzE4WZ3mGKVEOeMvr8zPEiZAdS3oQFW0 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 1423224ecdf64a9f8fdac0515d27d88f Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesActionsTest-1739801924 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1423224ecdf64a9f8fdac0515d27d88f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1423224ecdf64a9f8fdac0515d27d88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1423224ecdf64a9f8fdac0515d27d88f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1423224ecdf64a9f8fdac0515d27d88f", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesActionsTest-1739801924 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 1423224ecdf64a9f8fdac0515d27d88f Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesActionsTest-1739801924 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesActionsTest-1739801924-project Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 55ea03b0232f4b0ebef40f226f331148 Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesActionsTest-1739801924-project Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a could not be found. Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '44f3fd28-fc68-46a6-aaca-ac804c20c75a'} Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a could not be found. Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a could not be found. Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:49:53.297984 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a could not be found. Sep 08 10:49:53.302519 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:49:53.304349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] Returning 404 to user: Instance 44f3fd28-fc68-46a6-aaca-ac804c20c75a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:49:53.306172 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85d28a17-4dd2-4e92-920f-1da6b905587e tempest-VolumesActionsTest-1739801924 tempest-VolumesActionsTest-1739801924-project] 10.222.0.59 "GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a" status: 404 len: 111 microversion: 2.1 time: 0.096809 Sep 08 10:49:53.307208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2900/6025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:53 2022] GET /compute/v2.1/servers/44f3fd28-fc68-46a6-aaca-ac804c20c75a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:49:53.776058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:53.776998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:53.791782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.792583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.793820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.794993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:53.795672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:53.796674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:53.819843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:53.832927 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5de1e523-62a5-4c9c-a86a-baa725551ac4 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.639490 Sep 08 10:49:53.843496 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3126/6026] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:53 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:54.236913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:54.254862 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-266e5625-7878-421d-965e-c9e28d32f712 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.487673 Sep 08 10:49:54.256147 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2901/6027] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:53 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:54.863202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:54.863947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:54.882379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.884133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.884764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:54.889477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:54.891437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:54.892769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.282566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:55.284180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:55.297993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.298981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.300105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.301021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.301755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.302363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.327198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:55.338150 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f3a42983-11d7-4f26-b607-5b7596f6911c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.480219 Sep 08 10:49:55.339381 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3127/6028] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:54 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:55.662277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:55.672214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c197af50-96a7-4432-a497-097a82dfa0ab tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.397439 Sep 08 10:49:55.690456 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2902/6029] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:55 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:55.729523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-dbafc5fe-406f-4023-882b-b3399aeec8c2 req-c01a22d5-823b-423c-8469-fbf75eefe3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271e83d-7894-4671-8ca9-0736bc1b3cf9", "name": "network-vif-plugged", "status": "completed", "tag": "1dae152d-5a86-4c47-9fc6-9bcc5495ed01"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:55.752107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dbafc5fe-406f-4023-882b-b3399aeec8c2 req-c01a22d5-823b-423c-8469-fbf75eefe3a7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.753706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dbafc5fe-406f-4023-882b-b3399aeec8c2 req-c01a22d5-823b-423c-8469-fbf75eefe3a7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.755128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dbafc5fe-406f-4023-882b-b3399aeec8c2 req-c01a22d5-823b-423c-8469-fbf75eefe3a7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.770350 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-dbafc5fe-406f-4023-882b-b3399aeec8c2 req-c01a22d5-823b-423c-8469-fbf75eefe3a7 service nova] Creating event network-vif-plugged:1dae152d-5a86-4c47-9fc6-9bcc5495ed01 for instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 on n-h2-833090-19 Sep 08 10:49:55.779045 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-dbafc5fe-406f-4023-882b-b3399aeec8c2 req-c01a22d5-823b-423c-8469-fbf75eefe3a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054353 Sep 08 10:49:55.779978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3128/6030] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:55.803649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-459764d1-25a8-49ba-b4a5-299ca76b3744 req-c1d83267-fa11-47a5-a439-f4f8f730285d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "name": "network-vif-unplugged", "status": "completed", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:55.814051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-459764d1-25a8-49ba-b4a5-299ca76b3744 req-c1d83267-fa11-47a5-a439-f4f8f730285d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:55.815076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-459764d1-25a8-49ba-b4a5-299ca76b3744 req-c1d83267-fa11-47a5-a439-f4f8f730285d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:55.815545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-459764d1-25a8-49ba-b4a5-299ca76b3744 req-c1d83267-fa11-47a5-a439-f4f8f730285d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:55.851919 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-459764d1-25a8-49ba-b4a5-299ca76b3744 req-c1d83267-fa11-47a5-a439-f4f8f730285d service nova] Creating event network-vif-unplugged:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h1-833090-19 Sep 08 10:49:55.874304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-459764d1-25a8-49ba-b4a5-299ca76b3744 req-c1d83267-fa11-47a5-a439-f4f8f730285d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060516 Sep 08 10:49:55.875687 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2903/6031] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:56.363051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:56.364114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:56.377816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.378523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.379921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:56.380899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.384671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.386317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:56.696718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:56.697348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:56.718154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.718666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.719116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:56.719882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:56.722512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:56.727360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:57.007055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:57.017130 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd525f4a-2978-4df5-90ae-dda168136f9a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.658562 Sep 08 10:49:57.020487 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3129/6032] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:56 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:57.213585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:57.225681 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f132ee1-bdd7-44f0-83b1-237d27efde29 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1374 microversion: 2.1 time: 0.533461 Sep 08 10:49:57.226769 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2904/6033] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:56 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1374 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:58.055312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:58.056736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:58.077867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.078607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.079210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.080124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.080720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.081326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.251077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:58.251661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:58.261183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.274182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.275137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.276660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.277266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.278972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.564707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:58.660880 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ecab483-ac7c-41f4-bda6-e90a0941a633 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.618321 Sep 08 10:49:58.663753 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3130/6034] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:58 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:58.669609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-74da5ab3-6658-4705-8356-4aa85a341e28 req-78756975-1e7b-471e-b446-0535cd010fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:49:58.690449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-74da5ab3-6658-4705-8356-4aa85a341e28 req-78756975-1e7b-471e-b446-0535cd010fa1 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:58.691505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-74da5ab3-6658-4705-8356-4aa85a341e28 req-78756975-1e7b-471e-b446-0535cd010fa1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:58.705156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-74da5ab3-6658-4705-8356-4aa85a341e28 req-78756975-1e7b-471e-b446-0535cd010fa1 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:58.730072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-74da5ab3-6658-4705-8356-4aa85a341e28 req-78756975-1e7b-471e-b446-0535cd010fa1 service nova] Creating event network-changed:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h1-833090-19 Sep 08 10:49:58.738939 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-74da5ab3-6658-4705-8356-4aa85a341e28 req-78756975-1e7b-471e-b446-0535cd010fa1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073293 Sep 08 10:49:58.741196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3131/6035] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:49:59.084962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:59.094926 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01b77711-3ebb-4977-84f7-6a962843e745 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1546 microversion: 2.1 time: 0.847809 Sep 08 10:49:59.103241 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2905/6036] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:58 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1546 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:49:59.127893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.128513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:59.143794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.144311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.144895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.148337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.148897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.149739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.692449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:49:59.693921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:49:59.716189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.718840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.720422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:49:59.722711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:49:59.722840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:49:59.730033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b5ad858-2da0-481a-b582-653a958e7a8e tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1546 microversion: 2.1 time: 0.607503 Sep 08 10:49:59.735613 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3132/6037] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:59 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1546 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:49:59.748074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:49:59.748074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:00.155334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:00.187413 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2590ce87-c871-48aa-8463-2e9dc23ec415 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.499763 Sep 08 10:50:00.188296 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2906/6038] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:49:59 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:01.220333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:01.222998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:01.255286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.257034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.258350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:01.262255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:01.263752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:01.265046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:01.824253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:01.851934 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aa40cbc4-98ff-4520-980f-fbd8d90e44c3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.639416 Sep 08 10:50:01.853938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3133/6039] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:01 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:02.894381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:02.895001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:02.912361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:02.913359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:02.914061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:02.915036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:02.915739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:02.916734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:03.311684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:03.327110 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f19b108-c5cb-474a-83ce-9744301cc095 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.434569 Sep 08 10:50:03.329037 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2907/6040] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:02 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:04.246723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8abd924e-f04b-4f25-ac50-5b520cb8b0d7 req-5e5c0328-a2c5-4ee6-b6d6-44ef60d1b10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b271e83d-7894-4671-8ca9-0736bc1b3cf9", "tag": "1dae152d-5a86-4c47-9fc6-9bcc5495ed01"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:04.267841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8abd924e-f04b-4f25-ac50-5b520cb8b0d7 req-5e5c0328-a2c5-4ee6-b6d6-44ef60d1b10c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.268331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8abd924e-f04b-4f25-ac50-5b520cb8b0d7 req-5e5c0328-a2c5-4ee6-b6d6-44ef60d1b10c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.275994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8abd924e-f04b-4f25-ac50-5b520cb8b0d7 req-5e5c0328-a2c5-4ee6-b6d6-44ef60d1b10c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.311869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:04.314001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8abd924e-f04b-4f25-ac50-5b520cb8b0d7 req-5e5c0328-a2c5-4ee6-b6d6-44ef60d1b10c service nova] Creating event network-changed:1dae152d-5a86-4c47-9fc6-9bcc5495ed01 for instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 on n-h2-833090-19 Sep 08 10:50:04.345014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8abd924e-f04b-4f25-ac50-5b520cb8b0d7 req-5e5c0328-a2c5-4ee6-b6d6-44ef60d1b10c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102120 Sep 08 10:50:04.353646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:04.354941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:04.360795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3134/6041] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:04.365979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.372234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.372964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.374043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:04.374673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:04.376740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:04.793434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:04.805963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c87f0d4-35d2-42ef-9e5c-30afce553321 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.457660 Sep 08 10:50:04.806994 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2908/6042] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:04 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:05.835642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:05.836747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:05.869486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:05.878230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:05.881683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:05.883326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:05.886489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:05.892788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:06.282777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:06.298361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0068eb43-c6fc-4f24-ad65-9ce99851f1b8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.470652 Sep 08 10:50:06.301619 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3135/6043] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:05 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:07.322367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:07.323084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:07.334886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.336878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.339341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.341617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:07.342817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:07.346485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:07.995560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:08.017819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42b76d42-f9c1-4cdf-a635-15ae58517da2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.699293 Sep 08 10:50:08.031510 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2909/6044] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:07 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:09.049477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:09.050445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:09.067204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.070391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.071556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.079932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:09.082935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:09.092507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:09.407223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:09.418734 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-643fca8c-2346-43d6-928a-71f3a516fc55 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.373545 Sep 08 10:50:09.419928 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3136/6045] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:09 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:10.444528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:10.445321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:10.474509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:10.481765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:10.485752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:10.490009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:10.490559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:10.492479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:10.949893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:10.961083 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55aca303-c195-4e37-8df5-6cb428650f94 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1692 microversion: 2.1 time: 0.521302 Sep 08 10:50:10.966521 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2910/6046] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:10 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1692 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:11.195244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:11.197738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:11.213149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.215735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.216420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.218298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.218954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.219692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.408081 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55935249-0da1-428e-947f-8b246019c0c7 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.554178 Sep 08 10:50:11.425928 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3137/6047] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:50:10 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:50:11.431433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:11.433883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:11.452501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.457743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.458653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.459945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:11.460624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:11.461299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:11.919896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:11.929885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:11.948178 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-60381d86-607d-4363-b3a1-f4204e23f184 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1672 microversion: 2.1 time: 0.525888 Sep 08 10:50:11.952401 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2911/6048] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:11 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1672 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:11.991183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:11.991938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:12.017142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=58 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:12.025556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.029930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.033971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.034915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.038005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.039675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.418926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:12.435797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-63a83bb5-6e16-4400-90cc-d3d1f4cdf3ff tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1682 microversion: 2.1 time: 0.449286 Sep 08 10:50:12.436663 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3138/6049] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:11 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:12.461210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:12.462873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:12.482675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.484654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.486054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.487452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.489225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.489992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.900708 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70a09731-e61e-4540-92fd-b6fce9f4448e tempest-TestNetworkAdvancedServerOps-948682515 tempest-TestNetworkAdvancedServerOps-948682515-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1835 microversion: 2.1 time: 0.442544 Sep 08 10:50:12.902564 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2912/6050] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:12 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1835 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:12.927707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:12.928336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:12.939712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.940305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.940761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.941484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.941944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.942379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.977004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:12.977859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:12.987291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.990621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.991272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:12.992189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:12.996865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:12.997325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:13.277339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:13.290554 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2004206e-188a-45c8-85f5-796e92f53398 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1672 microversion: 2.1 time: 0.317764 Sep 08 10:50:13.291376 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2913/6051] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:12 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1672 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:13.313148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:13.359966 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b6ca8e42-8090-4185-8ee0-0b683c0e1851 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1682 microversion: 2.1 time: 0.436886 Sep 08 10:50:13.362475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3139/6052] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:12 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1682 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:13.579027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:13.589547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:13.603502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:13.603999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:13.607779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:13.608549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:13.609023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:13.609474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:13.737171 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42b7e0c2-897e-4100-93af-3d8069a7e0a8 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action" status: 200 len: 38671 microversion: 2.1 time: 0.162227 Sep 08 10:50:13.737860 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2914/6053] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:50:13 2022] POST /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be/action => generated 38671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:50:14.322362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:14.324145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:14.340984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.341925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.342544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.343490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:14.344253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:14.344902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:14.579736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:14.590302 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe5b3607-8e9a-4ca6-bb05-200d0d56863e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.271548 Sep 08 10:50:14.610871 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3140/6054] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:14 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:15.627742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:15.628450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:15.631218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:15.642070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6f04faa1-6df0-43a7-9049-392e387e690d req-4c89d909-c9f4-47c8-b7f7-1e135f2006f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:15.652756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:15.656258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:15.658896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:15.659902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:15.663779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:15.664799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:15.668787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6f04faa1-6df0-43a7-9049-392e387e690d req-4c89d909-c9f4-47c8-b7f7-1e135f2006f8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:15.673913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6f04faa1-6df0-43a7-9049-392e387e690d req-4c89d909-c9f4-47c8-b7f7-1e135f2006f8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:15.674393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6f04faa1-6df0-43a7-9049-392e387e690d req-4c89d909-c9f4-47c8-b7f7-1e135f2006f8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:15.705740 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6f04faa1-6df0-43a7-9049-392e387e690d req-4c89d909-c9f4-47c8-b7f7-1e135f2006f8 service nova] Creating event network-changed:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h2-833090-19 Sep 08 10:50:15.717851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6f04faa1-6df0-43a7-9049-392e387e690d req-4c89d909-c9f4-47c8-b7f7-1e135f2006f8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079380 Sep 08 10:50:15.719552 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3141/6055] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:15.740026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:50:15.994398 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9802ba12-12c5-4eec-90cb-5ef00f893b9b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 204 len: 0 microversion: 2.1 time: 0.369916 Sep 08 10:50:16.007330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:16.008355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:16.011175 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2915/6056] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:50:15 2022] DELETE /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:50:16.023927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.024538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.025169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.027347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:16.030902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:16.031613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:16.629021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:16.650123 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a34ed430-28bb-49b0-a950-34051b7b4b35 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1688 microversion: 2.1 time: 0.648254 Sep 08 10:50:16.652641 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3142/6057] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:15 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1688 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:17.688606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:17.689322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:17.714215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.714685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.718286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:17.724055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:17.724820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:17.728396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:18.233504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:18.243772 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03688b74-4b86-49ca-be0a-56c93929adb2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 200 len: 1569 microversion: 2.1 time: 0.560103 Sep 08 10:50:18.249024 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2916/6058] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:17 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 1569 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:18.723147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-94f5a084-92b3-44c2-93a6-db7035e356da req-ad44b8a0-87d5-4088-bacb-1907b88f451f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54208b9e-9e64-4d37-a2d5-74f345d0f2be", "name": "network-vif-deleted", "tag": "88754a7f-a9ea-4f51-9af5-91aee788c7b7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:18.763874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94f5a084-92b3-44c2-93a6-db7035e356da req-ad44b8a0-87d5-4088-bacb-1907b88f451f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:18.768060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94f5a084-92b3-44c2-93a6-db7035e356da req-ad44b8a0-87d5-4088-bacb-1907b88f451f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:18.771104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-94f5a084-92b3-44c2-93a6-db7035e356da req-ad44b8a0-87d5-4088-bacb-1907b88f451f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:18.812006 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-94f5a084-92b3-44c2-93a6-db7035e356da req-ad44b8a0-87d5-4088-bacb-1907b88f451f service nova] Creating event network-vif-deleted:88754a7f-a9ea-4f51-9af5-91aee788c7b7 for instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be on n-h2-833090-19 Sep 08 10:50:18.844571 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-94f5a084-92b3-44c2-93a6-db7035e356da req-ad44b8a0-87d5-4088-bacb-1907b88f451f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118931 Sep 08 10:50:18.847158 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3143/6059] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:19.278303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:19.281516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 54208b9e-9e64-4d37-a2d5-74f345d0f2be] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:19.309997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.311352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.311837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.312580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:19.313046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:19.313481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:19.365700 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] HTTP exception thrown: Instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be could not be found. Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Request method failure captured: Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be HTTP/1.1 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcbN7kVDbl2d9xWhQy9sas5ikS1r-wCjGuPvswVLKWW2eYrng081shN3QWLbsrgaqFbv4vkbON5vRl0d7co-dabrh0Zvt1MKDrEfki9ULYJrKU76dsoP9djIO8eKWw8yfgTEjhveMjDLXpNKFMlO1wcWo1CYm8sYRUmIXxhanJzr3_U Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6a37c5b0349d45558389e7e8a15b5f85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c7c9cc09a7b144e69cdf342c8f94680a Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be could not be found. Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '54208b9e-9e64-4d37-a2d5-74f345d0f2be'} Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be could not be found. Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be could not be found. Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:50:19.367971 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be could not be found. Sep 08 10:50:19.372596 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:50:19.374417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Returning 404 to user: Instance 54208b9e-9e64-4d37-a2d5-74f345d0f2be could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:50:19.375861 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fdf3f473-e6bd-48a9-bc78-05f382ebed5d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be" status: 404 len: 111 microversion: 2.1 time: 0.102490 Sep 08 10:50:19.376600 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2917/6060] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:19 2022] GET /compute/v2.1/servers/54208b9e-9e64-4d37-a2d5-74f345d0f2be => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:50:28.171219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f69402b7-629d-4e18-bb45-cac566af505a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '.version_select at 0x7f23504bd430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:28.223112 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f69402b7-629d-4e18-bb45-cac566af505a tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1129632549" status: 202 len: 0 microversion: 2.1 time: 0.057157 Sep 08 10:50:28.224771 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3144/6061] 10.222.0.59 () {58 vars in 1284 bytes} [Thu Sep 8 10:50:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1129632549 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:50:28.260151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb8ebdbc-7742-4556-973a-8052c37bdec0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: .version_select at 0x7f235006bca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-94127107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaVmg/ZDf4qkutk1cEEVHxcGEJnmhWpmlFg/VvriU5piFvj/zCjlhXlczZMXjBkSIi0aKJYwubnirwu5EeHwLuSXG1c9TB17l+z3Dl0KtG5hRc8ptvu7feS21T2GwoPwA=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:28.344886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-bb8ebdbc-7742-4556-973a-8052c37bdec0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:28.362524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-bb8ebdbc-7742-4556-973a-8052c37bdec0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:28.446362 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb8ebdbc-7742-4556-973a-8052c37bdec0 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.190121 Sep 08 10:50:28.448550 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2918/6062] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:50:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:36.774447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:36.777120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:36.805654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:36.814384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.816825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.817499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.819301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:36.820028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:36.820703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:36.926813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d129bfba-f555-4c9f-b282-be12e9e5a06d tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9/action" status: 200 len: 24575 microversion: 2.1 time: 0.156160 Sep 08 10:50:36.938036 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3145/6063] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:50:36 2022] POST /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9/action => generated 24575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:50:39.836283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1198749349", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "f882e246-f972-4a07-88c2-fe3f11fbdcf7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-94127107", "security_groups": [{"name": "tempest-secgroup-smoke-241829060"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:39.865360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:39.872553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:39.874060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:40.148958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] validate_networks() for [('f882e246-f972-4a07-88c2-fe3f11fbdcf7', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:41.120663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:41.122338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:41.123099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:41.123776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:41.124578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:41.161485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.166742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.168598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.170980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:41.172732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:41.177361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:41.259022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:41.286107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Getting quotas for user c7c9cc09a7b144e69cdf342c8f94680a and project 6a37c5b0349d45558389e7e8a15b5f85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:41.313426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:41.318360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:41.376108 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9d306cda-0c5c-4256-9005-091d73f1b7f2 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.545801 Sep 08 10:50:41.377851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2919/6064] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:50:41.393753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9afd234-2d51-4e3b-8f31-74370095257b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:41.396828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b9afd234-2d51-4e3b-8f31-74370095257b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:41.661370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b9afd234-2d51-4e3b-8f31-74370095257b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:41.677788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9afd234-2d51-4e3b-8f31-74370095257b tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1265 microversion: 2.1 time: 0.288433 Sep 08 10:50:41.693331 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3146/6065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:41 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:42.711043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:42.711699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:42.740056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.744105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.744884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:42.745908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:42.746527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:42.748442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:43.411668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:43.421855 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0626fb87-0198-4c85-b1d1-782d48edccbb tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1269 microversion: 2.1 time: 0.718025 Sep 08 10:50:43.447913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2920/6066] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:42 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1269 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:44.450273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:44.450915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:44.453913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:44.484813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.485571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.486032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:44.486809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:44.487279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:44.487917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:45.161955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:45.177425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9df81a4c-3aad-46d7-8940-45e40f3ea3de tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 0.731608 Sep 08 10:50:45.188558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3147/6067] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:44 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:46.215211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:46.215865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:46.225766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:46.240338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:46.240827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:46.241927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:46.242094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:46.242547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:46.291604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1265278579", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:46.393407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] validate_networks() for None {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:46.758245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:46.768043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e9e239af-49cf-49c8-84c3-a57d850098f9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 0.556752 Sep 08 10:50:46.769533 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2921/6068] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:46 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:46.775544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:46.776407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:46.784106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:46.784787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:46.785239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:46.785956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:46.786419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:46.786855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.098116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:47.098999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:47.100010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:47.100582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:47.102145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:47.114443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.115743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.116368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.117512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.118464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.119058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.138056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.148871 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a06ff3f0-ec49-4a19-9c09-6b00868f6074 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.378086 Sep 08 10:50:47.150036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2922/6069] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:46 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:47.160143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Getting quotas for project 6950c753eeeb4dc183e8a934656c25d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:47.168650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Getting quotas for user fa7df5d466e8483b89a8c723ca6829f5 and project 6950c753eeeb4dc183e8a934656c25d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:47.181467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-227d8df0-b783-4995-bd83-b5e44aa6dd2d req-e52b277f-9f2f-4066-a503-4ee954bf4f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c465251-1d48-4633-8136-3dc38f9f47e0", "tag": "2866cb9f-26a0-4136-a522-8f39adbe5b5a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:47.193525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-227d8df0-b783-4995-bd83-b5e44aa6dd2d req-e52b277f-9f2f-4066-a503-4ee954bf4f7f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.194763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-227d8df0-b783-4995-bd83-b5e44aa6dd2d req-e52b277f-9f2f-4066-a503-4ee954bf4f7f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.195397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-227d8df0-b783-4995-bd83-b5e44aa6dd2d req-e52b277f-9f2f-4066-a503-4ee954bf4f7f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.197734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:47.212845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:47.228279 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-227d8df0-b783-4995-bd83-b5e44aa6dd2d req-e52b277f-9f2f-4066-a503-4ee954bf4f7f service nova] Creating event network-changed:2866cb9f-26a0-4136-a522-8f39adbe5b5a for instance 6c465251-1d48-4633-8136-3dc38f9f47e0 on n-h1-833090-19 Sep 08 10:50:47.236164 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-227d8df0-b783-4995-bd83-b5e44aa6dd2d req-e52b277f-9f2f-4066-a503-4ee954bf4f7f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059335 Sep 08 10:50:47.237393 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2923/6070] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:47.247188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.250813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.265751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.267731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.268695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.269722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.270467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.271747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.338902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-01cf604a-060d-4fd5-a8e5-a45093bf451b tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053800 Sep 08 10:50:47.339619 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3148/6071] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:50:47.355214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f1b0120-cdd1-4f3b-92b4-f2c99ce47ae3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.355915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f1b0120-cdd1-4f3b-92b4-f2c99ce47ae3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.526813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f1b0120-cdd1-4f3b-92b4-f2c99ce47ae3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.547764 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f1b0120-cdd1-4f3b-92b4-f2c99ce47ae3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1214 microversion: 2.1 time: 0.196908 Sep 08 10:50:47.559700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3149/6072] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:47.705744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:47.720097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7582042-6244-419a-9da0-277a0e65bc97 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.481307 Sep 08 10:50:47.732216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2924/6073] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:47.743604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.744165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.753321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.760557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.761221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.762131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.762775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.763358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.793781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:47.794270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:47.803278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.805307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.805826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:47.806563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:47.807028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:47.807547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.094563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:48.108500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-962600ad-2c70-4085-9063-9d499542f426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 0.320645 Sep 08 10:50:48.109110 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2925/6074] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:48.167543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:48.177064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6358b0e5-f011-4a13-b305-9a074ebe54fe tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.437880 Sep 08 10:50:48.181462 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3150/6075] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:47 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:48.204542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:48.205073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:48.211319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.212096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.212689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.213718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.214333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.214934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.448441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:48.458078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-29569297-eca9-438c-85c1-9d6884543378 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.257577 Sep 08 10:50:48.459329 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2926/6076] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:48 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:48.580166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:48.582808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:48.602132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.604956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.605716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.606785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:48.607487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:48.608127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:48.704606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1316170408", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4f75c36b-02be-41ce-8aa0-0baf209b7e24"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:48.799324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] validate_networks() for [('4f75c36b-02be-41ce-8aa0-0baf209b7e24', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:50:48.808606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:48.818398 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10ac7186-e89f-4801-b34f-deff996ee4c6 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1266 microversion: 2.1 time: 0.250744 Sep 08 10:50:48.819247 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3151/6077] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:48 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:49.134814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:49.136147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:49.150113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.150464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.150905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:49.151648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:49.152114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:49.152760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.177661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.186604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a93b9f3a-9d61-48cd-a91d-97c5a1fae941 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 1.055665 Sep 08 10:50:50.188902 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3152/6078] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:49 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:50.202808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:50.203051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:50.241394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.241908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.242361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.243125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.243782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.244368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.386982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:50.403525 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe7f2b47-d9f6-422c-94c6-0d72035a61d9 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1272 microversion: 2.1 time: 0.211859 Sep 08 10:50:50.406482 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3153/6079] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:50 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:50.719106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:50:50.719625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:50:50.720091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:50:50.720662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:50:50.722071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:50:50.733016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.733739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.734324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.735225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:50.735848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:50.736417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:50.761864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:50:50.768151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for user dfc0dd22092d4110b24c5fa4efd5d9f2 and project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:50:50.785395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:50:50.788263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:50:50.889303 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-341e0744-e72e-4cfb-8795-35f7f2e784d4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190629 Sep 08 10:50:50.890551 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2927/6080] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:50:50.904514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-23abded0-7fb8-40f5-a832-9c4bfdf86820 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:50.905865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-23abded0-7fb8-40f5-a832-9c4bfdf86820 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:51.056910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-23abded0-7fb8-40f5-a832-9c4bfdf86820 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.071827 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-23abded0-7fb8-40f5-a832-9c4bfdf86820 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1215 microversion: 2.1 time: 0.170047 Sep 08 10:50:51.090466 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3154/6081] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:50 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:51.213794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:51.214660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:51.234122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.234962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.235586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.236467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.237441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.238140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.437776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:51.438411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:51.450874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.451738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.452659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.453855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:51.454651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:51.455619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:51.547623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.556198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e0295be4-fb83-4f4f-bd62-80fd841025a9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 0.348480 Sep 08 10:50:51.564325 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2928/6082] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:51 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:51.656184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:51.665418 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-55d66ee3-6c70-4653-bad8-673fcb5aed98 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1272 microversion: 2.1 time: 0.236107 Sep 08 10:50:51.667418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3155/6083] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:51 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:52.097743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:52.098500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:52.126936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.129563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.131611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.133884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.136731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.137386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.357539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:52.372702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87c60456-a153-4ea5-9264-dceccf2d98ad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1267 microversion: 2.1 time: 0.279390 Sep 08 10:50:52.382539 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2929/6084] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:52 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:52.590662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:52.591440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:52.609390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.614841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.616043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.617104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.617630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.618068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.693826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:52.695571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:52.713451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.714178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.715452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:52.716798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:52.717857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:52.718472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.363313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.382653 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83937634-97ed-42d4-b50f-d0e0941739ba tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 0.794777 Sep 08 10:50:53.385533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3156/6085] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:52 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:53.436731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.450974 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-973fa718-506d-44b9-a06a-5b46738e7520 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.760331 Sep 08 10:50:53.453236 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2930/6086] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:52 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:53.465647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:53.468905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:53.485363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.486441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.487120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.489307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.490237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.493375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.682639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:53.710834 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-027f4053-2b0c-462a-a06b-63ead63e552a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1273 microversion: 2.1 time: 0.255090 Sep 08 10:50:53.715418 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2931/6087] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:53 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:53.829187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9386e620-d0d3-4979-b61d-5bc52b7f30e3 req-a376f148-cf3f-424f-89b4-298b5e32ff87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c465251-1d48-4633-8136-3dc38f9f47e0", "name": "network-vif-plugged", "status": "completed", "tag": "2866cb9f-26a0-4136-a522-8f39adbe5b5a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:53.849261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9386e620-d0d3-4979-b61d-5bc52b7f30e3 req-a376f148-cf3f-424f-89b4-298b5e32ff87 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:53.849988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9386e620-d0d3-4979-b61d-5bc52b7f30e3 req-a376f148-cf3f-424f-89b4-298b5e32ff87 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:53.850611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9386e620-d0d3-4979-b61d-5bc52b7f30e3 req-a376f148-cf3f-424f-89b4-298b5e32ff87 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:53.893049 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9386e620-d0d3-4979-b61d-5bc52b7f30e3 req-a376f148-cf3f-424f-89b4-298b5e32ff87 service nova] Creating event network-vif-plugged:2866cb9f-26a0-4136-a522-8f39adbe5b5a for instance 6c465251-1d48-4633-8136-3dc38f9f47e0 on n-h1-833090-19 Sep 08 10:50:53.899723 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9386e620-d0d3-4979-b61d-5bc52b7f30e3 req-a376f148-cf3f-424f-89b4-298b5e32ff87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.511357 Sep 08 10:50:53.900361 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3157/6088] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:54.411804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:54.412860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:54.434571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.438257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.439570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.442605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.445382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.446148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.481417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:54.482576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:54.520573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.521857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.522839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:54.525615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:54.529318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:54.530197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.143125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:55.156766 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ac5d28b7-7fe7-4d2f-892e-0eb884d19dc3 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.681402 Sep 08 10:50:55.157380 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3158/6089] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:54 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:50:55.168139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:55.169397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:55.192890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.193408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.193855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.194585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.197151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.197733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.223788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:55.248196 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df90e151-f265-4fe6-8311-455471a16d0d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1390 microversion: 2.1 time: 0.841507 Sep 08 10:50:55.248814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2932/6090] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:54 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1390 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:55.732323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:55.743663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5c6c927-e852-4969-b595-4aa25e7f1a96 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1273 microversion: 2.1 time: 0.582705 Sep 08 10:50:55.744204 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3159/6091] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:55 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1273 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:55.809233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5d20c9a4-5029-4fe5-812d-ac36405cb129 req-7c4ad014-08b7-402b-994b-e1b1f09ea440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d84c0c-39de-48c6-ae3f-54ca409174b5", "tag": "2be97b60-b14f-4e8f-b10d-7b4491875831"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:55.830603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5d20c9a4-5029-4fe5-812d-ac36405cb129 req-7c4ad014-08b7-402b-994b-e1b1f09ea440 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:55.831096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5d20c9a4-5029-4fe5-812d-ac36405cb129 req-7c4ad014-08b7-402b-994b-e1b1f09ea440 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:55.831569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5d20c9a4-5029-4fe5-812d-ac36405cb129 req-7c4ad014-08b7-402b-994b-e1b1f09ea440 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:55.873155 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5d20c9a4-5029-4fe5-812d-ac36405cb129 req-7c4ad014-08b7-402b-994b-e1b1f09ea440 service nova] Creating event network-changed:2be97b60-b14f-4e8f-b10d-7b4491875831 for instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 on n-h2-833090-19 Sep 08 10:50:55.887229 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5d20c9a4-5029-4fe5-812d-ac36405cb129 req-7c4ad014-08b7-402b-994b-e1b1f09ea440 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081435 Sep 08 10:50:55.888456 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2933/6092] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:50:56.180003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:56.181419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:56.194900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.195407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.206951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.207783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.208263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.208703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.281291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:56.282197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:56.303518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.304735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.306658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.309942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.310880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.312205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.949051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:56.959374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-457e0c98-bb1a-4621-861d-8369b922c14d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1562 microversion: 2.1 time: 0.687166 Sep 08 10:50:56.962537 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2934/6093] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:56 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1562 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:56.970381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:56.974459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:56.988633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:56.990858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.991394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.996705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:56.997495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:56.997988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:56.998436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:57.025734 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4019603-4d70-46d1-9f56-8727911c3b0d tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.849381 Sep 08 10:50:57.045387 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3160/6094] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:56 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:57.052025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:57.053022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:57.071542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:57.072248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:57.072895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:57.073841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:57.074507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:57.075250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:57.141225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:50:57.621671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:57.658336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:57.680041 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5598e748-1725-4fc1-b725-7cac52bab2cf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.715003 Sep 08 10:50:57.680317 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc85d619-7a04-4f75-ae0f-46a346138f23 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1562 microversion: 2.1 time: 0.629355 Sep 08 10:50:57.680933 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3161/6095] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:57 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1562 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:57.683384 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2935/6096] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:56 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:58.056268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:58.057066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:58.067408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.069254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.069865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.071045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.074005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.077408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.445184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:58.468255 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6d8c7fd4-9bda-412d-9d9e-6e1e2aa01261 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.419385 Sep 08 10:50:58.471034 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3162/6097] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:58 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:58.665284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2defffae-7f9f-41b0-883e-3d673a2f7bf0 req-70b2b467-bdfc-44a4-abe3-e1777de4ab98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464177ba-158e-42e3-a6b8-6bd412d8979d", "tag": "2d3b4213-8d43-4d8d-8224-401beb9fbdd7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:50:58.677158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2defffae-7f9f-41b0-883e-3d673a2f7bf0 req-70b2b467-bdfc-44a4-abe3-e1777de4ab98 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.677650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2defffae-7f9f-41b0-883e-3d673a2f7bf0 req-70b2b467-bdfc-44a4-abe3-e1777de4ab98 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.678094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2defffae-7f9f-41b0-883e-3d673a2f7bf0 req-70b2b467-bdfc-44a4-abe3-e1777de4ab98 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.702500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2defffae-7f9f-41b0-883e-3d673a2f7bf0 req-70b2b467-bdfc-44a4-abe3-e1777de4ab98 service nova] Creating event network-changed:2d3b4213-8d43-4d8d-8224-401beb9fbdd7 for instance 464177ba-158e-42e3-a6b8-6bd412d8979d on n-h1-833090-19 Sep 08 10:50:58.709454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:58.710675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:58.724969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.725545 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2defffae-7f9f-41b0-883e-3d673a2f7bf0 req-70b2b467-bdfc-44a4-abe3-e1777de4ab98 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069520 Sep 08 10:50:58.728026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.728528 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2936/6098] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:50:58.729215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.730196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:58.730862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:58.731520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:58.990257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:58.998550 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cbeb0fb-056f-4ffb-be38-258cc2838c3f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.293021 Sep 08 10:50:59.005917 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3163/6099] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:58 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:50:59.499206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:50:59.500259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:50:59.510219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.512193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.513132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:59.514117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:50:59.522114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:50:59.523086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:50:59.819900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:50:59.837265 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a28f24e4-c73d-4cc1-bbdb-8a243217153c tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.341498 Sep 08 10:50:59.838740 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2937/6100] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:50:59 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:00.023004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:00.023823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:00.037842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.038444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.040630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.041456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.050095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.050095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.707479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:00.725947 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4264ec53-60af-476a-8eaf-4861c5ac4f2f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.707994 Sep 08 10:51:00.727792 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3164/6101] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:00 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:00.862341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:00.863627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:00.874566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:00.876180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:00.881044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.881929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.884189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:00.885668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:00.886304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:00.886900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:01.643270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:01.661881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:01.674739 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f93afb6d-9c69-4f4e-952f-aa28e68185bd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.817707 Sep 08 10:51:01.675349 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2938/6102] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:00 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:01.752931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:01.754347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:01.764575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:01.766966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:01.771329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:01.771912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:01.774995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:01.775701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:01.776262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.030773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:02.033306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:02.056867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.059388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.060935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.064540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.065220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.067186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.364467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:02.376305 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b814036-3753-4563-99f6-81d5e3dacac2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.626959 Sep 08 10:51:02.377609 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3165/6103] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:01 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:02.535703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a13c6f5d-bcfb-4190-96d5-3c20c93df6b0 req-b9790010-8488-4e71-adbe-dfb29fdced6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c465251-1d48-4633-8136-3dc38f9f47e0", "tag": "2866cb9f-26a0-4136-a522-8f39adbe5b5a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:02.557850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a13c6f5d-bcfb-4190-96d5-3c20c93df6b0 req-b9790010-8488-4e71-adbe-dfb29fdced6d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.558590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a13c6f5d-bcfb-4190-96d5-3c20c93df6b0 req-b9790010-8488-4e71-adbe-dfb29fdced6d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.558753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a13c6f5d-bcfb-4190-96d5-3c20c93df6b0 req-b9790010-8488-4e71-adbe-dfb29fdced6d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.572125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:02.583920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:02.600809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5595d02-6a61-4faf-822a-9c6951657423 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1562 microversion: 2.1 time: 0.577396 Sep 08 10:51:02.604190 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2939/6104] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:02 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1562 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:02.630923 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a13c6f5d-bcfb-4190-96d5-3c20c93df6b0 req-b9790010-8488-4e71-adbe-dfb29fdced6d service nova] Creating event network-changed:2866cb9f-26a0-4136-a522-8f39adbe5b5a for instance 6c465251-1d48-4633-8136-3dc38f9f47e0 on n-h1-833090-19 Sep 08 10:51:02.649332 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a13c6f5d-bcfb-4190-96d5-3c20c93df6b0 req-b9790010-8488-4e71-adbe-dfb29fdced6d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268443 Sep 08 10:51:02.665184 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3166/6105] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:02.702529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:02.707567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:02.721155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.722183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.723530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:02.727854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:02.730929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:02.731671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.218435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.227027 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ad48cad-2629-4654-82b7-c1962d6e600e tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.529444 Sep 08 10:51:03.227669 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2940/6106] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:02 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:03.402945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:03.403656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:03.423621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.424267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.424995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.426005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.426640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.428384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.810242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:03.827863 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7deff07b-d2c0-4d48-9608-744706384e58 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.424042 Sep 08 10:51:03.829475 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3167/6107] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:03 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:03.843364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2e168f80-e3eb-4d36-9c69-a51b39cd5bc2 req-6c9fbcdf-bdd4-4239-8317-3956b39ae130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d84c0c-39de-48c6-ae3f-54ca409174b5", "name": "network-vif-plugged", "status": "completed", "tag": "2be97b60-b14f-4e8f-b10d-7b4491875831"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:03.858032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2e168f80-e3eb-4d36-9c69-a51b39cd5bc2 req-6c9fbcdf-bdd4-4239-8317-3956b39ae130 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:03.860006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2e168f80-e3eb-4d36-9c69-a51b39cd5bc2 req-6c9fbcdf-bdd4-4239-8317-3956b39ae130 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:03.863699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2e168f80-e3eb-4d36-9c69-a51b39cd5bc2 req-6c9fbcdf-bdd4-4239-8317-3956b39ae130 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:03.884643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2e168f80-e3eb-4d36-9c69-a51b39cd5bc2 req-6c9fbcdf-bdd4-4239-8317-3956b39ae130 service nova] Creating event network-vif-plugged:2be97b60-b14f-4e8f-b10d-7b4491875831 for instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 on n-h2-833090-19 Sep 08 10:51:03.890151 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2e168f80-e3eb-4d36-9c69-a51b39cd5bc2 req-6c9fbcdf-bdd4-4239-8317-3956b39ae130 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051195 Sep 08 10:51:03.891587 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2941/6108] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:04.250302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:04.250935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:04.264842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.265351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.265795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.266702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.267309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.267971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.680030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:04.698208 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbaab081-95cc-49a3-a298-5c2517d934cf tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.451709 Sep 08 10:51:04.699389 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3168/6109] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:04 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:04.855279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:04.856606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:04.872679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.873943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.874721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:04.878236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:04.879033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:04.880575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:05.087960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:05.102572 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d027485f-fe20-450d-89f1-f896227f5131 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.251804 Sep 08 10:51:05.104641 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2942/6110] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:04 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:05.726242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:05.727624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:05.751070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:05.751578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:05.752038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:05.758269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:05.758893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:05.759355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:05.993419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:06.006155 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-71e98df2-deab-4f69-a6dc-2eb2726a28fd tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1314 microversion: 2.1 time: 0.285508 Sep 08 10:51:06.006656 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3169/6111] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:05 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:06.127053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:06.128498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:06.138614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:06.141813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:06.142369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:06.144227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:06.147303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:06.147860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:06.339225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:06.347963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-22542c7b-d503-4e3f-beb8-45765e3d1cf8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.224756 Sep 08 10:51:06.349937 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2943/6112] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:06 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:06.886995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d4bb6b70-7a02-42e7-a3cc-b7490c1d9c79 req-b0054797-3bd8-4dc4-b1e2-7247115c7262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464177ba-158e-42e3-a6b8-6bd412d8979d", "name": "network-vif-plugged", "status": "completed", "tag": "2d3b4213-8d43-4d8d-8224-401beb9fbdd7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:06.918803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d4bb6b70-7a02-42e7-a3cc-b7490c1d9c79 req-b0054797-3bd8-4dc4-b1e2-7247115c7262 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:06.919598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d4bb6b70-7a02-42e7-a3cc-b7490c1d9c79 req-b0054797-3bd8-4dc4-b1e2-7247115c7262 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:06.920178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d4bb6b70-7a02-42e7-a3cc-b7490c1d9c79 req-b0054797-3bd8-4dc4-b1e2-7247115c7262 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:06.935429 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d4bb6b70-7a02-42e7-a3cc-b7490c1d9c79 req-b0054797-3bd8-4dc4-b1e2-7247115c7262 service nova] Creating event network-vif-plugged:2d3b4213-8d43-4d8d-8224-401beb9fbdd7 for instance 464177ba-158e-42e3-a6b8-6bd412d8979d on n-h1-833090-19 Sep 08 10:51:06.942971 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d4bb6b70-7a02-42e7-a3cc-b7490c1d9c79 req-b0054797-3bd8-4dc4-b1e2-7247115c7262 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061595 Sep 08 10:51:06.945250 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3170/6113] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:07.034906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.035964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.044189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.046189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.046852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.047832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.048451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.049036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.277977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.286666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e146ed97-182e-4ef0-af40-0073b3297810 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1464 microversion: 2.1 time: 0.260799 Sep 08 10:51:07.287268 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2944/6114] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:07 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:07.311156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8a5a957-7c29-4621-9d6b-f7bf941f69e1", "device": "/dev/sdb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:07.318407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.335157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.336300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.336685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.337384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.337837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.338264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.370705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:07.371328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:07.377694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.382109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.383191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.383978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:07.384442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:07.392032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:07.619682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:07.633385 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb9aa1ab-9529-4e99-8376-df451706c52b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1315 microversion: 2.1 time: 0.266690 Sep 08 10:51:07.634819 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2945/6115] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:07 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:07.966955 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-299a7d66-3c2a-4581-a3e9-75c2f11ea177 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "POST /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659125 Sep 08 10:51:07.981599 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3171/6116] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 10:51:07 2022] POST /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:07.996867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-684062544", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "38ebc549-689e-4591-8d23-1fbba5f94e19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:08.090110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:51:08.667156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:08.668326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:08.676895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.677706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.678420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:08.679597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:08.680265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:08.680916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.203892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:09.215542 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ebc8696e-c97d-412a-890e-8a29b25bce47 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1502 microversion: 2.1 time: 0.557760 Sep 08 10:51:09.216170 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3172/6117] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:08 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1502 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:09.243744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:09.245141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:09.265979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.266933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.267564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.269034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.271514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.273911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.321137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:51:09.322105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:51:09.322741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:51:09.323308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:51:09.324626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:51:09.338270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.338772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.339220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.340003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:09.340467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:09.340906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:09.403113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:51:09.417056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:51:09.527892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Removing security group 18658726-cd09-46e6-9057-ac7a151195ca from port 2d3b4213-8d43-4d8d-8224-401beb9fbdd7 Sep 08 10:51:09.557748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:51:09.560009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38ebc549-689e-4591-8d23-1fbba5f94e19',volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:51:09.811212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:09.862222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eac38e03-ede3-4846-bdda-8c85683738f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875127 Sep 08 10:51:09.864949 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2946/6118] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:51:09.880213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7893ec1b-5988-4213-ac55-ec40ec50898a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:09.883253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7893ec1b-5988-4213-ac55-ec40ec50898a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:10.113757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7893ec1b-5988-4213-ac55-ec40ec50898a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.125256 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7893ec1b-5988-4213-ac55-ec40ec50898a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1056 microversion: 2.1 time: 0.251178 Sep 08 10:51:10.126990 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2947/6119] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:09 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1056 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:10.372381 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f24cb0a-0ace-4dc2-8efd-b0c3acc998b1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d/action" status: 202 len: 0 microversion: 2.1 time: 1.133729 Sep 08 10:51:10.373639 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3173/6120] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:09 2022] POST /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:51:10.382179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:10.383408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:10.388759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-de79076e-ec19-4ae4-911f-b610c0024c83 req-6f71aceb-2a9e-4735-9039-b7bdb896e9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464177ba-158e-42e3-a6b8-6bd412d8979d", "tag": "2d3b4213-8d43-4d8d-8224-401beb9fbdd7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:10.395945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.399495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.401546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.404489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.406384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.406994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.409648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de79076e-ec19-4ae4-911f-b610c0024c83 req-6f71aceb-2a9e-4735-9039-b7bdb896e9df service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.410272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de79076e-ec19-4ae4-911f-b610c0024c83 req-6f71aceb-2a9e-4735-9039-b7bdb896e9df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.414081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de79076e-ec19-4ae4-911f-b610c0024c83 req-6f71aceb-2a9e-4735-9039-b7bdb896e9df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.440930 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-de79076e-ec19-4ae4-911f-b610c0024c83 req-6f71aceb-2a9e-4735-9039-b7bdb896e9df service nova] Creating event network-changed:2d3b4213-8d43-4d8d-8224-401beb9fbdd7 for instance 464177ba-158e-42e3-a6b8-6bd412d8979d on n-h1-833090-19 Sep 08 10:51:10.452912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-de79076e-ec19-4ae4-911f-b610c0024c83 req-6f71aceb-2a9e-4735-9039-b7bdb896e9df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068322 Sep 08 10:51:10.454579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3174/6121] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:51:10.668520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:10.704720 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a971287d-3e2b-46be-bec1-2d8b6dd379e9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1460 microversion: 2.1 time: 0.326654 Sep 08 10:51:10.706923 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2948/6122] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:10 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1460 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:10.738215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:10.740991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:10.754965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.755737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.757238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:10.759663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:10.761077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:10.762282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.112670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.130671 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5bea54ee-310f-418e-860a-84b34e5319d2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.401135 Sep 08 10:51:11.132372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3175/6123] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:10 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:11.151966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.157269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:11.190214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.191294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.192865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.196358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.197031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.198787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.211586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.212342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:11.251994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.256066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.259236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.260066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.260554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.260999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.513888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.522148 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49757226-f72c-4605-bedf-46fa12142c08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1098 microversion: 2.1 time: 0.376770 Sep 08 10:51:11.533914 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2949/6124] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1098 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:11.711262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:11.724368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-88aab587-bbf7-4287-9f48-f0342ddf4167 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.548050 Sep 08 10:51:11.725193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3176/6125] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:11.748126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:11.748745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:11.760255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.760979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.761565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:11.762443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:11.763046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:11.763666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.008789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.019107 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f4e2410-61bb-44cb-bee9-40f355f2bfd0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.275766 Sep 08 10:51:12.027868 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2950/6126] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:11 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:12.067650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:12.068541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:12.076435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.079164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.079851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.088054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.090265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.091061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.561933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:12.562671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:12.574469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.575211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.575825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.576678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:12.577225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:12.577732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:12.845248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.851947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:12.855165 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-450399ed-e2c1-4465-aa36-564e5d8ce8d8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1172 microversion: 2.1 time: 0.297422 Sep 08 10:51:12.864327 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4e68a62-11a9-4015-a503-e07ffa85979d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.815047 Sep 08 10:51:12.883773 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2951/6127] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:12 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1172 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:12.884931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3177/6128] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:12 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:13.229361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2099733514", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "4f75c36b-02be-41ce-8aa0-0baf209b7e24"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:13.333730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] validate_networks() for [('4f75c36b-02be-41ce-8aa0-0baf209b7e24', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:51:13.883954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:13.885428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:13.898657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.900494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.901738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:13.904046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:13.906062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:13.914401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.049819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.064878 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca71f2ca-8ff2-4f9c-a027-4f8d91066bb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1172 microversion: 2.1 time: 0.186875 Sep 08 10:51:14.065832 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2952/6129] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:13 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1172 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:14.468447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:51:14.469455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:51:14.470096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:51:14.470695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:51:14.471270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:51:14.484626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.489041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.490838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.492604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:14.493263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:14.493874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:14.531138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:14.557572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:51:14.567896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Getting quotas for user dfc0dd22092d4110b24c5fa4efd5d9f2 and project 25af7888ff4a47bb9345d8274b0e61fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:51:14.587846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:51:14.590754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:51:14.667352 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7cc96e81-f1aa-45a8-b97c-e5d556cc3aa4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442106 Sep 08 10:51:14.668595 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3178/6130] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:51:14.680933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5598aaa4-12de-4cdc-bc98-4ffa006b522f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:14.681904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5598aaa4-12de-4cdc-bc98-4ffa006b522f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:14.784580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5598aaa4-12de-4cdc-bc98-4ffa006b522f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:14.800852 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5598aaa4-12de-4cdc-bc98-4ffa006b522f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1215 microversion: 2.1 time: 0.125185 Sep 08 10:51:14.811659 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2953/6131] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:14 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:15.089078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:15.089694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:15.104838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.105333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.106115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.106839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.107303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.107766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.811360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:15.814063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:15.827212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.827950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.828636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.829566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.830228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.830879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.919950 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6f77d88-8f45-457f-9e7e-f0a03b53d5f9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "POST /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9/action" status: 200 len: 32646 microversion: 2.1 time: 0.111411 Sep 08 10:51:15.932392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2954/6132] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:15 2022] POST /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9/action => generated 32646 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 10:51:15.941823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:15.943645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:15.959032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.959794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.961022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.962787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:15.968934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:15.973999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:15.979039 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5c2096c-a56c-4514-876b-6d91c6a510c8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1214 microversion: 2.1 time: 0.893800 Sep 08 10:51:15.979618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:15.988209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3179/6133] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:15 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1214 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:16.078151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:16.088893 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2c295ab-f3f2-458c-8a26-08bdf9064123 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1267 microversion: 2.1 time: 0.154220 Sep 08 10:51:16.089496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2955/6134] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:15 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:16.850357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-04717fa7-a5ea-4634-885d-e7bfb12a3474 req-270f6beb-672a-4262-bc8b-af59b014d73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf76311-823a-482f-a296-4e2ec7a692c6", "tag": "a1a09bf5-ac42-4787-bfc0-8e4527ea1ab1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:16.871856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-04717fa7-a5ea-4634-885d-e7bfb12a3474 req-270f6beb-672a-4262-bc8b-af59b014d73d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:16.872760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-04717fa7-a5ea-4634-885d-e7bfb12a3474 req-270f6beb-672a-4262-bc8b-af59b014d73d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:16.873606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-04717fa7-a5ea-4634-885d-e7bfb12a3474 req-270f6beb-672a-4262-bc8b-af59b014d73d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:16.894148 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-04717fa7-a5ea-4634-885d-e7bfb12a3474 req-270f6beb-672a-4262-bc8b-af59b014d73d service nova] Creating event network-changed:a1a09bf5-ac42-4787-bfc0-8e4527ea1ab1 for instance bdf76311-823a-482f-a296-4e2ec7a692c6 on n-h2-833090-19 Sep 08 10:51:16.901458 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-04717fa7-a5ea-4634-885d-e7bfb12a3474 req-270f6beb-672a-4262-bc8b-af59b014d73d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057948 Sep 08 10:51:16.902814 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3180/6135] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:17.010882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:17.012591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:17.023878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.024654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.026140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.027092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.027770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.028356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.114821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:17.115538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:17.129729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.131003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.131609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.132511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:17.133085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:17.133634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:17.369254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:17.381028 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf550720-737d-465b-8970-93567a7c0a45 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1273 microversion: 2.1 time: 0.270972 Sep 08 10:51:17.383064 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3181/6136] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:17 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:17.608843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:17.619753 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-009dcfb1-b38a-42c9-a421-b7aead25b155 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1214 microversion: 2.1 time: 0.617083 Sep 08 10:51:17.620987 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2956/6137] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:17 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1214 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:18.093620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3f729fba-8e7c-47ab-90e0-fa1f48d4f739 req-48b96370-ce5c-4098-9394-2ba8f2dabd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b271e83d-7894-4671-8ca9-0736bc1b3cf9", "tag": "1dae152d-5a86-4c47-9fc6-9bcc5495ed01"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:18.102274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.102793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:18.127499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.128136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.128727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.145007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.147250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.149420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3f729fba-8e7c-47ab-90e0-fa1f48d4f739 req-48b96370-ce5c-4098-9394-2ba8f2dabd0d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.150413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.152584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3f729fba-8e7c-47ab-90e0-fa1f48d4f739 req-48b96370-ce5c-4098-9394-2ba8f2dabd0d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.153367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3f729fba-8e7c-47ab-90e0-fa1f48d4f739 req-48b96370-ce5c-4098-9394-2ba8f2dabd0d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.209357 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3f729fba-8e7c-47ab-90e0-fa1f48d4f739 req-48b96370-ce5c-4098-9394-2ba8f2dabd0d service nova] Creating event network-changed:1dae152d-5a86-4c47-9fc6-9bcc5495ed01 for instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 on n-h2-833090-19 Sep 08 10:51:18.228058 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3f729fba-8e7c-47ab-90e0-fa1f48d4f739 req-48b96370-ce5c-4098-9394-2ba8f2dabd0d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139157 Sep 08 10:51:18.231496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2957/6138] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:18.244514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:18.408549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.409534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:18.423533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.431704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.437485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.440395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.442328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.444220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.451894 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-00e04688-5452-445a-9f7c-a097cd07c500 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 204 len: 0 microversion: 2.1 time: 0.367678 Sep 08 10:51:18.456936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3182/6139] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:18 2022] DELETE /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:18.475228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.476411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:18.502643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.503157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.503642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.504376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.504839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.505274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.562923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:18.854815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:18.865548 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2f97e14-9d48-4ac9-b31d-6a0014599c3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.462775 Sep 08 10:51:18.866235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2958/6140] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:18 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:18.877397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:18.878027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:18.893277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.895927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.896406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:18.898352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:18.898874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:18.900681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.035521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.070301 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-891c7cb0-60e7-4014-af06-db072063f0c9 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1671 microversion: 2.1 time: 0.606912 Sep 08 10:51:19.083820 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3183/6141] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:18 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1671 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:19.163494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:19.167346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:19.175317 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c35a73e-8b2c-42c8-a015-cce13334b33e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1214 microversion: 2.1 time: 0.305874 Sep 08 10:51:19.178485 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2959/6142] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:18 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:19.631507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:19.634024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:19.655662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.656260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.659651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.660463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.671716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.672773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.756152 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b6fa386-96de-4c15-acb1-9e88d742fb4d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0/action" status: 200 len: 24567 microversion: 2.1 time: 0.129384 Sep 08 10:51:19.757590 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3184/6143] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:19 2022] POST /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0/action => generated 24567 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:51:19.894501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:19.895132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:19.903288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:19.906223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.908038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.908643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:19.913856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:19.914346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:19.914791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:20.103599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:20.104780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:20.112860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:20.113581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:20.114168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:20.115069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:20.115708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:20.116341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.092118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.104682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2aea7cce-5fbb-44c2-b4e4-58bc703002f9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 1.213949 Sep 08 10:51:21.105288 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2960/6144] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:19 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:21.116957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:21.117913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:21.127627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.128389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.128980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.130955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.133036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.133478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.283393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.295740 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-30900fb8-a771-468f-b262-55ce28cbafaa tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1671 microversion: 2.1 time: 1.197387 Sep 08 10:51:21.311621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3185/6145] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:20 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1671 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:21.323324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-feb0c83f-4b4d-46e1-81cc-654d4006fa5c req-ff5e4d0b-555a-4084-8d1f-f4c1172b555a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f908f1b-5779-41dd-a378-e566b61c128d", "tag": "c018b279-c362-4904-8830-bdc1d4707e8e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:21.347679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-feb0c83f-4b4d-46e1-81cc-654d4006fa5c req-ff5e4d0b-555a-4084-8d1f-f4c1172b555a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.348403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-feb0c83f-4b4d-46e1-81cc-654d4006fa5c req-ff5e4d0b-555a-4084-8d1f-f4c1172b555a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.349007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-feb0c83f-4b4d-46e1-81cc-654d4006fa5c req-ff5e4d0b-555a-4084-8d1f-f4c1172b555a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.370684 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-feb0c83f-4b4d-46e1-81cc-654d4006fa5c req-ff5e4d0b-555a-4084-8d1f-f4c1172b555a service nova] Creating event network-changed:c018b279-c362-4904-8830-bdc1d4707e8e for instance 3f908f1b-5779-41dd-a378-e566b61c128d on n-h2-833090-19 Sep 08 10:51:21.377576 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-feb0c83f-4b4d-46e1-81cc-654d4006fa5c req-ff5e4d0b-555a-4084-8d1f-f4c1172b555a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064418 Sep 08 10:51:21.380156 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3186/6146] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:21.490891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:21.541386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b189c8e-214d-4152-9324-f1d6e400921c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1214 microversion: 2.1 time: 0.433889 Sep 08 10:51:21.542368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2961/6147] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:21 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:21.895617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7c7f20f2-9a0b-4103-af7b-edf885271720 req-7f228e41-e292-45fe-a030-ad7e082399df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271e83d-7894-4671-8ca9-0736bc1b3cf9", "name": "network-vif-deleted", "tag": "1dae152d-5a86-4c47-9fc6-9bcc5495ed01"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:21.910970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7c7f20f2-9a0b-4103-af7b-edf885271720 req-7f228e41-e292-45fe-a030-ad7e082399df service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:21.911495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7c7f20f2-9a0b-4103-af7b-edf885271720 req-7f228e41-e292-45fe-a030-ad7e082399df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:21.911913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7c7f20f2-9a0b-4103-af7b-edf885271720 req-7f228e41-e292-45fe-a030-ad7e082399df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:21.924589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7c7f20f2-9a0b-4103-af7b-edf885271720 req-7f228e41-e292-45fe-a030-ad7e082399df service nova] Creating event network-vif-deleted:1dae152d-5a86-4c47-9fc6-9bcc5495ed01 for instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 on n-h2-833090-19 Sep 08 10:51:21.930462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7c7f20f2-9a0b-4103-af7b-edf885271720 req-7f228e41-e292-45fe-a030-ad7e082399df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039775 Sep 08 10:51:21.931632 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3187/6148] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:22.130946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.131707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.140535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.141027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.141464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.142162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.142610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.143031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.320804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.322583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.333278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.336789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.337632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.338311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.339335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.340133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.340838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.344323 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3ef7e7b-b5bc-42ca-8691-ea265e6bedd9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.217732 Sep 08 10:51:22.345498 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2962/6149] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:22 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:22.423099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.432097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b6abb7f6-4a50-42fe-af9a-5629cd8bb6cf tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1603 microversion: 2.1 time: 0.116915 Sep 08 10:51:22.433032 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3188/6150] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:22 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1603 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:22.566543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:22.567329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:22.574046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.574812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.575395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.576515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:22.576919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:22.577563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:22.733253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:22.743404 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e16b48d-88f4-4b95-9d5e-40518f3162ce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1214 microversion: 2.1 time: 0.181605 Sep 08 10:51:22.754644 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2963/6151] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:22 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:23.369533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.370278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:23.387228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.388016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.388473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.389205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.389645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.390496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.457206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.458609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:23.466289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.466987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.467617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.468493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.469112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.469700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.633575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.645189 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a6106800-2010-44b6-aac0-57faff293719 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1333 microversion: 2.1 time: 0.193205 Sep 08 10:51:23.655843 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2964/6152] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1333 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:23.768244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:23.768846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:23.775789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.782004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.783282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.784496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:23.785957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:23.786819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:23.922723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:23.936570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ec68762-c6fe-4415-b2ff-3b014cd63e9e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.572212 Sep 08 10:51:23.937170 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3189/6153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:24.014204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:24.024742 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ac37f31-926b-48eb-8489-b6e7d2ec59fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.260324 Sep 08 10:51:24.025333 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2965/6154] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:23 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:24.682821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:24.684101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:24.687626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:24.688665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:24.698273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.698846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.699327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.700221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.700929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.701431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.737299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.737793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.738404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.738884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lazy-loading 'fault' on Instance uuid b271e83d-7894-4671-8ca9-0736bc1b3cf9 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:24.786990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:24.799800 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-543d2907-a861-41a8-b80f-1574f7b9e9ce tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1338 microversion: 2.1 time: 0.122137 Sep 08 10:51:24.814310 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3190/6155] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:24 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:24.962403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:24.963829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:24.967046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:24.974420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.975934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.976568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:24.977527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:24.978225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:24.978881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.049294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:25.050352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:25.064416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.065293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.068173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.075608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.079650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.080589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.320459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.334413 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9b7fa36-7a55-41eb-ac1f-34777a924a15 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.377701 Sep 08 10:51:25.335606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2966/6156] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:24 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:25.348925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.358356 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6132c7dc-d24f-4d98-82c8-2916afa7a450 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.314183 Sep 08 10:51:25.359104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3191/6157] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:25 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:25.826815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:25.827863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:25.849304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.850724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.851319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.852303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.852819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.853647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.897718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:25.898196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:25.898630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:25.899243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lazy-loading 'fault' on Instance uuid b271e83d-7894-4671-8ca9-0736bc1b3cf9 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:25.954588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:25.963621 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c4f153a-6ca3-427f-bd8c-7ebf8962f722 tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1338 microversion: 2.1 time: 0.141202 Sep 08 10:51:25.964235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2967/6158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:25 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:26.359021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:26.359866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:26.367510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.368246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.368690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.369403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.369886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.370312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.384413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:26.385332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:26.400722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.401961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.402430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.403167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.403735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.404799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.620325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.630885 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8f3bf3ed-0e53-4fe4-a001-68d349c58809 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.252544 Sep 08 10:51:26.632241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:26.633478 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2968/6159] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:26 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:26.641273 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2415c8b2-1028-4f5c-a2dc-c914faa27cab tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.285716 Sep 08 10:51:26.651944 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3192/6160] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:26 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:26.901964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-041a774e-98cf-4061-a6a0-0f8de5f9c344 req-8c0f287d-87cd-4519-98ae-64ee0b83bfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f908f1b-5779-41dd-a378-e566b61c128d", "name": "network-vif-plugged", "status": "completed", "tag": "c018b279-c362-4904-8830-bdc1d4707e8e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:26.922063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-041a774e-98cf-4061-a6a0-0f8de5f9c344 req-8c0f287d-87cd-4519-98ae-64ee0b83bfde service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.922835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-041a774e-98cf-4061-a6a0-0f8de5f9c344 req-8c0f287d-87cd-4519-98ae-64ee0b83bfde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.924620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-041a774e-98cf-4061-a6a0-0f8de5f9c344 req-8c0f287d-87cd-4519-98ae-64ee0b83bfde service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:26.944823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-041a774e-98cf-4061-a6a0-0f8de5f9c344 req-8c0f287d-87cd-4519-98ae-64ee0b83bfde service nova] Creating event network-vif-plugged:c018b279-c362-4904-8830-bdc1d4707e8e for instance 3f908f1b-5779-41dd-a378-e566b61c128d on n-h2-833090-19 Sep 08 10:51:26.950865 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-041a774e-98cf-4061-a6a0-0f8de5f9c344 req-8c0f287d-87cd-4519-98ae-64ee0b83bfde service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053686 Sep 08 10:51:26.952083 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2969/6161] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:26.988077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:26.988960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:26.998211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:26.998765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:26.999490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.000492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.001167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.001608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.148042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.149628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.151616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.152335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lazy-loading 'fault' on Instance uuid b271e83d-7894-4671-8ca9-0736bc1b3cf9 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:27.424944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4864b5d5cefa4fa593bb2adeb46c04d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5f3a5e35a248b8b6c85535e4e59b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:27.434924 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9febf9ab-9cd3-4a08-a93e-8f6ef8e96d0c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 200 len: 1489 microversion: 2.1 time: 0.452376 Sep 08 10:51:27.436090 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3193/6162] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:26 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 1489 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:27.658424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:27.665991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:27.666918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:27.675319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:27.705613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.707195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.717942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.718844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.719336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.720261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.720766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.721206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.721930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:27.722391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:27.722847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:27.724648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:28.039273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:28.050583 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b21224bb-048a-4c98-a30e-663e6a5b5c77 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.388898 Sep 08 10:51:28.054796 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3194/6163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:27 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:28.134622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:28.151918 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a8f8ef96-0e04-4377-a3a1-c1598306f780 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.498951 Sep 08 10:51:28.168863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2970/6164] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:27 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:28.461113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:28.462379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] [instance: b271e83d-7894-4671-8ca9-0736bc1b3cf9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:28.475776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:28.476572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:28.477175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:28.478139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:28.479454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:28.480083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:28.503338 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] HTTP exception thrown: Instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 could not be found. Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Request method failure captured: Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 HTTP/1.1 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcf7Ulfo5otorE81-zSfRkEAOqx-m5I5BQYVZIt5o4P5ocbk7uxh6tlPe2H2wmV2w1XtH6w0Gvz6A0jycT9996JHqTpd2lW1oA35evw7oUrC8wBN7p-lEerh-6IAxxd_GOllOSlhtIi3aBlGZOGOiAUjbxQ3LSg3BCFfAsY0nd6mWac Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0b5f3a5e35a248b8b6c85535e4e59b7b Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0b5f3a5e35a248b8b6c85535e4e59b7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0b5f3a5e35a248b8b6c85535e4e59b7b", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0b5f3a5e35a248b8b6c85535e4e59b7b Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestNetworkBasicOps-1716732823 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestNetworkBasicOps-1716732823-project Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4864b5d5cefa4fa593bb2adeb46c04d1 Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestNetworkBasicOps-1716732823-project Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 could not be found. Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b271e83d-7894-4671-8ca9-0736bc1b3cf9'} Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 could not be found. Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 could not be found. Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:28.505185 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 could not be found. Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Returning 404 to user: Instance b271e83d-7894-4671-8ca9-0736bc1b3cf9 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:28.508719 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76794b62-de5a-40c4-b760-5597a98d743b tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9" status: 404 len: 111 microversion: 2.1 time: 0.051887 Sep 08 10:51:28.510824 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3195/6165] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:28 2022] GET /compute/v2.1/servers/b271e83d-7894-4671-8ca9-0736bc1b3cf9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:51:28.943572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-28f59303-5d8a-4a3a-8077-addd143fdf2c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] Calling method '.version_select at 0x7f2351230040>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:28.986565 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-28f59303-5d8a-4a3a-8077-addd143fdf2c tempest-TestNetworkBasicOps-1716732823 tempest-TestNetworkBasicOps-1716732823-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1672482600" status: 202 len: 0 microversion: 2.1 time: 0.047903 Sep 08 10:51:28.987915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2971/6166] 10.222.0.59 () {58 vars in 1257 bytes} [Thu Sep 8 10:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1672482600 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:51:29.077497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:29.080071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:29.096072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.096942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.097646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.098797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.099499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.108323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.179219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:29.180160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:29.193173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.194105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.196136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.198367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:29.207723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:29.208556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:29.935443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:29.947949 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e1f81c6-b40e-4ead-abfe-3ee626e27fad tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1315 microversion: 2.1 time: 0.874535 Sep 08 10:51:29.966436 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3196/6167] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:29 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:30.016264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:30.026725 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5c29931-8b8e-41b3-bb47-8108fe4f810c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.855373 Sep 08 10:51:30.027272 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2972/6168] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:29 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:30.657152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:30.663341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:30.673333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.674654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.675323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.677101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.678796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.679518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.806316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:51:30.807019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:51:30.807816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:51:30.808469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:51:30.809121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:51:30.948748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:30.978458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:30.979091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:30.989169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.990321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.991349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.991865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.992598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:30.993064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.993460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:30.994026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.994614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:30.994793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.000188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.003518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.091334 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51e04748-9d61-468e-8ea4-d982fef3f4b9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0/action" status: 202 len: 1138 microversion: 2.1 time: 0.444417 Sep 08 10:51:31.092666 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3197/6169] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:30 2022] POST /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0/action => generated 1138 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 10:51:31.097456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:31.098229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:31.104768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.105442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.106059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.106923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.107567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.108201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.432702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:31.441675 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2c96396-7ce2-4423-b554-e2eabbe5e876 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1501 microversion: 2.1 time: 0.468622 Sep 08 10:51:31.445944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2973/6170] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:30 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:31.455399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:31.456069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:31.482212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.482722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.483169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.483930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.491533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.492107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.515511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:31.523847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fc5ea07-fd44-4e0b-be92-aa5d6e7c6332 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.429940 Sep 08 10:51:31.528269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3198/6171] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:31 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:31.535852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:31.539519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:31.555842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.565744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.568078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.569069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.578148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.579761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.645320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:31.735216 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe0d413e-f836-4d9d-90e8-7848142af33c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d/action" status: 202 len: 0 microversion: 2.1 time: 0.205168 Sep 08 10:51:31.735910 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3199/6172] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:31 2022] POST /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:51:31.753245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:31.754228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:31.768237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.770713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.771369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:31.772835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:31.780463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:31.781192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.043320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.075431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88b2d212-03e1-4980-aac8-f08700440150 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.627422 Sep 08 10:51:32.078770 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2974/6173] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:31 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:32.095144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-33e5258b-48db-4686-bcf7-c0dffe05564a req-27be166e-1047-4dd0-9e76-cbc5a136a7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf76311-823a-482f-a296-4e2ec7a692c6", "name": "network-vif-plugged", "status": "completed", "tag": "a1a09bf5-ac42-4787-bfc0-8e4527ea1ab1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:32.129078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-33e5258b-48db-4686-bcf7-c0dffe05564a req-27be166e-1047-4dd0-9e76-cbc5a136a7c3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.129870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-33e5258b-48db-4686-bcf7-c0dffe05564a req-27be166e-1047-4dd0-9e76-cbc5a136a7c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.130556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-33e5258b-48db-4686-bcf7-c0dffe05564a req-27be166e-1047-4dd0-9e76-cbc5a136a7c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.164182 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-33e5258b-48db-4686-bcf7-c0dffe05564a req-27be166e-1047-4dd0-9e76-cbc5a136a7c3 service nova] Creating event network-vif-plugged:a1a09bf5-ac42-4787-bfc0-8e4527ea1ab1 for instance bdf76311-823a-482f-a296-4e2ec7a692c6 on n-h2-833090-19 Sep 08 10:51:32.171149 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-33e5258b-48db-4686-bcf7-c0dffe05564a req-27be166e-1047-4dd0-9e76-cbc5a136a7c3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087093 Sep 08 10:51:32.176088 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2975/6174] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:32.261099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:32.271894 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-382e0512-b565-4128-bbe2-d53eece49a8d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1506 microversion: 2.1 time: 0.522858 Sep 08 10:51:32.284558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3200/6175] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:31 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:32.556647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:32.556647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:32.567274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.567802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.568346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:32.569280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:32.569746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:32.570321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.044916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:33.080474 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3acc8501-8616-45a8-9b16-0190f72086fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.528291 Sep 08 10:51:33.092621 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2976/6176] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:32 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:33.101901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:33.103082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:33.125540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.125978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.126593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.127326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.127820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.128260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.301024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:33.302085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:33.312740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.314513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.317342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.318285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.321124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.321771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.420495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:33.434117 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f507634b-c9d6-4ce2-b3a4-c5fe406cd076 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.336824 Sep 08 10:51:33.447952 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3201/6177] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:33 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:33.698999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:33.711134 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54ff8b64-85ee-4f36-ba36-07990a9eb561 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1486 microversion: 2.1 time: 0.417357 Sep 08 10:51:33.717977 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2977/6178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:33 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1486 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:33.777351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:33.780684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:33.791896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.792643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.793262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.794136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:33.795795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:33.796030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:33.842302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lazy-loading 'flavor' on Instance uuid 3f908f1b-5779-41dd-a378-e566b61c128d {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:34.106816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:34.107797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:34.138224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:34.139557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:34.140291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:34.141501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:34.142127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:34.142723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:34.212078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:34.260446 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb8699e0-d4ef-40c2-a438-63c3e215420c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d/action" status: 202 len: 0 microversion: 2.1 time: 0.496356 Sep 08 10:51:34.262924 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3202/6179] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:51:33 2022] POST /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:51:34.277253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:34.283935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:34.309603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:34.310204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:34.310761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:34.311632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:34.312204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:34.312741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:34.497083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:34.520278 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36db6252-797e-41ae-aea2-dde0a11108fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1202 microversion: 2.1 time: 0.415555 Sep 08 10:51:34.530911 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2978/6180] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:34 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1202 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:34.537769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:34.538706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:34.547156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:34.547916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:34.551368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:34.555555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:34.556222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:34.558638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:34.649706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:34.662841 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11879a8a-5de1-414a-a1da-ef5c609501c3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1492 microversion: 2.1 time: 0.393137 Sep 08 10:51:34.667623 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3203/6181] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:34 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1492 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:34.796782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:34.805273 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cac5b40-7678-4e8d-ba00-c5356b010ccf tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.272957 Sep 08 10:51:34.811706 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2979/6182] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:34 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:35.560033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:35.561558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:35.584521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.585073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.585578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.586307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.586767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.587193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.704721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:35.706153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:35.723397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.726033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.726492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.727233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:35.727732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:35.728160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:35.963570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:35.988625 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39c88b09-f8a1-4d3c-835e-587bc3878e23 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1389 microversion: 2.1 time: 0.433686 Sep 08 10:51:36.001966 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3204/6183] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:35 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1389 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:36.019953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:36.020581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:36.030183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.030679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.031185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.033933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.034584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.035171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.127946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:36.146294 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5b87a687-a10b-494b-83b9-920236db952c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1492 microversion: 2.1 time: 0.455261 Sep 08 10:51:36.156580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2980/6184] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:35 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1492 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:36.166187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:36.166808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:36.189416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.190938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.196484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.197552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.198438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.202681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.383962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:36.407761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b524761a-0f0e-4bf8-8125-6718697f3a34 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.403344 Sep 08 10:51:36.428515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3205/6185] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:36 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:36.584396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:36.605520 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1e0f580-0046-4d3a-a81d-681384c6f700 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1389 microversion: 2.1 time: 0.442862 Sep 08 10:51:36.611577 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2981/6186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:36 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1389 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:36.648049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:36.648678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:36.655754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.656256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.656737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.657508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:36.657972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:36.658405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:36.990139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.001843 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c0c3401d-09dd-451d-81b9-d3f83bf1958b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1389 microversion: 2.1 time: 0.369339 Sep 08 10:51:37.003486 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3206/6187] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:36 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1389 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:37.028325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:37.029202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:37.036326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.036889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.037890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.038611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.039262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.039748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.139176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:51:37.181517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:37.182128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:37.202439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.202966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.203426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.204192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.204657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.205095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.310030 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5025f0d6-364e-40c8-8834-cf4d9bce4b1f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 204 len: 0 microversion: 2.1 time: 0.284883 Sep 08 10:51:37.320514 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2982/6188] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:51:37 2022] DELETE /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:51:37.334956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:37.338879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:37.354998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.355778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.358895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.359918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.363453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.364612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.732106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.745525 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fe2bd997-22d8-4d10-bdc2-ef0644b6e801 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1395 microversion: 2.1 time: 0.415745 Sep 08 10:51:37.746524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2983/6189] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:37 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1395 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:37.751737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:37.752580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:37.762200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.762916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.763584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.764833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:37.765328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:37.765752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:37.796352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:37.809920 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d203dc06-9ce6-489c-8971-c6f32046f0a4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1513 microversion: 2.1 time: 0.632629 Sep 08 10:51:37.822833 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3207/6190] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:37 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1513 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:38.094462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:38.109905 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7fc49ae3-f7a9-40d8-9fdb-0fdb9cb53ef6 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.361602 Sep 08 10:51:38.111092 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2984/6191] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:37 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:38.774016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:38.774754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:38.788107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:38.788593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:38.789020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:38.789727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:38.791356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:38.792019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:38.838670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:38.840743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:38.864696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:38.865501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:38.866244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:38.866650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:38.872893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:38.873397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.191184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.211042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3beb507-f06e-4eda-86a3-c5f9b6eb8535 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1395 microversion: 2.1 time: 0.442538 Sep 08 10:51:39.223359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3208/6192] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:38 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1395 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:39.229016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:39.237006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:39.253507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:39.254290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:39.254994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.259579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:39.260348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:39.261125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:39.361325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.370645 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2cec5864-bf71-4146-b839-5a901343f467 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1513 microversion: 2.1 time: 0.537158 Sep 08 10:51:39.373874 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2985/6193] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:38 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:39.544234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:39.558446 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6e56aa70-7fb3-4bfe-93d0-221d8b429dca tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.331713 Sep 08 10:51:39.560802 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3209/6194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:39 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:40.244971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:40.246318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:40.252820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:40.254575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.255104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.255590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.260093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.260529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.261191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.285418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-62f2fd69-4e46-4569-8af9-68d9c2bb2956 req-22ab4387-6fff-4869-a882-bff99c522231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf76311-823a-482f-a296-4e2ec7a692c6", "name": "network-vif-deleted", "tag": "a1a09bf5-ac42-4787-bfc0-8e4527ea1ab1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:40.309255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62f2fd69-4e46-4569-8af9-68d9c2bb2956 req-22ab4387-6fff-4869-a882-bff99c522231 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.310360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62f2fd69-4e46-4569-8af9-68d9c2bb2956 req-22ab4387-6fff-4869-a882-bff99c522231 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.312660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62f2fd69-4e46-4569-8af9-68d9c2bb2956 req-22ab4387-6fff-4869-a882-bff99c522231 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.341674 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-62f2fd69-4e46-4569-8af9-68d9c2bb2956 req-22ab4387-6fff-4869-a882-bff99c522231 service nova] Creating event network-vif-deleted:a1a09bf5-ac42-4787-bfc0-8e4527ea1ab1 for instance bdf76311-823a-482f-a296-4e2ec7a692c6 on n-h2-833090-19 Sep 08 10:51:40.346449 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-62f2fd69-4e46-4569-8af9-68d9c2bb2956 req-22ab4387-6fff-4869-a882-bff99c522231 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064894 Sep 08 10:51:40.348215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3210/6195] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:51:40.406407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:40.408177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:40.416437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.417411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.418143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.419114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.420266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.421211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.435234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:40.450304 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7f64796-2a46-41ea-9350-25fd4ef5d530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1353 microversion: 2.1 time: 0.209138 Sep 08 10:51:40.488841 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2986/6196] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:40 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:40.592677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:40.594057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:40.611502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.614129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.615907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.617402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:40.620330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:40.620933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:40.645318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:40.656564 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b13df0b5-cb75-4894-8959-92b5b62a1043 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1513 microversion: 2.1 time: 0.254678 Sep 08 10:51:40.658027 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3211/6197] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:40 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:40.822045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:40.834815 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e32ce6f8-821e-4f0f-bfb0-64842b9f02bc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.245876 Sep 08 10:51:40.847719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2987/6198] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:40 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:51:41.360748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3c35917a-7bbc-4de8-a08f-a3332817524f req-60548a8d-6511-4438-a953-dcf6de19c546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f908f1b-5779-41dd-a378-e566b61c128d", "name": "network-vif-plugged", "status": "completed", "tag": "c018b279-c362-4904-8830-bdc1d4707e8e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:41.374071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c35917a-7bbc-4de8-a08f-a3332817524f req-60548a8d-6511-4438-a953-dcf6de19c546 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.374739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c35917a-7bbc-4de8-a08f-a3332817524f req-60548a8d-6511-4438-a953-dcf6de19c546 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.375351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3c35917a-7bbc-4de8-a08f-a3332817524f req-60548a8d-6511-4438-a953-dcf6de19c546 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:41.414896 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3c35917a-7bbc-4de8-a08f-a3332817524f req-60548a8d-6511-4438-a953-dcf6de19c546 service nova] Creating event network-vif-plugged:c018b279-c362-4904-8830-bdc1d4707e8e for instance 3f908f1b-5779-41dd-a378-e566b61c128d on n-h2-833090-19 Sep 08 10:51:41.442511 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3c35917a-7bbc-4de8-a08f-a3332817524f req-60548a8d-6511-4438-a953-dcf6de19c546 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088027 Sep 08 10:51:41.443170 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3212/6199] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:51:41.485732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:41.489430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:41.504650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.505146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.505623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:41.506330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.506916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.507829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:41.602178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:41.629923 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8ad90d5-28c0-47a9-84a7-69442d0335a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1187 microversion: 2.1 time: 0.148565 Sep 08 10:51:41.633214 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2988/6200] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:41 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:41.681877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:41.683144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:41.695392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.698308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.698956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:41.699712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:41.702698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:41.703601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.041790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.051055 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2f4d1840-112c-4050-b7a0-ed281688337e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1513 microversion: 2.1 time: 0.374189 Sep 08 10:51:42.051681 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3213/6201] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:41 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:42.249337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:42.250163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:42.266036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.267370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.268070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.269429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.273714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.274611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.458836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.468055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d67578ed-b031-48c0-8c75-5abb8e5d7803 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.611666 Sep 08 10:51:42.469202 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2989/6202] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:41 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:42.656743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:42.658373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:42.667849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.668602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.669201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.670354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:42.670970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:42.671601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:42.765829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:42.770655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:42.782748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02490896-1e07-4132-971f-457b0029ef1c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1187 microversion: 2.1 time: 0.130098 Sep 08 10:51:42.783356 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3214/6203] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:42 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1187 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:43.078300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:43.079369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:43.093731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.096387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.097139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.098038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.103165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.103770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.387666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:43.396426 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3ec21e9-3c9b-4874-b3bd-9a75b0b202d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.321987 Sep 08 10:51:43.401648 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2990/6204] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:43 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:43.500781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:43.501814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:43.524748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.526006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.527583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.530128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.530969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.534560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.808503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:43.809956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:43.818836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.819440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.827506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.833371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:43.841266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:43.842490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:43.873029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:43.888199 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b5fb67e-45ab-4145-8164-69b8bcff1aef tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.393810 Sep 08 10:51:43.893145 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3215/6205] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:43 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:43.980883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:43.992805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df115066-3cfc-4d98-abb5-18b98af7e9fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1187 microversion: 2.1 time: 0.188200 Sep 08 10:51:44.001532 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2991/6206] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:43 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1187 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:44.434144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:44.436084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:44.447618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:44.450544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.451376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.452351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.453712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.454669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.455308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.742163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:44.750853 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f987b4fe-74af-4ece-be49-d99879217483 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.326194 Sep 08 10:51:44.751822 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3216/6207] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:44 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:44.920055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:44.920940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:44.936558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.937124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.944981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:44.945992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:44.946511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:44.950003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.026473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:45.027629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:45.045991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.046615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.047083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.047906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.048392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.048831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.195253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:45.201864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:45.207677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d2f85402-4aad-48e1-b7d3-472c0237f2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1187 microversion: 2.1 time: 0.187502 Sep 08 10:51:45.216119 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3217/6208] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:45 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1187 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:45.218679 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-833e35cb-7fa6-426d-b12e-8c670ef247b3 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.306770 Sep 08 10:51:45.232708 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2992/6209] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:44 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:45.778414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:45.780587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:45.793737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.794877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.795729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:45.796824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:45.797502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:45.798150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.038358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.047099 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52871913-df35-4f0f-aa47-521d7eb8fe08 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.272551 Sep 08 10:51:46.069093 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3218/6210] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:45 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:46.236737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:46.242556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:46.249441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:46.250350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:46.264949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.265744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.266698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.269907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.271273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.272074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.272397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.273192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.273612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.275112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.277443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.279397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.334575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:51:46.373690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:46.374179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:46.374620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:46.375074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lazy-loading 'fault' on Instance uuid bdf76311-823a-482f-a296-4e2ec7a692c6 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:51:46.542424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.568972 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf3fb7ac-0efb-45e0-bdcc-175d20599c64 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 200 len: 1192 microversion: 2.1 time: 0.338316 Sep 08 10:51:46.569716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2993/6211] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:46 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 1192 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:46.692390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:46.700921 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af6c1297-bcf6-4c3f-8e80-8bcb9ae09700 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.457842 Sep 08 10:51:46.707394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3219/6212] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:46 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:47.083196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:47.084151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:47.094864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.095493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.096259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.097208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.097812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.098257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.329457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:47.337893 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-458a33ad-42fa-4963-92f7-b22f4dad56d1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.259197 Sep 08 10:51:47.338499 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2994/6213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:47 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:47.596690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:47.597308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: bdf76311-823a-482f-a296-4e2ec7a692c6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:47.604968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.605461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.605893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.606604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.607088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.607709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.625358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance bdf76311-823a-482f-a296-4e2ec7a692c6 could not be found. Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 HTTP/1.1 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance bdf76311-823a-482f-a296-4e2ec7a692c6 could not be found. Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bdf76311-823a-482f-a296-4e2ec7a692c6'} Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf76311-823a-482f-a296-4e2ec7a692c6 could not be found. Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf76311-823a-482f-a296-4e2ec7a692c6 could not be found. Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:51:47.627955 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf76311-823a-482f-a296-4e2ec7a692c6 could not be found. Sep 08 10:51:47.632405 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:51:47.634892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance bdf76311-823a-482f-a296-4e2ec7a692c6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:51:47.636432 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2211c8a2-60a4-4892-826a-cba078af643b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6" status: 404 len: 111 microversion: 2.1 time: 0.043357 Sep 08 10:51:47.637628 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3220/6214] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:47 2022] GET /compute/v2.1/servers/bdf76311-823a-482f-a296-4e2ec7a692c6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:51:47.748327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:47.748327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:47.781107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.788288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.792960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:47.797118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:47.800846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:47.802095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.122544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:48.135027 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ebb936e-94c7-43ac-988f-643ab406a3ac tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1690 microversion: 2.1 time: 0.406457 Sep 08 10:51:48.148580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2995/6215] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:47 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1690 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:48.366279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:48.367305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:48.374225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:48.375063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:48.375856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.376979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:48.377706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:48.378350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:48.565881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:48.576933 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b92cb06-11bf-49f7-a252-5b1b0ee71447 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.215506 Sep 08 10:51:48.583639 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3221/6216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:48 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:49.158970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:49.160910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:49.170661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.171410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.172128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.173138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.173838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.174488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.462073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:49.476849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6945e6f6-2d50-48fd-9a27-15609bdaca2e tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1696 microversion: 2.1 time: 0.322118 Sep 08 10:51:49.500549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2996/6217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:49 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1696 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:49.605558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:49.606701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:49.632116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.633478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.636454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.637236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:49.640514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:49.641580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:49.915655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:49.925895 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ff590888-4ff0-48e5-ad0d-79cd3694275b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.327038 Sep 08 10:51:49.929813 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3222/6218] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:49 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:50.504698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:50.505389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:50.523999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:50.524507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:50.524955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:50.525688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:50.526153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:50.527379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:50.880908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:50.890324 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01ec66d0-6d97-4dfb-882a-d1abfe19ad8d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1696 microversion: 2.1 time: 0.389635 Sep 08 10:51:50.891454 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2997/6219] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:50 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1696 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:50.954767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:50.955582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:50.974958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:50.977717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:50.978820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:50.982134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:50.982809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:50.985006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:51.288138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:51.299143 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e103da22-09ed-4170-82db-99f931b50bdd tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.348787 Sep 08 10:51:51.306579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3223/6220] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:50 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:51.914772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:51.915723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:51.928295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:51.929961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:51.931155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:51.932842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:51.933573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:51.934799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:52.281253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:52.297895 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34b913ab-d4c5-4337-99b7-4f84688075f5 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1681 microversion: 2.1 time: 0.384724 Sep 08 10:51:52.325523 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2998/6221] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:51 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1681 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:52.336944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:52.337574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:52.358506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:52.359384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:52.360177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:52.361423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:52.362822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:52.363976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:52.650766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:52.659543 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1bbf7945-2b1e-4981-bb6d-74971c9500f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.327462 Sep 08 10:51:52.676372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3224/6222] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:52 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:53.399405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0d5a66bb-9299-43cb-a65c-82b7f6a7a4d0 req-8d3045ac-0ab6-40c3-aa3a-689cde1a9193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c465251-1d48-4633-8136-3dc38f9f47e0", "name": "network-vif-plugged", "status": "completed", "tag": "2866cb9f-26a0-4136-a522-8f39adbe5b5a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:53.428206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0d5a66bb-9299-43cb-a65c-82b7f6a7a4d0 req-8d3045ac-0ab6-40c3-aa3a-689cde1a9193 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.429522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0d5a66bb-9299-43cb-a65c-82b7f6a7a4d0 req-8d3045ac-0ab6-40c3-aa3a-689cde1a9193 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.430276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0d5a66bb-9299-43cb-a65c-82b7f6a7a4d0 req-8d3045ac-0ab6-40c3-aa3a-689cde1a9193 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.458992 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0d5a66bb-9299-43cb-a65c-82b7f6a7a4d0 req-8d3045ac-0ab6-40c3-aa3a-689cde1a9193 service nova] Creating event network-vif-plugged:2866cb9f-26a0-4136-a522-8f39adbe5b5a for instance 6c465251-1d48-4633-8136-3dc38f9f47e0 on n-h1-833090-19 Sep 08 10:51:53.560345 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0d5a66bb-9299-43cb-a65c-82b7f6a7a4d0 req-8d3045ac-0ab6-40c3-aa3a-689cde1a9193 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150193 Sep 08 10:51:53.562313 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 2999/6223] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:51:53.691652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:53.692510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:53.703681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.704489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.705089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.705921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:53.706486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:53.707337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:53.925762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:53.939798 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1eb6d020-f7df-49bd-952c-279a7791244b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.255071 Sep 08 10:51:53.943747 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3225/6224] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:53 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:54.971678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:54.972599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:54.987371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:54.987890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:54.996610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:55.000086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:55.000622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:55.003010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:55.411496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:55.419318 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a7e9bb8-acdf-44d6-a4e2-025cb55ddb34 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.453413 Sep 08 10:51:55.419963 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3000/6225] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:54 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:56.443100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:56.444054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:56.460723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.464680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.468420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.468968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:56.469458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:56.469906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:56.722753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:56.731543 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3a2cf28-3aaa-4653-a28d-e57ad04cf18d tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.292995 Sep 08 10:51:56.732137 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3226/6226] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:56 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:57.767033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:57.767703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:57.787819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:57.791344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:57.792020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:57.819127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:57.819647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:57.820646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:57.958895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-33539554", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "db71071e-0ca3-4556-9878-77946fd1fa03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:51:58.107973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:58.112667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:51:58.121757 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09b09f06-0ee5-410a-9158-4b7a9e8efadf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.368452 Sep 08 10:51:58.122566 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3001/6227] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:57 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:58.797837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:51:58.798282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:51:58.798754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:51:58.799173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:51:58.799631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:51:58.810694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:58.811201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:58.811815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:58.812768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:58.813375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:58.813820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:58.847132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:51:58.856055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:51:58.964533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:51:58.972006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db71071e-0ca3-4556-9878-77946fd1fa03',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:51:59.147021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:59.147711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:59.158547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:59.159398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:59.161290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:59.163366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:51:59.164485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:51:59.165352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:51:59.319559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6eb40fba-6196-485a-ad02-5282eba80a9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364695 Sep 08 10:51:59.322994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3227/6228] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:51:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:51:59.337083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ba8ddce-bab4-4f3c-b312-0af825ccedd1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:51:59.338051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ba8ddce-bab4-4f3c-b312-0af825ccedd1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:51:59.470918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ba8ddce-bab4-4f3c-b312-0af825ccedd1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:59.486809 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ba8ddce-bab4-4f3c-b312-0af825ccedd1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1055 microversion: 2.1 time: 0.154424 Sep 08 10:51:59.488023 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3228/6229] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:59 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1055 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:51:59.498570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:51:59.521429 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-600b2d77-ea54-41c0-a4ea-6808350f2a56 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.379457 Sep 08 10:51:59.522851 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3002/6230] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:51:59 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:00.510496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:00.515170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:00.527172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:00.534563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:00.535429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:00.537492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:00.538179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:00.538624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:00.549624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:00.550247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:00.559182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:00.560019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:00.560677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:00.561611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:00.562290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:00.563575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:00.704173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:00.715191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad71ac57-3aa2-40ca-917f-5031366afc08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1153 microversion: 2.1 time: 0.208669 Sep 08 10:52:00.719703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3229/6231] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:00 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1153 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:01.323154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:01.329741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-954da3ca-f38d-4334-a961-87e579e5f0b4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1505 microversion: 2.1 time: 0.784158 Sep 08 10:52:01.340349 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3003/6232] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:00 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:01.742012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:01.742632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:01.757660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:01.758236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:01.758748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:01.759599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:01.760115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:01.760610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:01.879784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:01.896858 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e49e5eb-4b43-4f0f-bad4-79746fb5db02 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1171 microversion: 2.1 time: 0.159063 Sep 08 10:52:01.897768 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3230/6233] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:01 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1171 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:02.366319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:02.367237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:02.379084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.384319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.387848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.388838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.389339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.390324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.923397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:02.924460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:02.938234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.942931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.942931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.942931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:02.942931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:02.942931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:02.950724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:02.963603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fef196ad-09a4-4df5-8eb0-841b9cb6212a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1505 microversion: 2.1 time: 0.597503 Sep 08 10:52:02.964254 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3004/6234] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:02 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:03.273965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:03.291599 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52ca0f03-2caf-4cb9-9550-0f00317f68e7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1213 microversion: 2.1 time: 0.364316 Sep 08 10:52:03.292877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3231/6235] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:02 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1213 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:03.357661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0bd5b7aa-8645-42e8-9a61-75c38ae6ee32 req-fa8365d9-c7f6-425b-abb8-c5e80ab1efd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f908f1b-5779-41dd-a378-e566b61c128d", "name": "network-vif-unplugged", "status": "completed", "tag": "c018b279-c362-4904-8830-bdc1d4707e8e"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:03.380919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0bd5b7aa-8645-42e8-9a61-75c38ae6ee32 req-fa8365d9-c7f6-425b-abb8-c5e80ab1efd6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:03.381522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0bd5b7aa-8645-42e8-9a61-75c38ae6ee32 req-fa8365d9-c7f6-425b-abb8-c5e80ab1efd6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:03.383382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0bd5b7aa-8645-42e8-9a61-75c38ae6ee32 req-fa8365d9-c7f6-425b-abb8-c5e80ab1efd6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:03.408577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0bd5b7aa-8645-42e8-9a61-75c38ae6ee32 req-fa8365d9-c7f6-425b-abb8-c5e80ab1efd6 service nova] Creating event network-vif-unplugged:c018b279-c362-4904-8830-bdc1d4707e8e for instance 3f908f1b-5779-41dd-a378-e566b61c128d on n-h2-833090-19 Sep 08 10:52:03.423685 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0bd5b7aa-8645-42e8-9a61-75c38ae6ee32 req-fa8365d9-c7f6-425b-abb8-c5e80ab1efd6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069589 Sep 08 10:52:03.427611 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3005/6236] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:03.991216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:03.991803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:04.006599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.007424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.010201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.011253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.011898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.013015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.079673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4625ccde-868d-435c-83d0-0b0ce73699d0 req-fe593d66-a22c-479f-b379-dbace7d80c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279a52e8-e4ed-4d2e-a6eb-897027f3adeb", "tag": "c879fd78-dd6f-40c3-9d8b-39dd3edfdc80"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:04.120056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4625ccde-868d-435c-83d0-0b0ce73699d0 req-fe593d66-a22c-479f-b379-dbace7d80c88 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.120772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4625ccde-868d-435c-83d0-0b0ce73699d0 req-fe593d66-a22c-479f-b379-dbace7d80c88 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.121133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4625ccde-868d-435c-83d0-0b0ce73699d0 req-fe593d66-a22c-479f-b379-dbace7d80c88 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.136613 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4625ccde-868d-435c-83d0-0b0ce73699d0 req-fe593d66-a22c-479f-b379-dbace7d80c88 service nova] Creating event network-changed:c879fd78-dd6f-40c3-9d8b-39dd3edfdc80 for instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb on n-h1-833090-19 Sep 08 10:52:04.142293 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4625ccde-868d-435c-83d0-0b0ce73699d0 req-fe593d66-a22c-479f-b379-dbace7d80c88 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071976 Sep 08 10:52:04.143635 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3006/6237] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:04.315847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:04.316557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:04.326458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.326956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.327394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.334950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.335449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.335922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.521754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.567665 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-edc12efa-a3e0-42e2-a4a7-e0910915053b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 200 len: 1508 microversion: 2.1 time: 0.580767 Sep 08 10:52:04.570808 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3232/6238] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:03 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 1508 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:04.602970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:04.606001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:04.619868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.620377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.621428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.622148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:04.622603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:04.623034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:04.914416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:04.928022 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31c89f9b-3e7f-45c9-9749-ab0170f93f32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1213 microversion: 2.1 time: 0.617009 Sep 08 10:52:04.944736 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3007/6239] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:04 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1213 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:04.998728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.002599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:05.008961 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df3eb2ce-46a2-4e71-ad31-9f3382b27e25 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.409962 Sep 08 10:52:05.009556 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3233/6240] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:04 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:05.036104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:05.037126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:05.043913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.044675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.045256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.046141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.046753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.047630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.286802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.297604 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4497bda2-1cd5-4077-acc3-96a1434cd190 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.265951 Sep 08 10:52:05.317281 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3008/6241] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:05.323202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:05.323854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:05.337843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.338597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.339438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.340461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.341304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.341889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.784935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:05.804867 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c188d5c1-ab38-4b48-a167-46bd8dafc2e6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.485679 Sep 08 10:52:05.809202 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3234/6242] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:05.838623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:05.841720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:05.853091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.854098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.854987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.856206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.857357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.858932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.955755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:05.956443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:05.978238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.978748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.979196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:05.979958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:05.980418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:05.980854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.262918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:06.280220 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6bf31710-68a3-48a5-8939-7374e9dc35f6 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.447768 Sep 08 10:52:06.281500 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3009/6243] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:06.313958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-960e5fad-7380-4a39-891f-0c3dd1a154da tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:06.344578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-960e5fad-7380-4a39-891f-0c3dd1a154da tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.345576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-960e5fad-7380-4a39-891f-0c3dd1a154da tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.346158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-960e5fad-7380-4a39-891f-0c3dd1a154da tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.392464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-960e5fad-7380-4a39-891f-0c3dd1a154da tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 10:52:06.445634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:06.457738 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-960e5fad-7380-4a39-891f-0c3dd1a154da tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.148973 Sep 08 10:52:06.462576 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3010/6244] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:52:06 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:52:06.472074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:06.473418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:06.483913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.484728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.485989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.486944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:06.488178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:06.489473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:06.584044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:06.594202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f701b090-4637-47a7-a415-f8d87fe96623 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1213 microversion: 2.1 time: 0.643265 Sep 08 10:52:06.595571 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3235/6245] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:05 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1213 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:06.767343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:06.776505 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83130301-9efe-4123-8249-59cd741cac9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.311597 Sep 08 10:52:06.778477 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3011/6246] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:06 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:07.623319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:07.624090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:07.633308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.634362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.635024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.636317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.637039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.637707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.802680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:07.803538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:07.814433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.815083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.815662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:07.816678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:07.817356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:07.818000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:08.258518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:08.267481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c08a6d8-acc5-4a5b-9631-8c30fbc13e68 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1213 microversion: 2.1 time: 0.649024 Sep 08 10:52:08.269073 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3236/6247] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:07 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1213 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:08.328876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:08.338095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7843e625-b25a-413a-b478-23c1af0b20c5 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.539559 Sep 08 10:52:08.338748 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3012/6248] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:07 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:09.292886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:09.293609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:09.296752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:09.303399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.304124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.304871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.305794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.306444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.306946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.369747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:09.370935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:09.382602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.383342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.384092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.385344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:09.385901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:09.386477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:09.484024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:09.536476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.544709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-31eb3be5-bcd8-4e41-9b5c-42d88d75ebb3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.255857 Sep 08 10:52:09.545856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3237/6249] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:09 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:09.602310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:09.610447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ecba65d-1764-4114-a88d-9389801d30f4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.251412 Sep 08 10:52:09.611222 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3013/6250] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:09 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:10.569869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:10.570693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:10.577435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.577930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.578367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.579072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.579587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.580015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.636415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:10.637042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:10.647636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=58 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:10.656085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.656638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.657052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.657784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:10.658241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:10.658668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:10.868095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:10.883526 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1fca2555-ec53-4f38-90ed-3c7fa583f590 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.318562 Sep 08 10:52:10.887700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3238/6251] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:10 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:10.955651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:10.968264 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93ff8c6b-da55-48a2-bd9a-c820f9bd2f63 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.335708 Sep 08 10:52:10.969904 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3014/6252] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:10 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:11.916467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:11.917256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:11.924070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:11.924591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:11.925031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:11.925927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:11.926415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:11.927008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:11.996878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:11.998239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:12.006479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.007184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.008080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.009153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:12.009837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:12.010450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:12.217760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.227581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b37c9b7e-af49-42b3-b095-7068cc3ddb15 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.315915 Sep 08 10:52:12.243359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3239/6253] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:11 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:12.268017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:12.284007 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18c52b14-77c6-4fef-a98f-8640a9b199bf tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.291988 Sep 08 10:52:12.284796 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3015/6254] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:11 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:13.250366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:13.251148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:13.259123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.262811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.263525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.265045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.265539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.265976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.309468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:13.310004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:13.321890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.322652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.323283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.324473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:13.325085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:13.325665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:13.484474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:13.495938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5c4d2e57-520a-4f2c-bf51-6c125a0702b8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.249342 Sep 08 10:52:13.501012 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3240/6255] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:13 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:13.519275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:13.529026 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de52425f-e011-4f99-aa28-9b8e55e40a61 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.223743 Sep 08 10:52:13.534997 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3016/6256] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:13 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:14.522986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:14.523667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:14.530203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:14.532126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.532625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.533072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.533881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.534351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.534793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.555746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:14.556836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:14.564895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.565551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.566062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.567208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.567809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.568351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.768993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:14.773098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:14.784137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-545e3cf7-a19e-457f-a452-a6d8c1123e8f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.233531 Sep 08 10:52:14.784730 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3017/6257] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:14 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:14.792542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:14.795097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:14.799202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a666f19-2537-47ff-9579-8676aff23add tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.281643 Sep 08 10:52:14.816965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.817746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.818204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.818937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:14.819096 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3241/6258] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:14 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:14.819685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:14.820127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:14.884159 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c229abdf-9ae3-4195-9ccc-bc94ec7f7426 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "POST /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0/action" status: 200 len: 24572 microversion: 2.1 time: 0.094850 Sep 08 10:52:14.884944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3018/6259] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:52:14 2022] POST /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0/action => generated 24572 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 10:52:15.814659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:15.815312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:15.825384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:15.825988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.827928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.828639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:15.829319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:15.830754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.831390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.832617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:15.840491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.841152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.841696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:15.842597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:15.843159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:15.843732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:16.078740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.082708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:16.093724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-37d69e58-815d-49c7-ada8-d7f29a233924 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1680 microversion: 2.1 time: 0.283176 Sep 08 10:52:16.094215 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91d39e16-ada6-4914-8230-7ef7e05202c9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.274729 Sep 08 10:52:16.094917 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3242/6260] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:15 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:16.095193 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3019/6261] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:15 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:17.119090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:17.119919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:17.125512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:17.125512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:17.137543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.138343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.138930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.145483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.149429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.150125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.150950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.152557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.153569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.158028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.158773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.159519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.502990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.506224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.515387 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a979b94a-d886-42ed-9152-1181d498455d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.400950 Sep 08 10:52:17.515824 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50387750-7fc0-498e-881b-43b2ff0f8e9c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1657 microversion: 2.1 time: 0.400584 Sep 08 10:52:17.531488 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3020/6262] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:17 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1657 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:17.531872 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3243/6263] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:17 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:17.544325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-360a8690-a857-40bf-ae36-ea2c69b91a5e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:17.552029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-360a8690-a857-40bf-ae36-ea2c69b91a5e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.552903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-360a8690-a857-40bf-ae36-ea2c69b91a5e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.553427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-360a8690-a857-40bf-ae36-ea2c69b91a5e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.580026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-360a8690-a857-40bf-ae36-ea2c69b91a5e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Going to try to start instance {{(pid=122456) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 10:52:17.646786 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-360a8690-a857-40bf-ae36-ea2c69b91a5e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.106433 Sep 08 10:52:17.647533 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3021/6264] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:52:17 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:17.658886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:17.660379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:17.675318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.677033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.677751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.679444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:17.680173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:17.680860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:17.961614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:17.969669 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51b3d468-3956-4839-9f04-a3b50d8d0dcb tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1666 microversion: 2.1 time: 0.316112 Sep 08 10:52:17.970276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3244/6265] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:17 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1666 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:18.541697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.542399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:18.556389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.556890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.557683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.558154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:18.558608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:18.559027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:18.742139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:18.750480 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-90ada49a-1d18-4588-8400-06aaf1922873 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.214105 Sep 08 10:52:18.752448 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3022/6266] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:18 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:18.996947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:18.998164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:19.005958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.006474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.007090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.009324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.010274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.010758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.225398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.234710 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39da4378-798c-47ea-994c-6bed937fcff9 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1666 microversion: 2.1 time: 0.241706 Sep 08 10:52:19.236044 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3245/6267] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:18 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1666 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:19.357376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0631e7d5-d3a0-40f2-a8d5-f0de1c6f41b0 req-df0ca5c2-6b96-410d-a482-d409178d0389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279a52e8-e4ed-4d2e-a6eb-897027f3adeb", "name": "network-vif-plugged", "status": "completed", "tag": "c879fd78-dd6f-40c3-9d8b-39dd3edfdc80"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:19.368532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0631e7d5-d3a0-40f2-a8d5-f0de1c6f41b0 req-df0ca5c2-6b96-410d-a482-d409178d0389 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.370536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0631e7d5-d3a0-40f2-a8d5-f0de1c6f41b0 req-df0ca5c2-6b96-410d-a482-d409178d0389 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.371181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0631e7d5-d3a0-40f2-a8d5-f0de1c6f41b0 req-df0ca5c2-6b96-410d-a482-d409178d0389 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.386289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0631e7d5-d3a0-40f2-a8d5-f0de1c6f41b0 req-df0ca5c2-6b96-410d-a482-d409178d0389 service nova] Creating event network-vif-plugged:c879fd78-dd6f-40c3-9d8b-39dd3edfdc80 for instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb on n-h1-833090-19 Sep 08 10:52:19.392769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0631e7d5-d3a0-40f2-a8d5-f0de1c6f41b0 req-df0ca5c2-6b96-410d-a482-d409178d0389 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038998 Sep 08 10:52:19.393887 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3023/6268] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:52:19.775905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:19.776654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:19.784365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.785612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.786533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.787374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:19.787949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:19.788474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:19.949002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:19.958985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97141936-7230-4d0f-b3ee-f9190070f1e4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1201 microversion: 2.1 time: 0.187576 Sep 08 10:52:19.959608 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3246/6269] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:19 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1201 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:20.260413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.261718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.268260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.268969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.270104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.270969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.271668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.272252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.422369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.434593 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-03c720f6-5b3d-43ec-a4dc-4bcd462b7f28 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.179526 Sep 08 10:52:20.435895 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3024/6270] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:20.458479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.459238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.466914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.467733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.468385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.469299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.469960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.470598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.647748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.658471 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d4a43906-eb5b-4200-b2a2-e7b6f181c5a1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.203814 Sep 08 10:52:20.660017 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3247/6271] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:20.685293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.692193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.706567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.707364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.709925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.711074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.712620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.713210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.900755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:20.913135 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38f0da4e-4450-4cd9-a741-d2150a8caaef tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.231961 Sep 08 10:52:20.913801 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3025/6272] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:20.937979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.938607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.945167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.945662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.946097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.946817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.947269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.947762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.983227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:20.983893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:20.993403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.995782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.996229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:20.997126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:20.997585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:20.998008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.156493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.166538 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49efe67f-06ff-4af9-8dc3-176ebb0c0ffc tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.233657 Sep 08 10:52:21.174250 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3248/6273] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:21.202615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.203420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.211184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.211807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.212330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.213278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.213725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.214571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.335371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.343630 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4afe7b70-c1f8-4944-97f7-ebd92236b800 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1389 microversion: 2.1 time: 0.364359 Sep 08 10:52:21.364842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3026/6274] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:20 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1389 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:21.372462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.373075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.388397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.389165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.389787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.390762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.391357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.391956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.437765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:21.471740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.486037 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e307772d-9e2b-4f3c-afbf-a379387df272 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.287686 Sep 08 10:52:21.499910 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3249/6275] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:21.512618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:21.519427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.531950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.536235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.536846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.544107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.544745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.545343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.588212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:21.616210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.619062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lazy-loading 'flavor' on Instance uuid 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:21.631826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-56b17672-d2c1-4e51-9cad-d2b251dc9cf6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1389 microversion: 2.1 time: 0.265489 Sep 08 10:52:21.632791 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3027/6276] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1389 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:21.671165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.672114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.680389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.681243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.681847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.682737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.683401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.684014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.757063 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f5428a7f-13de-4131-83d0-25c2728dd065 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.248053 Sep 08 10:52:21.762168 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3250/6277] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:52:21 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:52:21.767969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.770954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.780978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.783363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.783994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.784898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.786189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.786854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.954368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:21.965525 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ea4069e-74c4-4b99-988a-ee9a83730ef1 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1389 microversion: 2.1 time: 0.301423 Sep 08 10:52:21.966607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3028/6278] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1389 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:21.989550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:21.990325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:21.996616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.997344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:21.998001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:21.998904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:21.999737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.000379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.011719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:22.021399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-858a431e-169d-4cd9-8e14-47654c819b39 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1678 microversion: 2.1 time: 0.257641 Sep 08 10:52:22.022396 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3251/6279] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:21 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:22.038443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:22.123434 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3acef4a4-dfef-4ba7-9a21-ef15c88d19cf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 204 len: 0 microversion: 2.1 time: 0.137663 Sep 08 10:52:22.127969 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3029/6280] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:21 2022] DELETE /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:52:22.134053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:22.134672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:22.140759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.141309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.141777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.142387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:22.142874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:22.143305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:22.360404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:22.372153 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-248888f8-65ef-4853-90c1-bdab7b5e5b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1395 microversion: 2.1 time: 0.241700 Sep 08 10:52:22.375364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3252/6281] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:22 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1395 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:23.045500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:23.046271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:23.055691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.056476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.056999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.057969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.058504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.059020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.205663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:23.214666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-799afff2-bd24-4c9d-ae29-afbec3c97ce8 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1678 microversion: 2.1 time: 0.173370 Sep 08 10:52:23.215397 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3030/6282] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:23 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:23.401328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:23.401935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:23.410112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.410769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.411212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.411954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:23.412571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:23.413009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:23.562585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:23.570909 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae2f0764-8708-4d7e-bc04-ff29495494fc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1395 microversion: 2.1 time: 0.173529 Sep 08 10:52:23.571507 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3253/6283] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:23 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1395 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:24.243445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.244774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0f4e500d-856a-48bf-b470-d400d258e01f req-08905b9f-6915-45ce-a4aa-353e1c130e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279a52e8-e4ed-4d2e-a6eb-897027f3adeb", "name": "network-vif-deleted", "tag": "c879fd78-dd6f-40c3-9d8b-39dd3edfdc80"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:24.248648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.262417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.263943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.264701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.266353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.267053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.267687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.270261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0f4e500d-856a-48bf-b470-d400d258e01f req-08905b9f-6915-45ce-a4aa-353e1c130e6d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.270838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0f4e500d-856a-48bf-b470-d400d258e01f req-08905b9f-6915-45ce-a4aa-353e1c130e6d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.271636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0f4e500d-856a-48bf-b470-d400d258e01f req-08905b9f-6915-45ce-a4aa-353e1c130e6d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.307125 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0f4e500d-856a-48bf-b470-d400d258e01f req-08905b9f-6915-45ce-a4aa-353e1c130e6d service nova] Creating event network-vif-deleted:c879fd78-dd6f-40c3-9d8b-39dd3edfdc80 for instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb on n-h1-833090-19 Sep 08 10:52:24.315373 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0f4e500d-856a-48bf-b470-d400d258e01f req-08905b9f-6915-45ce-a4aa-353e1c130e6d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075207 Sep 08 10:52:24.317220 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3254/6284] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:24.481715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:24.490960 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ac0fd05-8407-4418-b5c2-a49b90a08a9f tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1661 microversion: 2.1 time: 0.256247 Sep 08 10:52:24.492416 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3031/6285] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1661 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:24.515671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:24.516307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.523241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.523772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.524351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.525121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.525592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.526018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.604695 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a9455cf-9dc1-4e83-90b3-66b3be6b6508 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action" status: 202 len: 0 microversion: 2.1 time: 0.094002 Sep 08 10:52:24.605073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.608310 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3255/6286] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:52:24 2022] POST /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:24.608440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.624436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:24.624859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.625153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:24.625696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.626445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.627573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.629277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.629727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.632698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.633194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.633634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.634528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:24.635156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:24.635766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:24.810194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:24.825859 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8400427f-b382-49b2-8c38-4a9d12856583 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1186 microversion: 2.1 time: 0.224762 Sep 08 10:52:24.826485 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3032/6287] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1186 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:24.953898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:24.967635 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f0158a4-472e-4843-9c0c-b01ec15980b2 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1667 microversion: 2.1 time: 0.346053 Sep 08 10:52:24.969700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3256/6288] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:24 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1667 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:25.853891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:25.854523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:25.862090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:25.862977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:25.863797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:25.864736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:25.865423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:25.866065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:25.954572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:25.976083 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42dd4ff0-331d-4033-97a9-550bd6e97a8b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1186 microversion: 2.1 time: 0.125784 Sep 08 10:52:25.988936 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3033/6289] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:25 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:25.995911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:25.996660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:26.007680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:26.008933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:26.009592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:26.010665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:26.011538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:26.012237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:26.323070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:26.356450 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7fbc3723-4886-4bb6-ab33-530686688de3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1667 microversion: 2.1 time: 0.366774 Sep 08 10:52:26.362774 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3257/6290] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:25 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1667 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:27.005903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.007221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.015728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.016441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.017166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.018440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.019085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.019869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.131452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:27.159152 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac129f30-7493-406a-b45e-91f02351d170 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1186 microversion: 2.1 time: 0.160326 Sep 08 10:52:27.161958 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3034/6291] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:26 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1186 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:27.274551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1ba86067-f7b2-4669-bf5a-4af5b288d37e req-8ef84774-ad7c-4248-b4b3-b842b2999710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c465251-1d48-4633-8136-3dc38f9f47e0", "tag": "2866cb9f-26a0-4136-a522-8f39adbe5b5a"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:27.276472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.278843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.300546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.302238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.302757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.305069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.305954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.306294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ba86067-f7b2-4669-bf5a-4af5b288d37e req-8ef84774-ad7c-4248-b4b3-b842b2999710 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.306845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ba86067-f7b2-4669-bf5a-4af5b288d37e req-8ef84774-ad7c-4248-b4b3-b842b2999710 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.307372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.308664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1ba86067-f7b2-4669-bf5a-4af5b288d37e req-8ef84774-ad7c-4248-b4b3-b842b2999710 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.340364 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1ba86067-f7b2-4669-bf5a-4af5b288d37e req-8ef84774-ad7c-4248-b4b3-b842b2999710 service nova] Creating event network-changed:2866cb9f-26a0-4136-a522-8f39adbe5b5a for instance 6c465251-1d48-4633-8136-3dc38f9f47e0 on n-h1-833090-19 Sep 08 10:52:27.353489 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1ba86067-f7b2-4669-bf5a-4af5b288d37e req-8ef84774-ad7c-4248-b4b3-b842b2999710 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088009 Sep 08 10:52:27.355018 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3035/6292] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:27.366013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:27.381311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.382173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.395758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.396635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.398171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.400439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.401082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.402769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.544140 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-209c12ef-338f-4310-a93e-b124ec57de76 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 204 len: 0 microversion: 2.1 time: 0.280344 Sep 08 10:52:27.544382 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3258/6293] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:27 2022] DELETE /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:27.557351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.560463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.568958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.569798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.570316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.571308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.572152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.572274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.823325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:27.840808 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d336ee2-f4ac-4eb8-af0a-64e5b382f824 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.464347 Sep 08 10:52:27.844446 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3036/6294] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:27 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:27.865562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:27.866409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:27.873065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.873743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.874291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.875118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:27.875737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:27.876424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:27.880693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:27.889903 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-104c725d-c71d-45cd-a60a-66e2eb195cd9 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1687 microversion: 2.1 time: 0.339601 Sep 08 10:52:27.894762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3259/6295] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:27 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1687 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:28.151768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:28.164277 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce5ad235-1bc4-4ecb-8f0f-6f0d393f54e4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1670 microversion: 2.1 time: 0.303459 Sep 08 10:52:28.165702 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3037/6296] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:27 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1670 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:28.190524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.191035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.194948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.195803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.207089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.209117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.209850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.210496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.211420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.212182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.212868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.213532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.214449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.215088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.220030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.220756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.267240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:28.288676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Working on deleting snapshot 189475dc-04c1-4814-a310-5b73b6ed86d3 from shelved instance... Sep 08 10:52:28.339776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:28.350540 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9df6b243-c3d3-48a0-9cff-47be615b0f21 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1186 microversion: 2.1 time: 0.165027 Sep 08 10:52:28.368157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3260/6297] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:28 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1186 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:28.920875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:28.921490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:28.930429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.930975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.931363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:28.935995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:28.942223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:28.942927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.405524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:29.419955 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed7fbdc2-0873-4c24-8f9f-b3eb9bb924dc tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1687 microversion: 2.1 time: 0.502826 Sep 08 10:52:29.420559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3261/6298] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:28 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1687 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:29.430898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:29.431548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:29.448294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.448797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.449272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.450144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.450633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.451065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.641467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:29.653395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b28a58f7-cd7c-484d-8196-ddb9babfd45e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1186 microversion: 2.1 time: 0.228462 Sep 08 10:52:29.654266 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3262/6299] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:29 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1186 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:29.803643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Doing local delete in cell 52f990e6-f314-4e63-bea0-82e6545e9daa(cell1) {{(pid=122456) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 08 10:52:29.804450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.805118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.805728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.806333 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 08 10:52:29.832602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] deallocate_for_instance() {{(pid=122456) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 08 10:52:29.860691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7a929af1-b772-40b5-b0d4-424d6c1bd6f9 req-66d56e62-c946-44e3-acef-31ffbad69fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c465251-1d48-4633-8136-3dc38f9f47e0", "name": "network-vif-deleted", "tag": "2866cb9f-26a0-4136-a522-8f39adbe5b5a"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:29.885611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a929af1-b772-40b5-b0d4-424d6c1bd6f9 req-66d56e62-c946-44e3-acef-31ffbad69fbe service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:29.886363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a929af1-b772-40b5-b0d4-424d6c1bd6f9 req-66d56e62-c946-44e3-acef-31ffbad69fbe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:29.887955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7a929af1-b772-40b5-b0d4-424d6c1bd6f9 req-66d56e62-c946-44e3-acef-31ffbad69fbe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:29.915361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7a929af1-b772-40b5-b0d4-424d6c1bd6f9 req-66d56e62-c946-44e3-acef-31ffbad69fbe service nova] Creating event network-vif-deleted:2866cb9f-26a0-4136-a522-8f39adbe5b5a for instance 6c465251-1d48-4633-8136-3dc38f9f47e0 on n-h1-833090-19 Sep 08 10:52:29.932956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7a929af1-b772-40b5-b0d4-424d6c1bd6f9 req-66d56e62-c946-44e3-acef-31ffbad69fbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075926 Sep 08 10:52:29.933880 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3263/6300] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:30.452027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:30.452872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:30.464613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.465405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.466031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.468930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.469417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.469866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.479357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:30.566486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.567070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.567628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.568158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lazy-loading 'fault' on Instance uuid 6c465251-1d48-4633-8136-3dc38f9f47e0 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:30.645845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c9cc09a7b144e69cdf342c8f94680a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37c5b0349d45558389e7e8a15b5f85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:30.654286 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-77939b90-ddcf-40a5-9932-29900fc8234d tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 200 len: 1355 microversion: 2.1 time: 0.208466 Sep 08 10:52:30.668573 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3264/6301] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:30 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 1355 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:30.681853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:30.683543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:30.711644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.712462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.714195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.715694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:30.717335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:30.717791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:30.957378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Updating instance_info_cache with network_info: [] {{(pid=122456) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 10:52:31.088632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:31.103591 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b59f00a9-70ea-4b6f-8769-dc75fa2f15c6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1186 microversion: 2.1 time: 0.426363 Sep 08 10:52:31.107784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3265/6302] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:30 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1186 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:52:31.123923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b0fc2beb-5dc0-42ee-b5da-783afed2d037 req-de36fa58-c5b7-4ee8-82bf-363f00408acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f908f1b-5779-41dd-a378-e566b61c128d", "name": "network-vif-deleted", "tag": "c018b279-c362-4904-8830-bdc1d4707e8e"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:31.140870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0fc2beb-5dc0-42ee-b5da-783afed2d037 req-de36fa58-c5b7-4ee8-82bf-363f00408acc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.144606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0fc2beb-5dc0-42ee-b5da-783afed2d037 req-de36fa58-c5b7-4ee8-82bf-363f00408acc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.145391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b0fc2beb-5dc0-42ee-b5da-783afed2d037 req-de36fa58-c5b7-4ee8-82bf-363f00408acc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.187888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.server_external_events [req-b0fc2beb-5dc0-42ee-b5da-783afed2d037 req-de36fa58-c5b7-4ee8-82bf-363f00408acc service nova] Unable to find a host for instance 3f908f1b-5779-41dd-a378-e566b61c128d. Dropping event network-vif-deleted {{(pid=122457) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 10:52:31.189238 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b0fc2beb-5dc0-42ee-b5da-783afed2d037 req-de36fa58-c5b7-4ee8-82bf-363f00408acc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079265 Sep 08 10:52:31.191112 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3266/6303] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 10:52:31.571427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:31.640473 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f05039f-78e5-4a46-8564-c465bda8c0c0 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 204 len: 0 microversion: 2.1 time: 3.453531 Sep 08 10:52:31.642084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3038/6304] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:28 2022] DELETE /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 0 bytes in 3456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:31.650265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.651527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 3f908f1b-5779-41dd-a378-e566b61c128d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.659117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.659651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.660287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.661361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.662559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.663611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.682411 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] HTTP exception thrown: Instance 3f908f1b-5779-41dd-a378-e566b61c128d could not be found. Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Request method failure captured: Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d HTTP/1.1 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcext_l-x13rqAYE7pgy9joFU7N6RJ84cNZ1VfMsHvvhE7RPS_0_YJMxeqs1Hx5fIH8TyttqVjBB-jD4KB5Fc5TUMI-wqQZh6uKxQRT1YATeo1JQ9uJD_JkSt0ASyUtqjfE1r4wRtxf-1_7WeP4ok4WHAeBUfrqLYlP1uPiGPdpuOiM Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25af7888ff4a47bb9345d8274b0e61fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfc0dd22092d4110b24c5fa4efd5d9f2 Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3f908f1b-5779-41dd-a378-e566b61c128d could not be found. Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3f908f1b-5779-41dd-a378-e566b61c128d'} Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f908f1b-5779-41dd-a378-e566b61c128d could not be found. Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f908f1b-5779-41dd-a378-e566b61c128d could not be found. Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:31.684519 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f908f1b-5779-41dd-a378-e566b61c128d could not be found. Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Returning 404 to user: Instance 3f908f1b-5779-41dd-a378-e566b61c128d could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11d550ba-ce05-40c5-a71b-ecfbbfe13927 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d" status: 404 len: 111 microversion: 2.1 time: 0.039508 Sep 08 10:52:31.688989 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3267/6305] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:31 2022] GET /compute/v2.1/servers/3f908f1b-5779-41dd-a378-e566b61c128d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:31.694077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.694891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] [instance: 6c465251-1d48-4633-8136-3dc38f9f47e0] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.697791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.698474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.706613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.707486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.707980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.708445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.708778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.709080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.709383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.709539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.709902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.710114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.711645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.712302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.733682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] HTTP exception thrown: Instance 6c465251-1d48-4633-8136-3dc38f9f47e0 could not be found. Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Request method failure captured: Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 HTTP/1.1 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcbN7kVDbl2d9xWhQy9sas5ikS1r-wCjGuPvswVLKWW2eYrng081shN3QWLbsrgaqFbv4vkbON5vRl0d7co-dabrh0Zvt1MKDrEfki9ULYJrKU76dsoP9djIO8eKWw8yfgTEjhveMjDLXpNKFMlO1wcWo1CYm8sYRUmIXxhanJzr3_U Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6a37c5b0349d45558389e7e8a15b5f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6a37c5b0349d45558389e7e8a15b5f85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6a37c5b0349d45558389e7e8a15b5f85 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1869621317 Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: c7c9cc09a7b144e69cdf342c8f94680a Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1869621317-project Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 6c465251-1d48-4633-8136-3dc38f9f47e0 could not be found. Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6c465251-1d48-4633-8136-3dc38f9f47e0'} Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c465251-1d48-4633-8136-3dc38f9f47e0 could not be found. Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c465251-1d48-4633-8136-3dc38f9f47e0 could not be found. Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.735760 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c465251-1d48-4633-8136-3dc38f9f47e0 could not be found. Sep 08 10:52:31.741326 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:31.743112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Returning 404 to user: Instance 6c465251-1d48-4633-8136-3dc38f9f47e0 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:31.744151 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f67005e5-8732-4070-a02b-31358c00a7e7 tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0" status: 404 len: 111 microversion: 2.1 time: 0.055169 Sep 08 10:52:31.749470 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3039/6306] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:31 2022] GET /compute/v2.1/servers/6c465251-1d48-4633-8136-3dc38f9f47e0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:31.753665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:31.875580 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eff49629-30bc-4b74-a7a9-59d0134c2bce tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "DELETE /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 204 len: 0 microversion: 2.1 time: 0.183891 Sep 08 10:52:31.880258 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3268/6307] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:31 2022] DELETE /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:31.889174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:31.890140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:31.901936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.903960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.905663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:31.909582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:31.911321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:31.911917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.050582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:32.064590 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b3bfd1d-4710-4ef4-aeb0-8f0b1630a78e tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1466 microversion: 2.1 time: 0.180061 Sep 08 10:52:32.090062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3040/6308] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:31 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1466 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:32.134333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:32.135437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:32.142705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:32.143275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:32.143881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.144669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:32.145205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:32.145817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.194653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:32.195740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:32.196650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:32.197766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lazy-loading 'fault' on Instance uuid 279a52e8-e4ed-4d2e-a6eb-897027f3adeb {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:32.245227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:32.256083 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b5ac92d-bd15-400e-9f24-122a47425d40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 200 len: 1191 microversion: 2.1 time: 0.125923 Sep 08 10:52:32.257107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3269/6309] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:32 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 1191 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:33.097772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:33.099754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:33.108187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.108997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.109728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.110673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.111321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.112002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.216066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:33.233335 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80b22bcf-a33c-4b2d-ad39-d6eb3fb48004 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1466 microversion: 2.1 time: 0.139432 Sep 08 10:52:33.233910 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3041/6310] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:33 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:33.280331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:33.281005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 279a52e8-e4ed-4d2e-a6eb-897027f3adeb] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:33.289665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.290539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.291059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.291937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:33.292470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:33.293192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:33.310466 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb could not be found. Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb HTTP/1.1 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb could not be found. Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '279a52e8-e4ed-4d2e-a6eb-897027f3adeb'} Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb could not be found. Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb could not be found. Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:33.312785 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb could not be found. Sep 08 10:52:33.316400 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:33.318750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 279a52e8-e4ed-4d2e-a6eb-897027f3adeb could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:33.319986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1cdd304a-d9a5-4f91-8746-3469c614be95 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb" status: 404 len: 111 microversion: 2.1 time: 0.044197 Sep 08 10:52:33.320781 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3270/6311] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:33 2022] GET /compute/v2.1/servers/279a52e8-e4ed-4d2e-a6eb-897027f3adeb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:34.257603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:34.259039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:34.266570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.267494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.268679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.269627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.270342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.270982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.372971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:34.381846 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c40db811-b9f9-44da-ad0b-826afffd1160 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 200 len: 1466 microversion: 2.1 time: 0.128141 Sep 08 10:52:34.396343 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3042/6312] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:34 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:34.703191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-cd468bbc-5b54-4e5b-b0c0-89be87d94f23 req-bc8e0892-5fbc-41d1-9c43-d30e61aea8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464177ba-158e-42e3-a6b8-6bd412d8979d", "name": "network-vif-deleted", "tag": "2d3b4213-8d43-4d8d-8224-401beb9fbdd7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:34.748022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd468bbc-5b54-4e5b-b0c0-89be87d94f23 req-bc8e0892-5fbc-41d1-9c43-d30e61aea8fe service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:34.749333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd468bbc-5b54-4e5b-b0c0-89be87d94f23 req-bc8e0892-5fbc-41d1-9c43-d30e61aea8fe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:34.750338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd468bbc-5b54-4e5b-b0c0-89be87d94f23 req-bc8e0892-5fbc-41d1-9c43-d30e61aea8fe service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:34.765530 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-cd468bbc-5b54-4e5b-b0c0-89be87d94f23 req-bc8e0892-5fbc-41d1-9c43-d30e61aea8fe service nova] Creating event network-vif-deleted:2d3b4213-8d43-4d8d-8224-401beb9fbdd7 for instance 464177ba-158e-42e3-a6b8-6bd412d8979d on n-h1-833090-19 Sep 08 10:52:34.774399 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-cd468bbc-5b54-4e5b-b0c0-89be87d94f23 req-bc8e0892-5fbc-41d1-9c43-d30e61aea8fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078906 Sep 08 10:52:34.776809 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3271/6313] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:35.410151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:35.410923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 464177ba-158e-42e3-a6b8-6bd412d8979d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:35.436960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.437613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.439240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.440070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.440541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.442544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.472348 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] HTTP exception thrown: Instance 464177ba-158e-42e3-a6b8-6bd412d8979d could not be found. Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Request method failure captured: Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d HTTP/1.1 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcext_l-x13rqAYE7pgy9joFU7N6RJ84cNZ1VfMsHvvhE7RPS_0_YJMxeqs1Hx5fIH8TyttqVjBB-jD4KB5Fc5TUMI-wqQZh6uKxQRT1YATeo1JQ9uJD_JkSt0ASyUtqjfE1r4wRtxf-1_7WeP4ok4WHAeBUfrqLYlP1uPiGPdpuOiM Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25af7888ff4a47bb9345d8274b0e61fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfc0dd22092d4110b24c5fa4efd5d9f2 Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 464177ba-158e-42e3-a6b8-6bd412d8979d could not be found. Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '464177ba-158e-42e3-a6b8-6bd412d8979d'} Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464177ba-158e-42e3-a6b8-6bd412d8979d could not be found. Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464177ba-158e-42e3-a6b8-6bd412d8979d could not be found. Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:35.475048 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464177ba-158e-42e3-a6b8-6bd412d8979d could not be found. Sep 08 10:52:35.479283 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:35.481948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Returning 404 to user: Instance 464177ba-158e-42e3-a6b8-6bd412d8979d could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:35.483331 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51248723-1354-42ec-b8f1-571b2f32d1ea tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d" status: 404 len: 111 microversion: 2.1 time: 0.079133 Sep 08 10:52:35.487610 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3043/6314] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:35 2022] GET /compute/v2.1/servers/464177ba-158e-42e3-a6b8-6bd412d8979d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:35.495529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:35.496240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:35.529944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.531655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.532186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.534684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.543422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.544353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.622887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:35.802414 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb06f736-f14c-4c93-a992-0f838113defa tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 204 len: 0 microversion: 2.1 time: 0.312829 Sep 08 10:52:35.803832 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3272/6315] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:35 2022] DELETE /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 10:52:35.817886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:35.819369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:35.830301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.831166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.831959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:35.833421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:35.834691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:35.835310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:36.480383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:36.495131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82e397e3-cb69-486f-a96e-761718a8ede4 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1507 microversion: 2.1 time: 0.685703 Sep 08 10:52:36.503411 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3044/6316] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:35 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1507 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:37.526948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:37.527963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:37.543179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.543732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.544180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.544905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:37.545366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:37.545800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:37.703131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8b33ed5-5bba-4740-88a1-7f53bfb92f1c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] Calling method '.version_select at 0x7f23554bc940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:37.738592 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8b33ed5-5bba-4740-88a1-7f53bfb92f1c tempest-TestNetworkAdvancedServerOps-1869621317 tempest-TestNetworkAdvancedServerOps-1869621317-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-94127107" status: 202 len: 0 microversion: 2.1 time: 0.038918 Sep 08 10:52:37.741363 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3045/6317] 10.222.0.59 () {58 vars in 1278 bytes} [Thu Sep 8 10:52:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-94127107 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:37.885230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:37.908247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f401a5de-9ef5-4477-93db-3d8cbd304c4b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1507 microversion: 2.1 time: 0.385621 Sep 08 10:52:37.912443 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3273/6318] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:37 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:38.720849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6154d225-a2fc-4c0c-8621-fe07dfbb9e9e req-b72dd953-e4c2-472c-a07f-829e6fa0c76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a8d1386-72e0-4af2-b3e9-d08441f55430", "name": "network-vif-deleted", "tag": "6f87fa15-c647-4ad1-993a-cad185328baa"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:38.769088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6154d225-a2fc-4c0c-8621-fe07dfbb9e9e req-b72dd953-e4c2-472c-a07f-829e6fa0c76f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.769710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6154d225-a2fc-4c0c-8621-fe07dfbb9e9e req-b72dd953-e4c2-472c-a07f-829e6fa0c76f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.770159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6154d225-a2fc-4c0c-8621-fe07dfbb9e9e req-b72dd953-e4c2-472c-a07f-829e6fa0c76f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:38.795522 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6154d225-a2fc-4c0c-8621-fe07dfbb9e9e req-b72dd953-e4c2-472c-a07f-829e6fa0c76f service nova] Creating event network-vif-deleted:6f87fa15-c647-4ad1-993a-cad185328baa for instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 on n-h2-833090-19 Sep 08 10:52:38.801649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6154d225-a2fc-4c0c-8621-fe07dfbb9e9e req-b72dd953-e4c2-472c-a07f-829e6fa0c76f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086649 Sep 08 10:52:38.802814 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3046/6319] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:38.934488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:38.935837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:38.964997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.965698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.967007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:38.972059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:38.975409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:38.993106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.186875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:39.187385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:39.187911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:39.188381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lazy-loading 'fault' on Instance uuid 1a8d1386-72e0-4af2-b3e9-d08441f55430 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:39.439940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:39.462186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4999fcb7-0f29-4898-8dae-5f590004c80b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 200 len: 1305 microversion: 2.1 time: 0.531742 Sep 08 10:52:39.465716 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3274/6320] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:38 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 1305 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:40.494968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.496558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 1a8d1386-72e0-4af2-b3e9-d08441f55430] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:40.525537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.535809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.537520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.539616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.545717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.546506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.616382 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] HTTP exception thrown: Instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 could not be found. Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Request method failure captured: Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 HTTP/1.1 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcext_l-x13rqAYE7pgy9joFU7N6RJ84cNZ1VfMsHvvhE7RPS_0_YJMxeqs1Hx5fIH8TyttqVjBB-jD4KB5Fc5TUMI-wqQZh6uKxQRT1YATeo1JQ9uJD_JkSt0ASyUtqjfE1r4wRtxf-1_7WeP4ok4WHAeBUfrqLYlP1uPiGPdpuOiM Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25af7888ff4a47bb9345d8274b0e61fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfc0dd22092d4110b24c5fa4efd5d9f2 Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 could not be found. Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1a8d1386-72e0-4af2-b3e9-d08441f55430'} Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 could not be found. Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 could not be found. Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:40.623416 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 could not be found. Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Returning 404 to user: Instance 1a8d1386-72e0-4af2-b3e9-d08441f55430 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:40.627051 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e59787b-98f3-4026-9f70-37d1226a0117 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430" status: 404 len: 111 microversion: 2.1 time: 0.136481 Sep 08 10:52:40.629944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3047/6321] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:40 2022] GET /compute/v2.1/servers/1a8d1386-72e0-4af2-b3e9-d08441f55430 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:40.640086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:40.640682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:40.669444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.669952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.670396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.685237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:40.686943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:40.692009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:40.784252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:41.066421 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a757a6c6-41c1-4f71-99b9-9cd5ff356b3a tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "DELETE /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 204 len: 0 microversion: 2.1 time: 0.432261 Sep 08 10:52:41.069556 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3275/6322] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:40 2022] DELETE /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:41.080872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:41.081501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:41.083678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:41.092999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:41.093500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:41.093935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:41.094638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:41.095093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:41.095539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:41.426319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-335084709", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "59d55613-c63d-445d-972d-34e5334d01aa"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:41.433553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:41.445958 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e497231-4af2-4485-8732-718a5c3f4058 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1493 microversion: 2.1 time: 0.368406 Sep 08 10:52:41.455865 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3048/6323] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:41 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1493 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:41.456093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:41.524091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] validate_networks() for [('59d55613-c63d-445d-972d-34e5334d01aa', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:52:42.051820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:52:42.052450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:52:42.052984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:52:42.053506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:52:42.054290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:52:42.069408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:42.070427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:42.071204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:42.072522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:42.073221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:42.074283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:42.103266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Getting quotas for project 0a849ce63e35466fbf74d7c93ae8bd5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:52:42.110036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Getting quotas for user 5cd075922b20482a8ac962012a370296 and project 0a849ce63e35466fbf74d7c93ae8bd5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:52:42.128821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:52:42.132135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:52:42.222675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-12549e03-8283-4679-b948-69f47795f789 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081340 Sep 08 10:52:42.232898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3276/6324] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:52:42.250365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-215c108b-a85f-4a7a-967b-3d5ed5d4d6dd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:42.251408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-215c108b-a85f-4a7a-967b-3d5ed5d4d6dd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:42.422541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-215c108b-a85f-4a7a-967b-3d5ed5d4d6dd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:42.432686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-215c108b-a85f-4a7a-967b-3d5ed5d4d6dd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1213 microversion: 2.1 time: 0.191094 Sep 08 10:52:42.447976 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3049/6325] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:42 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:42.471026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:42.472603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:42.490982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:42.492713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:42.494597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:42.501563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:42.502071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:42.503073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:42.778608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:42.799527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dddf06ca-5b5c-4056-a972-02349b05cb30 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 200 len: 1493 microversion: 2.1 time: 0.332973 Sep 08 10:52:42.806071 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3277/6326] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:42 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 1493 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:43.085193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7e996380-32dc-4a74-82d9-1ae06f3248f7 req-c1e0b4b3-7e6e-4215-94b3-5410f8e81eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448defd5-ead5-4944-be22-6932a12c695e", "name": "network-vif-deleted", "tag": "1c1b8dfe-71bb-40ae-9003-90c4ecc78de4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:43.106675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e996380-32dc-4a74-82d9-1ae06f3248f7 req-c1e0b4b3-7e6e-4215-94b3-5410f8e81eab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.107167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e996380-32dc-4a74-82d9-1ae06f3248f7 req-c1e0b4b3-7e6e-4215-94b3-5410f8e81eab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.115351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e996380-32dc-4a74-82d9-1ae06f3248f7 req-c1e0b4b3-7e6e-4215-94b3-5410f8e81eab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.132136 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7e996380-32dc-4a74-82d9-1ae06f3248f7 req-c1e0b4b3-7e6e-4215-94b3-5410f8e81eab service nova] Creating event network-vif-deleted:1c1b8dfe-71bb-40ae-9003-90c4ecc78de4 for instance 448defd5-ead5-4944-be22-6932a12c695e on n-h1-833090-19 Sep 08 10:52:43.137406 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7e996380-32dc-4a74-82d9-1ae06f3248f7 req-c1e0b4b3-7e6e-4215-94b3-5410f8e81eab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066983 Sep 08 10:52:43.138296 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3050/6327] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:43.458674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.460114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:43.470769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.476190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.477518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.478945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.480361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.482271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.491396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:43.635091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:43.644836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-80ef63ef-0223-429e-ac14-18366bd8090b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1265 microversion: 2.1 time: 0.191077 Sep 08 10:52:43.647206 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3278/6328] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:43 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:43.831932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.833519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 448defd5-ead5-4944-be22-6932a12c695e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:43.851632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.854285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.854912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.855687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.856143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.856579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.871978 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] HTTP exception thrown: Instance 448defd5-ead5-4944-be22-6932a12c695e could not be found. Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Request method failure captured: Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e HTTP/1.1 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcext_l-x13rqAYE7pgy9joFU7N6RJ84cNZ1VfMsHvvhE7RPS_0_YJMxeqs1Hx5fIH8TyttqVjBB-jD4KB5Fc5TUMI-wqQZh6uKxQRT1YATeo1JQ9uJD_JkSt0ASyUtqjfE1r4wRtxf-1_7WeP4ok4WHAeBUfrqLYlP1uPiGPdpuOiM Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25af7888ff4a47bb9345d8274b0e61fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dfc0dd22092d4110b24c5fa4efd5d9f2 Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 448defd5-ead5-4944-be22-6932a12c695e could not be found. Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '448defd5-ead5-4944-be22-6932a12c695e'} Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448defd5-ead5-4944-be22-6932a12c695e could not be found. Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448defd5-ead5-4944-be22-6932a12c695e could not be found. Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:43.873801 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448defd5-ead5-4944-be22-6932a12c695e could not be found. Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Returning 404 to user: Instance 448defd5-ead5-4944-be22-6932a12c695e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a3fed19-3aae-4ab5-aad0-3d131cab2696 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e" status: 404 len: 111 microversion: 2.1 time: 0.049794 Sep 08 10:52:43.878146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3051/6329] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:43 2022] GET /compute/v2.1/servers/448defd5-ead5-4944-be22-6932a12c695e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:43.884646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:43.885145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:43.898674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.899105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.899567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.900272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:43.900894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:43.901880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:43.935010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:44.075527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8275fe81-5490-4a87-a634-72ea95e6dea1 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "DELETE /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 204 len: 0 microversion: 2.1 time: 0.194525 Sep 08 10:52:44.079638 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3279/6330] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:43 2022] DELETE /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:44.087143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:44.087975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:44.107136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.109871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.113806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.114636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.115140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.115620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.478115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:44.493577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-21d1846a-4fdc-46c5-90f8-047eed1bd17b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1676 microversion: 2.1 time: 0.412002 Sep 08 10:52:44.515373 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3052/6331] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:44 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1676 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:44.669250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:44.669888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:44.682563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.686532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.691514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.693029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:44.694010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:44.694862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:44.807227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:44.817448 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1336aee1-00d3-4588-9100-3d2bfd2a0d19 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1271 microversion: 2.1 time: 0.152621 Sep 08 10:52:44.834147 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3280/6332] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:44 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:45.522369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:45.522902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:45.530354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:45.531112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:45.531848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:45.532725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:45.533848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:45.534279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:45.776180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:45.776670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:45.790942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:45.791450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:45.791938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:45.792673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:45.793121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:45.793550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:45.827744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:45.847141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f4cf98b1-591b-47b3-a852-d30a30f2cd8c tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1676 microversion: 2.1 time: 0.322817 Sep 08 10:52:45.848283 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3053/6333] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:45 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1676 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:45.859452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:45.861072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:45.871678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:45.875906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:45.878075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:45.878903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:45.879446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:45.883310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:45.905867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lazy-loading 'services' on Instance uuid 18d84c0c-39de-48c6-ae3f-54ca409174b5 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:46.005892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-47d91e11-67b8-4e7f-8a5a-830d08f90b46 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "DELETE /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5/os-volume_attachments/c8a5a957-7c29-4621-9d6b-f7bf941f69e1" status: 202 len: 0 microversion: 2.1 time: 0.233957 Sep 08 10:52:46.007551 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3281/6334] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 10:52:45 2022] DELETE /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5/os-volume_attachments/c8a5a957-7c29-4621-9d6b-f7bf941f69e1 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:52:46.175141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:46.184146 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18b64622-a62c-41f7-a410-f2dce2989fdb tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.334655 Sep 08 10:52:46.185074 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3054/6335] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:45 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:46.234347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a2d2d753-30f1-4f0b-bfc8-02110c1a3cb9 req-f8163e8d-a13d-44a5-b38f-968940e9dae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5345694c-d140-45c2-9778-0de4ae6100b5", "tag": "28e04f9e-7092-4f11-8257-db2c8d712be6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:46.248208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2d2d753-30f1-4f0b-bfc8-02110c1a3cb9 req-f8163e8d-a13d-44a5-b38f-968940e9dae4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.248695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2d2d753-30f1-4f0b-bfc8-02110c1a3cb9 req-f8163e8d-a13d-44a5-b38f-968940e9dae4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.249162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2d2d753-30f1-4f0b-bfc8-02110c1a3cb9 req-f8163e8d-a13d-44a5-b38f-968940e9dae4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.266145 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a2d2d753-30f1-4f0b-bfc8-02110c1a3cb9 req-f8163e8d-a13d-44a5-b38f-968940e9dae4 service nova] Creating event network-changed:28e04f9e-7092-4f11-8257-db2c8d712be6 for instance 5345694c-d140-45c2-9778-0de4ae6100b5 on n-h2-833090-19 Sep 08 10:52:46.271544 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a2d2d753-30f1-4f0b-bfc8-02110c1a3cb9 req-f8163e8d-a13d-44a5-b38f-968940e9dae4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043382 Sep 08 10:52:46.272405 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3282/6336] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 10:52:46.734135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-71ed5ba0-c021-4a68-87a9-b13092b05f55 req-437ce115-d6b5-4003-b35d-854d86d6be1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2dae2-b6a3-4c39-baaf-a851b51c9e66", "name": "network-vif-deleted", "tag": "49326f9d-70aa-4c23-ba63-f11a4df4b2e1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:46.763766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-71ed5ba0-c021-4a68-87a9-b13092b05f55 req-437ce115-d6b5-4003-b35d-854d86d6be1f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.764554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-71ed5ba0-c021-4a68-87a9-b13092b05f55 req-437ce115-d6b5-4003-b35d-854d86d6be1f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.766747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-71ed5ba0-c021-4a68-87a9-b13092b05f55 req-437ce115-d6b5-4003-b35d-854d86d6be1f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.786133 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-71ed5ba0-c021-4a68-87a9-b13092b05f55 req-437ce115-d6b5-4003-b35d-854d86d6be1f service nova] Creating event network-vif-deleted:49326f9d-70aa-4c23-ba63-f11a4df4b2e1 for instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 on n-h1-833090-19 Sep 08 10:52:46.791395 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-71ed5ba0-c021-4a68-87a9-b13092b05f55 req-437ce115-d6b5-4003-b35d-854d86d6be1f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061145 Sep 08 10:52:46.792637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3055/6337] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:52:46.877333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:46.878906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:46.895685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.896215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.896672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.897405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.897869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.898303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.989638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:46.995506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:46.996714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:46.997418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lazy-loading 'fault' on Instance uuid 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:47.093147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc0dd22092d4110b24c5fa4efd5d9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25af7888ff4a47bb9345d8274b0e61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:47.109784 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f39fe4a-52ae-40b4-a2ea-03e9a2ffa8b3 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 200 len: 1329 microversion: 2.1 time: 0.240881 Sep 08 10:52:47.110410 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3283/6338] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:46 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 1329 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:47.213754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:47.215979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:47.233364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:47.234555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:47.237597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:47.238441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:47.239780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:47.242657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:47.470270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:47.480034 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6db84898-f457-46ee-b064-fe34572f0266 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.271903 Sep 08 10:52:47.496121 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3056/6339] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:47 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:48.135013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:48.135703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] [instance: 34b2dae2-b6a3-4c39-baaf-a851b51c9e66] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:48.147779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.148767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.149381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.150520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.151804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.152897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.175684 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] HTTP exception thrown: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 could not be found. Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Request method failure captured: Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 HTTP/1.1 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcext_l-x13rqAYE7pgy9joFU7N6RJ84cNZ1VfMsHvvhE7RPS_0_YJMxeqs1Hx5fIH8TyttqVjBB-jD4KB5Fc5TUMI-wqQZh6uKxQRT1YATeo1JQ9uJD_JkSt0ASyUtqjfE1r4wRtxf-1_7WeP4ok4WHAeBUfrqLYlP1uPiGPdpuOiM Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25af7888ff4a47bb9345d8274b0e61fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25af7888ff4a47bb9345d8274b0e61fa", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 25af7888ff4a47bb9345d8274b0e61fa Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-2072201546 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dfc0dd22092d4110b24c5fa4efd5d9f2 Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-2072201546-project Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 could not be found. Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '34b2dae2-b6a3-4c39-baaf-a851b51c9e66'} Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 could not be found. Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 could not be found. Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:48.177594 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 could not be found. Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Returning 404 to user: Instance 34b2dae2-b6a3-4c39-baaf-a851b51c9e66 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd705b25-37e8-4f37-96b5-a3f04475bf50 tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66" status: 404 len: 111 microversion: 2.1 time: 0.048862 Sep 08 10:52:48.181271 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3284/6340] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:48 2022] GET /compute/v2.1/servers/34b2dae2-b6a3-4c39-baaf-a851b51c9e66 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:52:48.188020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-38e98390-22d6-491b-825f-04c0ccae208b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] Calling method '.version_select at 0x7f23516a0940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:48.226403 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-38e98390-22d6-491b-825f-04c0ccae208b tempest-ServerActionsTestJSON-2072201546 tempest-ServerActionsTestJSON-2072201546-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835092664" status: 202 len: 0 microversion: 2.1 time: 0.042125 Sep 08 10:52:48.227608 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3057/6341] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 10:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835092664 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:52:48.506753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:48.508014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:48.516784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.518277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.518961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.520029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:48.522291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:48.523258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:48.761311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:48.776120 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-91845c12-cfa0-4719-afd5-d8e5a12d0ba3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.271990 Sep 08 10:52:48.791501 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3285/6342] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:48 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:49.800515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:49.801723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:49.812215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:49.813593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:49.814943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:49.817441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:49.820372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:49.820812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:50.084373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:50.093337 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d33bb61-7f57-464f-bb01-bafd2d92450c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.297122 Sep 08 10:52:50.094376 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3058/6343] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:49 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:51.116959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:51.117720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:51.127577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.132654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.133511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.134445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.135160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.135864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.297779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:51.306291 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c797dae0-ed0d-4b36-b5cb-d35920926d1b tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.193522 Sep 08 10:52:51.307087 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3286/6344] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:51 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:51.554381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:51.556101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:51.563244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.563758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.564396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.565418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.566043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.566796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.609968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:52:51.674254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=87 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:51.742063 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3ac5238f-75a9-41d1-9357-21339b4387ac tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "DELETE /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 204 len: 0 microversion: 2.1 time: 0.182532 Sep 08 10:52:51.743667 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3059/6345] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:52:51 2022] DELETE /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:52:51.751479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:51.752488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:51.758923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.759608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.760208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.760913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:51.761367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:51.761788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:51.916478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:51.925911 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ded6fca4-c5b2-4b7a-8f7a-9ce9f3c0f2de tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1470 microversion: 2.1 time: 0.178226 Sep 08 10:52:51.940121 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3287/6346] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:51 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:52.332326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:52.333054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:52.342667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.343159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.343658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.344879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.345342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.346048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.437269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:52.605993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:52.616281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee0de6f1-fbad-4782-8f34-d619f18025cd tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.290163 Sep 08 10:52:52.632267 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3060/6347] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:52 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:52.950673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:52.951302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:52.953378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:52.956971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:52:52.973979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.974714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.975307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:52.977083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:52.978544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:52.979151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.231778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:53.237672 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afc838c9-ac64-49e9-8c86-7eec7c2f67d1 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1470 microversion: 2.1 time: 0.291195 Sep 08 10:52:53.238672 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3288/6348] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:52 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:53.642291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:53.643758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:53.653848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.654555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.655339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.656270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.656886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.657470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.710271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5ec50fa2-5503-4792-a5a4-3c2e4da964d6 req-db31073d-02e8-4924-879a-ea679e92c52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5345694c-d140-45c2-9778-0de4ae6100b5", "name": "network-vif-plugged", "status": "completed", "tag": "28e04f9e-7092-4f11-8257-db2c8d712be6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:53.725138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ec50fa2-5503-4792-a5a4-3c2e4da964d6 req-db31073d-02e8-4924-879a-ea679e92c52d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:53.726225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ec50fa2-5503-4792-a5a4-3c2e4da964d6 req-db31073d-02e8-4924-879a-ea679e92c52d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:53.726858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5ec50fa2-5503-4792-a5a4-3c2e4da964d6 req-db31073d-02e8-4924-879a-ea679e92c52d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:53.754497 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5ec50fa2-5503-4792-a5a4-3c2e4da964d6 req-db31073d-02e8-4924-879a-ea679e92c52d service nova] Creating event network-vif-plugged:28e04f9e-7092-4f11-8257-db2c8d712be6 for instance 5345694c-d140-45c2-9778-0de4ae6100b5 on n-h2-833090-19 Sep 08 10:52:53.768761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5ec50fa2-5503-4792-a5a4-3c2e4da964d6 req-db31073d-02e8-4924-879a-ea679e92c52d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062616 Sep 08 10:52:53.770027 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3289/6349] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:52:54.204452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:54.216002 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb5710da-b1da-4669-b1ed-74df7a47d2c3 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.578128 Sep 08 10:52:54.217292 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3061/6350] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:53 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:54.268683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:54.269504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:54.280552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:54.281059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:54.281503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:54.282333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:54.283376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:54.283828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:54.882883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:54.892994 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-613f3ab3-75cb-41e7-9c4f-f363194b96d2 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1470 microversion: 2.1 time: 0.632050 Sep 08 10:52:54.911043 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3290/6351] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:54 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1470 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:55.044726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f5002d4e-1f06-44da-9668-1deb7d253b46 req-2090b674-d2d4-4110-89cd-265c09b334c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d84c0c-39de-48c6-ae3f-54ca409174b5", "name": "network-vif-deleted", "tag": "2be97b60-b14f-4e8f-b10d-7b4491875831"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:52:55.075344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f5002d4e-1f06-44da-9668-1deb7d253b46 req-2090b674-d2d4-4110-89cd-265c09b334c3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.075882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f5002d4e-1f06-44da-9668-1deb7d253b46 req-2090b674-d2d4-4110-89cd-265c09b334c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.082476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f5002d4e-1f06-44da-9668-1deb7d253b46 req-2090b674-d2d4-4110-89cd-265c09b334c3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.097093 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f5002d4e-1f06-44da-9668-1deb7d253b46 req-2090b674-d2d4-4110-89cd-265c09b334c3 service nova] Creating event network-vif-deleted:2be97b60-b14f-4e8f-b10d-7b4491875831 for instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 on n-h2-833090-19 Sep 08 10:52:55.104670 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f5002d4e-1f06-44da-9668-1deb7d253b46 req-2090b674-d2d4-4110-89cd-265c09b334c3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065058 Sep 08 10:52:55.105894 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3062/6352] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:52:55.239136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:55.239806 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:55.254669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.255172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.255835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.259110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.259811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.260952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.549102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:55.572752 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9a910e4-81e4-4e5c-89ca-d0491fc0d8ff tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1313 microversion: 2.1 time: 0.337730 Sep 08 10:52:55.573400 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3291/6353] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:55 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:55.919154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:55.920224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:55.929712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.930472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.931915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.933188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.934374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.935801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:55.989890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:55.990536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:55.999249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.000471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lazy-loading 'fault' on Instance uuid 18d84c0c-39de-48c6-ae3f-54ca409174b5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:52:56.084093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa7df5d466e8483b89a8c723ca6829f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6950c753eeeb4dc183e8a934656c25d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:56.092757 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af3599ea-44c3-4bf4-895c-caf441ef508a tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 200 len: 1304 microversion: 2.1 time: 0.178422 Sep 08 10:52:56.096545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3063/6354] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:55 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 1304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:56.596833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:56.597465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:56.609177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.609916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.610364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.611734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:56.612198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:56.612628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:56.866766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:52:56.875396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1498 microversion: 2.1 time: 0.283462 Sep 08 10:52:56.892269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3292/6355] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:56 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1498 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:52:57.135255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:52:57.135916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] [instance: 18d84c0c-39de-48c6-ae3f-54ca409174b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:52:57.150380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.150940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.152273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.153315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:52:57.153926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:52:57.154362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:52:57.173020 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] HTTP exception thrown: Instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 could not be found. Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Request method failure captured: Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 HTTP/1.1 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckCJGrlD6ODhxRUBN6HMFvymT7MYBESEgMMGfzaUnKlxZPlLC7TTgdcPFuSayGZwtDDWnA4VBeE5Zg2ghxq8w-Yj7dA7pWJ6lZKoX6LCAEf1iAdtfLqhJ7OpQehxWuToPhienS3mePTK37FBq36Zx6USd1BAw9PRZnzujLVZPTRWhg Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 6950c753eeeb4dc183e8a934656c25d2 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-VolumesBackupsTest-482704880 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6950c753eeeb4dc183e8a934656c25d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6950c753eeeb4dc183e8a934656c25d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6950c753eeeb4dc183e8a934656c25d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6950c753eeeb4dc183e8a934656c25d2", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-VolumesBackupsTest-482704880 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 6950c753eeeb4dc183e8a934656c25d2 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-VolumesBackupsTest-482704880 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-VolumesBackupsTest-482704880-project Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: fa7df5d466e8483b89a8c723ca6829f5 Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-VolumesBackupsTest-482704880-project Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 could not be found. Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '18d84c0c-39de-48c6-ae3f-54ca409174b5'} Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 could not be found. Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 could not be found. Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:52:57.175681 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 could not be found. Sep 08 10:52:57.181559 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:52:57.193093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] Returning 404 to user: Instance 18d84c0c-39de-48c6-ae3f-54ca409174b5 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:52:57.194517 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93199e32-cacd-419b-81a4-1501dfb8d017 tempest-VolumesBackupsTest-482704880 tempest-VolumesBackupsTest-482704880-project] 10.222.0.59 "GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5" status: 404 len: 111 microversion: 2.1 time: 0.077619 Sep 08 10:52:57.195890 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3064/6356] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:52:57 2022] GET /compute/v2.1/servers/18d84c0c-39de-48c6-ae3f-54ca409174b5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:53:01.544171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:01.545710 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f493677-ec15-4277-8d6d-43fa0c5d7007 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001951 Sep 08 10:53:01.546265 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3293/6357] 10.222.0.59 () {56 vars in 886 bytes} [Thu Sep 8 10:53:01 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 10:53:01.678107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:01.678690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:01.686103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:01.702961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:01.703601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:01.705920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:01.706486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:01.708256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:01.776744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:53:01.963849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c14ff89-7912-410d-960e-1665aee6aca1 tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 204 len: 0 microversion: 2.1 time: 0.289531 Sep 08 10:53:01.964452 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3065/6358] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:53:01 2022] DELETE /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:53:01.974756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:01.975683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:01.994403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:01.995190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:01.996019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:01.998942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:02.001703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:02.002330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:02.245664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:02.259299 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2d8bd32b-93b0-44cb-8417-a403c2f9e27c tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1504 microversion: 2.1 time: 0.290065 Sep 08 10:53:02.260101 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3294/6359] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:01 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:03.292225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:03.293863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:03.310597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:03.312254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:03.313420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:03.323146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:03.327412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:03.330180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:03.712045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:03.728065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-441134dd-c10a-49c5-b2b1-b0352d18ba0d tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1504 microversion: 2.1 time: 0.446076 Sep 08 10:53:03.744116 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3066/6360] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:03 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:04.435308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1bec8458-cbd7-4f2a-b56e-ae069ccb2bfa req-e0001cec-4464-4c04-8eaa-9b3e09b9a2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5345694c-d140-45c2-9778-0de4ae6100b5", "name": "network-vif-deleted", "tag": "28e04f9e-7092-4f11-8257-db2c8d712be6"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:04.457926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1bec8458-cbd7-4f2a-b56e-ae069ccb2bfa req-e0001cec-4464-4c04-8eaa-9b3e09b9a2e6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.458991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1bec8458-cbd7-4f2a-b56e-ae069ccb2bfa req-e0001cec-4464-4c04-8eaa-9b3e09b9a2e6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.459795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1bec8458-cbd7-4f2a-b56e-ae069ccb2bfa req-e0001cec-4464-4c04-8eaa-9b3e09b9a2e6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.464499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:04.474582 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1bec8458-cbd7-4f2a-b56e-ae069ccb2bfa req-e0001cec-4464-4c04-8eaa-9b3e09b9a2e6 service nova] Creating event network-vif-deleted:28e04f9e-7092-4f11-8257-db2c8d712be6 for instance 5345694c-d140-45c2-9778-0de4ae6100b5 on n-h2-833090-19 Sep 08 10:53:04.481794 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1bec8458-cbd7-4f2a-b56e-ae069ccb2bfa req-e0001cec-4464-4c04-8eaa-9b3e09b9a2e6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051260 Sep 08 10:53:04.483845 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3295/6361] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:04.761110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:04.761806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:04.771727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.772627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.773293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.774597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.775289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.775981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.861683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:04.862925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:04.872504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:04.873500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lazy-loading 'fault' on Instance uuid 5345694c-d140-45c2-9778-0de4ae6100b5 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:53:05.085793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd075922b20482a8ac962012a370296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a849ce63e35466fbf74d7c93ae8bd5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:05.097600 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-830898a6-6318-42c3-a8fb-4f7e8491372a tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 200 len: 1303 microversion: 2.1 time: 0.340550 Sep 08 10:53:05.098818 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3067/6362] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:04 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 1303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:06.133539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:06.134933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] [instance: 5345694c-d140-45c2-9778-0de4ae6100b5] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:06.156501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:06.160069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:06.160701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:06.161987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:06.162636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:06.163319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:06.204443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] HTTP exception thrown: Instance 5345694c-d140-45c2-9778-0de4ae6100b5 could not be found. Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Request method failure captured: Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 HTTP/1.1 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcl19qO_cNxXRwDllRnbHOuzvs4sgmNbQJP3h7rE0NTl4wzGSH8DUUQ19xlkTVbraGJrUmDjUvnr633MTmDdrd9z07Xmire_eYd9PUI3OqzcKBK6D9iakjOhBJ4yYRDpA_uzKVdd97nPTEjm1kQYP7T8p1v-8_0Zyf8hMIoIrU-WJNs Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 0a849ce63e35466fbf74d7c93ae8bd5a Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-VolumesActionsTest-652706931 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0a849ce63e35466fbf74d7c93ae8bd5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0a849ce63e35466fbf74d7c93ae8bd5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0a849ce63e35466fbf74d7c93ae8bd5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0a849ce63e35466fbf74d7c93ae8bd5a", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-VolumesActionsTest-652706931 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 0a849ce63e35466fbf74d7c93ae8bd5a Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-VolumesActionsTest-652706931 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-VolumesActionsTest-652706931-project Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 5cd075922b20482a8ac962012a370296 Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-VolumesActionsTest-652706931-project Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 5345694c-d140-45c2-9778-0de4ae6100b5 could not be found. Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '5345694c-d140-45c2-9778-0de4ae6100b5'} Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5345694c-d140-45c2-9778-0de4ae6100b5 could not be found. Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5345694c-d140-45c2-9778-0de4ae6100b5 could not be found. Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:06.206610 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5345694c-d140-45c2-9778-0de4ae6100b5 could not be found. Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] Returning 404 to user: Instance 5345694c-d140-45c2-9778-0de4ae6100b5 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-203a2a4e-6f7f-430f-b5a8-cba82a56fc5e tempest-VolumesActionsTest-652706931 tempest-VolumesActionsTest-652706931-project] 10.222.0.59 "GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5" status: 404 len: 111 microversion: 2.1 time: 0.089478 Sep 08 10:53:06.213621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3296/6363] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:06 2022] GET /compute/v2.1/servers/5345694c-d140-45c2-9778-0de4ae6100b5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:53:09.056321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-297618347", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "034706eb-3c15-4fa6-9957-8ba0b1d0d180", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:09.203002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:53:09.877720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:53:09.878231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:53:09.878729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:53:09.879709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:53:09.880138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:53:09.894207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:09.894701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:09.895144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:09.895901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:09.896373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:09.896968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:09.919359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:53:09.927332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:53:09.942440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:53:09.945017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='034706eb-3c15-4fa6-9957-8ba0b1d0d180',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:53:10.044682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b4dc455c-32b5-49fc-88e4-a0308113e7dd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003970 Sep 08 10:53:10.045671 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3068/6364] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:53:10.058576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abbe9903-92e9-48bc-b8dc-dae027e51f4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:10.064834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-abbe9903-92e9-48bc-b8dc-dae027e51f4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:10.166009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-abbe9903-92e9-48bc-b8dc-dae027e51f4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:10.177904 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-abbe9903-92e9-48bc-b8dc-dae027e51f4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1056 microversion: 2.1 time: 0.122921 Sep 08 10:53:10.178497 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3297/6365] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:10 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1056 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:11.204758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:11.206216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:11.215239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:11.217242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:11.218185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:11.218941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:11.219982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:11.220557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:11.221096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:11.337940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:11.347735 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b790c60-a81a-482e-a95d-e0ae3440ac8a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1108 microversion: 2.1 time: 0.147466 Sep 08 10:53:11.359687 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3069/6366] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:11 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1108 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:12.372744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:12.373238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:12.377702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:12.389957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.390489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.390902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.391702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:12.392164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:12.392599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:12.693306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:12.706599 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5f8a0d12-2032-43c3-8652-5c0bd155e70a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.338148 Sep 08 10:53:12.708709 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3298/6367] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:12 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:13.733021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:13.734845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:13.750515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.752416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.753625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.754609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.755306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.756221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.863042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-640b1cfe-73ee-4df4-a493-e5d27d4b368d req-f34e3d6c-14b0-4dd2-81f1-206bafbd0a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba88864-5336-4f23-acce-41a81cbfac02", "tag": "7f41204c-6e03-4981-bef6-e8b581eb6100"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:13.892376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-640b1cfe-73ee-4df4-a493-e5d27d4b368d req-f34e3d6c-14b0-4dd2-81f1-206bafbd0a47 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:13.893292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-640b1cfe-73ee-4df4-a493-e5d27d4b368d req-f34e3d6c-14b0-4dd2-81f1-206bafbd0a47 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:13.893951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-640b1cfe-73ee-4df4-a493-e5d27d4b368d req-f34e3d6c-14b0-4dd2-81f1-206bafbd0a47 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:13.920864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-640b1cfe-73ee-4df4-a493-e5d27d4b368d req-f34e3d6c-14b0-4dd2-81f1-206bafbd0a47 service nova] Creating event network-changed:7f41204c-6e03-4981-bef6-e8b581eb6100 for instance cba88864-5336-4f23-acce-41a81cbfac02 on n-h1-833090-19 Sep 08 10:53:13.947986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-640b1cfe-73ee-4df4-a493-e5d27d4b368d req-f34e3d6c-14b0-4dd2-81f1-206bafbd0a47 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089221 Sep 08 10:53:13.948623 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3299/6368] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:14.021993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:14.037431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e4d7ee1-7351-4f6c-862c-c972314b0f6c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.308233 Sep 08 10:53:14.053205 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3070/6369] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:13 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:15.067701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:15.068414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:15.089419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:15.089853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:15.090310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:15.091132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:15.091641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:15.092085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:15.333037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:15.350804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd0cb390-0eda-4c49-bee1-28b5fd841664 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.289970 Sep 08 10:53:15.352416 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3300/6370] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:15 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:16.380054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:16.381263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:16.390645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:16.393360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:16.394857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:16.396546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:16.397863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:16.400358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:16.652478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:16.662953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85e15258-6191-40b5-8afc-b20870a4add3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.286992 Sep 08 10:53:16.665531 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3071/6371] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:16 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:17.700936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:17.701358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:17.727114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.727716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.728076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:17.728800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:17.729253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:17.733089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:18.023908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:18.035221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6475610-07ac-4de8-8b65-2610facb6258 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.340478 Sep 08 10:53:18.036244 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3301/6372] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:17 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:19.092664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:19.093285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:19.123238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.124058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.131578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.132988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:19.133634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:19.134241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:19.407344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:19.415348 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a8144661-35b2-448d-9333-097d9a373808 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.335449 Sep 08 10:53:19.415964 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3072/6373] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:19 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:20.443281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:20.444253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:20.457346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:20.459093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:20.461264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:20.467807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.469017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:20.473528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:20.474403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:20.797153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:20.808095 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-629d2034-0313-438c-a23e-92e0a824ba29 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.367880 Sep 08 10:53:20.823937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3302/6374] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:20 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:21.832441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:21.834298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:21.848161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:21.852209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:21.859291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:21.865129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:21.866084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:21.866859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:21.867332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:21.869475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:21.886401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:22.125218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:22.140028 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f230818-e510-43d1-b82f-534e2fe31cc6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.311532 Sep 08 10:53:22.158057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3073/6375] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:21 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:23.166307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:23.167752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:23.177609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.178446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.179133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:23.180116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:23.181014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:23.181666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:23.418353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:23.431047 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ee07f32-398c-468a-ab86-f283f526e5dc tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.269675 Sep 08 10:53:23.443092 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3303/6376] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:23 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:24.455570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:24.456188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:24.467869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:24.468360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:24.470030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:24.470950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:24.471746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:24.472347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:24.687212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:24.698214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70685fdb-b5c7-4d28-80fb-6967df912b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.246183 Sep 08 10:53:24.713463 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3074/6377] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:24 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:25.725930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:25.726552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:25.747014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:25.747548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:25.748004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:25.748739 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:25.749203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:25.749640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:25.999243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:26.011274 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f89702c0-ecf9-40c2-8897-1ad1ec7c8b82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.288821 Sep 08 10:53:26.012589 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3304/6378] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:25 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:27.034688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:27.035338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:27.046378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:27.047408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:27.047884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:27.048621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:27.055644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:27.056111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:27.325683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:27.333728 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7790414c-a30b-4cf2-88df-8a60f7e22a48 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.303365 Sep 08 10:53:27.337075 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3075/6379] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:27 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:28.361823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:28.362467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:28.376268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:28.376689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:28.377141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:28.377868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:28.383657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:28.384313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:28.683156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:28.693578 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9bcd1fb2-8686-440d-aae4-3ce21efb2c3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.340485 Sep 08 10:53:28.694898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3305/6380] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:28 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:29.721897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:29.723174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:29.741865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.743402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.743893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:29.748036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:29.749888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:29.751716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:30.073546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:30.085332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb292d00-16fa-4c9e-a71d-3f7fbce1c5f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.368550 Sep 08 10:53:30.109944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3076/6381] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:29 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:31.117726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:31.119615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:31.129476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.135830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.136630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.138844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:31.141189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:31.141928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:31.433314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:31.448977 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-905d362a-71ac-4e55-bba6-46ad26ce0b35 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1168 microversion: 2.1 time: 0.331686 Sep 08 10:53:31.450320 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3306/6382] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:31 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1168 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:32.478162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:32.478876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:32.486444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.487018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.487564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:32.488340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:32.488988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:32.489422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:32.650269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:32.660104 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b33a19b-25c5-466d-8875-b51fbfa80e82 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.185847 Sep 08 10:53:32.661224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3077/6383] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:32 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:33.697637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:33.699417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:33.719820 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:53:33.719971 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 10:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 (ip 10.222.0.59) !!! Sep 08 10:53:33.722795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.725482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.726087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.726815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:33.727275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:33.727723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:33.924530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:33.935940 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a04dea27-eb25-4cd0-8a80-8d745258a0b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.246027 Sep 08 10:53:33.937633 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3307/6384] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:33 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:34.964816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:34.966301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:34.978514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:34.980211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:34.981230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:34.982095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:34.985297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:34.986437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:35.169992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:35.178799 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-680ab2de-0641-43d5-9663-a193aef72b71 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.219682 Sep 08 10:53:35.180348 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3078/6385] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:34 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:36.203136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:36.205026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:36.215577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.216971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.217637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.219111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:36.219815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:36.220437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:36.223803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=59 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:36.558143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:36.568985 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-edc19d90-1ec0-4b31-8a79-8934af216e08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.370202 Sep 08 10:53:36.571049 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3308/6386] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:36 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:37.592873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:37.594029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:37.601622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:37.602185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:37.602827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:37.603774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:37.604421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:37.605035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:38.133170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:38.143210 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f4d5924d-4a0b-4ff3-8dd3-2a5a4302da14 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.554497 Sep 08 10:53:38.143913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3079/6387] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:37 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:39.168247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:39.169563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:39.177661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.178525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.179196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.180155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:39.180833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:39.181476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:39.379287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:39.387316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e40ab9fe-c472-43e3-9d0b-943eba3caac3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.224517 Sep 08 10:53:39.387934 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3309/6388] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:39 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:40.418896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:40.421520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:40.446184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:40.449488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:40.455241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:40.456295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:40.457000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:40.457684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:40.775355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:40.789621 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-92424bb6-ba23-4480-9495-a82aadd9325c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.376047 Sep 08 10:53:40.790839 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3080/6389] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:40 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:41.708982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-28e46686-c706-41c4-9f70-0d71928a4476 req-0115bedf-95a4-4122-9a1e-a4817885c593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba88864-5336-4f23-acce-41a81cbfac02", "name": "network-vif-plugged", "status": "completed", "tag": "7f41204c-6e03-4981-bef6-e8b581eb6100"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:41.733592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28e46686-c706-41c4-9f70-0d71928a4476 req-0115bedf-95a4-4122-9a1e-a4817885c593 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.735653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28e46686-c706-41c4-9f70-0d71928a4476 req-0115bedf-95a4-4122-9a1e-a4817885c593 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.738511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28e46686-c706-41c4-9f70-0d71928a4476 req-0115bedf-95a4-4122-9a1e-a4817885c593 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.771916 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-28e46686-c706-41c4-9f70-0d71928a4476 req-0115bedf-95a4-4122-9a1e-a4817885c593 service nova] Creating event network-vif-plugged:7f41204c-6e03-4981-bef6-e8b581eb6100 for instance cba88864-5336-4f23-acce-41a81cbfac02 on n-h1-833090-19 Sep 08 10:53:41.789824 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-28e46686-c706-41c4-9f70-0d71928a4476 req-0115bedf-95a4-4122-9a1e-a4817885c593 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084626 Sep 08 10:53:41.793140 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3310/6390] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:41.824682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:41.825609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:41.844584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=24 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:41.849537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.853321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.854028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:41.857543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:41.859505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:41.861156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:42.176814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:42.188281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88f1791c-2549-4e78-b203-b5891ce29a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1202 microversion: 2.1 time: 0.375200 Sep 08 10:53:42.190279 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3081/6391] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:41 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1202 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:43.225854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:43.231664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:43.241070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=26 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:43.261589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.264440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.265130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.270602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:43.272726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:43.275267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:43.970930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:43.986662 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3bca8bfe-5adf-408f-8889-033edd21282c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1389 microversion: 2.1 time: 0.775025 Sep 08 10:53:43.988133 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3311/6392] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:43 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1389 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:53:44.009195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:44.010451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:44.019979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.020482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.020925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.021632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.022322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.022970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.220597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:44.229695 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e3f6df45-9bca-492f-862c-030c64da542e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1389 microversion: 2.1 time: 0.224307 Sep 08 10:53:44.230953 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3082/6393] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:44 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1389 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:44.252546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:44.254135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:44.261717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.262402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.263033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.265080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.265844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.266457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.435532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:44.446824 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f89786a4-97cf-4f16-ae76-5b8b63c8f51c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1389 microversion: 2.1 time: 0.198102 Sep 08 10:53:44.460645 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3312/6394] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:44 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1389 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:44.533061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:44.534480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:44.540718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.541407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.542091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.542940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.543603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.545390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.576207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:53:44.690563 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aba01199-9943-4e1b-bd82-42d16e3fdbd3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 204 len: 0 microversion: 2.1 time: 0.161038 Sep 08 10:53:44.691673 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3083/6395] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:53:44 2022] DELETE /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:53:44.703153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:44.703936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:44.714480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.715284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.716067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.717099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:44.717974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:44.718656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:44.913599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:44.923055 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c168c9d-86af-44b2-ac22-cac0d8719d8e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1395 microversion: 2.1 time: 0.226987 Sep 08 10:53:44.925939 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3313/6396] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:44 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1395 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:45.959439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:45.960178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:45.978379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.980686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.981834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:45.985061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:45.985723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:45.988451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:46.202548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:46.213858 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-40834dfd-69bf-4c47-8efa-cf94f9018526 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1395 microversion: 2.1 time: 0.265800 Sep 08 10:53:46.214453 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3084/6397] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:45 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1395 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:46.815257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-21946f25-d1e7-4c5d-9bbc-101fef0298b2 req-157863e6-3b88-4e14-87f2-4b1fab910a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba88864-5336-4f23-acce-41a81cbfac02", "name": "network-vif-deleted", "tag": "7f41204c-6e03-4981-bef6-e8b581eb6100"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:53:46.830091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-21946f25-d1e7-4c5d-9bbc-101fef0298b2 req-157863e6-3b88-4e14-87f2-4b1fab910a8a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:46.833945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-21946f25-d1e7-4c5d-9bbc-101fef0298b2 req-157863e6-3b88-4e14-87f2-4b1fab910a8a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:46.834850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-21946f25-d1e7-4c5d-9bbc-101fef0298b2 req-157863e6-3b88-4e14-87f2-4b1fab910a8a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:46.892863 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-21946f25-d1e7-4c5d-9bbc-101fef0298b2 req-157863e6-3b88-4e14-87f2-4b1fab910a8a service nova] Creating event network-vif-deleted:7f41204c-6e03-4981-bef6-e8b581eb6100 for instance cba88864-5336-4f23-acce-41a81cbfac02 on n-h1-833090-19 Sep 08 10:53:46.911366 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-21946f25-d1e7-4c5d-9bbc-101fef0298b2 req-157863e6-3b88-4e14-87f2-4b1fab910a8a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102641 Sep 08 10:53:46.912050 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3314/6398] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:47.238670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:47.239984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:47.259060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.259176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.259648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.260361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:47.260997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:47.261591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:47.350037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:47.360776 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4298ea75-a0f5-4cea-89eb-1cf189993171 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1187 microversion: 2.1 time: 0.124946 Sep 08 10:53:47.360776 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3085/6399] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:47 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:48.390487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:48.391161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:48.399854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.400340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.400947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.402965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:48.403606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:48.405703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:48.515237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:48.523829 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f9b5c2f-b2e1-4f49-b6cd-99ecd27d1178 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1187 microversion: 2.1 time: 0.142399 Sep 08 10:53:48.524728 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3315/6400] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:48 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:49.546895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:49.547436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:49.557713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.558213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.558656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.559373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:49.559865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:49.560296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:49.647321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:49.656648 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ab7575dc-59af-4961-ad45-9aacdac70918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1187 microversion: 2.1 time: 0.114311 Sep 08 10:53:49.658572 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3086/6401] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:49 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:50.681155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:50.681993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:50.690524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:50.691027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:50.691485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:50.692528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:50.693002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:50.693465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:50.776939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:50.785519 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-31949fda-a1c5-4557-bcff-023d977b9665 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1187 microversion: 2.1 time: 0.108307 Sep 08 10:53:50.786615 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3316/6402] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:50 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:51.810614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:51.811612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:51.819028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:51.819803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:51.820538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:51.821404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:51.822196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:51.822785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:51.932082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:53:51.940616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:53:51.944011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6558e1e9-7fcc-4c13-974f-16318ed13214 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 200 len: 1187 microversion: 2.1 time: 0.138097 Sep 08 10:53:51.945905 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3087/6403] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:51 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:53:52.969706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:52.970982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:52.981637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:52.984122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:52.987350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:52.990859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:52.991991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:52.992934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:53.011084 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 HTTP/1.1 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'cba88864-5336-4f23-acce-41a81cbfac02'} Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:53.013238 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:53.017288 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:53.022091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:53.025122 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d6f422b-22b3-4462-97b1-d9314234ba40 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 404 len: 111 microversion: 2.1 time: 0.059786 Sep 08 10:53:53.027041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3317/6404] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:52 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:53:55.267318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Calling method '.version_select at 0x7f2351e12820>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:55.269154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.269641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.270080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.284512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.284995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.285488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.296872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:55.297452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:55.297967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:55.304590 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd2ead49-09f2-4510-afcb-f7ea713ec32b tempest-PortsAdminExtendedAttrsTestJSON-1428590759 tempest-PortsAdminExtendedAttrsTestJSON-1428590759-project-admin] 10.222.0.59 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.218650 Sep 08 10:53:55.305263 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3088/6405] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 10:53:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:53:58.482971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:58.483820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:58.493815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.494306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.494974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.495784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.496239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.496972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.511239 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 HTTP/1.1 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'cba88864-5336-4f23-acce-41a81cbfac02'} Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:53:58.513042 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:58.517952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7087754-2457-4c07-a30a-736671cbb762 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 404 len: 111 microversion: 2.1 time: 0.037530 Sep 08 10:53:58.519950 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3318/6406] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:53:58 2022] DELETE /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:53:58.524993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:53:58.525676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: cba88864-5336-4f23-acce-41a81cbfac02] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:53:58.533971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.534562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.535357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.536282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:53:58.536928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:53:58.537576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:53:58.562041 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 HTTP/1.1 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'cba88864-5336-4f23-acce-41a81cbfac02'} Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:53:58.564155 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. Sep 08 10:53:58.568024 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:53:58.570092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance cba88864-5336-4f23-acce-41a81cbfac02 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:53:58.571219 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45c1d4e2-9b0d-4f0c-9e18-a3c88825f293 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02" status: 404 len: 111 microversion: 2.1 time: 0.050376 Sep 08 10:53:58.572425 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3089/6407] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:53:58 2022] GET /compute/v2.1/servers/cba88864-5336-4f23-acce-41a81cbfac02 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:54:32.920038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1805735418", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b8c3ca3e-dec6-4c44-a943-7bb621f11187", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:32.975948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=15 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:32.979338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=49 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:33.132129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:54:33.810649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:54:33.811067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:54:33.811803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:54:33.812376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:54:33.813063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:54:33.826389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.827281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.827967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.828862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:33.829410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:33.829865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:33.860237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:54:33.880290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:54:33.971708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:54:33.973840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8c3ca3e-dec6-4c44-a943-7bb621f11187',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:54:34.205195 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-30847a1c-754c-4d88-aa3b-e16e6bd97e1e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.290271 Sep 08 10:54:34.206183 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3319/6408] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:54:34.226843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9bfeaf9a-9a53-46b0-993b-e53f2924951d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:34.227436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9bfeaf9a-9a53-46b0-993b-e53f2924951d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:34.244779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:34.247710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=9 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:34.390960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9bfeaf9a-9a53-46b0-993b-e53f2924951d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:34.419809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9bfeaf9a-9a53-46b0-993b-e53f2924951d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1071 microversion: 2.1 time: 0.184117 Sep 08 10:54:34.419809 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3090/6409] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:34 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1071 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:35.426839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:35.428098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:35.439551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.441378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.444127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.445101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:35.445756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:35.447938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:35.558167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:35.571149 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-62c28f42-c8ef-47a9-a3f2-1d063d3d121e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1169 microversion: 2.1 time: 0.149582 Sep 08 10:54:35.593933 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3320/6410] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:35 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:36.597183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:36.598387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:36.622054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.622777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.623446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.624386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:36.625020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:36.625683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:36.743405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:36.749050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8df48da3-33a5-4dfd-a822-4c74c164d009 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1187 microversion: 2.1 time: 0.155740 Sep 08 10:54:36.749637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3091/6411] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:36 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1187 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:37.775018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:37.775666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:37.794836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.797144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.797791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:37.801677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:37.802306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:37.802903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:38.330370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:38.342882 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-526b3ddc-fcfa-45ae-977c-4fe058c3edbd tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1229 microversion: 2.1 time: 0.572018 Sep 08 10:54:38.345006 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3321/6412] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:37 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1229 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:39.286848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6ffcd3a3-02fc-4d93-a306-7f100466eab0 req-effe52cb-a429-42c6-85db-451678659e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69fb7be-c65d-4154-a686-c7f0821afb1d", "tag": "924697e5-9412-4ccd-92c6-c585328d826b"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:39.366447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:39.367057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:39.369372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6ffcd3a3-02fc-4d93-a306-7f100466eab0 req-effe52cb-a429-42c6-85db-451678659e33 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.369870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6ffcd3a3-02fc-4d93-a306-7f100466eab0 req-effe52cb-a429-42c6-85db-451678659e33 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.370307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6ffcd3a3-02fc-4d93-a306-7f100466eab0 req-effe52cb-a429-42c6-85db-451678659e33 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.381642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.390969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.391729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.392670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:39.393658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:39.398565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:39.399675 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6ffcd3a3-02fc-4d93-a306-7f100466eab0 req-effe52cb-a429-42c6-85db-451678659e33 service nova] Creating event network-changed:924697e5-9412-4ccd-92c6-c585328d826b for instance b69fb7be-c65d-4154-a686-c7f0821afb1d on n-h1-833090-19 Sep 08 10:54:39.429814 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6ffcd3a3-02fc-4d93-a306-7f100466eab0 req-effe52cb-a429-42c6-85db-451678659e33 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160759 Sep 08 10:54:39.430496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3092/6413] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:40.044797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:40.056000 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7689225e-349c-40ec-93fe-21470e2a0996 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1229 microversion: 2.1 time: 0.691226 Sep 08 10:54:40.057648 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3322/6414] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:39 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1229 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:54:41.084975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:41.085877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:41.098919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.099677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.101382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.102287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:41.103966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:41.104573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:41.379549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:41.395664 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24a9e37d-d282-4d05-9557-eec4bef44ded tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1229 microversion: 2.1 time: 0.317031 Sep 08 10:54:41.397331 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3093/6415] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:41 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1229 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:42.421872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:42.422546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:42.434413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.437814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.438278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.447304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:42.447885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:42.448337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:42.717038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:42.727280 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3c3957bc-6e13-496d-b205-110756d5f6f5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1229 microversion: 2.1 time: 0.310220 Sep 08 10:54:42.739492 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3323/6416] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:42 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1229 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:43.756103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:43.756666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:43.768106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.768844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.769702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:43.770963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:43.771409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:43.771866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:44.027228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:44.042004 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-464bd165-778e-4e8e-ab24-55bcc59224d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1229 microversion: 2.1 time: 0.291513 Sep 08 10:54:44.043552 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3094/6417] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:43 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1229 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:45.068690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:45.069322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:45.080258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:45.080997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:45.084159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:45.084510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:45.084960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.085693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:45.090514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:45.091061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:45.644615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:45.675557 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65bcab34-d4f8-450a-ac90-70d444e0bf66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.610659 Sep 08 10:54:45.677116 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3324/6418] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:45 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:46.702666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:46.703501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:46.713088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:54:46.719669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.720833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.722383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:46.723520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:46.724393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:46.725187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:47.024190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:47.033681 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-122f61d2-3321-470b-894e-3a6cf17c27aa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.335938 Sep 08 10:54:47.035116 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3095/6419] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:46 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:48.069681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:48.070395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:48.080926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:48.081424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:48.081866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:48.082578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:48.083043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:48.083496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:48.377664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:48.397028 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c7fec40-f845-4e1b-bfbf-7afde5d23127 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.339989 Sep 08 10:54:48.398626 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3325/6420] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:48 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:49.422653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:49.423380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:49.431284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.432832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.434038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.435007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:49.436666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:49.437324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:49.632308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:49.644271 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27d32d20-9759-4c18-a779-438b42c4f5f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.227131 Sep 08 10:54:49.644995 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3096/6421] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:49 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:50.666608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:50.667870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:50.675531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:50.676026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:50.676461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:50.677164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:50.677618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:50.678046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:50.829571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:50.838675 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-183993eb-c490-4191-a43b-0ca5fb34a398 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.175838 Sep 08 10:54:50.839939 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3326/6422] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:50 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:51.863377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:51.864876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:51.875360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.876248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.876906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:51.877835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:51.878663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:51.879346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:52.133952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:52.144762 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cda69f4-13a1-4174-8b67-bf1eb266d802 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.285708 Sep 08 10:54:52.161921 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3097/6423] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:51 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:53.176670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:53.181729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:53.191449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:53.192275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:53.192973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:53.194180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:53.194834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:53.195573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:53.476305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:53.485972 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-96ac8260-7a06-49b5-8ad8-4f468770da4c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.316959 Sep 08 10:54:53.516204 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3327/6424] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:53 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:54.337417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b3698f55-9f46-43c7-8edd-647c0f78c8c3 req-3e8dd626-0fb2-423b-a92e-41804f2918ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69fb7be-c65d-4154-a686-c7f0821afb1d", "name": "network-vif-plugged", "status": "completed", "tag": "924697e5-9412-4ccd-92c6-c585328d826b"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:54.354792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b3698f55-9f46-43c7-8edd-647c0f78c8c3 req-3e8dd626-0fb2-423b-a92e-41804f2918ce service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.355816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b3698f55-9f46-43c7-8edd-647c0f78c8c3 req-3e8dd626-0fb2-423b-a92e-41804f2918ce service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.357012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b3698f55-9f46-43c7-8edd-647c0f78c8c3 req-3e8dd626-0fb2-423b-a92e-41804f2918ce service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.380439 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b3698f55-9f46-43c7-8edd-647c0f78c8c3 req-3e8dd626-0fb2-423b-a92e-41804f2918ce service nova] Creating event network-vif-plugged:924697e5-9412-4ccd-92c6-c585328d826b for instance b69fb7be-c65d-4154-a686-c7f0821afb1d on n-h1-833090-19 Sep 08 10:54:54.386207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b3698f55-9f46-43c7-8edd-647c0f78c8c3 req-3e8dd626-0fb2-423b-a92e-41804f2918ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053002 Sep 08 10:54:54.387423 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3098/6425] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:54:54.508345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:54.508959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:54.529558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.530901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.532938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:54.535620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:54.536706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:54.537326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:55.454732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:55.480925 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0bf3ee11-b2b0-4a84-82d3-768149151a13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1217 microversion: 2.1 time: 0.976282 Sep 08 10:54:55.484910 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3328/6426] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:54 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1217 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:56.530562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:56.531653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:56.543892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.544552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.545261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:56.563905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:56.569641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:56.571208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.278390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:57.300990 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af990917-918d-4544-bcdc-69728b226e84 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1404 microversion: 2.1 time: 0.793850 Sep 08 10:54:57.306748 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3099/6427] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:56 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1404 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:57.325430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:54:57.326489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:57.341765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.342278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.342725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.343485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.344193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.345957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.805235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:54:57.814713 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29510912-dfa6-4eba-af1a-5a7761581396 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1404 microversion: 2.1 time: 0.493259 Sep 08 10:54:57.816838 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3329/6428] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:54:57 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:54:57.839796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1935855950"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:54:57.842409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:54:57.857350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.859506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.860316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:57.862202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:54:57.863421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:54:57.864537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:54:58.075253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Attempting to quiesce instance before volume snapshot. Sep 08 10:54:58.133926 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 08 10:54:58.283655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Creating snapshot from volume b8c3ca3e-dec6-4c44-a943-7bb621f11187. {{(pid=122456) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 08 10:55:00.075756 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cbf77c8-d8ba-460a-b17c-b910a4f970a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d/action" status: 202 len: 0 microversion: 2.1 time: 2.240575 Sep 08 10:55:00.083957 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3100/6429] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:54:57 2022] POST /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d/action => generated 0 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 10:55:02.398102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1244744434", "imageRef": "7fe6fac3-78a6-4907-b159-e17007e9d832", "flavorRef": "452", "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:02.476083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:55:03.159377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:55:03.159847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:55:03.160418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:55:03.160740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:55:03.161451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:55:03.163756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:03.173414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.174172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.174611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.175342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:03.175995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:03.176432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:03.184455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=63 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:03.196716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:55:03.201831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:55:03.216397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:55:03.219131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3f26f536-01ce-401f-979d-d61df44c48be',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:55:03.304828 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e410c57b-3476-435d-9c29-412e6c29c593 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910774 Sep 08 10:55:03.306146 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3330/6430] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:55:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:55:03.318764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de9fdf59-979f-47d6-9adf-4348757cf373 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:03.319633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de9fdf59-979f-47d6-9adf-4348757cf373 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:03.400020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de9fdf59-979f-47d6-9adf-4348757cf373 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:03.412493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de9fdf59-979f-47d6-9adf-4348757cf373 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1230 microversion: 2.1 time: 0.098742 Sep 08 10:55:03.413342 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3101/6431] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:03 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:04.439333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:04.440762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:04.449106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:04.449814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:04.450321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:04.451104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:04.451672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:04.452164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:04.528107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:04.536645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae8de9cc-5801-408e-8051-36df6ebf8881 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1282 microversion: 2.1 time: 0.102886 Sep 08 10:55:04.538194 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3331/6432] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:04 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:05.619104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:05.714621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:06.044238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:06.076367 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d570387a-044d-4776-823f-fc9395c3869b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1300 microversion: 2.1 time: 0.507890 Sep 08 10:55:06.076912 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3102/6433] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:05 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1300 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:07.112424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:07.114911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:07.134881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.137219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.137816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.142591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:07.148121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:07.148900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:07.517412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:07.529640 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-adf41d8d-d3b2-4b22-99d7-f18ba760048b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.434345 Sep 08 10:55:07.545799 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3332/6434] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:07 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:55:08.558878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:08.560304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:08.577586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.577894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-6ac3f97a-aaba-4777-814a-e0c0f26022bb req-8e251829-a9e6-49d2-9dc6-a3d8a9335210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34372dbe-c251-4cb3-b312-dee0b4a94b5a", "tag": "5e30453d-b06a-40ae-9647-105c14d7f17d"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:08.579067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.579813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:08.580863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.581544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.582245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:08.603768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6ac3f97a-aaba-4777-814a-e0c0f26022bb req-8e251829-a9e6-49d2-9dc6-a3d8a9335210 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:08.604191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6ac3f97a-aaba-4777-814a-e0c0f26022bb req-8e251829-a9e6-49d2-9dc6-a3d8a9335210 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:08.604642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-6ac3f97a-aaba-4777-814a-e0c0f26022bb req-8e251829-a9e6-49d2-9dc6-a3d8a9335210 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:08.674987 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-6ac3f97a-aaba-4777-814a-e0c0f26022bb req-8e251829-a9e6-49d2-9dc6-a3d8a9335210 service nova] Creating event network-changed:5e30453d-b06a-40ae-9647-105c14d7f17d for instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a on n-h2-833090-19 Sep 08 10:55:08.681358 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-6ac3f97a-aaba-4777-814a-e0c0f26022bb req-8e251829-a9e6-49d2-9dc6-a3d8a9335210 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.475324 Sep 08 10:55:08.699842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3103/6435] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:09.015990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:09.025919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-255b9ee5-2c9d-459f-a9b9-e30abe62d24e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.473947 Sep 08 10:55:09.033127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3333/6436] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:08 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:10.060383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:10.061739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:10.075637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:10.076503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:10.077208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:10.078181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:10.078877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:10.079586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:10.549442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:10.565768 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3464f839-d56c-480f-9d0c-061888908222 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.511209 Sep 08 10:55:10.569063 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3104/6437] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:10 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:11.592841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:11.599129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:11.617626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.618694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.621454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.622892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:11.623903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:11.624907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:11.934390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:11.943831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3c99f63-2af8-4e51-a167-d19798edff3b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.357382 Sep 08 10:55:11.948578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3334/6438] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:11 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:12.970459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:12.971814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:12.983130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.984596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.986032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:12.987978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:12.988782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:12.989538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:13.350565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:13.366143 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c5bcd812-0d63-459a-b651-2dc293cc0b72 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.399101 Sep 08 10:55:13.367635 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3105/6439] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:12 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:14.415046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:14.417585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:14.421629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:14.423076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:14.429943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.430682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.431345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.433217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:14.434207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:14.434799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:14.756367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:14.778650 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c3d2ae15-2e33-4b20-b0fe-611989962388 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.368042 Sep 08 10:55:14.779257 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3335/6440] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:14 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:15.808218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:15.809116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:15.819057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:15.826561 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 10:55:15.827104 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 10:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a (ip 10.222.0.59) !!! Sep 08 10:55:15.830099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:15.835657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:15.836619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:15.838971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:15.841224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:15.849839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:16.195270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:16.209331 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39d80ad0-c0ff-47ed-8da2-661ded9af286 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.404861 Sep 08 10:55:16.210560 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3106/6441] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:15 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:17.234248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:17.234869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:17.243709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:17.244583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:17.245206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:17.246110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:17.246748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:17.247503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:17.502535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:17.516395 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dd6d9e3d-bcac-4381-b772-92e7fe7d36ab tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.285939 Sep 08 10:55:17.517008 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3336/6442] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:17 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:18.544111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:18.545797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:18.553090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:18.553873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:18.554765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:18.555589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:18.556303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:18.557425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:18.813563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:18.825471 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50d1833a-39d4-419f-abbc-697987259715 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.285800 Sep 08 10:55:18.826351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3107/6443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:18 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:19.849629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:19.850269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:19.858794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:19.859531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:19.860521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:19.861908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:19.863196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:19.863674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:20.045583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:20.055258 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4315aa0-8104-4da9-833d-84829fc8d420 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.210421 Sep 08 10:55:20.056720 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3337/6444] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:19 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:21.081440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:21.082132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:21.110440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.110971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.111431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.112186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:21.112652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:21.113091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:21.337668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:21.381282 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c0bcf57-4647-47e6-b6f5-dee3ae06799f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.288184 Sep 08 10:55:21.381282 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3108/6445] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:21 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:22.414399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:22.416099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:22.424120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.424999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.426133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.427684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:22.428537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:22.429194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:22.657483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:22.666413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc5e600c-be4d-438e-8789-4c45383a18f7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.258905 Sep 08 10:55:22.668204 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3338/6446] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:22 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:23.692260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:23.692895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:23.704149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.705001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.705621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.706826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:23.707363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:23.708147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:23.906935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:23.916094 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2820ccb7-7b10-4181-b57e-0cc516ad2202 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.227142 Sep 08 10:55:23.916674 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3109/6447] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:23 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:24.940077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:24.940077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:24.947599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.948299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.948916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:24.949784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:24.950395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:24.950975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:25.172395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:25.184623 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-844149fc-b292-46a3-b73f-afaf4965c61a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.250107 Sep 08 10:55:25.187090 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3339/6448] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:24 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:26.211991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:26.212805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:26.223592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:26.224228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:26.225110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:26.226077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:26.226756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:26.227367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:26.468290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:26.502258 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5546f5f1-5f7a-47a7-803a-078c5e9f3151 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.294435 Sep 08 10:55:26.503847 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3110/6449] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:26 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:27.530729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:27.533161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:27.544100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.547593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.548474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.549473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:27.550152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:27.551900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:27.758457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:27.769458 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1113f795-f913-4871-a139-78dc3d76ecce tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.243703 Sep 08 10:55:27.770703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3340/6450] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:27 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:28.795229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:28.796447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:28.804902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:28.806277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:28.806945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:28.807986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:28.808626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:28.809341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:28.986346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:28.996940 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f05ffe2f-b9fe-4cd8-a43c-7eed3452a08d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1342 microversion: 2.1 time: 0.207368 Sep 08 10:55:28.998462 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3111/6451] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:28 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:30.027194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:30.028534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:30.050849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.051786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.052590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.053544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:30.054299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:30.055169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:30.253209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:30.262267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-034fb43c-5523-4107-a2fb-e8622436f75d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1388 microversion: 2.1 time: 0.242589 Sep 08 10:55:30.273764 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3341/6452] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:30 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1388 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:31.291439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:31.291439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:31.299030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.299572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.300023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:31.300757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:31.301226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:31.301668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:31.496035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:31.505791 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-76df3014-e8aa-47bb-8898-73839739fe3c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.222977 Sep 08 10:55:31.507233 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3112/6453] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:31 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:32.548135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:32.551400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:32.560722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:32.561224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:32.561668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:32.562427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:32.562920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:32.563376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:32.769804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:32.786011 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-395ccc84-49c3-40fb-8a4e-e7ff91331792 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.252567 Sep 08 10:55:32.800166 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3342/6454] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:32 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:33.838860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:33.846753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:33.868414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.868940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.869406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:33.874601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:33.877767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:33.879485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:34.072026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:34.082437 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c625cd00-35d9-4271-bed5-acffbe10bfe8 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.247374 Sep 08 10:55:34.092171 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3113/6455] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:33 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:35.106341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:35.107287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:35.114836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:35.117612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.118257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.118779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.119623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:35.120308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:35.121046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:35.189533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=74 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:35.414750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:35.446204 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9536a0ab-e761-43ec-8128-1b005f50414d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.344564 Sep 08 10:55:35.449336 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3343/6456] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:35 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:36.472431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:36.473091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:36.478137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=24 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:36.489144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.489930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.490983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:36.492141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:36.493166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:36.493845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:36.532107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=68 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:55:36.666284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:36.674766 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e511c93e-0b2c-42a0-8cd2-140df9f164d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.206322 Sep 08 10:55:36.675386 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3114/6457] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:36 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:37.700267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:37.701632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:37.726157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.726701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.727218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.728351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:37.728505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:37.728962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:37.921584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:37.931345 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5310a98d-8f25-4719-a0d1-c218b5c45896 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.236258 Sep 08 10:55:37.932482 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3344/6458] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:37 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:38.960377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:38.960377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:38.980005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.983087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.983853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:38.984728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:38.987692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:38.988422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:39.341112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:39.350945 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1e3dd01-dd4c-4480-be33-487acafb4feb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.399350 Sep 08 10:55:39.351736 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3115/6459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:38 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:40.362881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-799a6b0b-625b-41cc-be27-566db0f06c00 req-d8ac29d9-47f7-4678-aa2a-7c6023f62a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34372dbe-c251-4cb3-b312-dee0b4a94b5a", "name": "network-vif-plugged", "status": "completed", "tag": "5e30453d-b06a-40ae-9647-105c14d7f17d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:40.376222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:40.376910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:40.382291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-799a6b0b-625b-41cc-be27-566db0f06c00 req-d8ac29d9-47f7-4678-aa2a-7c6023f62a58 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.382875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-799a6b0b-625b-41cc-be27-566db0f06c00 req-d8ac29d9-47f7-4678-aa2a-7c6023f62a58 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.383885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-799a6b0b-625b-41cc-be27-566db0f06c00 req-d8ac29d9-47f7-4678-aa2a-7c6023f62a58 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.390474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.391238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.391872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.392762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:40.393538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:40.394140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:40.418053 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-799a6b0b-625b-41cc-be27-566db0f06c00 req-d8ac29d9-47f7-4678-aa2a-7c6023f62a58 service nova] Creating event network-vif-plugged:5e30453d-b06a-40ae-9647-105c14d7f17d for instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a on n-h2-833090-19 Sep 08 10:55:40.429639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-799a6b0b-625b-41cc-be27-566db0f06c00 req-d8ac29d9-47f7-4678-aa2a-7c6023f62a58 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070808 Sep 08 10:55:40.430421 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3345/6460] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:40.767959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:40.781864 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0aa98742-3b15-41ea-a3a5-d41a4f7ddc41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.409296 Sep 08 10:55:40.783367 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3116/6461] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:40 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:41.812954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:41.814303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:41.823805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.824207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.824681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:41.829607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:41.829607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:41.829607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:42.011152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:42.020240 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8b46708-381a-416c-9a87-71c8dda7d6b7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1376 microversion: 2.1 time: 0.213764 Sep 08 10:55:42.020836 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3346/6462] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:41 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:43.052877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.053654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.064938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.065816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.066596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.067757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.068414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.069683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.260970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:43.272225 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-791687ff-b418-496d-b73c-5689a1f51b11 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1563 microversion: 2.1 time: 0.227253 Sep 08 10:55:43.273212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3117/6463] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:43 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:43.300497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.301631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.310189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.310985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.311422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.312178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.312827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.313382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.511658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:43.523637 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e00e624c-5d65-4a27-a11b-80a1c44699eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1563 microversion: 2.1 time: 0.227605 Sep 08 10:55:43.525363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3347/6464] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:43 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:43.621836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.623348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.632175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.633144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.633819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.634733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.635512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.636119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.669776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:55:43.781471 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7823406c-4eb6-4662-ae75-73eb482635f4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 204 len: 0 microversion: 2.1 time: 0.164887 Sep 08 10:55:43.782167 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3118/6465] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:55:43 2022] DELETE /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:55:43.799831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:43.803125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:43.819284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.820211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.820935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.821983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:43.822701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:43.823352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:43.978450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:43.987223 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e8d8193c-f475-48a7-a805-a2ee806676f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1569 microversion: 2.1 time: 0.200146 Sep 08 10:55:43.988221 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3348/6466] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:43 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:45.014351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:45.016146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:45.028126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.028803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.029603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.030947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:45.031422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:45.032244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:45.195813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:45.204636 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9949703d-88e8-4959-8175-e9a0b4f8aae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1569 microversion: 2.1 time: 0.195710 Sep 08 10:55:45.205355 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3119/6467] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:45 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:46.124359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-53bcf597-2ddb-488e-bfbc-b117731ca0e3 req-8e5b412c-62e1-47d4-8a03-4a71dd3276a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34372dbe-c251-4cb3-b312-dee0b4a94b5a", "name": "network-vif-deleted", "tag": "5e30453d-b06a-40ae-9647-105c14d7f17d"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:55:46.149687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-53bcf597-2ddb-488e-bfbc-b117731ca0e3 req-8e5b412c-62e1-47d4-8a03-4a71dd3276a7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.152054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-53bcf597-2ddb-488e-bfbc-b117731ca0e3 req-8e5b412c-62e1-47d4-8a03-4a71dd3276a7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.153201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-53bcf597-2ddb-488e-bfbc-b117731ca0e3 req-8e5b412c-62e1-47d4-8a03-4a71dd3276a7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.196796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-53bcf597-2ddb-488e-bfbc-b117731ca0e3 req-8e5b412c-62e1-47d4-8a03-4a71dd3276a7 service nova] Creating event network-vif-deleted:5e30453d-b06a-40ae-9647-105c14d7f17d for instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a on n-h2-833090-19 Sep 08 10:55:46.203262 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-53bcf597-2ddb-488e-bfbc-b117731ca0e3 req-8e5b412c-62e1-47d4-8a03-4a71dd3276a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083319 Sep 08 10:55:46.208650 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3349/6468] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:55:46.229359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:46.230618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:46.242090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.246675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.247178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.251706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:46.252356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:46.252728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:46.355722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:46.364367 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9494320c-f594-42ba-aaaa-fd525fbc630b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1361 microversion: 2.1 time: 0.139419 Sep 08 10:55:46.365960 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3120/6469] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:46 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1361 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:47.390398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:47.391262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:47.398548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.399053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.399557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.400579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:47.401097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:47.401538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:47.474916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:47.484559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb1d9676-f3e3-47ec-9ad6-1975df0c222b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1361 microversion: 2.1 time: 0.099757 Sep 08 10:55:47.485502 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3350/6470] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:47 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:48.509404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:48.510740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:48.521291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.522354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.523246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.524656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:48.525838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:48.526727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:48.602869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:48.611375 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f518400d-69ee-4bc2-b758-c1613e61152c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1361 microversion: 2.1 time: 0.107025 Sep 08 10:55:48.613761 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3121/6471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:48 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1361 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:49.637501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:49.638126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:49.645993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.646500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.646946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.647701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:49.648162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:49.649145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:49.759664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:49.767999 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e54bf6ba-98a0-483d-83f6-7e18a55937c0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1361 microversion: 2.1 time: 0.134994 Sep 08 10:55:49.768602 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3351/6472] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:49 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1361 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:50.793788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:50.795107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:50.809457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.812481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.813790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.816208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:50.817881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:50.820958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:50.987378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:50.997656 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d7474ef-bba1-4659-a9ba-3dc8b92541bf tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1361 microversion: 2.1 time: 0.209154 Sep 08 10:55:50.999107 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3122/6473] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:50 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:52.027438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:52.028399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:52.036134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.036734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.037598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.038556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:52.039717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:52.040455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:52.125524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:55:52.140721 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-178e3cc4-54f6-4c83-9412-922df91c88ea tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 200 len: 1361 microversion: 2.1 time: 0.118149 Sep 08 10:55:52.141852 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3352/6474] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:52 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 1361 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:55:53.165555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:55:53.166221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:55:53.173746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.174150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.174640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.175369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:55:53.175865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:55:53.176441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:55:53.191388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a HTTP/1.1 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '34372dbe-c251-4cb3-b312-dee0b4a94b5a'} Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:55:53.193113 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7925934a-8394-4ad6-910f-46518fe5f20c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 404 len: 111 microversion: 2.1 time: 0.033838 Sep 08 10:55:53.197568 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3123/6475] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:55:53 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:02.151075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:02.151614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:02.165343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=19 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:02.166717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=51 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:02.168389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.168884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.169325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.170043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.170498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.177130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.240299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:56:02.351663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0eaf98ce-2cf7-435a-ac64-2c7d6b3d8841 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 204 len: 0 microversion: 2.1 time: 0.201159 Sep 08 10:56:02.354896 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3353/6476] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:56:02 2022] DELETE /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:56:02.364266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:02.365313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:02.373594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.374109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.374560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.375283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:02.376000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:02.376450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:02.518533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:02.529289 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f8582b4-22e4-4358-a362-bc30c13e3927 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1410 microversion: 2.1 time: 0.169346 Sep 08 10:56:02.530068 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3124/6477] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:02 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1410 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:03.554084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:03.555913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:03.571179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:03.571710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:03.572156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.572877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:03.573337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:03.573767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:03.954742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:03.965290 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b51a9785-6723-4c52-b2be-c5e3800ced16 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1410 microversion: 2.1 time: 0.415549 Sep 08 10:56:03.979658 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3354/6478] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:03 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1410 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:04.997198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:04.997937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:05.011941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.012901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.013352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.014085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.014546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.015091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.035306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-29eaf3e0-a8e8-4798-9e85-a0d6eb60d43c req-6065fcc9-46e4-4833-880c-4837d18d7f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69fb7be-c65d-4154-a686-c7f0821afb1d", "name": "network-vif-deleted", "tag": "924697e5-9412-4ccd-92c6-c585328d826b"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:05.061375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29eaf3e0-a8e8-4798-9e85-a0d6eb60d43c req-6065fcc9-46e4-4833-880c-4837d18d7f9f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:05.070273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29eaf3e0-a8e8-4798-9e85-a0d6eb60d43c req-6065fcc9-46e4-4833-880c-4837d18d7f9f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:05.072738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29eaf3e0-a8e8-4798-9e85-a0d6eb60d43c req-6065fcc9-46e4-4833-880c-4837d18d7f9f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:05.103849 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-29eaf3e0-a8e8-4798-9e85-a0d6eb60d43c req-6065fcc9-46e4-4833-880c-4837d18d7f9f service nova] Creating event network-vif-deleted:924697e5-9412-4ccd-92c6-c585328d826b for instance b69fb7be-c65d-4154-a686-c7f0821afb1d on n-h1-833090-19 Sep 08 10:56:05.110819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-29eaf3e0-a8e8-4798-9e85-a0d6eb60d43c req-6065fcc9-46e4-4833-880c-4837d18d7f9f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.404796 Sep 08 10:56:05.120066 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3125/6479] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:05.202352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:05.229124 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b57a7417-280f-4998-9054-ad14c071e4db tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1202 microversion: 2.1 time: 0.241129 Sep 08 10:56:05.230099 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3355/6480] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:04 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1202 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:06.254109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:06.254924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:06.266878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:06.267694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:06.268156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:06.268895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:06.269368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:06.269813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:06.411714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:06.424377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aaa28fd5-5cd1-47e7-89e9-693c1fe4d1e5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1202 microversion: 2.1 time: 0.175194 Sep 08 10:56:06.442382 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3126/6481] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:06 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:07.449937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:07.451135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:07.466465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.467490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.468093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.468981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:07.469853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:07.470449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:07.614637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:07.642217 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-466b1b42-bda4-49ae-97b7-94b4dababa41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1202 microversion: 2.1 time: 0.196344 Sep 08 10:56:07.643815 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3356/6482] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:07 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:08.672179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:08.672816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:08.675302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:08.689081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.689605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.690069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.690809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:08.691286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:08.695681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:08.699863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:08.831178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:08.840864 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-00c6b228-ae6e-408f-ab6b-f46c88eed738 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1202 microversion: 2.1 time: 0.172954 Sep 08 10:56:08.841972 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3127/6483] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:08 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:09.870591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:09.874071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:09.885921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.886704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.887480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.888415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:09.889029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:09.889612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:09.967269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:09.976145 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-203ff5cf-149b-436a-9d18-47d08f1a6116 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 200 len: 1202 microversion: 2.1 time: 0.111132 Sep 08 10:56:09.977414 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3357/6484] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:09 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 1202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:11.005010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:11.005784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:11.015282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.016137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.016784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.018359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:11.018995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:11.019604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:11.039737 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d HTTP/1.1 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b69fb7be-c65d-4154-a686-c7f0821afb1d'} Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:11.041435 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:11.046339 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ff84aa3-45a8-4b12-b862-3214143fc918 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 404 len: 111 microversion: 2.1 time: 0.042052 Sep 08 10:56:11.078658 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3128/6485] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:10 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:14.406781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:14.407993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:14.416015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.416950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.417550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.419827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.420465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.421054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.440495 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a HTTP/1.1 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '34372dbe-c251-4cb3-b312-dee0b4a94b5a'} Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:14.443239 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.448864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:14.450223 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90ecece2-7efe-4cd4-acdc-73f13ef19274 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 404 len: 111 microversion: 2.1 time: 0.047687 Sep 08 10:56:14.460836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:14.461760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 34372dbe-c251-4cb3-b312-dee0b4a94b5a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:14.466947 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3358/6486] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:56:14 2022] DELETE /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:14.471254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.471901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.472455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.473280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:14.473850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:14.475674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:14.494315 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a HTTP/1.1 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '34372dbe-c251-4cb3-b312-dee0b4a94b5a'} Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:14.497380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. Sep 08 10:56:14.501260 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:14.503692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 34372dbe-c251-4cb3-b312-dee0b4a94b5a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:14.504851 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9ad0782-5849-4eda-b78a-0c40d3986d4a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a" status: 404 len: 111 microversion: 2.1 time: 0.048860 Sep 08 10:56:14.511949 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3129/6487] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:14 2022] GET /compute/v2.1/servers/34372dbe-c251-4cb3-b312-dee0b4a94b5a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:15.962790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:15.970336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:15.989462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:15.989973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:15.990920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:15.992177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:15.992737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:15.993113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.018576 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d HTTP/1.1 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b69fb7be-c65d-4154-a686-c7f0821afb1d'} Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:16.021174 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.027107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:16.029229 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3245d366-0eee-4971-9db2-d3570a3cf761 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 404 len: 111 microversion: 2.1 time: 0.074092 Sep 08 10:56:16.034423 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3359/6488] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:56:15 2022] DELETE /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:16.041230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:16.041871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: b69fb7be-c65d-4154-a686-c7f0821afb1d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:16.049036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:16.049552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:16.050235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.051715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:16.052381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:16.053133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:16.074795 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d HTTP/1.1 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b69fb7be-c65d-4154-a686-c7f0821afb1d'} Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:16.077145 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. Sep 08 10:56:16.081903 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:56:16.085397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance b69fb7be-c65d-4154-a686-c7f0821afb1d could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:16.087806 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2a69bcf0-3c27-4a24-8a69-0c627f3dbceb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d" status: 404 len: 111 microversion: 2.1 time: 0.052278 Sep 08 10:56:16.089465 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3130/6489] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:16 2022] GET /compute/v2.1/servers/b69fb7be-c65d-4154-a686-c7f0821afb1d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:16.197623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-99a975a2-5658-4a27-8b6f-95a04e78853f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: .version_select at 0x7f234bda5790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-591858070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAIuc7v62g2cn7mGhGz4iIYtVI23lLwyeMPhVXCcfEJ1dMXvyfXNJUmabbxPb1m7vbf3/mFJhNjsJWs2xuSQvVONcPU+qvtAByGScvMDGAgRsVNSee2Ptgk4CNMtie7Sg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:16.221416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-99a975a2-5658-4a27-8b6f-95a04e78853f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:16.228479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-99a975a2-5658-4a27-8b6f-95a04e78853f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:16.260923 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-99a975a2-5658-4a27-8b6f-95a04e78853f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.073270 Sep 08 10:56:16.262411 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3360/6490] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:56:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:26.321936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=7 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:26.325760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=11 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:26.544950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2106616860", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "8ebc1d8f-c85e-4129-9746-01a29b85d261"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:26.644968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] validate_networks() for [('8ebc1d8f-c85e-4129-9746-01a29b85d261', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:27.136446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:27.136798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:27.137497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:27.137926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:27.138357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:27.148396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:27.148915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:27.149630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:27.150474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:27.150951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:27.151419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:27.181544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Getting quotas for project 73d779e05005415faebd5ec0ee82c82e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:27.188222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Getting quotas for user dae7c50f41494b959f9b904e2356d8ec and project 73d779e05005415faebd5ec0ee82c82e. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:27.203301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:27.205818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:27.260534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f891f92-422c-4938-8da0-d7981a777924 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946152 Sep 08 10:56:27.261461 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3131/6491] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:27.270920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:27.273411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:27.274814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:27.280921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-807787a8-bbe0-4930-b3cb-7330aa3d9b7b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:27.281884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-807787a8-bbe0-4930-b3cb-7330aa3d9b7b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:27.371149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-807787a8-bbe0-4930-b3cb-7330aa3d9b7b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:27.383068 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-807787a8-bbe0-4930-b3cb-7330aa3d9b7b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1215 microversion: 2.1 time: 0.111997 Sep 08 10:56:27.385577 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3361/6492] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:27 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:28.411513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:28.412118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:28.428815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:28.429552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:28.444103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:28.445810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:28.446342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:28.447334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:28.552489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:28.564716 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-37fd5061-b6e6-4f48-9254-d9f87403481f tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1267 microversion: 2.1 time: 0.159900 Sep 08 10:56:28.565319 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3132/6493] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:28 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:29.590002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:29.590620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:29.598803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:29.599709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:29.600676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:29.601398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:29.601956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:29.602411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:29.758557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:29.770071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-472c9c54-81aa-4d20-ba8c-c0ba7c1d0ec6 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1273 microversion: 2.1 time: 0.184106 Sep 08 10:56:29.778374 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3362/6494] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:29 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:30.803935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:30.805039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:30.819103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:30.823441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:30.824856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:30.826963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:30.830724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:30.831396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.375312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:31.405803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-50abeb1d-e0a7-4c85-8c41-c9bac1b02213 req-ea59a8a8-4dd3-43c9-b862-32d23bb77144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6101b2be-af09-4ed3-9801-188246948ff9", "tag": "f189cd14-ba2a-42ef-9935-208fb3a6c9aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:31.409431 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-44168dd4-15a2-40f8-9978-3dd656b7c9b8 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1315 microversion: 2.1 time: 0.610201 Sep 08 10:56:31.410645 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3133/6495] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:30 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:31.420161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-50abeb1d-e0a7-4c85-8c41-c9bac1b02213 req-ea59a8a8-4dd3-43c9-b862-32d23bb77144 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:31.421524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-50abeb1d-e0a7-4c85-8c41-c9bac1b02213 req-ea59a8a8-4dd3-43c9-b862-32d23bb77144 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:31.422264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-50abeb1d-e0a7-4c85-8c41-c9bac1b02213 req-ea59a8a8-4dd3-43c9-b862-32d23bb77144 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:31.442090 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-50abeb1d-e0a7-4c85-8c41-c9bac1b02213 req-ea59a8a8-4dd3-43c9-b862-32d23bb77144 service nova] Creating event network-changed:f189cd14-ba2a-42ef-9935-208fb3a6c9aa for instance 6101b2be-af09-4ed3-9801-188246948ff9 on n-h2-833090-19 Sep 08 10:56:31.449659 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-50abeb1d-e0a7-4c85-8c41-c9bac1b02213 req-ea59a8a8-4dd3-43c9-b862-32d23bb77144 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051361 Sep 08 10:56:31.456234 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3363/6496] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:56:32.434628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:32.435261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:32.443418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:32.444236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:32.445114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:32.446194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:32.447083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:32.447719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:32.642283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:32.651817 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e091eaca-be1c-4831-af31-fdff977565fa tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1315 microversion: 2.1 time: 0.221021 Sep 08 10:56:32.652417 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3134/6497] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:32 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:33.682081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:33.682808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:33.692130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.701943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.704127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.705112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:33.705617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:33.706100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:33.890208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:33.902372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-11aabeda-70f0-4258-a4d4-d4acdb6734d1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1315 microversion: 2.1 time: 0.230677 Sep 08 10:56:33.903356 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3364/6498] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:33 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:34.926679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:34.927882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:34.945600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.946312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.947148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:34.948096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:34.948735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:34.949348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:35.158825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:35.172335 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dccbf24b-e5fb-430f-a2af-263214d7229b tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1315 microversion: 2.1 time: 0.249605 Sep 08 10:56:35.185706 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3135/6499] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:34 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:36.197644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:36.200355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:36.208011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.209355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.209997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.210942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.211675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.212306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.367590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:36.376199 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35a0aa17-7a5e-40ee-925e-8820b75d4331 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1315 microversion: 2.1 time: 0.182492 Sep 08 10:56:36.376789 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3365/6500] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:36 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:36.820442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-00ea0ec8-c55f-4332-befd-79a5b2847ea9 req-25a19bd5-0c0c-4f3c-b1b1-142758dbecb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6101b2be-af09-4ed3-9801-188246948ff9", "name": "network-vif-plugged", "status": "completed", "tag": "f189cd14-ba2a-42ef-9935-208fb3a6c9aa"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:36.862610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-00ea0ec8-c55f-4332-befd-79a5b2847ea9 req-25a19bd5-0c0c-4f3c-b1b1-142758dbecb0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:36.863761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-00ea0ec8-c55f-4332-befd-79a5b2847ea9 req-25a19bd5-0c0c-4f3c-b1b1-142758dbecb0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:36.864417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-00ea0ec8-c55f-4332-befd-79a5b2847ea9 req-25a19bd5-0c0c-4f3c-b1b1-142758dbecb0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:36.904498 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-00ea0ec8-c55f-4332-befd-79a5b2847ea9 req-25a19bd5-0c0c-4f3c-b1b1-142758dbecb0 service nova] Creating event network-vif-plugged:f189cd14-ba2a-42ef-9935-208fb3a6c9aa for instance 6101b2be-af09-4ed3-9801-188246948ff9 on n-h2-833090-19 Sep 08 10:56:36.910714 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-00ea0ec8-c55f-4332-befd-79a5b2847ea9 req-25a19bd5-0c0c-4f3c-b1b1-142758dbecb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226137 Sep 08 10:56:36.911986 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3136/6501] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:37.401487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:37.402118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:37.410025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:37.414500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.415277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.416065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.417030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:37.417686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:37.418322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:37.585179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:37.593789 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1c4e1d5-b3b5-4552-a4a0-902fc5501591 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1315 microversion: 2.1 time: 0.198055 Sep 08 10:56:37.594403 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3366/6502] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:37 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:38.630042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:38.642149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:38.648544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:38.649526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.657379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.657888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.658342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.659055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.659737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.660179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.846889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:38.863845 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cd7f37d-ac39-4d51-88f9-ec8ae58e8171 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1502 microversion: 2.1 time: 0.233870 Sep 08 10:56:38.865751 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3137/6503] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:38 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:38.889326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:38.890489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:38.898760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.899562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.899965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:38.900849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:38.901483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:38.902074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.110410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:39.130931 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9434a48f-8fc9-4458-816e-154e5932934c tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1502 microversion: 2.1 time: 0.244393 Sep 08 10:56:39.130931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3367/6504] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:38 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:39.155402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:39.155980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:39.167756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.168349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.168803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.169747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.170388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.170996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.220116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lazy-loading 'flavor' on Instance uuid 6101b2be-af09-4ed3-9801-188246948ff9 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:56:39.327186 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9117805-5d92-4550-af96-e786aa608660 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.175601 Sep 08 10:56:39.331524 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3138/6505] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:39 2022] POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:56:39.338464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:39.339270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:39.345776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.346753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.347738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.348604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:39.349182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:39.349747 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:39.551898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:39.563031 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f478d79-8d33-4bc1-a4a4-2e354f5b660d tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1510 microversion: 2.1 time: 0.229608 Sep 08 10:56:39.564203 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3368/6506] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:39 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:40.591970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:40.592968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:40.602384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.603754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.604459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.605429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.606232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.607210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.857583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:40.875329 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-15362cfd-3cc2-426e-a7f8-67868e84f04e tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1493 microversion: 2.1 time: 0.289678 Sep 08 10:56:40.892629 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3139/6507] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:40 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1493 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:40.903863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:40.905045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:40.918691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.919406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.919668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:40.920750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:40.921763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:40.922388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.028474 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1012a210-b927-4328-b364-cf8ef4c23fd1 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.128722 Sep 08 10:56:41.029270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3369/6508] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:40 2022] POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 10:56:41.039044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:41.039781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:41.058874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:41.059769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:41.060528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.061931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:41.062667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:41.063277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:41.331168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:41.341478 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-127c1312-5dca-4322-bc57-2d8895e3cbe3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1499 microversion: 2.1 time: 0.307562 Sep 08 10:56:41.356335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3140/6509] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:41 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1499 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:41.458613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-530601332", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-591858070", "security_groups": [{"name": "tempest-secgroup-smoke-1228686066"}], "block_device_mapping_v2": [{"uuid": "a6ac1b47-4ac9-42ae-bcaf-d09b1c60bcc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:41.682033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:56:42.305695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:56:42.306451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:56:42.307148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:56:42.307592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:56:42.308320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:56:42.321236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.321734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.322177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.322913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.323756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.324121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.342199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:56:42.347770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:56:42.371986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:42.374124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:42.389298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.390446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.392065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.393305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:42.394354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:42.394994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:42.436012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:56:42.441568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6ac1b47-4ac9-42ae-bcaf-d09b1c60bcc0',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:56:42.582779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:42.592807 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0ca3ec7b-24be-4aef-be29-17ee56052913 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1499 microversion: 2.1 time: 0.230357 Sep 08 10:56:42.593472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3141/6510] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:42 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1499 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:42.605018 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b62bf760-9b01-4c44-b570-53412abf4ff9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.154260 Sep 08 10:56:42.606248 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3370/6511] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:56:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:56:42.617476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2cafad62-3f88-4d75-a23a-cd38bc30e13b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:42.618620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2cafad62-3f88-4d75-a23a-cd38bc30e13b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:42.692170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2cafad62-3f88-4d75-a23a-cd38bc30e13b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:42.701682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2cafad62-3f88-4d75-a23a-cd38bc30e13b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1093 microversion: 2.1 time: 0.087636 Sep 08 10:56:42.703075 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3142/6512] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:42 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:43.624754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:43.625387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:43.632818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.633323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.633771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.634497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.634955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.635612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.725209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:43.727188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:43.742283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.743273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.744027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.745993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:43.746583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:43.747322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:43.845272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:43.879703 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-76e9aac7-fd50-48cb-9c70-7e3d47a44a9a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1191 microversion: 2.1 time: 0.158537 Sep 08 10:56:43.882120 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3143/6513] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:43 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1191 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:43.934021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:43.953893 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-772d7a03-0e15-45bc-8607-91ad07582e80 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1502 microversion: 2.1 time: 0.334015 Sep 08 10:56:43.954494 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3371/6514] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:43 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1502 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:43.992388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:43.993153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:44.015281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.015822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.021743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.022865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.028868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.029378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.110026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lazy-loading 'flavor' on Instance uuid 6101b2be-af09-4ed3-9801-188246948ff9 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:56:44.247180 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-05c79be3-fceb-4d82-b60a-7b83dd4b45bd tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.272518 Sep 08 10:56:44.249766 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3144/6515] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:43 2022] POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:56:44.259433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:44.260129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:44.269776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.275548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.277171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.279607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.281456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.282774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.467575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:44.478191 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8732b5ca-3f3f-4057-af73-a56ec0002e93 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1510 microversion: 2.1 time: 0.223517 Sep 08 10:56:44.479546 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3372/6516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:44 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:44.909508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:44.910927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:44.917654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.919527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.920439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:44.921968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:44.923107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:44.923495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.190427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:45.218359 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-438fec33-0ead-4c72-b36f-14a3878ad049 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.313454 Sep 08 10:56:45.219762 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3145/6517] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:44 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:45.504443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:45.505642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:45.513139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.513665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.514105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.515042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.515514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.515956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.718541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:45.728796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27a0cf36-3fce-419c-831a-16c35381f021 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1493 microversion: 2.1 time: 0.228491 Sep 08 10:56:45.729617 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3373/6518] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:45 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1493 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:45.752858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:45.753510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:45.761717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.762610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.763528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.764370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.764950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.765656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.783830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:45.851834 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d871fba-09a1-4b51-a7bd-bfbfa441fae3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.102786 Sep 08 10:56:45.853187 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3146/6519] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 10:56:45 2022] POST /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:56:45.863031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:45.863987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:45.872711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.873629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.874222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.875839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.877029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.877479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.934893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c4a73d20-db84-4c60-904b-13094da1dda8 req-87043b63-7446-47a1-8d42-96320f34d4ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3843697b-7129-4c3f-a071-fd0c0c4ab214", "tag": "b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:45.977825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c4a73d20-db84-4c60-904b-13094da1dda8 req-87043b63-7446-47a1-8d42-96320f34d4ad service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:45.978432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c4a73d20-db84-4c60-904b-13094da1dda8 req-87043b63-7446-47a1-8d42-96320f34d4ad service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:45.979191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c4a73d20-db84-4c60-904b-13094da1dda8 req-87043b63-7446-47a1-8d42-96320f34d4ad service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:45.995107 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c4a73d20-db84-4c60-904b-13094da1dda8 req-87043b63-7446-47a1-8d42-96320f34d4ad service nova] Creating event network-changed:b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5 for instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 on n-h1-833090-19 Sep 08 10:56:46.018054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c4a73d20-db84-4c60-904b-13094da1dda8 req-87043b63-7446-47a1-8d42-96320f34d4ad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104893 Sep 08 10:56:46.019048 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3147/6520] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:56:46.089334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:46.098266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42157d0e-ab6b-442d-a4c3-7ef9b7a09b95 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1499 microversion: 2.1 time: 0.239392 Sep 08 10:56:46.100195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3374/6521] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:45 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:46.244580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:46.245537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:46.252723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.253483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.254129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.255061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:46.255726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:46.256341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:46.515007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:46.526092 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a308f30-ac5f-418b-8597-aabbe4ccd638 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.285587 Sep 08 10:56:46.528061 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3148/6522] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:46 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:47.124280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:47.125584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:47.134184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.134989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.135624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.136545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.137185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.137782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.297496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:47.306846 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5eb7ef1-a135-4710-8f21-8680db984f85 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1499 microversion: 2.1 time: 0.186649 Sep 08 10:56:47.308098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3375/6523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:47 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1499 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:47.549330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:47.550819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:47.558047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.558572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.559024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.559771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:47.560236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:47.560672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:47.703316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:47.711789 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04f83813-4940-40a9-af61-735579f2a402 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.166397 Sep 08 10:56:47.712944 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3149/6524] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:47 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:48.332234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:48.333846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:48.347011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.347728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.350100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.351925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.352646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.353178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.525777 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:48.537556 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2862e23d-c6ad-47c3-8b0d-dc5d3f9c0dd5 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1502 microversion: 2.1 time: 0.210387 Sep 08 10:56:48.538160 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3376/6525] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:48 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:48.561520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:48.562037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:48.568685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.569187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.569641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.570465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.570884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.571265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.602309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:56:48.687375 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a15fceb-4048-42e2-aa58-55994ae1e9fc tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 204 len: 0 microversion: 2.1 time: 0.129308 Sep 08 10:56:48.688719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3150/6526] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:56:48 2022] DELETE /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:56:48.697032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:48.697651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:48.704522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.705015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.705457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.706393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.706857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.707289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.736592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:48.737577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:48.744763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.745510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.746139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.747051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:48.747733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:48.748366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:48.933675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:48.947742 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4c9df12-c893-4436-8659-2da48b0d73ca tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1508 microversion: 2.1 time: 0.254444 Sep 08 10:56:48.948533 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3377/6527] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:48 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:48.988743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:48.999688 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb9c0f75-a2e9-4fbb-a00b-930915fc42a6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.267534 Sep 08 10:56:49.017389 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3151/6528] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:48 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:49.970641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:49.971300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:49.978931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.979419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.979898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:49.980604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:49.981065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:49.981499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:50.025006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:50.026320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:50.034166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:50.034676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:50.035208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:50.036095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:50.037227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:50.037742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:50.162823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:50.166694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:50.172483 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7a63703-93d3-4106-ac23-18de1e5b7d30 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1508 microversion: 2.1 time: 0.206117 Sep 08 10:56:50.173305 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3378/6529] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:49 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:50.210611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:50.219740 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26d592a4-a546-4840-acc1-a29ac17da130 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.199568 Sep 08 10:56:50.220325 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3152/6530] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:50 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:51.196025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:51.197473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:51.207184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.208976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.209637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.210626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.211291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.211968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.242439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:51.243731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:51.251535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.252324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.253014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.253939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.254703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.255347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.303334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae7c50f41494b959f9b904e2356d8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d779e05005415faebd5ec0ee82c82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:51.317622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f665efd6-cf7c-475c-81d6-0c37de64a4b3 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 200 len: 1466 microversion: 2.1 time: 0.125122 Sep 08 10:56:51.327476 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3379/6531] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:51 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 1466 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:51.729577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-743371fd-e502-44f2-b741-fa7353a174cf req-09fabcab-0305-4587-84ce-53a9f35a854b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6101b2be-af09-4ed3-9801-188246948ff9", "name": "network-vif-deleted", "tag": "f189cd14-ba2a-42ef-9935-208fb3a6c9aa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:56:51.742060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-743371fd-e502-44f2-b741-fa7353a174cf req-09fabcab-0305-4587-84ce-53a9f35a854b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:51.742549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-743371fd-e502-44f2-b741-fa7353a174cf req-09fabcab-0305-4587-84ce-53a9f35a854b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:51.742984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-743371fd-e502-44f2-b741-fa7353a174cf req-09fabcab-0305-4587-84ce-53a9f35a854b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:51.755745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-743371fd-e502-44f2-b741-fa7353a174cf req-09fabcab-0305-4587-84ce-53a9f35a854b service nova] Creating event network-vif-deleted:f189cd14-ba2a-42ef-9935-208fb3a6c9aa for instance 6101b2be-af09-4ed3-9801-188246948ff9 on n-h2-833090-19 Sep 08 10:56:51.760230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:51.762376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-743371fd-e502-44f2-b741-fa7353a174cf req-09fabcab-0305-4587-84ce-53a9f35a854b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037596 Sep 08 10:56:51.763153 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3380/6532] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:56:51.769203 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51ad231d-7a45-40e0-a9d7-a0cf6d1cc2d2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.530846 Sep 08 10:56:51.769791 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3153/6533] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:51 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:52.339879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:52.344563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:52.345275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] [instance: 6101b2be-af09-4ed3-9801-188246948ff9] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:52.353213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.353755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.354146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.354859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.355308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.355755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.356215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:52.372251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] HTTP exception thrown: Instance 6101b2be-af09-4ed3-9801-188246948ff9 could not be found. Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Request method failure captured: Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 HTTP/1.1 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcpYCNnLPEMQC3zfBLC-6znJ_3Uy5khCSePKCiPHUDdPugeJNNncfxSjHZ9Nxy_nKY6RzSQyhBZqC5Fm5YnXvxeGqj1O8IbL0Iazk58qPBmW-Bi9BmddQM0pecXXgKcD2keKV4UReTCGHyAiubu_8mvcVsF1RpKTKTIwizRyCl2ra10 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 73d779e05005415faebd5ec0ee82c82e Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestServerAdvancedOps-2047344150 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d779e05005415faebd5ec0ee82c82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/73d779e05005415faebd5ec0ee82c82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/73d779e05005415faebd5ec0ee82c82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_73d779e05005415faebd5ec0ee82c82e", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestServerAdvancedOps-2047344150 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 73d779e05005415faebd5ec0ee82c82e Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestServerAdvancedOps-2047344150 Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestServerAdvancedOps-2047344150-project Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dae7c50f41494b959f9b904e2356d8ec Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestServerAdvancedOps-2047344150-project Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6101b2be-af09-4ed3-9801-188246948ff9 could not be found. Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6101b2be-af09-4ed3-9801-188246948ff9'} Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6101b2be-af09-4ed3-9801-188246948ff9 could not be found. Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6101b2be-af09-4ed3-9801-188246948ff9 could not be found. Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:56:52.373975 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6101b2be-af09-4ed3-9801-188246948ff9 could not be found. Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] Returning 404 to user: Instance 6101b2be-af09-4ed3-9801-188246948ff9 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7fd13c51-1841-45a5-98f9-6fa6a9768080 tempest-TestServerAdvancedOps-2047344150 tempest-TestServerAdvancedOps-2047344150-project] 10.222.0.59 "GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9" status: 404 len: 111 microversion: 2.1 time: 0.037551 Sep 08 10:56:52.378793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3381/6534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:52 2022] GET /compute/v2.1/servers/6101b2be-af09-4ed3-9801-188246948ff9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:56:52.793183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:52.794378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:52.801617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:52.809860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.810391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.810856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:52.811695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:52.812177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:52.812624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:53.111585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:53.121698 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ca6f6eb5-95cc-48d8-b2df-eb5c682638de tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.332488 Sep 08 10:56:53.123670 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3154/6535] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:52 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:54.149213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:54.150456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:54.164429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.164931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.165381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.166120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:54.166583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:54.167019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:54.364756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:54.376570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6d63270b-650d-4e72-a246-7b9d5f4f8bc4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1277 microversion: 2.1 time: 0.233099 Sep 08 10:56:54.379538 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3382/6536] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:54 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:55.417275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:55.418839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:55.426914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.427766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.428562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.429490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:55.430245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:55.430881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:55.608814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:55.617660 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ea08e4d-f0f6-479b-bb5f-fa2798cb7460 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.204258 Sep 08 10:56:55.619110 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3155/6537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:55 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:56:56.641991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:56.642972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:56.650925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:56.651798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:56.652359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:56.652929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:56.653383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:56.653803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:56.889094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:56.902247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-406aa022-dde4-4ca5-b78b-bb541b67356a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.264145 Sep 08 10:56:56.911746 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3383/6538] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:56 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:57.935312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:57.936243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:57.946218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:57.947944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.948739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.949410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:57.950424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:57.951155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:57.952069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:58.181220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:58.193115 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b49256cf-2c87-4976-9ae8-c0060cdb7b5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.262397 Sep 08 10:56:58.194346 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3156/6539] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:57 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:56:59.222632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:56:59.224091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:56:59.227063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:56:59.239757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:59.240263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:59.249137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:59.249929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:56:59.250405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:56:59.256347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:56:59.497578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:56:59.507231 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-af5cfbef-9198-411b-b17e-cc2dd9757530 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.288965 Sep 08 10:56:59.507794 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3384/6540] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:56:59 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:00.533916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:00.534569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:00.548908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.551691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.554129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.554909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:00.556873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:00.557347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:00.889589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:00.905074 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e24c5b19-3b1d-4132-be11-200bd46b84eb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.377048 Sep 08 10:57:00.906176 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3157/6541] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:00 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:01.930969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:01.931646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:01.951323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.952128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.952971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:01.953877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:01.954501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:01.955093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:02.139161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:02.152411 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6c8f5672-35dd-41e3-b832-d2ca2ecf416c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.226442 Sep 08 10:57:02.154348 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3385/6542] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:01 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:03.177383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:03.178077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:03.186219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.190537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.194009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.194963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:03.195632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:03.196255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:03.697633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:03.708999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dbbe2087-9cf5-49b5-8d18-5398a698b0d5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.536253 Sep 08 10:57:03.711096 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3158/6543] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:03 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:04.744439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c6387619-fcf7-46cf-882a-f56243b4a6f3 req-99ed9c56-76ad-4aa6-880c-349616d71270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3843697b-7129-4c3f-a071-fd0c0c4ab214", "name": "network-vif-plugged", "status": "completed", "tag": "b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:04.745016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:04.745598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:04.761991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6387619-fcf7-46cf-882a-f56243b4a6f3 req-99ed9c56-76ad-4aa6-880c-349616d71270 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.763259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6387619-fcf7-46cf-882a-f56243b4a6f3 req-99ed9c56-76ad-4aa6-880c-349616d71270 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.764371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c6387619-fcf7-46cf-882a-f56243b4a6f3 req-99ed9c56-76ad-4aa6-880c-349616d71270 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.774535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.776559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.781810 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c6387619-fcf7-46cf-882a-f56243b4a6f3 req-99ed9c56-76ad-4aa6-880c-349616d71270 service nova] Creating event network-vif-plugged:b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5 for instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 on n-h1-833090-19 Sep 08 10:57:04.788468 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c6387619-fcf7-46cf-882a-f56243b4a6f3 req-99ed9c56-76ad-4aa6-880c-349616d71270 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056414 Sep 08 10:57:04.789667 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3159/6544] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:04.790073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:04.792427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:04.792983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:04.794180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:05.121031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:05.129511 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7121b34c-28d5-48bd-b9aa-c7af38a2f886 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1265 microversion: 2.1 time: 0.398246 Sep 08 10:57:05.130093 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3386/6545] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:04 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:06.156195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:06.160750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:06.177079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.177473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.177931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.178652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.179218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.179559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.464562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:06.492666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f27175f-2396-4306-a902-531e82a54093 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1452 microversion: 2.1 time: 0.342971 Sep 08 10:57:06.494439 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3160/6546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:06 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1452 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:06.528903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:06.530057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:06.546388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.548855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.549486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.550399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:06.559352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:06.560134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:06.744474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:06.754522 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd21c95e-5c7a-40f5-8054-d9206f108883 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1452 microversion: 2.1 time: 0.237252 Sep 08 10:57:06.770343 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3387/6547] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:06 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1452 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:11.657273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f947fa45-c5bd-4c7b-925d-cae7bab718e5 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Action: 'create', calling method: .version_select at 0x7f234bf59160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-139232025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpWWDa1W+s52xx9wUDHvsc3kSvkImG6xkdHSXp8cV7jV7QbA1yhFqlFs5R8WVFOIRFec71oB36kCkBMGuWD4XW1mz/9MkVP8bOyg7247CoSvZ8sfyHSOT5OZ3buzRpVg=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:11.692467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f947fa45-c5bd-4c7b-925d-cae7bab718e5 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Getting quotas for project c71e37b10c644c858b0e98bd7b5af343. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:57:11.699763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f947fa45-c5bd-4c7b-925d-cae7bab718e5 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Getting quotas for user 6f4cef04b4874239be161acb7154c472 and project c71e37b10c644c858b0e98bd7b5af343. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:57:11.738734 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f947fa45-c5bd-4c7b-925d-cae7bab718e5 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.454119 Sep 08 10:57:11.740565 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3161/6548] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:57:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:12.265439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1b6f49c0-8bb4-4374-a5b3-720857229197 req-dac45387-0714-4d68-a915-720fbbafd7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3843697b-7129-4c3f-a071-fd0c0c4ab214", "tag": "b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:12.288038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1b6f49c0-8bb4-4374-a5b3-720857229197 req-dac45387-0714-4d68-a915-720fbbafd7ae service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:12.290983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1b6f49c0-8bb4-4374-a5b3-720857229197 req-dac45387-0714-4d68-a915-720fbbafd7ae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:12.292088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1b6f49c0-8bb4-4374-a5b3-720857229197 req-dac45387-0714-4d68-a915-720fbbafd7ae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:12.321330 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1b6f49c0-8bb4-4374-a5b3-720857229197 req-dac45387-0714-4d68-a915-720fbbafd7ae service nova] Creating event network-changed:b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5 for instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 on n-h1-833090-19 Sep 08 10:57:12.329622 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1b6f49c0-8bb4-4374-a5b3-720857229197 req-dac45387-0714-4d68-a915-720fbbafd7ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069080 Sep 08 10:57:12.330789 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3388/6549] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:57:14.027489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1686872146", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-139232025", "security_groups": [{"name": "tempest-secgroup-smoke-818478545"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0bcf7a18-8b1a-47a7-b431-348e2594181b"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:14.177044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] validate_networks() for [('0bcf7a18-8b1a-47a7-b431-348e2594181b', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:57:14.803961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Getting quotas for project c71e37b10c644c858b0e98bd7b5af343. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:57:14.816343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Getting quotas for user 6f4cef04b4874239be161acb7154c472 and project c71e37b10c644c858b0e98bd7b5af343. Resources: dict_keys(['metadata_items']) {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:57:14.845580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:57:14.846125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:57:14.846698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:57:14.847871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:57:14.848469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:57:14.872350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.875497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.876088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.877099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:14.877756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:14.879545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:14.943486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Getting quotas for project c71e37b10c644c858b0e98bd7b5af343. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:57:14.955181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Getting quotas for user 6f4cef04b4874239be161acb7154c472 and project c71e37b10c644c858b0e98bd7b5af343. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:57:14.986407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:57:14.993969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:57:15.090468 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-478a9bac-33df-433a-845e-b1c91fe297da tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.068546 Sep 08 10:57:15.100013 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3162/6550] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:57:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:57:15.117702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ee951e00-1776-4389-a304-e9881d9ef3f7 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:15.119164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ee951e00-1776-4389-a304-e9881d9ef3f7 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:15.250464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ee951e00-1776-4389-a304-e9881d9ef3f7 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:15.284267 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ee951e00-1776-4389-a304-e9881d9ef3f7 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1302 microversion: 2.1 time: 0.167591 Sep 08 10:57:15.287896 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3389/6551] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:15 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:16.310480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:16.311276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:16.334168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.336109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.337013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.339289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:16.343730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:16.344609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:16.350101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:16.465541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:16.482318 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b73a2a2b-cf0b-46fa-b16c-714ee663ccae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1298 microversion: 2.1 time: 0.176593 Sep 08 10:57:16.492391 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3163/6552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:16 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:17.526207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:17.530090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:17.547025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.547786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.548444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.549372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:17.550626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:17.551413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:17.682280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:17.708669 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e5dd2f50-b158-4f90-b23f-3bcef5304dcb tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1360 microversion: 2.1 time: 0.192659 Sep 08 10:57:17.709526 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3390/6553] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:17 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:18.734550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:18.736338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:18.744601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.745645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.746739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:18.748017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:18.748598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:18.749191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.202843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:19.211712 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a5cd2d5-8447-4797-8508-e8e8e4c783f0 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.481267 Sep 08 10:57:19.212910 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3164/6554] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:18 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:19.725050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-61d1e884-9ec2-4f03-bcf3-f0d9dcde8cfd req-0caed12d-a8d3-43b8-8e5a-4ced80fdbfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a", "tag": "95a40eeb-50b4-456c-bf48-470727dbc0ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:19.739867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-61d1e884-9ec2-4f03-bcf3-f0d9dcde8cfd req-0caed12d-a8d3-43b8-8e5a-4ced80fdbfd9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:19.740845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-61d1e884-9ec2-4f03-bcf3-f0d9dcde8cfd req-0caed12d-a8d3-43b8-8e5a-4ced80fdbfd9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:19.741364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-61d1e884-9ec2-4f03-bcf3-f0d9dcde8cfd req-0caed12d-a8d3-43b8-8e5a-4ced80fdbfd9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:19.761968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-61d1e884-9ec2-4f03-bcf3-f0d9dcde8cfd req-0caed12d-a8d3-43b8-8e5a-4ced80fdbfd9 service nova] Creating event network-changed:95a40eeb-50b4-456c-bf48-470727dbc0ab for instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a on n-h2-833090-19 Sep 08 10:57:19.768438 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-61d1e884-9ec2-4f03-bcf3-f0d9dcde8cfd req-0caed12d-a8d3-43b8-8e5a-4ced80fdbfd9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050526 Sep 08 10:57:19.769675 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3391/6555] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:20.239774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:20.244761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:20.252445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.253479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.255476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.257084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:20.257899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:20.258524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:20.479411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:20.490929 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e9016395-6b37-4f7a-834d-f41cc64d6a86 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.258749 Sep 08 10:57:20.493124 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3165/6556] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:20 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:21.527337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:21.528913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:21.535862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:21.536359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:21.536798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:21.537503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:21.538147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:21.538620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:21.543021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=57 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:21.719670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:21.731020 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6664342d-91d9-443d-a098-8ae4dec40735 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.209247 Sep 08 10:57:21.735648 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3392/6557] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:21 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:22.760045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:22.760677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:22.775316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:22.776153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:22.776799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:22.777711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:22.778879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:22.780992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:23.055894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:23.064134 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f4b886d-bac8-43c3-8280-486b86db40ae tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.308346 Sep 08 10:57:23.079886 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3166/6558] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:22 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:24.088668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:24.089476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:24.097066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.097561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.098006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.098717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.099206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.099797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.258618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:24.267137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd702ce3-28e4-4298-90ca-9a1747ed2eca tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.182378 Sep 08 10:57:24.267923 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3393/6559] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:24 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:57:24.847936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-8ebaa211-fa63-4481-b2df-d8613f4044c4 req-e42e1125-1948-43cc-b0e9-7ea77a44f669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a", "name": "network-vif-plugged", "status": "completed", "tag": "95a40eeb-50b4-456c-bf48-470727dbc0ab"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:24.874349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8ebaa211-fa63-4481-b2df-d8613f4044c4 req-e42e1125-1948-43cc-b0e9-7ea77a44f669 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:24.874857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8ebaa211-fa63-4481-b2df-d8613f4044c4 req-e42e1125-1948-43cc-b0e9-7ea77a44f669 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:24.875355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8ebaa211-fa63-4481-b2df-d8613f4044c4 req-e42e1125-1948-43cc-b0e9-7ea77a44f669 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:24.892427 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-8ebaa211-fa63-4481-b2df-d8613f4044c4 req-e42e1125-1948-43cc-b0e9-7ea77a44f669 service nova] Creating event network-vif-plugged:95a40eeb-50b4-456c-bf48-470727dbc0ab for instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a on n-h2-833090-19 Sep 08 10:57:24.904574 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-8ebaa211-fa63-4481-b2df-d8613f4044c4 req-e42e1125-1948-43cc-b0e9-7ea77a44f669 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060047 Sep 08 10:57:24.906136 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3167/6560] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:25.292474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:25.293182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:25.296726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:25.304070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.304575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.305026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.305750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:25.306211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:25.306650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:25.465706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:25.474646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e723a69f-fd60-4e8b-8a09-e00e98a6ba69 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.186663 Sep 08 10:57:25.475136 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3394/6561] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:25 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:26.500095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:26.500823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:26.504817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:26.505981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:26.515539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.516316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.516783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.517635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:26.518129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:26.519125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:26.688318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:26.696429 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91f0eed4-8a9c-481d-a527-0eac4d5b672c tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1427 microversion: 2.1 time: 0.202157 Sep 08 10:57:26.697216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3168/6562] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:26 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:27.721001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:27.722368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:27.730164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.730782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.731279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.732129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.732903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.733405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.883870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:27.892184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d68dd767-bf0b-4201-95ae-3296d867e06b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1607 microversion: 2.1 time: 0.175225 Sep 08 10:57:27.893163 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3395/6563] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:27 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1607 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:27.915055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:27.915697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:27.922936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.923737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.924187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:27.925561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:27.926034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:27.926464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.106230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:28.114854 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3677276f-60d9-430b-9d11-ed1cb860ff46 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1607 microversion: 2.1 time: 0.203494 Sep 08 10:57:28.115479 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3169/6564] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:27 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1607 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:28.137757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:28.138487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:28.146026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.146568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.147000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.148043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:28.148808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:28.149238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:28.313760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:28.322826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c923aee-a714-4b1d-9150-008a7f334f1b tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1607 microversion: 2.1 time: 0.188988 Sep 08 10:57:28.323417 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3396/6565] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:28 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1607 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:31.047822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d4ab416e-6db3-4783-aa03-6f569f99357e req-ae5fc68f-450f-4931-92fe-bf066889205a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a", "tag": "95a40eeb-50b4-456c-bf48-470727dbc0ab"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:31.058658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:31.068317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d4ab416e-6db3-4783-aa03-6f569f99357e req-ae5fc68f-450f-4931-92fe-bf066889205a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:31.069205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d4ab416e-6db3-4783-aa03-6f569f99357e req-ae5fc68f-450f-4931-92fe-bf066889205a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:31.070647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d4ab416e-6db3-4783-aa03-6f569f99357e req-ae5fc68f-450f-4931-92fe-bf066889205a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:31.096570 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d4ab416e-6db3-4783-aa03-6f569f99357e req-ae5fc68f-450f-4931-92fe-bf066889205a service nova] Creating event network-changed:95a40eeb-50b4-456c-bf48-470727dbc0ab for instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a on n-h2-833090-19 Sep 08 10:57:31.103640 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d4ab416e-6db3-4783-aa03-6f569f99357e req-ae5fc68f-450f-4931-92fe-bf066889205a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064225 Sep 08 10:57:31.105141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3170/6566] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:35.162260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e35858f-6d14-4ec5-9575-5b9bda8d54f7 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Action: 'create', calling method: .version_select at 0x7f234bd67790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-334879554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImYpCMZBbwYqVo31uZVH9EeA7Od/KAyY5cfdZRe0Sktt+3Tz98yyuAOr5Wlzi1W4FS4dfI1d80wViIU3ecbjxSA9+AL1pAicRLHtGNZjGbnhJC253N8d9VubXtl/QLUuw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:35.167716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=28 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:35.179864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4e35858f-6d14-4ec5-9575-5b9bda8d54f7 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Getting quotas for project ede2f979d7784fd38caf3a90b7f34945. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:57:35.185761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4e35858f-6d14-4ec5-9575-5b9bda8d54f7 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Getting quotas for user 24d149a93e3a4a3aab5f108e3fcf86c1 and project ede2f979d7784fd38caf3a90b7f34945. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:57:35.210967 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e35858f-6d14-4ec5-9575-5b9bda8d54f7 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.235452 Sep 08 10:57:35.211936 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3397/6567] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 10:57:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:41.315153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=39 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:41.316789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:41.322832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-290002363-access_point-372867492", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "6d61974f-4b5a-421c-8c8b-faefdd07dd5e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-334879554", "security_groups": [{"name": "tempest-secgroup_access--967491549"}, {"name": "tempest-secgroup_general--842731249"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:41.672408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] validate_networks() for [('6d61974f-4b5a-421c-8c8b-faefdd07dd5e', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:57:42.800387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:57:42.802303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:57:42.803055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:57:42.803705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:57:42.805289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:57:42.824743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.826289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.827791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.829107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:42.831060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:42.833962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:42.882444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Getting quotas for project ede2f979d7784fd38caf3a90b7f34945. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:57:42.905739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Getting quotas for user 24d149a93e3a4a3aab5f108e3fcf86c1 and project ede2f979d7784fd38caf3a90b7f34945. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:57:42.939091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:57:42.941716 n-d-833090-19 devstack@n-api.service[122456]: WARNING nova.utils [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-290002363-access_point-372867492 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-290002363-acc Sep 08 10:57:42.943016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:57:43.009722 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fac2e687-414e-48a8-899b-f11dafc5443b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.696547 Sep 08 10:57:43.020976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=29 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:43.026097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0c83203-8698-43b9-8f87-17237c02fd2b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:43.026801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a0c83203-8698-43b9-8f87-17237c02fd2b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:43.027603 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3171/6568] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:57:41 2022] POST /compute/v2.1/servers => generated 456 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:57:43.130237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a0c83203-8698-43b9-8f87-17237c02fd2b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:43.140232 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0c83203-8698-43b9-8f87-17237c02fd2b tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1292 microversion: 2.1 time: 0.120721 Sep 08 10:57:43.141316 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3398/6569] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:43 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1292 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:44.169826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:44.170467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:44.178591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:44.179102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:44.179617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:44.180546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:44.181012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:44.181449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:44.251657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:44.260219 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ecdcd53d-5bc3-47b0-8a7c-20af5142cc95 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1344 microversion: 2.1 time: 0.094254 Sep 08 10:57:44.263282 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3172/6570] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:44 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:45.287337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:45.288016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:45.311152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.311924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.312559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.313617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:45.314740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:45.315412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:45.411761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:45.423489 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a7936f2-0180-4678-b39e-f41af9d9d3dc tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1350 microversion: 2.1 time: 0.140830 Sep 08 10:57:45.425618 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3399/6571] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:45 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:46.239829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7996a09f-9108-42a0-8a45-441c8f4db983 req-6c9e9897-04ae-4462-88e3-1c9d289f0708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e238330-3d0f-4ef7-bc07-3d43aaa87cdd", "tag": "525ad491-2023-4e4b-9a25-a047b7bd29d9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:46.250866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7996a09f-9108-42a0-8a45-441c8f4db983 req-6c9e9897-04ae-4462-88e3-1c9d289f0708 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.251509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7996a09f-9108-42a0-8a45-441c8f4db983 req-6c9e9897-04ae-4462-88e3-1c9d289f0708 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.252629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7996a09f-9108-42a0-8a45-441c8f4db983 req-6c9e9897-04ae-4462-88e3-1c9d289f0708 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.264600 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7996a09f-9108-42a0-8a45-441c8f4db983 req-6c9e9897-04ae-4462-88e3-1c9d289f0708 service nova] Creating event network-changed:525ad491-2023-4e4b-9a25-a047b7bd29d9 for instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd on n-h1-833090-19 Sep 08 10:57:46.269935 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7996a09f-9108-42a0-8a45-441c8f4db983 req-6c9e9897-04ae-4462-88e3-1c9d289f0708 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035125 Sep 08 10:57:46.270717 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3173/6572] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:46.455448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:46.455448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:46.456775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.457285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.457720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.469447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:46.470034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:46.471234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:46.637365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:46.647744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4fa21b96-83f3-4565-a688-bd613bf610b9 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1468 microversion: 2.1 time: 0.202636 Sep 08 10:57:46.648946 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3400/6573] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:46 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:47.674794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:47.676564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:47.682367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.683201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.683443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.684064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:47.684535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:47.684976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:47.856549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:47.866183 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-edb9e58e-c8bd-4012-b099-3fd2ce1768e6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1468 microversion: 2.1 time: 0.197025 Sep 08 10:57:47.867555 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3174/6574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:47 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:48.889873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:48.890538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:48.903927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.904748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.905374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:48.908881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:48.910927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:48.912132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:49.104895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:49.113629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e87e60a-7744-4208-a38c-cd5e0f2b76bb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1468 microversion: 2.1 time: 0.228395 Sep 08 10:57:49.115209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3401/6575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:48 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:50.135741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:50.136461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:50.143375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.143999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.144444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.145147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.145615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.146100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.294409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:50.309245 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e744406-d81c-44f4-8b42-dda3f8a1492f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1468 microversion: 2.1 time: 0.176889 Sep 08 10:57:50.311256 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3175/6576] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:50 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:50.776850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-62b8478e-a7ab-4cd3-b1c4-2d7dcfe0434a req-4485bb2f-3f70-4800-aa81-4c2d2c000e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e238330-3d0f-4ef7-bc07-3d43aaa87cdd", "name": "network-vif-plugged", "status": "completed", "tag": "525ad491-2023-4e4b-9a25-a047b7bd29d9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:50.789489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62b8478e-a7ab-4cd3-b1c4-2d7dcfe0434a req-4485bb2f-3f70-4800-aa81-4c2d2c000e97 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:50.790115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62b8478e-a7ab-4cd3-b1c4-2d7dcfe0434a req-4485bb2f-3f70-4800-aa81-4c2d2c000e97 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:50.790679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-62b8478e-a7ab-4cd3-b1c4-2d7dcfe0434a req-4485bb2f-3f70-4800-aa81-4c2d2c000e97 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:50.803987 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-62b8478e-a7ab-4cd3-b1c4-2d7dcfe0434a req-4485bb2f-3f70-4800-aa81-4c2d2c000e97 service nova] Creating event network-vif-plugged:525ad491-2023-4e4b-9a25-a047b7bd29d9 for instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd on n-h1-833090-19 Sep 08 10:57:50.810884 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-62b8478e-a7ab-4cd3-b1c4-2d7dcfe0434a req-4485bb2f-3f70-4800-aa81-4c2d2c000e97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038654 Sep 08 10:57:50.811844 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3402/6577] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:57:51.342313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:51.342932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:51.349778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.350270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.350716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.351416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:51.351909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:51.352346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:51.511233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:51.523758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94d3ffff-d05f-4e9f-95ff-bb34bb225e2d tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1468 microversion: 2.1 time: 0.184989 Sep 08 10:57:51.524384 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3176/6578] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:51 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:52.549243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:52.551255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.558882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.559371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.559843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.560608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.561062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.561530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.718362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:52.727039 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc7bff6f-83ff-4875-bee8-216c9347a00f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1640 microversion: 2.1 time: 0.183190 Sep 08 10:57:52.727582 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3403/6579] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:52 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1640 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:52.750831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:52.752281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.759430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.759973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.760435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.761147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.761618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.762058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.860651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:52.907276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:57:52.915377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd50d573-b218-4c69-81c9-1b0d0a415c34 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1640 microversion: 2.1 time: 0.168521 Sep 08 10:57:52.916076 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3177/6580] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:52 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1640 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:52.937795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:57:52.938411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:57:52.945351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.945858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.946300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:52.947005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:52.947490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:52.947928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:53.138005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:53.224291 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2c9da041-9df1-42da-96fb-ede804c8ffff tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1793 microversion: 2.1 time: 0.290251 Sep 08 10:57:53.229756 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3404/6581] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:57:52 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1793 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:57:54.923922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-8b92d59a-b133-4de3-9025-f1c033c02b2b req-aee5e717-3b2b-4476-a65f-2dd3891ce302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e238330-3d0f-4ef7-bc07-3d43aaa87cdd", "tag": "525ad491-2023-4e4b-9a25-a047b7bd29d9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:57:54.933936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:57:54.951806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8b92d59a-b133-4de3-9025-f1c033c02b2b req-aee5e717-3b2b-4476-a65f-2dd3891ce302 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:57:54.952312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8b92d59a-b133-4de3-9025-f1c033c02b2b req-aee5e717-3b2b-4476-a65f-2dd3891ce302 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:57:54.952786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8b92d59a-b133-4de3-9025-f1c033c02b2b req-aee5e717-3b2b-4476-a65f-2dd3891ce302 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:57:54.977198 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-8b92d59a-b133-4de3-9025-f1c033c02b2b req-aee5e717-3b2b-4476-a65f-2dd3891ce302 service nova] Creating event network-changed:525ad491-2023-4e4b-9a25-a047b7bd29d9 for instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd on n-h1-833090-19 Sep 08 10:57:54.983647 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-8b92d59a-b133-4de3-9025-f1c033c02b2b req-aee5e717-3b2b-4476-a65f-2dd3891ce302 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070002 Sep 08 10:57:54.984711 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3178/6582] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:34.617144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-477115223", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "0ead3e61-bc8a-48eb-81b6-b4804d9254ef"}], "key_name": "tempest-TestSecurityGroupsBasicOps-334879554", "security_groups": []}, "os:scheduler_hints": {"different_host": ["7e238330-3d0f-4ef7-bc07-3d43aaa87cdd"]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:34.626850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:34.627681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=32 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:34.682360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] validate_networks() for [('0ead3e61-bc8a-48eb-81b6-b4804d9254ef', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:58:35.220482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:58:35.221214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:58:35.222251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:58:35.222899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:58:35.223883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:58:35.234797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:35.235801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:35.236519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:35.237656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:35.238362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:35.239066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:35.260211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Getting quotas for project ede2f979d7784fd38caf3a90b7f34945. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:58:35.277850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Getting quotas for user 24d149a93e3a4a3aab5f108e3fcf86c1 and project ede2f979d7784fd38caf3a90b7f34945. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:58:35.307237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:58:35.310995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:58:35.388474 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b2ce6c46-fe64-42c4-86ae-85c05ca3369c tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.773688 Sep 08 10:58:35.403104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-76c5fc3d-2c29-4aa0-9d14-142951ad04f3 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:35.404592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-76c5fc3d-2c29-4aa0-9d14-142951ad04f3 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:35.407689 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3405/6583] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:58:34 2022] POST /compute/v2.1/servers => generated 361 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:58:35.415143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:35.416650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:35.529269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-76c5fc3d-2c29-4aa0-9d14-142951ad04f3 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:35.546486 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-76c5fc3d-2c29-4aa0-9d14-142951ad04f3 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1240 microversion: 2.1 time: 0.145889 Sep 08 10:58:35.566745 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3179/6584] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:35 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1240 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:58:36.575260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:36.576051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:36.583843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.584496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.584934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.585635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:36.586199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:36.586690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:36.698645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:36.708930 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1642a5e4-f962-4d9a-a156-86db29b53a9e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1292 microversion: 2.1 time: 0.141608 Sep 08 10:58:36.724857 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3406/6585] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:36 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1292 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:37.738149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:37.739658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:37.753314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:37.755335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:37.756126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:37.757239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:37.758224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:37.758890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:38.241148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:38.250672 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c4a9cc5b-ce59-460f-a2b7-f79e1b5801ea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.518565 Sep 08 10:58:38.251724 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3180/6586] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:37 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:38.921635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3f0dc92c-bae3-4a74-9dca-9a4cbcd46641 req-74c314f7-248e-41a1-9c56-b3e694bf63b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ad286b-0754-40f0-864f-8cf91ffccb22", "tag": "4df6e208-914e-4b8d-ae0b-37945f4bda6c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:38.932473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f0dc92c-bae3-4a74-9dca-9a4cbcd46641 req-74c314f7-248e-41a1-9c56-b3e694bf63b8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:38.932953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f0dc92c-bae3-4a74-9dca-9a4cbcd46641 req-74c314f7-248e-41a1-9c56-b3e694bf63b8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:38.933378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f0dc92c-bae3-4a74-9dca-9a4cbcd46641 req-74c314f7-248e-41a1-9c56-b3e694bf63b8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:38.946438 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3f0dc92c-bae3-4a74-9dca-9a4cbcd46641 req-74c314f7-248e-41a1-9c56-b3e694bf63b8 service nova] Creating event network-changed:4df6e208-914e-4b8d-ae0b-37945f4bda6c for instance a8ad286b-0754-40f0-864f-8cf91ffccb22 on n-h2-833090-19 Sep 08 10:58:38.953473 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3f0dc92c-bae3-4a74-9dca-9a4cbcd46641 req-74c314f7-248e-41a1-9c56-b3e694bf63b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035019 Sep 08 10:58:38.954401 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3407/6587] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:39.275239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:39.276466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:39.283219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.283745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.284397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.285124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:39.285575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:39.286039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:39.417207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:39.426343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5836bf6f-7ed9-4845-aca6-72b75e97eac6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.155417 Sep 08 10:58:39.429857 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3181/6588] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:39 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:40.451567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:40.452943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:40.459381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:40.459914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:40.460355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:40.461058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:40.461546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:40.461977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:40.549204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:40.557107 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f26d5f3b-e7d3-47b6-8ec6-4bfda4b3cea8 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.110788 Sep 08 10:58:40.557685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3408/6589] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:40 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:41.579738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:41.580394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:41.587356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:41.587888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:41.588343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:41.589106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:41.589581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:41.590027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:41.673853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:41.682324 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-753c9291-f8c7-427e-94d2-dd611a898a15 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.107010 Sep 08 10:58:41.683598 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3182/6590] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:41 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:42.706495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:42.707214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:42.715937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.716515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.717027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:42.718345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:42.718857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:42.719353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:42.809163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:42.818397 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c55bc907-bebb-4dfd-8c4b-b9cd0fad7364 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.116073 Sep 08 10:58:42.819222 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3409/6591] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:42 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:43.842490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:43.843198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:43.850680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:43.851321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:43.851854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:43.852597 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:43.853118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:43.853641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:44.003845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:44.013732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8dc783ac-93d1-453b-8cc2-9143b77c8da0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.175211 Sep 08 10:58:44.015005 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3183/6592] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:43 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:45.067897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:45.070813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:45.092204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:45.093745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:45.094356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:45.095543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:45.096108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:45.096854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:45.254927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:45.295516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:45.493479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-29773571-34aa-4ed7-9623-ed49994838f8 req-c7f1e3a6-19e8-440e-925e-b4bbbdcb0d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ad286b-0754-40f0-864f-8cf91ffccb22", "name": "network-vif-plugged", "status": "completed", "tag": "4df6e208-914e-4b8d-ae0b-37945f4bda6c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:45.495333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:45.508988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44bf931b-42b4-49ca-86e0-cf553f98cf28 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.471929 Sep 08 10:58:45.509590 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3410/6593] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:45 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:45.511341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29773571-34aa-4ed7-9623-ed49994838f8 req-c7f1e3a6-19e8-440e-925e-b4bbbdcb0d13 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:45.512083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29773571-34aa-4ed7-9623-ed49994838f8 req-c7f1e3a6-19e8-440e-925e-b4bbbdcb0d13 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:45.513886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29773571-34aa-4ed7-9623-ed49994838f8 req-c7f1e3a6-19e8-440e-925e-b4bbbdcb0d13 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:45.536754 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-29773571-34aa-4ed7-9623-ed49994838f8 req-c7f1e3a6-19e8-440e-925e-b4bbbdcb0d13 service nova] Creating event network-vif-plugged:4df6e208-914e-4b8d-ae0b-37945f4bda6c for instance a8ad286b-0754-40f0-864f-8cf91ffccb22 on n-h2-833090-19 Sep 08 10:58:45.544931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-29773571-34aa-4ed7-9623-ed49994838f8 req-c7f1e3a6-19e8-440e-925e-b4bbbdcb0d13 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059140 Sep 08 10:58:45.546513 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3184/6594] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:46.533409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:46.534669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:46.542968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.543783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.544452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.545425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:46.546714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:46.547378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:46.750280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:46.765676 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a9e573e-433c-451c-85c3-901bab9cc584 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1298 microversion: 2.1 time: 0.236619 Sep 08 10:58:46.767719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3411/6595] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:46 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:47.799195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:47.801437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:47.805635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:58:47.812502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:47.813015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:47.813467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:47.814189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:47.814663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:47.815273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:47.939226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:47.947606 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-336deb59-cc91-4604-ae02-adf1d9b468eb tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1471 microversion: 2.1 time: 0.160640 Sep 08 10:58:47.948194 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3185/6596] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:47 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:47.971964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:47.972707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:47.982151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:47.982805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:47.983906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:47.984815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:47.985449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:47.986058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.139498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:48.151297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9d9ae90-fc0b-4a9a-8788-c97cafcde426 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1471 microversion: 2.1 time: 0.185221 Sep 08 10:58:48.163873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3412/6597] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:47 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:48.174561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.175198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.189330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.190187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.190844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.191806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.192470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.193129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.340377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27841fbc-e332-458c-968b-397ef1514a38 tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1624 microversion: 2.1 time: 0.169833 Sep 08 10:58:48.341132 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3186/6598] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1624 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:48.368870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.369873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.391004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.393321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.394401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.396675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.398607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.400154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.541578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.546079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.552672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.553464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.554201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.555119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.556176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.556872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.584881 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ad964004-d25b-444c-af84-c1765ce4e7f9 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.048580 Sep 08 10:58:48.590255 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3187/6599] 10.222.0.59 () {58 vars in 1293 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a/os-server-password => generated 116 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:58:48.604867 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-47e3d04b-4bbd-4c85-af8a-6c2689ce850d tempest-TestSecurityGroupsBasicOps-1926412048 tempest-TestSecurityGroupsBasicOps-1926412048-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1911 microversion: 2.1 time: 0.244183 Sep 08 10:58:48.605576 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3413/6600] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1911 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:48.680689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.681436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.689085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.689677 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.690198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.691161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.691729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.692408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.723965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:58:48.818035 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db33be88-271e-4fc9-aad6-088a19a38aea tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 204 len: 0 microversion: 2.1 time: 0.141007 Sep 08 10:58:48.821085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3188/6601] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:58:48 2022] DELETE /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:58:48.831046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:48.831595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:48.842208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.842852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.843568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.844759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:48.845548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:48.846088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:48.952290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:48.963216 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-86a1c888-d636-4399-b1be-aff6abda18f0 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1477 microversion: 2.1 time: 0.137592 Sep 08 10:58:48.966289 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3414/6602] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:48 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1477 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:49.988749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:49.990839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:49.999501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:50.000321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:50.000839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:50.001841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:50.002438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:50.003242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:50.139256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:50.148970 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ff1c969-e887-4c74-b770-8aee0a06f19a tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1477 microversion: 2.1 time: 0.166358 Sep 08 10:58:50.155205 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3189/6603] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:49 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:51.173096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:51.174327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:51.182815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:51.183521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:51.184150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:51.185028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:51.185853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:51.186486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:51.358184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:51.367368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f06e7cb-b837-440f-a7d2-f0bbe752b604 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1477 microversion: 2.1 time: 0.198774 Sep 08 10:58:51.368371 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3415/6604] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:51 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:52.041420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7d02d8e9-f0d8-456f-b543-3901a9d497c4 req-36669a6d-6680-471b-92ec-e6ada795c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ad286b-0754-40f0-864f-8cf91ffccb22", "name": "network-vif-deleted", "tag": "4df6e208-914e-4b8d-ae0b-37945f4bda6c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:52.075482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7d02d8e9-f0d8-456f-b543-3901a9d497c4 req-36669a6d-6680-471b-92ec-e6ada795c1c6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.076554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7d02d8e9-f0d8-456f-b543-3901a9d497c4 req-36669a6d-6680-471b-92ec-e6ada795c1c6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.080630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7d02d8e9-f0d8-456f-b543-3901a9d497c4 req-36669a6d-6680-471b-92ec-e6ada795c1c6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.106710 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7d02d8e9-f0d8-456f-b543-3901a9d497c4 req-36669a6d-6680-471b-92ec-e6ada795c1c6 service nova] Creating event network-vif-deleted:4df6e208-914e-4b8d-ae0b-37945f4bda6c for instance a8ad286b-0754-40f0-864f-8cf91ffccb22 on n-h2-833090-19 Sep 08 10:58:52.124843 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7d02d8e9-f0d8-456f-b543-3901a9d497c4 req-36669a6d-6680-471b-92ec-e6ada795c1c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084421 Sep 08 10:58:52.126640 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3190/6605] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:52.390979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:52.392405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:52.413667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.414161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.415029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.415763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.416571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.417162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.458506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:52.459258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:52.459904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:52.460529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lazy-loading 'fault' on Instance uuid a8ad286b-0754-40f0-864f-8cf91ffccb22 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:58:52.515794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:58:52.526159 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eff134a5-2139-487f-a258-2d5e55be23f1 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 200 len: 1330 microversion: 2.1 time: 0.138978 Sep 08 10:58:52.528288 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3416/6606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:52 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 1330 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:58:53.554893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:53.556632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: a8ad286b-0754-40f0-864f-8cf91ffccb22] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:53.565306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:53.566368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:53.567813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:53.569428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:53.570349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:53.571139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:53.599769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] HTTP exception thrown: Instance a8ad286b-0754-40f0-864f-8cf91ffccb22 could not be found. Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Request method failure captured: Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 HTTP/1.1 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcqd655x4gIgH1hSvIoboUKPVVsTJbtqWyr2kencUZX1p6RTJvsoD3QWxyFB6iRWAscNkWOWt6BGRW6aWi-GDwF13-rbbnfokdeTjJ9tDp25aQ5pNZv_IJDblIY3MZJRJgWGIrvUVzx_D6WRcTAPDBbG5sNSOYDslqX2Wf4Wc7kX8EY Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: ede2f979d7784fd38caf3a90b7f34945 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-290002363 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ede2f979d7784fd38caf3a90b7f34945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ede2f979d7784fd38caf3a90b7f34945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ede2f979d7784fd38caf3a90b7f34945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ede2f979d7784fd38caf3a90b7f34945", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestSecurityGroupsBasicOps-290002363 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: ede2f979d7784fd38caf3a90b7f34945 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-290002363 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestSecurityGroupsBasicOps-290002363-project Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 24d149a93e3a4a3aab5f108e3fcf86c1 Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestSecurityGroupsBasicOps-290002363-project Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance a8ad286b-0754-40f0-864f-8cf91ffccb22 could not be found. Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'a8ad286b-0754-40f0-864f-8cf91ffccb22'} Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ad286b-0754-40f0-864f-8cf91ffccb22 could not be found. Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ad286b-0754-40f0-864f-8cf91ffccb22 could not be found. Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:58:53.602838 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ad286b-0754-40f0-864f-8cf91ffccb22 could not be found. Sep 08 10:58:53.608516 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:58:53.611187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Returning 404 to user: Instance a8ad286b-0754-40f0-864f-8cf91ffccb22 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:58:53.612493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0bd7270-a73e-44cc-b56e-a8b4e132e579 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22" status: 404 len: 111 microversion: 2.1 time: 0.062473 Sep 08 10:58:53.613344 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3191/6607] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:53 2022] GET /compute/v2.1/servers/a8ad286b-0754-40f0-864f-8cf91ffccb22 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 10:58:54.689212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34abb32d-52d4-4004-a8fc-e8ddd3edfbfd tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1177777087", "availability_zone": "foo_zone"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:54.692926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.aggregate [None req-34abb32d-52d4-4004-a8fc-e8ddd3edfbfd tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Generated uuid 7632bdbb-66e7-4a42-8f75-03aff042674e for aggregate {{(pid=122457) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 10:58:54.722504 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34abb32d-52d4-4004-a8fc-e8ddd3edfbfd tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.184378 Sep 08 10:58:54.723753 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3417/6608] 10.222.0.59 () {60 vars in 1164 bytes} [Thu Sep 8 10:58:54 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:54.734594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1679356a-6dc0-4631-a062-2a83ab5e89b1 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:54.770558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1679356a-6dc0-4631-a062-2a83ab5e89b1 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.039769 Sep 08 10:58:54.778176 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3192/6609] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:58:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:54.783095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:54.798648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.800018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.800481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:54.801261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.801720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.802185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:54.868667 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1124fa7a-6e8f-41b6-8271-912a4aaa55ad tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.089267 Sep 08 10:58:54.871349 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3418/6610] 10.222.0.59 () {58 vars in 1176 bytes} [Thu Sep 8 10:58:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:54.887755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-79f2963f-608b-45de-bccc-ef9647382b10 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:54.896637 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-79f2963f-608b-45de-bccc-ef9647382b10 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.018192 Sep 08 10:58:54.904696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3193/6611] 10.222.0.59 () {58 vars in 1143 bytes} [Thu Sep 8 10:58:54 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:54.910350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3db26bf9-c5a3-49f4-8a95-6ea97e8c1674 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-19"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:54.922490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db26bf9-c5a3-49f4-8a95-6ea97e8c1674 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:54.922993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db26bf9-c5a3-49f4-8a95-6ea97e8c1674 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:54.923435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3db26bf9-c5a3-49f4-8a95-6ea97e8c1674 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:55.289686 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3db26bf9-c5a3-49f4-8a95-6ea97e8c1674 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.383141 Sep 08 10:58:55.290303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3419/6612] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:58:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.302177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c8b253e9-83da-4419-8613-46cf3df2be1d tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:55.314535 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c8b253e9-83da-4419-8613-46cf3df2be1d tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.015949 Sep 08 10:58:55.316318 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3194/6613] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:58:55 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.330540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9431c4eb-da36-4a32-9a68-aa835f0f704f tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1336272147", "availability_zone": "foo_zone"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:55.389988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9431c4eb-da36-4a32-9a68-aa835f0f704f tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.063356 Sep 08 10:58:55.393823 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3420/6614] 10.222.0.59 () {60 vars in 1173 bytes} [Thu Sep 8 10:58:55 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.402235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e20969a3-d64f-4eac-875d-acf33d011ed3 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:55.433593 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e20969a3-d64f-4eac-875d-acf33d011ed3 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.034991 Sep 08 10:58:55.434225 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3195/6615] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:58:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.445672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5645ad6-14b6-4105-80fb-9c8645509a07 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:55.460101 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5645ad6-14b6-4105-80fb-9c8645509a07 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.018159 Sep 08 10:58:55.460698 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3421/6616] 10.222.0.59 () {58 vars in 1152 bytes} [Thu Sep 8 10:58:55 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.477336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4abbf5c9-0830-44ff-8d94-2081ad4dfcd8 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-19"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:55.490685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4abbf5c9-0830-44ff-8d94-2081ad4dfcd8 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:55.490972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4abbf5c9-0830-44ff-8d94-2081ad4dfcd8 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:55.491668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4abbf5c9-0830-44ff-8d94-2081ad4dfcd8 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:55.742533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4abbf5c9-0830-44ff-8d94-2081ad4dfcd8 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.269466 Sep 08 10:58:55.743222 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3196/6617] 10.222.0.59 () {60 vars in 1194 bytes} [Thu Sep 8 10:58:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:55.754690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a4c6e0e-1633-4a1a-a445-fdbaca925012 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:55.804314 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a4c6e0e-1633-4a1a-a445-fdbaca925012 tempest-TestAggregatesBasicOps-1200973352 tempest-TestAggregatesBasicOps-1200973352-project-admin] 10.222.0.59 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.053117 Sep 08 10:58:55.805513 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3422/6618] 10.222.0.59 () {58 vars in 1155 bytes} [Thu Sep 8 10:58:55 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 10:58:59.407838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.408949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:59.415363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-41b6302d-3dd8-49f0-9105-176a693e4a40 req-ce9885b9-4b5a-44b8-8804-252640e9d51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e238330-3d0f-4ef7-bc07-3d43aaa87cdd", "tag": "525ad491-2023-4e4b-9a25-a047b7bd29d9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:58:59.424709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.425474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.426622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.428711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.437469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.438186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.453444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-41b6302d-3dd8-49f0-9105-176a693e4a40 req-ce9885b9-4b5a-44b8-8804-252640e9d51e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.454080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-41b6302d-3dd8-49f0-9105-176a693e4a40 req-ce9885b9-4b5a-44b8-8804-252640e9d51e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.454613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-41b6302d-3dd8-49f0-9105-176a693e4a40 req-ce9885b9-4b5a-44b8-8804-252640e9d51e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.472969 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-41b6302d-3dd8-49f0-9105-176a693e4a40 req-ce9885b9-4b5a-44b8-8804-252640e9d51e service nova] Creating event network-changed:525ad491-2023-4e4b-9a25-a047b7bd29d9 for instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd on n-h1-833090-19 Sep 08 10:58:59.483617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-41b6302d-3dd8-49f0-9105-176a693e4a40 req-ce9885b9-4b5a-44b8-8804-252640e9d51e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072346 Sep 08 10:58:59.486075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:58:59.487809 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3423/6619] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:58:59.658815 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3143c48d-e85e-4bef-a282-4f18d0baa14f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 204 len: 0 microversion: 2.1 time: 0.255387 Sep 08 10:58:59.660770 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3197/6620] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:58:59 2022] DELETE /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:58:59.676354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:58:59.677862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:58:59.691983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.693908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.695833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:58:59.697815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:58:59.698535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:58:59.699183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:00.040769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:00.054285 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8285dbc4-9603-41c2-bec5-67f5d9fb14f6 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1764 microversion: 2.1 time: 0.386420 Sep 08 10:59:00.071748 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3424/6621] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:58:59 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1764 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:01.083790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:01.084527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:01.095397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.095943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.096404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.097140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.097619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.098068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:01.549092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24d149a93e3a4a3aab5f108e3fcf86c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede2f979d7784fd38caf3a90b7f34945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:01.557746 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83d2ae5b-ff17-4495-8b2b-33c77a998d36 tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 200 len: 1764 microversion: 2.1 time: 0.478232 Sep 08 10:59:01.559567 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3198/6622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:01 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 1764 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:01.727085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0bbcb994-4697-4259-ba21-76298b51a160 req-3d692018-931e-4e79-85e7-07dcca0058e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e238330-3d0f-4ef7-bc07-3d43aaa87cdd", "name": "network-vif-deleted", "tag": "525ad491-2023-4e4b-9a25-a047b7bd29d9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:01.746366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0bbcb994-4697-4259-ba21-76298b51a160 req-3d692018-931e-4e79-85e7-07dcca0058e8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:01.746855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0bbcb994-4697-4259-ba21-76298b51a160 req-3d692018-931e-4e79-85e7-07dcca0058e8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:01.747289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0bbcb994-4697-4259-ba21-76298b51a160 req-3d692018-931e-4e79-85e7-07dcca0058e8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.093089 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0bbcb994-4697-4259-ba21-76298b51a160 req-3d692018-931e-4e79-85e7-07dcca0058e8 service nova] Creating event network-vif-deleted:525ad491-2023-4e4b-9a25-a047b7bd29d9 for instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd on n-h1-833090-19 Sep 08 10:59:02.101419 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0bbcb994-4697-4259-ba21-76298b51a160 req-3d692018-931e-4e79-85e7-07dcca0058e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386426 Sep 08 10:59:02.102762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3425/6623] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:02.582273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:02.582843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] [instance: 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:02.589775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:02.590281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:02.590737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.591504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:02.591951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:02.592397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:02.606653 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] HTTP exception thrown: Instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd could not be found. Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Request method failure captured: Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd HTTP/1.1 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcqd655x4gIgH1hSvIoboUKPVVsTJbtqWyr2kencUZX1p6RTJvsoD3QWxyFB6iRWAscNkWOWt6BGRW6aWi-GDwF13-rbbnfokdeTjJ9tDp25aQ5pNZv_IJDblIY3MZJRJgWGIrvUVzx_D6WRcTAPDBbG5sNSOYDslqX2Wf4Wc7kX8EY Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: ede2f979d7784fd38caf3a90b7f34945 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-290002363 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ede2f979d7784fd38caf3a90b7f34945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ede2f979d7784fd38caf3a90b7f34945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ede2f979d7784fd38caf3a90b7f34945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ede2f979d7784fd38caf3a90b7f34945", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestSecurityGroupsBasicOps-290002363 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: ede2f979d7784fd38caf3a90b7f34945 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-290002363 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestSecurityGroupsBasicOps-290002363-project Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 24d149a93e3a4a3aab5f108e3fcf86c1 Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestSecurityGroupsBasicOps-290002363-project Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd could not be found. Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7e238330-3d0f-4ef7-bc07-3d43aaa87cdd'} Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd could not be found. Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd could not be found. Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:02.608987 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd could not be found. Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Returning 404 to user: Instance 7e238330-3d0f-4ef7-bc07-3d43aaa87cdd could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39083aa7-09c6-4116-8195-e921f2e8343f tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd" status: 404 len: 111 microversion: 2.1 time: 0.032447 Sep 08 10:59:02.614178 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3199/6624] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:02 2022] GET /compute/v2.1/servers/7e238330-3d0f-4ef7-bc07-3d43aaa87cdd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:06.093365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:06.094608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:06.098627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:06.100596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:06.107414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:06.108293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:06.108924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:06.113338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:06.114001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:06.114609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:06.122669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=83 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:06.155503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:06.272714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-66e95fbe-4926-48e0-a77f-05128de13d5f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 204 len: 0 microversion: 2.1 time: 0.185022 Sep 08 10:59:06.273997 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3426/6625] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:06 2022] DELETE /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:59:06.284448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:06.285131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:06.288668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:06.301485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:06.302022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:06.302472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:06.315927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:06.316554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:06.317030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:06.320769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:06.607493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:06.621756 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0d817ac-eaf5-4816-bd1f-77e8f0851889 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1577 microversion: 2.1 time: 0.343058 Sep 08 10:59:06.636556 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3200/6626] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:06 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1577 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:07.500930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35a5b044-2206-436d-bf8c-c850b98f351e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] Calling method '.version_select at 0x7f234bdf3790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:07.522120 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35a5b044-2206-436d-bf8c-c850b98f351e tempest-TestSecurityGroupsBasicOps-290002363 tempest-TestSecurityGroupsBasicOps-290002363-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-334879554" status: 202 len: 0 microversion: 2.1 time: 0.025510 Sep 08 10:59:07.522980 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3427/6627] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 10:59:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-334879554 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 10:59:07.648532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:07.649077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:07.657659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:07.658422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:07.659032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.659791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:07.660265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:07.660713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:07.820495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:07.826576 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-69988f44-a69f-4481-b55f-a9e1eec4e675 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1577 microversion: 2.1 time: 0.182698 Sep 08 10:59:07.827507 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3201/6628] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:07 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:08.854589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:08.855353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:08.873832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.874342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.874796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.875547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:08.876014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:08.876447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:08.974450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:08.983943 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7e35daea-f286-4ff2-9d80-d55d610bb59d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1509 microversion: 2.1 time: 0.137789 Sep 08 10:59:08.984685 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3428/6629] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:08 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1509 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:09.229262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-04882996-09c6-413c-80b4-33a025085517 req-91ee8d13-d959-44be-b91f-d59b200fd76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3843697b-7129-4c3f-a071-fd0c0c4ab214", "name": "network-vif-deleted", "tag": "b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:09.252481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-04882996-09c6-413c-80b4-33a025085517 req-91ee8d13-d959-44be-b91f-d59b200fd76d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:09.253198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-04882996-09c6-413c-80b4-33a025085517 req-91ee8d13-d959-44be-b91f-d59b200fd76d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:09.254036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-04882996-09c6-413c-80b4-33a025085517 req-91ee8d13-d959-44be-b91f-d59b200fd76d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:09.270986 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-04882996-09c6-413c-80b4-33a025085517 req-91ee8d13-d959-44be-b91f-d59b200fd76d service nova] Creating event network-vif-deleted:b1cc2f99-57f2-4bdf-b438-3aee6adb1cf5 for instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 on n-h1-833090-19 Sep 08 10:59:09.280099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-04882996-09c6-413c-80b4-33a025085517 req-91ee8d13-d959-44be-b91f-d59b200fd76d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056739 Sep 08 10:59:09.281191 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3202/6630] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:10.007363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:10.008792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:10.017697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:10.018742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:10.019500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:10.020482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:10.021608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:10.024167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:10.114497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:10.124918 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4ba9cd33-8757-4ee6-8ef0-5d4b56a99064 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1224 microversion: 2.1 time: 0.121143 Sep 08 10:59:10.126380 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3429/6631] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:10 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:11.160191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:11.161776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:11.172436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:11.173271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:11.174387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:11.175452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:11.176675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:11.177444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:11.287367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:11.299999 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-86b2098f-f2c1-475e-b2e4-e03ff57aecc2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1224 microversion: 2.1 time: 0.148940 Sep 08 10:59:11.302057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3203/6632] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:11 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:12.324826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:12.325495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:12.335417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.336135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.336755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.338093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:12.338765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:12.339382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:12.428914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:12.437435 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fc8d4107-3ff1-42b0-96db-8e28fce2a55a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1224 microversion: 2.1 time: 0.117116 Sep 08 10:59:12.438009 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3430/6633] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:12 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:13.460690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:13.461491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:13.471196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:13.475818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:13.476657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:13.477603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:13.478094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:13.478539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:13.593618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:13.608419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4e94e2b7-4ac2-4458-a1f6-97556a113785 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 200 len: 1224 microversion: 2.1 time: 0.150968 Sep 08 10:59:13.632006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3204/6634] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:13 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 1224 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:14.640226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:14.641599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:14.663371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:14.666190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:14.666906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:14.668028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:14.668814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:14.669533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:14.704016 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 HTTP/1.1 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3843697b-7129-4c3f-a071-fd0c0c4ab214'} Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:14.705703 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 10:59:14.710361 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:14.712190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:14.713053 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8132920f-f406-489b-bc88-deabc4b6850e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 404 len: 111 microversion: 2.1 time: 0.077594 Sep 08 10:59:14.713922 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3431/6635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:14 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:14.850101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1910249391", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-591858070", "security_groups": [{"name": "tempest-secgroup-smoke-1228686066"}], "block_device_mapping_v2": [{"uuid": "a6ac1b47-4ac9-42ae-bcaf-d09b1c60bcc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:15.037461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:16.100308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:16.100854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:16.101235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:16.101666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:16.102094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:16.113104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:16.113897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:16.114686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.115660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:16.116146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:16.116714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:16.144589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:16.150589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:16.218437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:16.220824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6ac1b47-4ac9-42ae-bcaf-d09b1c60bcc0',volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:16.368224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c551119f-4560-4956-b82c-452912eeb345 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.522121 Sep 08 10:59:16.369518 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3205/6636] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:59:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:59:16.380722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76134720-a7bd-44ea-92d4-09fbac075d3a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:16.381437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76134720-a7bd-44ea-92d4-09fbac075d3a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:16.451491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76134720-a7bd-44ea-92d4-09fbac075d3a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:16.470266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76134720-a7bd-44ea-92d4-09fbac075d3a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1094 microversion: 2.1 time: 0.093551 Sep 08 10:59:16.471123 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3432/6637] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:16 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:17.498647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:17.499991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:17.514386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:17.518294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:17.519360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:17.520357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:17.521158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:17.521934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:17.705196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:17.715919 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9a37e816-b821-487b-ab8f-c07a19810cda tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1192 microversion: 2.1 time: 0.226060 Sep 08 10:59:17.738888 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3206/6638] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:17 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1192 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:18.740102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:18.740874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:18.760275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.763075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.763685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.765906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:18.766395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:18.768373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:18.978285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:18.989967 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fb83dd2a-950a-4c87-ac49-5469c533e3e0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1210 microversion: 2.1 time: 0.254532 Sep 08 10:59:18.990568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3433/6639] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:18 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1210 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:20.018230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:20.020378 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:20.039433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.047370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.051773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.056835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.063113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.063627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.454576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:20.468376 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ccf4ced9-6173-471c-b0de-7a8125ee9a86 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1278 microversion: 2.1 time: 0.450986 Sep 08 10:59:20.483499 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3207/6640] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:20 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1278 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:20.912524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3fce4ada-c972-4399-843c-e273ac2c21a9 req-9846549b-b8a8-4234-974a-4657e1569940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bc4195-bd35-429c-94b6-b4bd9056000e", "tag": "2d3f0514-496f-48cc-a6f5-e1c2c01c6852"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:20.935313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3fce4ada-c972-4399-843c-e273ac2c21a9 req-9846549b-b8a8-4234-974a-4657e1569940 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:20.936058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3fce4ada-c972-4399-843c-e273ac2c21a9 req-9846549b-b8a8-4234-974a-4657e1569940 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:20.936672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3fce4ada-c972-4399-843c-e273ac2c21a9 req-9846549b-b8a8-4234-974a-4657e1569940 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:20.961184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3fce4ada-c972-4399-843c-e273ac2c21a9 req-9846549b-b8a8-4234-974a-4657e1569940 service nova] Creating event network-changed:2d3f0514-496f-48cc-a6f5-e1c2c01c6852 for instance 80bc4195-bd35-429c-94b6-b4bd9056000e on n-h1-833090-19 Sep 08 10:59:20.970744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3fce4ada-c972-4399-843c-e273ac2c21a9 req-9846549b-b8a8-4234-974a-4657e1569940 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063001 Sep 08 10:59:20.979085 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3434/6641] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 10:59:21.497158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:21.501393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:21.532759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.533627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.535838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:21.539215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:21.542256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:21.543157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:22.194497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:22.196290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:22.196987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:22.197770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:22.198691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:22.199307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:22.200083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:22.234758 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-39debe6f-99ca-4ee4-8004-9e1405029b2f tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.290726 Sep 08 10:59:22.236514 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3435/6642] 10.222.0.59 () {58 vars in 1185 bytes} [Thu Sep 8 10:59:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:22.412409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:22.424928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9378316-f75d-4910-93a3-8a5203898c0d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1278 microversion: 2.1 time: 0.932483 Sep 08 10:59:22.440847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1515288788", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "availability_zone": "nova:n-h1-833090-19", "networks": [{"uuid": "526341ba-506e-4195-aea3-31005c10dd6f"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:22.445931 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3208/6643] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:21 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1278 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:22.526239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] validate_networks() for [('526341ba-506e-4195-aea3-31005c10dd6f', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:23.268894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:23.269524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:23.269941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:23.270374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:23.270800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:23.282067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:23.282562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:23.283183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:23.283952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:23.284412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:23.284912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:23.306472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Getting quotas for project 235df4de8e14418eb1ebc7dcc0d9e902. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:23.312671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Getting quotas for user 4914505783e54e3bb2722883a06f612e and project 235df4de8e14418eb1ebc7dcc0d9e902. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:23.326094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:23.328887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:23.391256 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89132d5c-9aa4-4223-bdb0-ba55d1d599d8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954776 Sep 08 10:59:23.391956 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3436/6644] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 10:59:23.403204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dbbfb281-108d-4a09-9fa9-3dcc9ca26eca tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:23.403857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dbbfb281-108d-4a09-9fa9-3dcc9ca26eca tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:23.459193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:23.461379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:23.473656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:23.474449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:23.475068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:23.476227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:23.478428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:23.479050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:23.490042 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dbbfb281-108d-4a09-9fa9-3dcc9ca26eca tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1329 microversion: 2.1 time: 0.090509 Sep 08 10:59:23.491059 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3209/6645] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:23 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1329 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:23.664461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:23.673593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9fb9193e-e47a-4f9e-a0d1-992104b2e521 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1278 microversion: 2.1 time: 0.223391 Sep 08 10:59:23.674468 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3437/6646] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:23 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:24.513307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:24.514043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:24.522318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.523182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.523779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.524569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.525257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.525703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.595928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b70c3ae1-01f6-46a8-a6d2-0014eb900aef tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1418 microversion: 2.1 time: 0.087156 Sep 08 10:59:24.607537 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3210/6647] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:24 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1418 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:24.698029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:24.698658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:24.707303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.707954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.708551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.709414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:24.709999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:24.710472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:24.962172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:24.971657 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2258901a-be36-47fb-bf84-9691352410d4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1278 microversion: 2.1 time: 0.277670 Sep 08 10:59:24.972551 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3438/6648] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:24 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:25.619120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:25.619769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:25.626570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.627071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.627545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.628257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:25.628754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:25.629193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:25.847798 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fbd9ac8d-b3a9-4327-a035-72a6734e3ca7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1466 microversion: 2.1 time: 0.232114 Sep 08 10:59:25.848829 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3211/6649] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:25 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1466 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:25.997451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:25.998062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:26.005207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.005772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.006212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.006924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.007374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.007843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.279768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:26.288144 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-735944ab-f425-4d11-a392-a6113f2a9f10 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.294662 Sep 08 10:59:26.288795 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3439/6650] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:25 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:26.494791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5f8306c4-dcd3-46dc-ab70-cd08de788f45 req-e90eb0be-1235-449c-9440-fb35479a02eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6306cc-ebf0-4eef-8d54-205ae5cc44e7", "tag": "a88f89b8-59ae-40f1-9056-246f280c04d3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:26.501950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:26.508150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f8306c4-dcd3-46dc-ab70-cd08de788f45 req-e90eb0be-1235-449c-9440-fb35479a02eb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.508801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f8306c4-dcd3-46dc-ab70-cd08de788f45 req-e90eb0be-1235-449c-9440-fb35479a02eb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.509445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5f8306c4-dcd3-46dc-ab70-cd08de788f45 req-e90eb0be-1235-449c-9440-fb35479a02eb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.524124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5f8306c4-dcd3-46dc-ab70-cd08de788f45 req-e90eb0be-1235-449c-9440-fb35479a02eb service nova] Creating event network-changed:a88f89b8-59ae-40f1-9056-246f280c04d3 for instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 on n-h1-833090-19 Sep 08 10:59:26.527021 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5f8306c4-dcd3-46dc-ab70-cd08de788f45 req-e90eb0be-1235-449c-9440-fb35479a02eb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036711 Sep 08 10:59:26.527686 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3212/6651] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:26.874686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:26.875323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:26.883143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.884497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.885084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:26.885993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:26.886460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:26.886897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:27.039709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-306c81c3-ed2a-45b4-b9b6-d5619e696924 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1466 microversion: 2.1 time: 0.171193 Sep 08 10:59:27.040413 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3440/6652] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:26 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1466 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:27.313886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:27.314691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:27.321037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:27.321622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:27.322157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:27.322992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:27.323493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:27.323959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:27.461553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:27.470414 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1921ff2e-6a7d-480a-b9cf-13b7276796be tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.161785 Sep 08 10:59:27.471006 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3213/6653] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:27 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:28.064165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:28.065620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:28.073830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.074706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.075483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:28.076451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.077294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.077945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:28.320105 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-94194dc4-645b-4e9a-adfa-b194632a4202 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1466 microversion: 2.1 time: 0.261144 Sep 08 10:59:28.328420 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3441/6654] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:28 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1466 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:28.493774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:28.494484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:28.502266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.502771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.503228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:28.504115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:28.504577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:28.505033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:28.642649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:28.650785 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e61e2a9-4f12-4eb6-afed-e9ed7d435a5c tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.160941 Sep 08 10:59:28.651360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3214/6655] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:28 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:29.342364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:29.342986 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:29.350036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.350528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.350974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.351707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.352170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.352605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.484365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-87aede73-ae74-4e26-ada5-aada891e1224 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1466 microversion: 2.1 time: 0.145854 Sep 08 10:59:29.484984 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3442/6656] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:29 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:29.674629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:29.675240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:29.682456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.682947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.683396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.684128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:29.684589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:29.685052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:29.831009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:29.839410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d264c5af-981c-4494-b953-43e11faa4442 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.169225 Sep 08 10:59:29.840024 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3215/6657] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:29 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:30.507003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:30.507658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:30.514565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.515614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.516054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.516741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.517189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.517608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.642905 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-758e318c-188f-48ef-bd74-8ff51e013acc tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1466 microversion: 2.1 time: 0.139569 Sep 08 10:59:30.643503 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3443/6658] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:30 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:30.862632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:30.863186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:30.870226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.870750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.871208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:30.871948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:30.872423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:30.872896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.014301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:31.024332 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d1f554b8-d3c0-47d6-9237-975865d2abf7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.165649 Sep 08 10:59:31.024960 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3216/6659] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:30 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:31.237797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4634778d-6cc3-4e76-9e1b-4175200d1801 req-f94a07b3-0ec0-4ec3-b697-3752ff4df7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6306cc-ebf0-4eef-8d54-205ae5cc44e7", "name": "network-vif-plugged", "status": "completed", "tag": "a88f89b8-59ae-40f1-9056-246f280c04d3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:31.247850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4634778d-6cc3-4e76-9e1b-4175200d1801 req-f94a07b3-0ec0-4ec3-b697-3752ff4df7a4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.248367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4634778d-6cc3-4e76-9e1b-4175200d1801 req-f94a07b3-0ec0-4ec3-b697-3752ff4df7a4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.249539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4634778d-6cc3-4e76-9e1b-4175200d1801 req-f94a07b3-0ec0-4ec3-b697-3752ff4df7a4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.260730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4634778d-6cc3-4e76-9e1b-4175200d1801 req-f94a07b3-0ec0-4ec3-b697-3752ff4df7a4 service nova] Creating event network-vif-plugged:a88f89b8-59ae-40f1-9056-246f280c04d3 for instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 on n-h1-833090-19 Sep 08 10:59:31.265990 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4634778d-6cc3-4e76-9e1b-4175200d1801 req-f94a07b3-0ec0-4ec3-b697-3752ff4df7a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Sep 08 10:59:31.266597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3444/6660] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:31.665560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:31.666439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:31.672628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.673123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.673561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.674266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:31.674726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:31.675165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:31.804131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b981ec47-b67e-4f52-a8b4-f4bad0b490ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1466 microversion: 2.1 time: 0.142267 Sep 08 10:59:31.804719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3217/6661] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:31 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:32.047954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:32.049091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.055655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.056151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.056601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.057317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.057779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.058216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.196394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:32.204877 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45253bdd-9b86-4250-8d9c-3ce54a1c342f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.162228 Sep 08 10:59:32.205457 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3445/6662] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:32 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:32.827836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:32.828512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.835697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.836196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.836680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.837403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.837872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:32.838313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:32.969497 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-21e22de2-3a45-4278-96d7-c70d82367134 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1652 microversion: 2.1 time: 0.145604 Sep 08 10:59:32.970093 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3218/6663] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:32 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:32.992602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:32.993233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:32.999442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:32.999969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.000416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.001120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.001580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.002017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.017190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:33.140192 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-62df66e3-3a5e-41fd-a981-aedbe182a816 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1652 microversion: 2.1 time: 0.151445 Sep 08 10:59:33.140850 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3446/6664] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:32 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:33.162673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:33.163299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:33.169315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.169829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.170269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.170971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.171439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.171902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.227565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:33.228500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:33.234499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.234995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.235731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.236457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.236916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.237352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.293893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:33.320225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:33.323479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=100 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:33.331731 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7cdd41b1-e441-47f0-af4e-13355a3bcb68 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1652 microversion: 2.1 time: 0.172599 Sep 08 10:59:33.332365 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3219/6665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:33 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1652 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:33.395939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:33.397903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-332261406", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "availability_zone": "nova:n-h2-833090-19", "networks": [{"uuid": "526341ba-506e-4195-aea3-31005c10dd6f"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:33.404422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0889d561-94fe-4de4-8afd-2af6040ddda3 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.180748 Sep 08 10:59:33.405668 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3447/6666] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:33 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:33.476345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] validate_networks() for [('526341ba-506e-4195-aea3-31005c10dd6f', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 10:59:33.490138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:33.854205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 10:59:33.854774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 10:59:33.855161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 10:59:33.855679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 10:59:33.856109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 10:59:33.865542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.866043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.866523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.867263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:33.867777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:33.868220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:33.886697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Getting quotas for project 235df4de8e14418eb1ebc7dcc0d9e902. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 10:59:33.892090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Getting quotas for user 4914505783e54e3bb2722883a06f612e and project 235df4de8e14418eb1ebc7dcc0d9e902. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 10:59:33.904951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 10:59:33.907319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 10:59:33.953741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7033c62c-a6e0-4404-b9b5-f4bfcfa78784 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559809 Sep 08 10:59:33.954406 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3220/6667] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 10:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 10:59:33.966223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-227e1c58-4dff-4e37-bede-c977479359d4 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:33.966841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-227e1c58-4dff-4e37-bede-c977479359d4 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:34.032612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-227e1c58-4dff-4e37-bede-c977479359d4 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1328 microversion: 2.1 time: 0.070400 Sep 08 10:59:34.033354 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3448/6668] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:33 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1328 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:34.428161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:34.428787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:34.435101 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:34.435663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:34.436729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:34.437681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:34.438152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:34.438596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:34.579246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:34.588396 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-64e8aa63-417b-480e-b173-4a80c4de327a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.164169 Sep 08 10:59:34.588995 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3221/6669] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:34 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:35.057800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:35.059021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:35.067999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.068498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.073885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.073885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.073885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.073885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.192820 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3bdcd0f9-e1f6-4405-893b-4ce751c19e52 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1425 microversion: 2.1 time: 0.140791 Sep 08 10:59:35.208191 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3449/6670] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:35 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1425 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:35.285642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1f8ee9d3-0492-40fd-a55b-aca480ee2296 req-0dc9e1cc-2d04-4993-a034-457c6c6f38fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bc4195-bd35-429c-94b6-b4bd9056000e", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f0514-496f-48cc-a6f5-e1c2c01c6852"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:35.302285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1f8ee9d3-0492-40fd-a55b-aca480ee2296 req-0dc9e1cc-2d04-4993-a034-457c6c6f38fc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.304218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1f8ee9d3-0492-40fd-a55b-aca480ee2296 req-0dc9e1cc-2d04-4993-a034-457c6c6f38fc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.304218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1f8ee9d3-0492-40fd-a55b-aca480ee2296 req-0dc9e1cc-2d04-4993-a034-457c6c6f38fc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.318042 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1f8ee9d3-0492-40fd-a55b-aca480ee2296 req-0dc9e1cc-2d04-4993-a034-457c6c6f38fc service nova] Creating event network-vif-plugged:2d3f0514-496f-48cc-a6f5-e1c2c01c6852 for instance 80bc4195-bd35-429c-94b6-b4bd9056000e on n-h1-833090-19 Sep 08 10:59:35.325778 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1f8ee9d3-0492-40fd-a55b-aca480ee2296 req-0dc9e1cc-2d04-4993-a034-457c6c6f38fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045954 Sep 08 10:59:35.327553 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3222/6671] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:35.612585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:35.613156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:35.619622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.620126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.620570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:35.621310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:35.621794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:35.622237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.003479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:36.012204 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dddc3133-d81d-4062-a1be-9e2738aec663 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1266 microversion: 2.1 time: 0.404421 Sep 08 10:59:36.027762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3450/6672] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:35 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:36.217948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:36.218670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:36.225641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:36.226153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:36.226615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.227353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:36.227951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:36.228298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.486339 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da7bf2eb-5ecb-4f67-9fb1-1608d7fd9ff3 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1465 microversion: 2.1 time: 0.273129 Sep 08 10:59:36.486925 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3223/6673] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:36 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1465 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:36.901436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4b21b154-e4b8-4aff-8d10-65ffcc8e8190 req-5601037c-3571-40ae-a5a6-c1e19c204417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "301ccc85-a4e1-4da1-aa5e-23ee604e062f", "tag": "254c2abc-e89a-4a6d-82ab-44d29b3f7ce9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:36.915636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:36.928051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b21b154-e4b8-4aff-8d10-65ffcc8e8190 req-5601037c-3571-40ae-a5a6-c1e19c204417 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:36.928551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b21b154-e4b8-4aff-8d10-65ffcc8e8190 req-5601037c-3571-40ae-a5a6-c1e19c204417 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:36.928997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4b21b154-e4b8-4aff-8d10-65ffcc8e8190 req-5601037c-3571-40ae-a5a6-c1e19c204417 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:36.959732 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4b21b154-e4b8-4aff-8d10-65ffcc8e8190 req-5601037c-3571-40ae-a5a6-c1e19c204417 service nova] Creating event network-changed:254c2abc-e89a-4a6d-82ab-44d29b3f7ce9 for instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f on n-h2-833090-19 Sep 08 10:59:36.965326 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4b21b154-e4b8-4aff-8d10-65ffcc8e8190 req-5601037c-3571-40ae-a5a6-c1e19c204417 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076472 Sep 08 10:59:36.966273 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3451/6674] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:37.038887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:37.039790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:37.044297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:37.051961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.052546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.053516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.054376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.054964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.055809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.483746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:37.495383 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20e9f45e-0ddd-495a-a244-b0cd2172df41 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1453 microversion: 2.1 time: 0.461879 Sep 08 10:59:37.496682 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3224/6675] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:37 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1453 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:37.514361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:37.515314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:37.521017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:37.522866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:37.523017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.523812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.524431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.525183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.525667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.526123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.533465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.534167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.534832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.535990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:37.536632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:37.537285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:37.751294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 10:59:37.753916 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65b4d4d0-59a2-4156-9f8b-5c6ac29fa0b0 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1465 microversion: 2.1 time: 0.246368 Sep 08 10:59:37.754547 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3452/6676] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:37 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1465 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:37.760001 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-435f0210-47e5-40ec-9199-d61b4397b8c5 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1453 microversion: 2.1 time: 0.244734 Sep 08 10:59:37.760580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3225/6677] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:37 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1453 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 10:59:38.780929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:38.781544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:38.788829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.789350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.789793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.790502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:38.790959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:38.791398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:38.925279 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a2e4c13a-84b8-4f1a-bc9e-8cee8924d877 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1465 microversion: 2.1 time: 0.148044 Sep 08 10:59:38.925864 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3453/6678] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:38 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:39.849056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ed981108-b714-4773-9a77-8ee959728494 req-f9d220bb-9fd4-4961-950c-22feea9563a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bc4195-bd35-429c-94b6-b4bd9056000e", "tag": "2d3f0514-496f-48cc-a6f5-e1c2c01c6852"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:39.860788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ed981108-b714-4773-9a77-8ee959728494 req-f9d220bb-9fd4-4961-950c-22feea9563a6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:39.861286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ed981108-b714-4773-9a77-8ee959728494 req-f9d220bb-9fd4-4961-950c-22feea9563a6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:39.861734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ed981108-b714-4773-9a77-8ee959728494 req-f9d220bb-9fd4-4961-950c-22feea9563a6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:39.874200 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ed981108-b714-4773-9a77-8ee959728494 req-f9d220bb-9fd4-4961-950c-22feea9563a6 service nova] Creating event network-changed:2d3f0514-496f-48cc-a6f5-e1c2c01c6852 for instance 80bc4195-bd35-429c-94b6-b4bd9056000e on n-h1-833090-19 Sep 08 10:59:39.879860 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ed981108-b714-4773-9a77-8ee959728494 req-f9d220bb-9fd4-4961-950c-22feea9563a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Sep 08 10:59:39.880843 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3226/6679] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:39.948766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:39.949391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:39.956713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:39.957284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:39.957802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:39.958581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:39.959149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:39.959685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:40.180382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18d6f0fd-7ab0-41ef-8e3a-ef442e596435 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1465 microversion: 2.1 time: 0.235411 Sep 08 10:59:40.180965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3454/6680] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:39 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1465 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:41.205539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:41.206248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:41.213188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.213690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.214153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:41.214873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.215345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.215811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:41.361327 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-02a5e7fd-539c-4e02-87d2-8ca0c8b19a07 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1465 microversion: 2.1 time: 0.161406 Sep 08 10:59:41.361892 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3227/6681] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:41 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:41.615326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-63296067-5443-430b-b5c8-20eeabb17b46 req-89f5d9a4-a7c0-4521-87dd-476e12bfbf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301ccc85-a4e1-4da1-aa5e-23ee604e062f", "name": "network-vif-plugged", "status": "completed", "tag": "254c2abc-e89a-4a6d-82ab-44d29b3f7ce9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:41.627543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-63296067-5443-430b-b5c8-20eeabb17b46 req-89f5d9a4-a7c0-4521-87dd-476e12bfbf6c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:41.628140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-63296067-5443-430b-b5c8-20eeabb17b46 req-89f5d9a4-a7c0-4521-87dd-476e12bfbf6c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:41.628669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-63296067-5443-430b-b5c8-20eeabb17b46 req-89f5d9a4-a7c0-4521-87dd-476e12bfbf6c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:41.652121 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-63296067-5443-430b-b5c8-20eeabb17b46 req-89f5d9a4-a7c0-4521-87dd-476e12bfbf6c service nova] Creating event network-vif-plugged:254c2abc-e89a-4a6d-82ab-44d29b3f7ce9 for instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f on n-h2-833090-19 Sep 08 10:59:41.660997 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-63296067-5443-430b-b5c8-20eeabb17b46 req-89f5d9a4-a7c0-4521-87dd-476e12bfbf6c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050029 Sep 08 10:59:41.662249 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3455/6682] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:42.384464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:42.385052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:42.392019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.392527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.392978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.393693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:42.394167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:42.394613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:42.526328 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-974b2313-06dc-4ec7-9613-36dec02c5c37 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1465 microversion: 2.1 time: 0.145618 Sep 08 10:59:42.526899 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3228/6683] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:42 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1465 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:43.550991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.551729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.558075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.558567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.559031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.559753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.560216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.560650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.688820 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa78ac42-019c-404d-9187-e7599b6aa033 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1650 microversion: 2.1 time: 0.143075 Sep 08 10:59:43.689418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3456/6684] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:43.711753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.712392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.720080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.720586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.721057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.721780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.722259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.722705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.855049 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8abf985b-f6be-4048-adc0-84dd1ad63e40 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1650 microversion: 2.1 time: 0.147105 Sep 08 10:59:43.855655 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3229/6685] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:43.877587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:43.878205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:43.884431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.884867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.885311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:43.886008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:43.886466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:43.886896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.017420 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58e8774c-9d65-46e6-894f-a79ae151b9e7 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1650 microversion: 2.1 time: 0.144115 Sep 08 10:59:44.017981 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3457/6686] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:43 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:44.040901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:44.041424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:44.043389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:44.044108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:44.050680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.051204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.051694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.052433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.052914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.053362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.081608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:44.158580 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7abdb46-8321-4b0e-a81b-27a3784157e8 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "DELETE /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 204 len: 0 microversion: 2.1 time: 0.121070 Sep 08 10:59:44.159096 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3230/6687] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:44 2022] DELETE /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:59:44.167282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:44.167941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:44.169894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:44.175849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.176371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.176814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.177543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:44.178002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:44.178428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:44.303828 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-65ab649a-fb22-44fc-9c2b-b60a8d51268b tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1656 microversion: 2.1 time: 0.140248 Sep 08 10:59:44.304415 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3458/6688] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:44 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1656 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:45.326891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:45.327503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:45.334310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:45.334811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:45.335265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.336002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:45.336478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:45.336917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:45.476626 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e673c89-630c-4e95-a58a-2ae82918409c tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1656 microversion: 2.1 time: 0.153855 Sep 08 10:59:45.491813 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3231/6689] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:45 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:46.189051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d4b66d2b-2c61-485e-954a-0b3b32e4979e req-038eb04d-3845-4931-8afa-59a2e2e40e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301ccc85-a4e1-4da1-aa5e-23ee604e062f", "name": "network-vif-deleted", "tag": "254c2abc-e89a-4a6d-82ab-44d29b3f7ce9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:46.205093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d4b66d2b-2c61-485e-954a-0b3b32e4979e req-038eb04d-3845-4931-8afa-59a2e2e40e21 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.205954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d4b66d2b-2c61-485e-954a-0b3b32e4979e req-038eb04d-3845-4931-8afa-59a2e2e40e21 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.207222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d4b66d2b-2c61-485e-954a-0b3b32e4979e req-038eb04d-3845-4931-8afa-59a2e2e40e21 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.221538 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d4b66d2b-2c61-485e-954a-0b3b32e4979e req-038eb04d-3845-4931-8afa-59a2e2e40e21 service nova] Creating event network-vif-deleted:254c2abc-e89a-4a6d-82ab-44d29b3f7ce9 for instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f on n-h2-833090-19 Sep 08 10:59:46.228932 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d4b66d2b-2c61-485e-954a-0b3b32e4979e req-038eb04d-3845-4931-8afa-59a2e2e40e21 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044207 Sep 08 10:59:46.229618 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3459/6690] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:46.500893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:46.501526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:46.508408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.508947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.509408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.510124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.510598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.511044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.542076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:46.542603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:46.543062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:46.543571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lazy-loading 'fault' on Instance uuid 301ccc85-a4e1-4da1-aa5e-23ee604e062f {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 10:59:46.594390 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef7628de-eab8-470c-b436-4abd0a08f641 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 200 len: 1455 microversion: 2.1 time: 0.097643 Sep 08 10:59:46.594984 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3232/6691] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:46 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:47.619708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:47.620423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 301ccc85-a4e1-4da1-aa5e-23ee604e062f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:47.628201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.628862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.629339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.630040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.630511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.631106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.646275 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] HTTP exception thrown: Instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f could not be found. Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Request method failure captured: Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f HTTP/1.1 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcsJGhSz2kbf2raX0PhwG2mfaKhhH3oRki98ibfOh17q4x8HvcQ_W_AqsSKfn3kENbjX3GyfemP5xWY_FWDwbT869KMVA20nbZxRJgyqy0KxRFoSypbs8CmLVflGz2DGdlMUY0Crz2ONabrnLfo05lXYbVpKuA6L79pg_TlWBnMnht0 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 235df4de8e14418eb1ebc7dcc0d9e902 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestServerMultinode-723076239 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/235df4de8e14418eb1ebc7dcc0d9e902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/235df4de8e14418eb1ebc7dcc0d9e902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/235df4de8e14418eb1ebc7dcc0d9e902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_235df4de8e14418eb1ebc7dcc0d9e902", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestServerMultinode-723076239 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 235df4de8e14418eb1ebc7dcc0d9e902 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestServerMultinode-723076239 Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestServerMultinode-723076239-project-admin Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4914505783e54e3bb2722883a06f612e Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestServerMultinode-723076239-project-admin Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f could not be found. Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '301ccc85-a4e1-4da1-aa5e-23ee604e062f'} Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f could not be found. Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f could not be found. Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:47.650483 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f could not be found. Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Returning 404 to user: Instance 301ccc85-a4e1-4da1-aa5e-23ee604e062f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1fa4e890-5242-4e0f-a130-7c0ead27e114 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f" status: 404 len: 111 microversion: 2.1 time: 0.036124 Sep 08 10:59:47.657765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3460/6692] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:47 2022] GET /compute/v2.1/servers/301ccc85-a4e1-4da1-aa5e-23ee604e062f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 10:59:47.663651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:47.664291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:47.672273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.672760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.673273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.673969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.674441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.674885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.700552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 10:59:47.777256 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17c55de8-cb94-45d1-9f75-c8ea4f241e53 tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "DELETE /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 204 len: 0 microversion: 2.1 time: 0.117370 Sep 08 10:59:47.777606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3233/6693] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 10:59:47 2022] DELETE /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 10:59:47.787579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:47.788277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:47.795003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.795606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.796172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.796882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:47.797373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:47.797809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:47.938852 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-66c70c9d-2f2e-4b83-b795-e4af7901fd5e tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1658 microversion: 2.1 time: 0.155200 Sep 08 10:59:47.939513 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3461/6694] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:47 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1658 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:48.966873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:48.967629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:48.975159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:48.975727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:48.976192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:48.976911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:48.977389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:48.977832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:49.102554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 10:59:49.110192 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9efd9016-cf18-445d-b91a-0aa23fa2366a tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 200 len: 1658 microversion: 2.1 time: 0.147624 Sep 08 10:59:49.110778 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3234/6695] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:48 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 1658 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 10:59:49.577520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e8b7f798-03d1-4ef4-b1dd-f9ddcf6e9e8b req-05c88b25-2057-4ca7-86cc-8c5751af14ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6306cc-ebf0-4eef-8d54-205ae5cc44e7", "name": "network-vif-deleted", "tag": "a88f89b8-59ae-40f1-9056-246f280c04d3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 10:59:49.595001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e8b7f798-03d1-4ef4-b1dd-f9ddcf6e9e8b req-05c88b25-2057-4ca7-86cc-8c5751af14ae service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:49.595973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e8b7f798-03d1-4ef4-b1dd-f9ddcf6e9e8b req-05c88b25-2057-4ca7-86cc-8c5751af14ae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:49.595973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e8b7f798-03d1-4ef4-b1dd-f9ddcf6e9e8b req-05c88b25-2057-4ca7-86cc-8c5751af14ae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:49.611285 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e8b7f798-03d1-4ef4-b1dd-f9ddcf6e9e8b req-05c88b25-2057-4ca7-86cc-8c5751af14ae service nova] Creating event network-vif-deleted:a88f89b8-59ae-40f1-9056-246f280c04d3 for instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 on n-h1-833090-19 Sep 08 10:59:49.616407 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e8b7f798-03d1-4ef4-b1dd-f9ddcf6e9e8b req-05c88b25-2057-4ca7-86cc-8c5751af14ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042832 Sep 08 10:59:49.617592 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3462/6696] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 10:59:50.133377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 10:59:50.134012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] [instance: 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 10:59:50.142701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:50.143213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:50.143704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.144432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 10:59:50.144913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 10:59:50.145358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 10:59:50.159266 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] HTTP exception thrown: Instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 could not be found. Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Request method failure captured: Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 HTTP/1.1 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcsJGhSz2kbf2raX0PhwG2mfaKhhH3oRki98ibfOh17q4x8HvcQ_W_AqsSKfn3kENbjX3GyfemP5xWY_FWDwbT869KMVA20nbZxRJgyqy0KxRFoSypbs8CmLVflGz2DGdlMUY0Crz2ONabrnLfo05lXYbVpKuA6L79pg_TlWBnMnht0 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 235df4de8e14418eb1ebc7dcc0d9e902 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestServerMultinode-723076239 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/235df4de8e14418eb1ebc7dcc0d9e902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/235df4de8e14418eb1ebc7dcc0d9e902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/235df4de8e14418eb1ebc7dcc0d9e902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_235df4de8e14418eb1ebc7dcc0d9e902", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestServerMultinode-723076239 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 235df4de8e14418eb1ebc7dcc0d9e902 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestServerMultinode-723076239 Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestServerMultinode-723076239-project-admin Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4914505783e54e3bb2722883a06f612e Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestServerMultinode-723076239-project-admin Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 could not be found. Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '1b6306cc-ebf0-4eef-8d54-205ae5cc44e7'} Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 could not be found. Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 could not be found. Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 10:59:50.160976 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 could not be found. Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] Returning 404 to user: Instance 1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5e02829d-29a4-46cb-b499-512b10a629ac tempest-TestServerMultinode-723076239 tempest-TestServerMultinode-723076239-project-admin] 10.222.0.59 "GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7" status: 404 len: 111 microversion: 2.1 time: 0.032958 Sep 08 10:59:50.164682 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3235/6697] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 10:59:50 2022] GET /compute/v2.1/servers/1b6306cc-ebf0-4eef-8d54-205ae5cc44e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:01:20.454084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=23 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:20.454084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=73 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:20.464461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1150610722", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-591858070", "security_groups": [{"name": "tempest-secgroup-smoke-1228686066"}], "block_device_mapping_v2": [{"uuid": "40f66bc9-5f62-48f5-a60e-0d34e4d8c1f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a3781df-de9a-4385-ac30-c767f69c4abc"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:20.585319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] validate_networks() for [('8a3781df-de9a-4385-ac30-c767f69c4abc', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:01:21.188321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:01:21.189043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:01:21.189536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:01:21.189955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:01:21.190379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:01:21.199700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:21.200614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:21.200614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:21.201361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:21.201826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:21.202788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:21.221024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:01:21.227145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Getting quotas for user ee9b9bcfe41643749e6c6d80efbbde2d and project 774cd8750fa045169fe4e52b2ff5c883. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:01:21.290402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:01:21.292889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40f66bc9-5f62-48f5-a60e-0d34e4d8c1f6',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:01:21.437865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1a2c7ae-82d0-4b45-b5ab-aa0474d12145 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.988752 Sep 08 11:01:21.438638 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3463/6698] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:01:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:01:21.448283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:21.449052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:21.454992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ebceab18-afef-4d4f-80c3-fb328840a114 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:21.455807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ebceab18-afef-4d4f-80c3-fb328840a114 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:21.521658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ebceab18-afef-4d4f-80c3-fb328840a114 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:21.530042 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ebceab18-afef-4d4f-80c3-fb328840a114 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1094 microversion: 2.1 time: 0.083975 Sep 08 11:01:21.530821 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3236/6699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:21 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:22.554628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:22.555152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:22.564361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:22.564880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:22.565332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:22.566367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:22.566789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:22.567508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:22.681040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:22.691612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c6ad7ec-91a8-4833-b289-7772c4d7e787 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1210 microversion: 2.1 time: 0.141986 Sep 08 11:01:22.692829 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3464/6700] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:22 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1210 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:23.715268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:23.716575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:23.729395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:23.729987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:23.730704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:23.732012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:23.732786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:23.733411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:23.980854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:23.995365 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3a11b6fd-1d44-4f3b-b7c9-768ee4dbdeaa tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1278 microversion: 2.1 time: 0.284454 Sep 08 11:01:24.015650 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3237/6701] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:23 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:24.412151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-053935ea-80b7-4d69-92a2-f4f65a4dd705 req-e8ce1957-8967-4c52-8550-a1579a014432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a156417-0db3-48a7-b0ec-bcd187668ea2", "tag": "fde8c09c-f9af-4918-a029-a3583167089c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:24.424640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-053935ea-80b7-4d69-92a2-f4f65a4dd705 req-e8ce1957-8967-4c52-8550-a1579a014432 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:24.425126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-053935ea-80b7-4d69-92a2-f4f65a4dd705 req-e8ce1957-8967-4c52-8550-a1579a014432 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:24.425558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-053935ea-80b7-4d69-92a2-f4f65a4dd705 req-e8ce1957-8967-4c52-8550-a1579a014432 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:24.441221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-053935ea-80b7-4d69-92a2-f4f65a4dd705 req-e8ce1957-8967-4c52-8550-a1579a014432 service nova] Creating event network-changed:fde8c09c-f9af-4918-a029-a3583167089c for instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 on n-h1-833090-19 Sep 08 11:01:24.446856 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-053935ea-80b7-4d69-92a2-f4f65a4dd705 req-e8ce1957-8967-4c52-8550-a1579a014432 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228257 Sep 08 11:01:24.447527 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3465/6702] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:25.022791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:25.023441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:25.032911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:25.033433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:25.034425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:25.035580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:25.036345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:25.036956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:25.622212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:25.633146 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-148e38fb-a0aa-41cf-8d04-7c6a7c33c67a tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1278 microversion: 2.1 time: 0.614714 Sep 08 11:01:25.634434 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3238/6703] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:25 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1278 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:26.660664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:26.661383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:26.669701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:26.670272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:26.670876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:26.671691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:26.672252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:26.672748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:26.819674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:26.829494 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14860084-66c5-4485-9168-d967d3ad7f9f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1278 microversion: 2.1 time: 0.174486 Sep 08 11:01:26.830098 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3466/6704] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:26 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:27.855842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:27.857053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:27.870393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:27.871657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:27.872475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:27.874401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:27.876784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:27.877596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:28.047315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:28.058728 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99915dae-f292-4001-927e-849fe369ade6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1278 microversion: 2.1 time: 0.207851 Sep 08 11:01:28.073974 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3239/6705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:27 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:29.083019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:29.084030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:29.090674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:29.091178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:29.092109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:29.092453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:29.092954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:29.093377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:29.240091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:29.248181 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64c43ffd-0bf9-4dd8-b6ad-72582bb4acc0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.169012 Sep 08 11:01:29.249328 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3467/6706] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:29 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:30.274847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:30.275513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:30.283186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:30.283718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:30.284179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:30.284901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:30.285380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:30.285859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:30.421877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:30.429794 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e038bc2-6100-457d-8d7e-a263f5ba8e85 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.159311 Sep 08 11:01:30.430374 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3240/6707] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:30 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:31.454872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:31.455526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:31.458355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:31.459064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:31.465580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:31.466079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:31.466528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:31.467233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:31.468362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:31.468826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:31.604321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:31.614283 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ee7acd6-d975-4879-b971-770e03d7af13 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.163305 Sep 08 11:01:31.615221 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3468/6708] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:31 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:32.641968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:32.642771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:32.645391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:01:32.651433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.651968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.652499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.653218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:32.653693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:32.654151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:32.821306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:32.830756 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a3504ab-bef2-45b8-b5e8-50a695a0f0d6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.192909 Sep 08 11:01:32.831583 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3241/6709] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:32 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:33.855827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:33.856379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:33.863326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.864308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.864769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:33.865480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:33.865967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:33.866399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:34.001314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:34.009286 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e96ab84-2366-4372-a897-a71ba9e40244 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.157702 Sep 08 11:01:34.009849 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3469/6710] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:33 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:35.033629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:35.034264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:35.041224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.041736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.042199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.042919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:35.043397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:35.043905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:35.183286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:35.191130 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a173deeb-f570-4bdc-aafc-a21cf1b130a4 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.162093 Sep 08 11:01:35.191734 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3242/6711] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:35 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:36.214269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:36.214917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:36.222551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:36.223044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:36.223692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:36.224411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:36.224876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:36.225310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:36.369018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:36.377849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-23cc8405-50a3-413c-8b81-b3d02ab5f2f6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.167521 Sep 08 11:01:36.378438 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3470/6712] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:36 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:37.402415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:37.403097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:37.410791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:37.411307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:37.411795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.412528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:37.413001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:37.413449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.554447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:37.562576 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eafec489-44da-43ab-87b3-8021fde6c15f tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.164792 Sep 08 11:01:37.563177 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3243/6713] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:37 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:37.914137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c0ca30de-f804-49d2-9ae1-ec97e1ac8646 req-0aac5251-227a-4bd0-ad38-9aedb9925406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a156417-0db3-48a7-b0ec-bcd187668ea2", "name": "network-vif-plugged", "status": "completed", "tag": "fde8c09c-f9af-4918-a029-a3583167089c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:37.923991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0ca30de-f804-49d2-9ae1-ec97e1ac8646 req-0aac5251-227a-4bd0-ad38-9aedb9925406 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:37.924510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0ca30de-f804-49d2-9ae1-ec97e1ac8646 req-0aac5251-227a-4bd0-ad38-9aedb9925406 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:37.924949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c0ca30de-f804-49d2-9ae1-ec97e1ac8646 req-0aac5251-227a-4bd0-ad38-9aedb9925406 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:37.936188 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c0ca30de-f804-49d2-9ae1-ec97e1ac8646 req-0aac5251-227a-4bd0-ad38-9aedb9925406 service nova] Creating event network-vif-plugged:fde8c09c-f9af-4918-a029-a3583167089c for instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 on n-h1-833090-19 Sep 08 11:01:37.943245 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c0ca30de-f804-49d2-9ae1-ec97e1ac8646 req-0aac5251-227a-4bd0-ad38-9aedb9925406 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152656 Sep 08 11:01:37.944299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3471/6714] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:01:38.586520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:38.587156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:38.594347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:38.594856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:38.595316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:38.596068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:38.596545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:38.596996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:38.734936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:38.742902 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-521e00b0-aca3-4df4-a816-a8dca9d83742 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1266 microversion: 2.1 time: 0.160666 Sep 08 11:01:38.743506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3244/6715] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:38 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:39.767108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:39.767854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:39.774711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.775213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.775689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.776409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.776866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.777298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.921957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:39.930199 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-58686a81-1dad-4773-8c04-a5633aa420a0 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1454 microversion: 2.1 time: 0.168307 Sep 08 11:01:39.930971 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3472/6716] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:39 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:39.955330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:01:39.956026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:01:39.962905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.963506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.964047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:39.964825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:39.965365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:39.965875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:40.109065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:01:40.117250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dfe6b06d-1324-4365-bcf2-74d103209772 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1454 microversion: 2.1 time: 0.165841 Sep 08 11:01:40.117830 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3245/6717] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:01:39 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:01:41.852081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3e8df396-50c9-47e2-b8b7-2d6b12277c0b req-b3d474bb-80d9-45b1-86a6-3203112facf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a156417-0db3-48a7-b0ec-bcd187668ea2", "tag": "fde8c09c-f9af-4918-a029-a3583167089c"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:01:41.863313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3e8df396-50c9-47e2-b8b7-2d6b12277c0b req-b3d474bb-80d9-45b1-86a6-3203112facf7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:01:41.863846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3e8df396-50c9-47e2-b8b7-2d6b12277c0b req-b3d474bb-80d9-45b1-86a6-3203112facf7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:01:41.864286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3e8df396-50c9-47e2-b8b7-2d6b12277c0b req-b3d474bb-80d9-45b1-86a6-3203112facf7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:01:41.876265 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3e8df396-50c9-47e2-b8b7-2d6b12277c0b req-b3d474bb-80d9-45b1-86a6-3203112facf7 service nova] Creating event network-changed:fde8c09c-f9af-4918-a029-a3583167089c for instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 on n-h1-833090-19 Sep 08 11:01:41.881262 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3e8df396-50c9-47e2-b8b7-2d6b12277c0b req-b3d474bb-80d9-45b1-86a6-3203112facf7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033024 Sep 08 11:01:41.882052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3473/6718] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:01.623879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3cb64e29-2968-4a31-8810-91fac7527e37 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Action: 'create', calling method: .version_select at 0x7f23500f5040>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-325329126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFoMi8utOoNmcNS6s15jYrHI3hjNqqSPniflPPjWkWOon32okbx65v19nwj0mUyxypzJkajPbuLX8SXNXI2NnVo1/M0wNoJc5FLfQXktW2CljrhU2SI3UMRHcEgoY0EGQ=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:01.630874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=22 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:01.631588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=54 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:01.644430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3cb64e29-2968-4a31-8810-91fac7527e37 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Getting quotas for project 8c44cc28faa04fd3bc19c48adacd8324. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:02:01.650366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-3cb64e29-2968-4a31-8810-91fac7527e37 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Getting quotas for user b4b2b34ba7aa4223bf4a0e8b0dfe871d and project 8c44cc28faa04fd3bc19c48adacd8324. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:02:01.664518 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3cb64e29-2968-4a31-8810-91fac7527e37 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:02:02.675513 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [None req-3cb64e29-2968-4a31-8810-91fac7527e37 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 44532. Sep 08 11:02:02.694806 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3cb64e29-2968-4a31-8810-91fac7527e37 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 1.075092 Sep 08 11:02:02.695554 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3246/6719] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:02:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:03.686732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:03.687505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=50 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:03.691724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1694571011", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6f10d728-a1c3-441a-a2d4-9ccbe2774b79", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-325329126", "security_groups": [{"name": "tempest-secgroup-smoke-486287574"}], "networks": [{"uuid": "1b6cbccd-fd69-40df-82ab-73f80bc7fb96"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:03.808798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] validate_networks() for [('1b6cbccd-fd69-40df-82ab-73f80bc7fb96', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:02:04.186331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:02:04.186750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:02:04.187223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:02:04.187671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:02:04.188173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:02:04.197695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:04.198175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:04.198654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:04.199373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:04.199854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:04.200284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:04.217224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Getting quotas for project 8c44cc28faa04fd3bc19c48adacd8324. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:02:04.222955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Getting quotas for user b4b2b34ba7aa4223bf4a0e8b0dfe871d and project 8c44cc28faa04fd3bc19c48adacd8324. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:02:04.281643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:02:04.283961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f10d728-a1c3-441a-a2d4-9ccbe2774b79',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:02:04.411564 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ffe2901-9676-4a89-a00b-c85bfa9513e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726607 Sep 08 11:02:04.412218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3474/6720] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:02:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:02:04.425802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a72ec9c1-ae8b-4ace-8b91-10ee4997f836 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:04.426524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a72ec9c1-ae8b-4ace-8b91-10ee4997f836 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:04.481307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a72ec9c1-ae8b-4ace-8b91-10ee4997f836 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:04.488874 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a72ec9c1-ae8b-4ace-8b91-10ee4997f836 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1098 microversion: 2.1 time: 0.069317 Sep 08 11:02:04.489492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3247/6721] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:04 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:05.513456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:05.514073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:05.521413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:05.521899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:05.522341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:05.523036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:05.523525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:05.523966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:05.591104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:05.598951 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3715a6b-115d-40ff-b485-41bcf29300c5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1196 microversion: 2.1 time: 0.090409 Sep 08 11:02:05.599556 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3475/6722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:05 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1196 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:06.622781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:06.624183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:06.633200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:06.634083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:06.634741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:06.635865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:06.636352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:06.636858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:06.714369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:06.725201 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-67fa57f9-a992-4761-b525-8f3132dd2c2f tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1214 microversion: 2.1 time: 0.106733 Sep 08 11:02:06.726055 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3248/6723] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:06 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:07.697153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-841f3a93-8794-4462-b80d-7d6381471ef2 req-38f64231-52cd-49b4-be05-bf3162217488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:07.715998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-841f3a93-8794-4462-b80d-7d6381471ef2 req-38f64231-52cd-49b4-be05-bf3162217488 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.716482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-841f3a93-8794-4462-b80d-7d6381471ef2 req-38f64231-52cd-49b4-be05-bf3162217488 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.716913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-841f3a93-8794-4462-b80d-7d6381471ef2 req-38f64231-52cd-49b4-be05-bf3162217488 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.729910 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-841f3a93-8794-4462-b80d-7d6381471ef2 req-38f64231-52cd-49b4-be05-bf3162217488 service nova] Creating event network-changed:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:02:07.739337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-841f3a93-8794-4462-b80d-7d6381471ef2 req-38f64231-52cd-49b4-be05-bf3162217488 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054854 Sep 08 11:02:07.740509 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3476/6724] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:07.758371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:07.759114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:07.768508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.769118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.769857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:07.770931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:07.771512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:07.772030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:08.045622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:08.056459 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1bf018ca-d8b0-43bd-8889-de8c0bc1f7da tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1281 microversion: 2.1 time: 0.302484 Sep 08 11:02:08.057102 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3249/6725] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:07 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:09.087361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:09.088212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:09.095962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:09.096479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:09.096929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:09.097667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:09.098130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:09.098573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:09.243428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:09.251646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-62f665ab-e547-4884-9979-7f0cfefa4e38 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1281 microversion: 2.1 time: 0.168836 Sep 08 11:02:09.252237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3477/6726] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:09 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:10.274727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:10.275305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:10.282131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:10.282635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:10.283607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:10.284316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:10.284785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:10.285223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:10.438923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:10.446794 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0ccf903a-34c7-433e-86e8-b11b6e00fcbb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1281 microversion: 2.1 time: 0.176450 Sep 08 11:02:10.447503 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3250/6727] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:10 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:11.467908 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:02:11.471998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:11.472648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:11.479200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:11.479742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:11.480186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:11.480914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:11.481379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:11.481807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:11.620504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:11.628470 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54ead63a-a715-463d-8b31-cd0f3e1ae5b3 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.162160 Sep 08 11:02:11.629064 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3478/6728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:11 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:12.652188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:12.652821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:12.660055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:12.660607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:12.661121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:12.662338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:12.662819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:12.663268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:12.797050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:12.805545 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f29edaf4-660a-4256-842f-1b515346aa16 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.157308 Sep 08 11:02:12.806136 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3251/6729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:12 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:13.829670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:13.830278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:13.838992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:13.839510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:13.839950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:13.840646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:13.841100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:13.841523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:13.847506 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 44600. Sep 08 11:02:13.978505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:13.987358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecc96503-a9aa-4478-9de2-efd188535cbc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.161694 Sep 08 11:02:13.987972 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3479/6730] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:13 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:15.010113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:15.010750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:15.013309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:15.019704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:15.020476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:15.020941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:15.021908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:15.022417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:15.022862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:15.158953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:15.166919 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7441561b-ee3e-4f00-8dac-cee78a18718a tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.160755 Sep 08 11:02:15.167512 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3252/6731] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:15 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:16.190900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:16.191537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:16.193394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:16.194065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:16.201361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:16.201854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:16.202296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:16.202998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:16.203452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:16.203908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:16.339342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:16.347478 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-52e56e2e-ce5a-4d70-9b2d-da4bb1004723 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.161053 Sep 08 11:02:16.348059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3480/6732] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:16 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:17.370972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:17.371653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:17.378415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:17.378923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:17.379380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:17.380133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:17.380604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:17.381051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:17.511309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:17.519969 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42cbc3b1-278a-4ff8-b50e-98278fa5caa5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.152941 Sep 08 11:02:17.520812 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3253/6733] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:17 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:18.542942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:18.543604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:18.551181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:18.551698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:18.552139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:18.552835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:18.553290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:18.553717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:18.688165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:18.695995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-182a0004-ecf6-4e27-a33f-8cedb8fa18a1 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.156972 Sep 08 11:02:18.696578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3481/6734] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:18 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:19.718892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:19.719648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:19.727119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:19.727736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:19.728302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:19.729055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:19.729695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:19.730287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:19.887196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:19.896408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08c09d4d-fb23-4dfc-bd8e-15c9c6ce48f2 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.181970 Sep 08 11:02:19.897193 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3254/6735] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:19 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:20.921888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:20.923145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:20.935741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:20.936501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:20.937745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:20.938839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:20.942149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:20.943713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:21.121753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:21.131516 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-73392076-c633-49dd-b290-6964d9f17b32 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.214460 Sep 08 11:02:21.132621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3482/6736] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:20 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:02:22.155890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:22.156464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:22.163762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:22.164261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:22.164710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:22.165444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:22.165908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:22.166348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:22.302626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:22.310480 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da7eba91-ff90-4f69-a871-01523138b287 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.158572 Sep 08 11:02:22.311159 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3255/6737] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:22 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:22.480354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8df067dd-a61f-4dbe-a423-4426babd9026 req-bafc7136-40f5-4616-8282-1c04399c3253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "name": "network-vif-plugged", "status": "completed", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:22.490490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8df067dd-a61f-4dbe-a423-4426babd9026 req-bafc7136-40f5-4616-8282-1c04399c3253 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:22.490992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8df067dd-a61f-4dbe-a423-4426babd9026 req-bafc7136-40f5-4616-8282-1c04399c3253 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:22.491418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8df067dd-a61f-4dbe-a423-4426babd9026 req-bafc7136-40f5-4616-8282-1c04399c3253 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:22.502791 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8df067dd-a61f-4dbe-a423-4426babd9026 req-bafc7136-40f5-4616-8282-1c04399c3253 service nova] Creating event network-vif-plugged:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:02:22.507936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8df067dd-a61f-4dbe-a423-4426babd9026 req-bafc7136-40f5-4616-8282-1c04399c3253 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Sep 08 11:02:22.508761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3483/6738] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:23.333396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:23.333969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:23.341061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:23.341560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:23.342016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:23.342732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:23.343198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:23.343682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:23.487814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:23.496239 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-35abcbf0-b7ce-4702-a931-c3e8d375cbfe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1269 microversion: 2.1 time: 0.166841 Sep 08 11:02:23.496817 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3256/6739] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:23 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:24.521172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:24.521876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:24.528281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:24.528770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:24.529218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:24.529915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:24.530374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:24.530805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:24.674849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:24.683523 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-066027f3-ed4e-42f4-81f5-d026a7000a64 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1458 microversion: 2.1 time: 0.168339 Sep 08 11:02:24.684087 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3484/6740] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:24 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:24.706662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:24.707618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:24.714466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:24.714976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:24.715438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:24.716192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:24.716666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:24.717112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:24.856017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:24.865006 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4cee0167-01ac-4c67-8a2f-72c6a3381a60 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1458 microversion: 2.1 time: 0.162116 Sep 08 11:02:24.865599 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3257/6741] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:24 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:26.941060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7b2d535c-809c-45a1-b5d0-f222ee7bf1f2 req-a48120e6-6729-41e1-a0b9-5523285e45a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:26.953482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7b2d535c-809c-45a1-b5d0-f222ee7bf1f2 req-a48120e6-6729-41e1-a0b9-5523285e45a3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:26.954089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7b2d535c-809c-45a1-b5d0-f222ee7bf1f2 req-a48120e6-6729-41e1-a0b9-5523285e45a3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:26.954590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7b2d535c-809c-45a1-b5d0-f222ee7bf1f2 req-a48120e6-6729-41e1-a0b9-5523285e45a3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:26.967952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7b2d535c-809c-45a1-b5d0-f222ee7bf1f2 req-a48120e6-6729-41e1-a0b9-5523285e45a3 service nova] Creating event network-changed:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:02:26.973500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7b2d535c-809c-45a1-b5d0-f222ee7bf1f2 req-a48120e6-6729-41e1-a0b9-5523285e45a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036370 Sep 08 11:02:26.974745 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3485/6742] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:28.049141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-989c380b-eb42-4b65-95f4-6ce349e9956d req-c0909a50-5b5d-4236-9f7c-8bfd40d16037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:28.059041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-989c380b-eb42-4b65-95f4-6ce349e9956d req-c0909a50-5b5d-4236-9f7c-8bfd40d16037 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:28.059623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-989c380b-eb42-4b65-95f4-6ce349e9956d req-c0909a50-5b5d-4236-9f7c-8bfd40d16037 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:28.060082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-989c380b-eb42-4b65-95f4-6ce349e9956d req-c0909a50-5b5d-4236-9f7c-8bfd40d16037 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:28.073182 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-989c380b-eb42-4b65-95f4-6ce349e9956d req-c0909a50-5b5d-4236-9f7c-8bfd40d16037 service nova] Creating event network-changed:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:02:28.078746 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-989c380b-eb42-4b65-95f4-6ce349e9956d req-c0909a50-5b5d-4236-9f7c-8bfd40d16037 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110179 Sep 08 11:02:28.079385 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3258/6743] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:30.094940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0d89b2bd-5d8c-43a1-8efb-bec2851b4e4b req-eb0a4fe3-e82a-4016-9c03-f15f2428e587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:30.104978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0d89b2bd-5d8c-43a1-8efb-bec2851b4e4b req-eb0a4fe3-e82a-4016-9c03-f15f2428e587 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:30.105447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0d89b2bd-5d8c-43a1-8efb-bec2851b4e4b req-eb0a4fe3-e82a-4016-9c03-f15f2428e587 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:30.105876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0d89b2bd-5d8c-43a1-8efb-bec2851b4e4b req-eb0a4fe3-e82a-4016-9c03-f15f2428e587 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:30.116849 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0d89b2bd-5d8c-43a1-8efb-bec2851b4e4b req-eb0a4fe3-e82a-4016-9c03-f15f2428e587 service nova] Creating event network-changed:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:02:30.122025 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0d89b2bd-5d8c-43a1-8efb-bec2851b4e4b req-eb0a4fe3-e82a-4016-9c03-f15f2428e587 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032081 Sep 08 11:02:30.123013 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3486/6744] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:52.097917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:52.098683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=62 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:52.205979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:52.206585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:52.213232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:52.213725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:52.214173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:52.214872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:52.215355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:52.215797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:52.241902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:02:52.320631 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-88dc6b71-f87a-4685-b284-fdfc6b2cc701 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 204 len: 0 microversion: 2.1 time: 0.224563 Sep 08 11:02:52.321419 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3259/6745] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:02:52 2022] DELETE /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:02:52.332440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:52.333174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:52.335274 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:52.336446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=58 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:02:52.344023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:52.344510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:52.344947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:52.345645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:52.346102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:52.346532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:52.486549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:52.494419 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4af98c75-7ebf-4330-a337-fce0daaa4073 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1732 microversion: 2.1 time: 0.166879 Sep 08 11:02:52.494996 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3487/6746] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:52 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:53.518637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:53.519281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:53.526881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:53.527394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:53.527892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:53.528617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:53.529094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:53.529578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:53.722926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4cef04b4874239be161acb7154c472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c71e37b10c644c858b0e98bd7b5af343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:02:53.733833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7f6558b-817c-4673-b039-e7aadfe39fa3 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 200 len: 1732 microversion: 2.1 time: 0.219549 Sep 08 11:02:53.734906 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3260/6747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:53 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:02:54.096246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9312751c-73f5-4576-a3d8-16d9afdcbf3e req-a384372d-258e-4e54-b407-da8d29daf6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a", "name": "network-vif-deleted", "tag": "95a40eeb-50b4-456c-bf48-470727dbc0ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:54.107640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9312751c-73f5-4576-a3d8-16d9afdcbf3e req-a384372d-258e-4e54-b407-da8d29daf6d0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:54.108440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9312751c-73f5-4576-a3d8-16d9afdcbf3e req-a384372d-258e-4e54-b407-da8d29daf6d0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:54.108703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9312751c-73f5-4576-a3d8-16d9afdcbf3e req-a384372d-258e-4e54-b407-da8d29daf6d0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:54.120785 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9312751c-73f5-4576-a3d8-16d9afdcbf3e req-a384372d-258e-4e54-b407-da8d29daf6d0 service nova] Creating event network-vif-deleted:95a40eeb-50b4-456c-bf48-470727dbc0ab for instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a on n-h2-833090-19 Sep 08 11:02:54.126730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9312751c-73f5-4576-a3d8-16d9afdcbf3e req-a384372d-258e-4e54-b407-da8d29daf6d0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035246 Sep 08 11:02:54.127786 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3488/6748] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:02:54.758283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:54.758926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:54.767158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:54.767720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:54.768179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:54.768912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:54.769385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:54.770110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:54.787638 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] HTTP exception thrown: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Request method failure captured: Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a HTTP/1.1 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcp-CgdUQzyVwDSI-EBJWvwEVSggv7LGbrSKGRGi7yFbpHkf6mhwOwhv-dlETGKFpolz8r4c1mRaYMR3QwZ-NDZtcsXSKtKl2O91BxwzOnFp-_fHLtccTevYnLS8q6-FqWqjmxaTaxBI-7gDpn383xdTEcJQGgqms1zKcY14qt0YSAw Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: c71e37b10c644c858b0e98bd7b5af343 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestServerBasicOps-238312751 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c71e37b10c644c858b0e98bd7b5af343", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestServerBasicOps-238312751 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: c71e37b10c644c858b0e98bd7b5af343 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestServerBasicOps-238312751 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestServerBasicOps-238312751-project Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 6f4cef04b4874239be161acb7154c472 Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestServerBasicOps-238312751-project Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a'} Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:54.789884 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Returning 404 to user: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc8ff2d5-0ac8-4581-b972-fc64b5f96106 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 404 len: 111 microversion: 2.1 time: 0.037709 Sep 08 11:02:54.793713 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3261/6749] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:54 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:55.299758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:55.300350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:55.306845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:55.307323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:55.307810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:55.308504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:55.308958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:55.309388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:55.322683 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] HTTP exception thrown: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Request method failure captured: Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a HTTP/1.1 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcp-CgdUQzyVwDSI-EBJWvwEVSggv7LGbrSKGRGi7yFbpHkf6mhwOwhv-dlETGKFpolz8r4c1mRaYMR3QwZ-NDZtcsXSKtKl2O91BxwzOnFp-_fHLtccTevYnLS8q6-FqWqjmxaTaxBI-7gDpn383xdTEcJQGgqms1zKcY14qt0YSAw Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: c71e37b10c644c858b0e98bd7b5af343 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestServerBasicOps-238312751 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c71e37b10c644c858b0e98bd7b5af343", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestServerBasicOps-238312751 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: c71e37b10c644c858b0e98bd7b5af343 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestServerBasicOps-238312751 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestServerBasicOps-238312751-project Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 6f4cef04b4874239be161acb7154c472 Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestServerBasicOps-238312751-project Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a'} Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:55.324367 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Returning 404 to user: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-08a8b09b-af53-4680-afc4-8831e3376132 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 404 len: 111 microversion: 2.1 time: 0.031306 Sep 08 11:02:55.328454 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3489/6750] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:02:55 2022] DELETE /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:55.334425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:55.335096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [instance: 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:55.341740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:55.342243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:55.342708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:55.343419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:55.343927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:55.344376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:55.358461 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] HTTP exception thrown: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Request method failure captured: Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a HTTP/1.1 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcp-CgdUQzyVwDSI-EBJWvwEVSggv7LGbrSKGRGi7yFbpHkf6mhwOwhv-dlETGKFpolz8r4c1mRaYMR3QwZ-NDZtcsXSKtKl2O91BxwzOnFp-_fHLtccTevYnLS8q6-FqWqjmxaTaxBI-7gDpn383xdTEcJQGgqms1zKcY14qt0YSAw Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: c71e37b10c644c858b0e98bd7b5af343 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestServerBasicOps-238312751 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c71e37b10c644c858b0e98bd7b5af343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c71e37b10c644c858b0e98bd7b5af343", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestServerBasicOps-238312751 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: c71e37b10c644c858b0e98bd7b5af343 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestServerBasicOps-238312751 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestServerBasicOps-238312751-project Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 6f4cef04b4874239be161acb7154c472 Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestServerBasicOps-238312751-project Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a'} Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:02:55.360022 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Returning 404 to user: Instance 6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9168459c-adfd-4069-8986-d7880369d037 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a" status: 404 len: 111 microversion: 2.1 time: 0.031003 Sep 08 11:02:55.364064 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3262/6751] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:02:55 2022] GET /compute/v2.1/servers/6d0c76d3-3f9b-4afc-a24e-eb28f6a06e3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:02:55.524325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1d95ed0-e015-43ec-8c80-df41efa5a786 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] Calling method '.version_select at 0x7f234be9e9d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:55.528777 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1d95ed0-e015-43ec-8c80-df41efa5a786 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [dcede2e2-00be-4640-97df-519dabdb8975] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:02:56.537507 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1d95ed0-e015-43ec-8c80-df41efa5a786 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] [dcede2e2-00be-4640-97df-519dabdb8975] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 44678. Sep 08 11:02:56.559806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1d95ed0-e015-43ec-8c80-df41efa5a786 tempest-TestServerBasicOps-238312751 tempest-TestServerBasicOps-238312751-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-139232025" status: 202 len: 0 microversion: 2.1 time: 1.040361 Sep 08 11:02:56.560415 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3490/6752] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 11:02:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-139232025 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:02:59.846526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:02:59.847151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:02:59.853187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-50c2a787-6bdc-4152-9f6a-b31b0fc77601 req-bc84b690-6a4a-41c9-ace0-b22f59410e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:02:59.862767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:59.864367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:59.866480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:59.867391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:59.867990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:59.868572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:59.877085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-50c2a787-6bdc-4152-9f6a-b31b0fc77601 req-bc84b690-6a4a-41c9-ace0-b22f59410e4e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:02:59.878743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-50c2a787-6bdc-4152-9f6a-b31b0fc77601 req-bc84b690-6a4a-41c9-ace0-b22f59410e4e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:02:59.880413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-50c2a787-6bdc-4152-9f6a-b31b0fc77601 req-bc84b690-6a4a-41c9-ace0-b22f59410e4e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:02:59.899732 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-50c2a787-6bdc-4152-9f6a-b31b0fc77601 req-bc84b690-6a4a-41c9-ace0-b22f59410e4e service nova] Creating event network-changed:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:02:59.907042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:02:59.912040 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-50c2a787-6bdc-4152-9f6a-b31b0fc77601 req-bc84b690-6a4a-41c9-ace0-b22f59410e4e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065635 Sep 08 11:02:59.913652 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3491/6753] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:03:00.084250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aba86441-30cc-44fd-b25d-89cb8048ffbe tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 204 len: 0 microversion: 2.1 time: 0.245484 Sep 08 11:03:00.085301 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3263/6754] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:02:59 2022] DELETE /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:03:00.096361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:00.097231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:00.110536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:00.112542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:00.113430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:00.114812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:00.115677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:00.116320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:00.353877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:00.366028 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89b363d9-b10b-4782-9186-f5e7cb6a7fef tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1581 microversion: 2.1 time: 0.274616 Sep 08 11:03:00.367129 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3492/6755] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:00 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1581 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:01.392610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:01.393338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:01.400800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:01.402233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:01.403009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:01.403954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:01.404585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:01.405222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:01.459549 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:03:01.459908 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b (ip 10.222.0.59) !!! Sep 08 11:03:01.742882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:01.751827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-04194ebe-18fd-4d90-89c5-c11f158ddb33 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1581 microversion: 2.1 time: 0.363484 Sep 08 11:03:01.752421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3264/6756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:01 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1581 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:02.777310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:02.777837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:02.785532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:02.786017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:02.786458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:02.787164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:02.787646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:02.788076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:03.105528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:03.115629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9cf353c0-0c15-43fe-817e-4b6f7d6364b0 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1464 microversion: 2.1 time: 0.342766 Sep 08 11:03:03.116563 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3493/6757] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:02 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:03.242702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-404bd2c5-0cf7-4464-9983-4d5eeaa3b275 req-44385693-65ee-4454-84ad-34eb329ea54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ccfbea-3bc7-44f2-b178-29a9e0addf1b", "name": "network-vif-deleted", "tag": "ac6f5661-25f8-4f75-bfa3-041ab43b36fa"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:03.260663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-404bd2c5-0cf7-4464-9983-4d5eeaa3b275 req-44385693-65ee-4454-84ad-34eb329ea54c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:03.261168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-404bd2c5-0cf7-4464-9983-4d5eeaa3b275 req-44385693-65ee-4454-84ad-34eb329ea54c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:03.261619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-404bd2c5-0cf7-4464-9983-4d5eeaa3b275 req-44385693-65ee-4454-84ad-34eb329ea54c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:03.278512 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-404bd2c5-0cf7-4464-9983-4d5eeaa3b275 req-44385693-65ee-4454-84ad-34eb329ea54c service nova] Creating event network-vif-deleted:ac6f5661-25f8-4f75-bfa3-041ab43b36fa for instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b on n-h2-833090-19 Sep 08 11:03:03.286798 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-404bd2c5-0cf7-4464-9983-4d5eeaa3b275 req-44385693-65ee-4454-84ad-34eb329ea54c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047527 Sep 08 11:03:03.287434 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3265/6758] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:03:04.143195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:04.144439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:04.151666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:04.152158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:04.152598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:04.153309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:04.153757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:04.154177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:04.224610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:04.234475 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29f5a060-c4ec-4893-b217-ab9f38ec3b3b tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1229 microversion: 2.1 time: 0.096769 Sep 08 11:03:04.235069 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3494/6759] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:04 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:05.259194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:05.260121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:05.272364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:05.272364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:05.272364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:05.272364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:05.272364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:05.272364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:05.355803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:05.357564 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2b695307-e07c-4e7f-9335-361ed4484feb tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1229 microversion: 2.1 time: 0.103091 Sep 08 11:03:05.358167 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3266/6760] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:05 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:06.381944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:06.382492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:06.395505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:06.396506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:06.397175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:06.398154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:06.399341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:06.400061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:06.467259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:06.475936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1f8c1c6-9a97-43bb-844c-c3b5251f97cc tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1229 microversion: 2.1 time: 0.098814 Sep 08 11:03:06.477383 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3495/6761] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:06 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:07.499454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:07.500155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:07.508268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:07.509074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:07.509534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:07.510272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:07.510744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:07.511352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:07.585448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b2b34ba7aa4223bf4a0e8b0dfe871d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cc28faa04fd3bc19c48adacd8324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:07.595702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c3e4fc5-2ce8-484e-9a5c-dd768cfb2b8e tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 200 len: 1229 microversion: 2.1 time: 0.099611 Sep 08 11:03:07.596863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3267/6762] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:07 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:08.625187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:08.628691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] [instance: b2ccfbea-3bc7-44f2-b178-29a9e0addf1b] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:08.640000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:08.640502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:08.640950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:08.641698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:08.642160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:08.642594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:08.665014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] HTTP exception thrown: Instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b could not be found. Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Request method failure captured: Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b HTTP/1.1 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcszEjkZBXAqMU7ASCFBUCOGLkBLpNFeChxNXQuxMENiYLgkffwEZf902aDQaJQiJnDdDTfjXGtJmVKJDU6tAU79Jj5fs6HSH2PTvhqvBk-Xp0AUtWPRhgfKzxrC2pgIXO0ooNciPtw3wGKNMd1OKaSdWkGM9T9dizyznHNlhte4r_4 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 8c44cc28faa04fd3bc19c48adacd8324 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBackupRestore-2101489601 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8c44cc28faa04fd3bc19c48adacd8324"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8c44cc28faa04fd3bc19c48adacd8324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8c44cc28faa04fd3bc19c48adacd8324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8c44cc28faa04fd3bc19c48adacd8324", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBackupRestore-2101489601 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 8c44cc28faa04fd3bc19c48adacd8324 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2101489601 Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBackupRestore-2101489601-project Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: b4b2b34ba7aa4223bf4a0e8b0dfe871d Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBackupRestore-2101489601-project Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b could not be found. Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'b2ccfbea-3bc7-44f2-b178-29a9e0addf1b'} Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b could not be found. Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b could not be found. Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:08.666909 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b could not be found. Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Returning 404 to user: Instance b2ccfbea-3bc7-44f2-b178-29a9e0addf1b could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8e994550-434e-4913-b8ab-8c77c4f131e5 tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b" status: 404 len: 111 microversion: 2.1 time: 0.047580 Sep 08 11:03:08.671282 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3496/6763] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:08 2022] GET /compute/v2.1/servers/b2ccfbea-3bc7-44f2-b178-29a9e0addf1b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:03:08.857982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-195882f0-0a2c-4975-8248-4cf22b0249ff tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] Calling method '.version_select at 0x7f23500f98b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:08.892897 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-195882f0-0a2c-4975-8248-4cf22b0249ff tempest-TestVolumeBackupRestore-2101489601 tempest-TestVolumeBackupRestore-2101489601-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-325329126" status: 202 len: 0 microversion: 2.1 time: 0.039150 Sep 08 11:03:08.893860 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3268/6764] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 11:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-325329126 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:03:11.983165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:11.990124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-29ec8c1b-b1f1-4020-8c1e-430e1f804347 req-28811ad9-3061-42d8-9707-c03e8e90b379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a156417-0db3-48a7-b0ec-bcd187668ea2", "tag": "fde8c09c-f9af-4918-a029-a3583167089c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:11.993241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:12.013276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:12.013774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:12.020118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:12.021553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:12.022437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:12.023018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:12.046908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29ec8c1b-b1f1-4020-8c1e-430e1f804347 req-28811ad9-3061-42d8-9707-c03e8e90b379 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:12.061653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29ec8c1b-b1f1-4020-8c1e-430e1f804347 req-28811ad9-3061-42d8-9707-c03e8e90b379 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:12.062684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-29ec8c1b-b1f1-4020-8c1e-430e1f804347 req-28811ad9-3061-42d8-9707-c03e8e90b379 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:12.129093 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-29ec8c1b-b1f1-4020-8c1e-430e1f804347 req-28811ad9-3061-42d8-9707-c03e8e90b379 service nova] Creating event network-changed:fde8c09c-f9af-4918-a029-a3583167089c for instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 on n-h1-833090-19 Sep 08 11:03:12.129243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:03:12.149487 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-29ec8c1b-b1f1-4020-8c1e-430e1f804347 req-28811ad9-3061-42d8-9707-c03e8e90b379 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161939 Sep 08 11:03:12.151320 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3269/6765] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:03:12.327487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dc341da5-55f5-401c-91b7-3e75fc6dae0b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 204 len: 0 microversion: 2.1 time: 0.348595 Sep 08 11:03:12.331185 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3497/6766] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:03:11 2022] DELETE /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:03:12.337743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:12.338455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:12.353642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:12.354182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:12.356051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:12.356862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:12.358559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:12.359930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:12.709895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:12.732019 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18d200e6-d2ad-4f76-9a71-611772d69ae7 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1578 microversion: 2.1 time: 0.398743 Sep 08 11:03:12.732870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3270/6767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:12 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1578 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:13.758681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:13.759630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:13.780420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:13.781281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:13.786384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:13.787341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:13.846720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:13.847414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.059s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:14.289416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:14.308551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5113c827-19ba-4c80-b98c-24711e6cb716 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1578 microversion: 2.1 time: 0.555681 Sep 08 11:03:14.315081 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3498/6768] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:13 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1578 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:15.114870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5d817d29-8a41-43ca-b177-d4a8040e935b req-fe6b31bf-760a-43d4-82fe-d29819ae1bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a156417-0db3-48a7-b0ec-bcd187668ea2", "name": "network-vif-deleted", "tag": "fde8c09c-f9af-4918-a029-a3583167089c"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:15.131648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5d817d29-8a41-43ca-b177-d4a8040e935b req-fe6b31bf-760a-43d4-82fe-d29819ae1bea service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:15.132892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5d817d29-8a41-43ca-b177-d4a8040e935b req-fe6b31bf-760a-43d4-82fe-d29819ae1bea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:15.133534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5d817d29-8a41-43ca-b177-d4a8040e935b req-fe6b31bf-760a-43d4-82fe-d29819ae1bea service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:15.151500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5d817d29-8a41-43ca-b177-d4a8040e935b req-fe6b31bf-760a-43d4-82fe-d29819ae1bea service nova] Creating event network-vif-deleted:fde8c09c-f9af-4918-a029-a3583167089c for instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 on n-h1-833090-19 Sep 08 11:03:15.157249 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5d817d29-8a41-43ca-b177-d4a8040e935b req-fe6b31bf-760a-43d4-82fe-d29819ae1bea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046438 Sep 08 11:03:15.158392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3271/6769] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:03:15.339682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:15.340308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:15.348222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:15.348717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:15.349692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:15.350403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:15.351392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:15.351936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:15.543996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:15.561441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b584d2ca-0af9-4dfe-940b-b81699b4f2df tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1225 microversion: 2.1 time: 0.226094 Sep 08 11:03:15.562061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3499/6770] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:15 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1225 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:16.588048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:16.589010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:16.604983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:16.606247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:16.606916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:16.608367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:16.611123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:16.611820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:16.741426 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:16.751833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1066bce4-d8ce-4948-9379-c123b474bc1d tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1225 microversion: 2.1 time: 0.170298 Sep 08 11:03:16.754812 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3272/6771] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:16 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:17.780558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:17.781181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:17.799510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:17.800173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:17.800627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:17.801349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:17.801819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:17.802254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:17.935043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:17.949531 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04e36c84-8b78-4d83-be96-7628715cad66 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1225 microversion: 2.1 time: 0.173972 Sep 08 11:03:17.951581 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3500/6772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:17 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:18.975864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:18.977090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:18.986268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:18.986795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:18.987275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:18.989546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:18.990043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:18.992157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:19.103297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:19.112887 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d973d47-8dd6-448c-95cc-ab3fea27d23e tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1225 microversion: 2.1 time: 0.140940 Sep 08 11:03:19.114723 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3273/6773] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:18 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:20.138175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:20.139116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:20.152082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:20.154208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:20.157304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:20.160984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:20.162100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:20.164758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:20.381210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:20.394044 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d633cec7-9fe4-46b5-93b3-87bd63bb0158 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1225 microversion: 2.1 time: 0.259898 Sep 08 11:03:20.396164 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3501/6774] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:20 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1225 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:21.422837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:21.425465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:21.457230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:21.458471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:21.465142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:21.466718 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:21.467779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:21.468690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:21.861692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:21.893537 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c98b2322-157d-4953-b0bd-a56d56bb5617 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 200 len: 1225 microversion: 2.1 time: 0.477972 Sep 08 11:03:21.894161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3274/6775] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:21 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 1225 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:22.918809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:22.920332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 0a156417-0db3-48a7-b0ec-bcd187668ea2] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:22.927783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:22.929833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:22.930642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:22.931509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:22.932627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:22.933195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:22.933848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:22.937958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:22.955263 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 could not be found. Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 HTTP/1.1 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 could not be found. Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0a156417-0db3-48a7-b0ec-bcd187668ea2'} Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 could not be found. Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 could not be found. Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:22.957734 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 could not be found. Sep 08 11:03:22.962869 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:22.964591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 0a156417-0db3-48a7-b0ec-bcd187668ea2 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:03:22.965753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-800c8c5e-56a8-4bb9-b91a-069c3ad1bde9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2" status: 404 len: 111 microversion: 2.1 time: 0.051152 Sep 08 11:03:22.970394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3502/6776] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:22 2022] GET /compute/v2.1/servers/0a156417-0db3-48a7-b0ec-bcd187668ea2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:03:29.322213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:29.322762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:29.327573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:29.330693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-77112976-d0a4-4738-bf33-163e11b1c88f req-fef17fb7-1449-4258-9909-d5a2153a1d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bc4195-bd35-429c-94b6-b4bd9056000e", "tag": "2d3f0514-496f-48cc-a6f5-e1c2c01c6852"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:29.342264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-77112976-d0a4-4738-bf33-163e11b1c88f req-fef17fb7-1449-4258-9909-d5a2153a1d5b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:29.343003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-77112976-d0a4-4738-bf33-163e11b1c88f req-fef17fb7-1449-4258-9909-d5a2153a1d5b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:29.343643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-77112976-d0a4-4738-bf33-163e11b1c88f req-fef17fb7-1449-4258-9909-d5a2153a1d5b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:29.345090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:29.345890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:29.346417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:29.347395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:29.350070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:29.352161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:29.360337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-77112976-d0a4-4738-bf33-163e11b1c88f req-fef17fb7-1449-4258-9909-d5a2153a1d5b service nova] Creating event network-changed:2d3f0514-496f-48cc-a6f5-e1c2c01c6852 for instance 80bc4195-bd35-429c-94b6-b4bd9056000e on n-h1-833090-19 Sep 08 11:03:29.362046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:29.367732 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-77112976-d0a4-4738-bf33-163e11b1c88f req-fef17fb7-1449-4258-9909-d5a2153a1d5b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043138 Sep 08 11:03:29.369045 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3503/6777] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:03:29.390218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:03:29.482812 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-770e490d-6de0-47f7-ac4b-cc5df0e9c6a9 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 204 len: 0 microversion: 2.1 time: 0.163944 Sep 08 11:03:29.486872 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3275/6778] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:03:29 2022] DELETE /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:03:29.494534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:29.495597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:29.504851 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:29.505350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:29.505791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:29.506529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:29.506982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:29.507407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:29.650672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:29.660040 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d0359829-63e1-4d2c-8250-82eb17b04e25 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1578 microversion: 2.1 time: 0.171439 Sep 08 11:03:29.660779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3504/6779] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:29 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:30.685390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:30.686113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:30.693720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:30.694793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:30.695247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:30.696201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:30.696673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:30.697119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:30.832745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:30.840675 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50a9fbc2-b357-46a2-8318-ed1c1bd62f08 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1578 microversion: 2.1 time: 0.159644 Sep 08 11:03:30.841253 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3276/6780] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:30 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:31.392932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4bdf1df2-1174-4920-b263-d02e7cb69c81 req-4d63b208-d211-4e6e-8818-2fa1ca7483f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bc4195-bd35-429c-94b6-b4bd9056000e", "name": "network-vif-deleted", "tag": "2d3f0514-496f-48cc-a6f5-e1c2c01c6852"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:31.404053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4bdf1df2-1174-4920-b263-d02e7cb69c81 req-4d63b208-d211-4e6e-8818-2fa1ca7483f6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:31.404522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4bdf1df2-1174-4920-b263-d02e7cb69c81 req-4d63b208-d211-4e6e-8818-2fa1ca7483f6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:31.404947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4bdf1df2-1174-4920-b263-d02e7cb69c81 req-4d63b208-d211-4e6e-8818-2fa1ca7483f6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:31.416950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4bdf1df2-1174-4920-b263-d02e7cb69c81 req-4d63b208-d211-4e6e-8818-2fa1ca7483f6 service nova] Creating event network-vif-deleted:2d3f0514-496f-48cc-a6f5-e1c2c01c6852 for instance 80bc4195-bd35-429c-94b6-b4bd9056000e on n-h1-833090-19 Sep 08 11:03:31.421705 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4bdf1df2-1174-4920-b263-d02e7cb69c81 req-4d63b208-d211-4e6e-8818-2fa1ca7483f6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Sep 08 11:03:31.422341 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3505/6781] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:03:31.864914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:31.865540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:31.873105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:31.873610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:31.874068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:31.874785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:31.875262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:31.875740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:31.943233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:31.951347 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f30e7633-d049-4690-b20c-0fbc0729e763 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1225 microversion: 2.1 time: 0.090403 Sep 08 11:03:31.951976 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3277/6782] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:31 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:03:32.975859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:32.976619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:32.983100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:32.983616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:32.984053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:32.984760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:32.985217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:32.985640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:33.055453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:33.066145 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0a3551d6-432f-4687-a61a-fb834edb1190 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1225 microversion: 2.1 time: 0.095095 Sep 08 11:03:33.067153 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3506/6783] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:32 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:34.089940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:34.091027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:34.098046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:34.098545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:34.099003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:34.099737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:34.100710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:34.101222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:34.165141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:34.173321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bee5b6bc-a80f-4d33-9bca-1635225b53fb tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1225 microversion: 2.1 time: 0.087471 Sep 08 11:03:34.173904 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3278/6784] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:34 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:35.196566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:35.197185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:35.204218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:35.204707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:35.205150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:35.205859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:35.206332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:35.206749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:35.277616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9b9bcfe41643749e6c6d80efbbde2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd8750fa045169fe4e52b2ff5c883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:35.285882 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7605053-b1de-4691-a8a4-e84934e1a683 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 200 len: 1225 microversion: 2.1 time: 0.093292 Sep 08 11:03:35.286856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3507/6785] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:35 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:03:36.310140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:36.310777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 80bc4195-bd35-429c-94b6-b4bd9056000e] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:36.317676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:36.318185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:36.319136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:36.319885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:36.320362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:36.320814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:36.334991 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 80bc4195-bd35-429c-94b6-b4bd9056000e could not be found. Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e HTTP/1.1 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 80bc4195-bd35-429c-94b6-b4bd9056000e could not be found. Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '80bc4195-bd35-429c-94b6-b4bd9056000e'} Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bc4195-bd35-429c-94b6-b4bd9056000e could not be found. Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bc4195-bd35-429c-94b6-b4bd9056000e could not be found. Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:36.336708 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bc4195-bd35-429c-94b6-b4bd9056000e could not be found. Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 80bc4195-bd35-429c-94b6-b4bd9056000e could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96f67cae-4235-4d2d-be24-0d37fd28289b tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e" status: 404 len: 111 microversion: 2.1 time: 0.032365 Sep 08 11:03:36.344335 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3279/6786] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:36 2022] GET /compute/v2.1/servers/80bc4195-bd35-429c-94b6-b4bd9056000e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:03:36.799791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:36.800343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:36.807223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:36.807738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:36.808178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:36.808873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:36.809363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:36.809793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:36.828066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 HTTP/1.1 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3843697b-7129-4c3f-a071-fd0c0c4ab214'} Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:03:36.829767 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf71ddea-2563-4dae-a256-50b894a0dde6 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 404 len: 111 microversion: 2.1 time: 0.035369 Sep 08 11:03:36.833336 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3508/6787] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:03:36 2022] DELETE /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:03:36.840929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:36.841601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] [instance: 3843697b-7129-4c3f-a071-fd0c0c4ab214] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:36.847861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:36.848373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:36.848834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:36.849562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:36.850075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:36.850522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:36.864096 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] HTTP exception thrown: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Request method failure captured: Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 HTTP/1.1 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGckLFvy6wUB083T74jfoMYCvnWpdsTAw8huOtagh0MvUeFFf89erlsPKxpl_052MNJx3ylsPDC7xku5QY7GBCcBa6crSENh2WUf6Qru3odXXgyLQnyKDk6BOtJejMpY1Az6YzxylMi9Hc6bzXOV_Z4vqsJ0nLnEifuJ9md84Wvg_-E4 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/774cd8750fa045169fe4e52b2ff5c883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_774cd8750fa045169fe4e52b2ff5c883", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 774cd8750fa045169fe4e52b2ff5c883 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestVolumeBootPattern-989134801 Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ee9b9bcfe41643749e6c6d80efbbde2d Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestVolumeBootPattern-989134801-project Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '3843697b-7129-4c3f-a071-fd0c0c4ab214'} Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:03:36.865652 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Returning 404 to user: Instance 3843697b-7129-4c3f-a071-fd0c0c4ab214 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1d40668a-c367-4761-b220-524aec258c32 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214" status: 404 len: 111 microversion: 2.1 time: 0.030253 Sep 08 11:03:36.870300 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3280/6788] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:36 2022] GET /compute/v2.1/servers/3843697b-7129-4c3f-a071-fd0c0c4ab214 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:03:40.294767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d03b616f-d5ca-422d-92b4-a7d751d494e2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] Calling method '.version_select at 0x7f234bd169d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:40.316595 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d03b616f-d5ca-422d-92b4-a7d751d494e2 tempest-TestVolumeBootPattern-989134801 tempest-TestVolumeBootPattern-989134801-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-591858070" status: 202 len: 0 microversion: 2.1 time: 0.026087 Sep 08 11:03:40.317290 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3509/6789] 10.222.0.59 () {58 vars in 1260 bytes} [Thu Sep 8 11:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-591858070 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:03:58.795594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:58.796351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:58.930424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1825636766", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:03:59.164859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] validate_networks() for None {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:03:59.443162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:03:59.443641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:03:59.444140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:03:59.444571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:03:59.445006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:03:59.454106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:59.454527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:59.454982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:59.455768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:03:59.456239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:03:59.456685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:03:59.473886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Getting quotas for project f570cfceb5014615a67f3d8d153aa95c. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:03:59.479139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Getting quotas for user 4c42c2b503814da7bb00c31056d620f5 and project f570cfceb5014615a67f3d8d153aa95c. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:03:59.491700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:03:59.494059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:03:59.539609 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6a63892-0839-4e4f-80dc-596e2c9fe433 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749151 Sep 08 11:03:59.540265 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3281/6790] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:03:59.554397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=25 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:59.555338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:03:59.560998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-869db3bd-7e3c-4de4-94cf-43743c48bab3 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:03:59.561615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-869db3bd-7e3c-4de4-94cf-43743c48bab3 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:03:59.733121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-869db3bd-7e3c-4de4-94cf-43743c48bab3 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:03:59.740936 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-869db3bd-7e3c-4de4-94cf-43743c48bab3 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1222 microversion: 2.1 time: 0.188384 Sep 08 11:03:59.741597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3510/6791] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:03:59 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1222 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:00.763713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:00.764341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:00.773065 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:00.773838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:00.774454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:00.775276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:00.775685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:00.776132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:01.215304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:01.223209 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ece59e8-ad8b-427f-b56e-5f06f48d38a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1282 microversion: 2.1 time: 0.463393 Sep 08 11:04:01.223838 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3282/6792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:00 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1282 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:02.246175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:02.246831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:02.253758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:02.254364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:02.255306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:02.256048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:02.256513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:02.256947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:02.510560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:02.519769 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-081b8479-9cca-4bee-93cd-c164b8fd3d4f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.277416 Sep 08 11:04:02.520721 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3511/6793] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:02 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:02.732779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1557df19-ccbc-447a-98db-a60a62b212d1 req-ba77f0e6-c180-4775-9e6e-4af74fb28ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7461b785-6587-4f36-a246-579c62c8b65a", "tag": "4b880d66-40ce-45bc-b5ca-a5d4ad399903"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:02.745291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1557df19-ccbc-447a-98db-a60a62b212d1 req-ba77f0e6-c180-4775-9e6e-4af74fb28ed2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:02.745796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1557df19-ccbc-447a-98db-a60a62b212d1 req-ba77f0e6-c180-4775-9e6e-4af74fb28ed2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:02.746250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1557df19-ccbc-447a-98db-a60a62b212d1 req-ba77f0e6-c180-4775-9e6e-4af74fb28ed2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:02.758679 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1557df19-ccbc-447a-98db-a60a62b212d1 req-ba77f0e6-c180-4775-9e6e-4af74fb28ed2 service nova] Creating event network-changed:4b880d66-40ce-45bc-b5ca-a5d4ad399903 for instance 7461b785-6587-4f36-a246-579c62c8b65a on n-h2-833090-19 Sep 08 11:04:02.764084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1557df19-ccbc-447a-98db-a60a62b212d1 req-ba77f0e6-c180-4775-9e6e-4af74fb28ed2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034991 Sep 08 11:04:02.764778 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3283/6794] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:03.543567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:03.544184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:03.551638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:03.552129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:03.552620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:03.553348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:03.553801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:03.554230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:03.686841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:03.694703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f518fa28-a4eb-48d1-b8aa-bad9d11a7e3e tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.155129 Sep 08 11:04:03.695284 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3512/6795] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:03 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:04.719489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:04.720266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:04.726709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:04.727212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:04.727716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:04.728429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:04.728909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:04.729351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:04.863097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:04.871769 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1176cf90-1b59-4dfb-96be-792b9ed33053 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.157391 Sep 08 11:04:04.872353 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3284/6796] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:04 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:05.896038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:05.896655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:05.906013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:05.906496 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:05.906927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:05.907657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:05.908105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:05.908525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:06.043148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:06.052222 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bff76eda-c5ce-4c42-b340-7e32cd407683 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.160923 Sep 08 11:04:06.052818 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3513/6797] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:05 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:07.075767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:07.084169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:07.093058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:07.093603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:07.094102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:07.094798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:07.095271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:07.095743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:07.239291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:07.247054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9fc91563-d804-4787-924f-21af0a9b2c3b tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.175363 Sep 08 11:04:07.247668 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3285/6798] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:07 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:08.269928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:08.271175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:08.278094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.278580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.279024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:08.279755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.280218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.280649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:08.413194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:08.420980 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f43fb7e9-45d0-481b-8cff-bd3d4de6f9a7 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.155290 Sep 08 11:04:08.421560 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3514/6799] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:08 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:08.985969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a701f833-3e19-4123-aa59-e812683c6ef1 req-6be747a1-35bb-4dfc-831e-97e02f0cd196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7461b785-6587-4f36-a246-579c62c8b65a", "name": "network-vif-plugged", "status": "completed", "tag": "4b880d66-40ce-45bc-b5ca-a5d4ad399903"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:08.997310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a701f833-3e19-4123-aa59-e812683c6ef1 req-6be747a1-35bb-4dfc-831e-97e02f0cd196 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:08.997823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a701f833-3e19-4123-aa59-e812683c6ef1 req-6be747a1-35bb-4dfc-831e-97e02f0cd196 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:08.999069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a701f833-3e19-4123-aa59-e812683c6ef1 req-6be747a1-35bb-4dfc-831e-97e02f0cd196 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.011571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a701f833-3e19-4123-aa59-e812683c6ef1 req-6be747a1-35bb-4dfc-831e-97e02f0cd196 service nova] Creating event network-vif-plugged:4b880d66-40ce-45bc-b5ca-a5d4ad399903 for instance 7461b785-6587-4f36-a246-579c62c8b65a on n-h2-833090-19 Sep 08 11:04:09.017070 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a701f833-3e19-4123-aa59-e812683c6ef1 req-6be747a1-35bb-4dfc-831e-97e02f0cd196 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Sep 08 11:04:09.018022 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3286/6800] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:09.443668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:09.444284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:09.451175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:09.451705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:09.452143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.452843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:09.453292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:09.453717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:09.586338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:09.594333 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f88d4e5a-7edd-4dff-a539-9c5bf6328885 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.155242 Sep 08 11:04:09.594939 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3515/6801] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:09 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:10.618223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:10.618937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:10.620923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:10.621801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:10.629147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:10.629739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:10.630195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:10.630912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:10.631385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:10.631861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:10.770996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:10.781954 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26535c62-bb1a-48d4-8188-b1e1843ec1cd tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1322 microversion: 2.1 time: 0.168460 Sep 08 11:04:10.782919 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3287/6802] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:10 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:11.805742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:11.806356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:11.808233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:11.814482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:11.814980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:11.815426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:11.816205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:11.816666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:11.817676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:11.949010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:11.957087 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-90ac6faa-43f7-43c2-b40f-67d2e8efab3c tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1470 microversion: 2.1 time: 0.155820 Sep 08 11:04:11.957703 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3516/6803] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:11 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:12.031757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-356fa868-98d8-47b7-bf05-eef49e09fd6b tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Calling method '.version_select at 0x7f23487318b0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.102720 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-356fa868-98d8-47b7-bf05-eef49e09fd6b tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/e824c69c385843f8a2e6cbff276c49a8" status: 200 len: 371 microversion: 2.1 time: 0.124636 Sep 08 11:04:12.103299 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3288/6804] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 11:04:11 2022] GET /compute/v2.1/os-quota-sets/e824c69c385843f8a2e6cbff276c49a8 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:12.115859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f940175e-7990-4bd6-a25c-cc0dd962aa4c tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1262962195", "id": 903807819, "os-flavor-access:is_public": "True"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:12.133753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f940175e-7990-4bd6-a25c-cc0dd962aa4c tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022152 Sep 08 11:04:12.134351 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3517/6805] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:04:12 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:12.147213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "903807819"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:12.149567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:12.155965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.156498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.156960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.157682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.158161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.158679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.257586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3770b24961064179b24f8a73e59b9161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e824c69c385843f8a2e6cbff276c49a8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:12.263830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1262962195 {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:04:12.270893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.271395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.271880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.272628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.273104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.273547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.296377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Getting quotas for project f570cfceb5014615a67f3d8d153aa95c. Resources: {'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:04:12.302249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Getting quotas for user 4c42c2b503814da7bb00c31056d620f5 and project f570cfceb5014615a67f3d8d153aa95c. Resources: {'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:04:12.315167 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] ram quota exceeded for e824c69c385843f8a2e6cbff276c49a8, tried to resize instance. Sep 08 11:04:12.315758 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Request method failure captured: Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a/action HTTP/1.1 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 38 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcweNxqsM3ZJGrQ_6gOwVaJQ6dbFhZOJO0-w_t-7dbqkh-b2_VDpGMuxz2Dy3uzwhKdCKJb2EzVKm0uPb81HCZgocgf2UhxY4I6n2VGp0oaEDDDxz2Ipk4Y2ao8BQ-I-ZzJBUkUFRvV-tSKmKBFnq6_OC4ONMYUtzeKI7yocV7a5B1s Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: e824c69c385843f8a2e6cbff276c49a8 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407046066 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,admin,member Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,admin,member Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e824c69c385843f8a2e6cbff276c49a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e824c69c385843f8a2e6cbff276c49a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e824c69c385843f8a2e6cbff276c49a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e824c69c385843f8a2e6cbff276c49a8", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407046066 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: e824c69c385843f8a2e6cbff276c49a8 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407046066 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersAdminNegativeTestJSON-1407046066-project-admin Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3770b24961064179b24f8a73e59b9161 Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407046066-project-admin Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: {"resize": {"flavorRef": "903807819"}} Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '7461b785-6587-4f36-a246-579c62c8b65a', 'body': {'resize': {'flavorRef': '903807819'}}} Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:04:12.321617 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f9ac7158-d2cf-4809-917a-c2d3a44969d3 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a/action" status: 403 len: 118 microversion: 2.1 time: 0.180147 Sep 08 11:04:12.325948 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3289/6806] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:04:12 2022] POST /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a/action => generated 118 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:04:12.332199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2134e21c-03d6-4ce1-8ee8-3f29054876f2 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.350402 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2134e21c-03d6-4ce1-8ee8-3f29054876f2 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/903807819" status: 202 len: 0 microversion: 2.1 time: 0.021943 Sep 08 11:04:12.351406 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3518/6807] 10.222.0.59 () {58 vars in 1158 bytes} [Thu Sep 8 11:04:12 2022] DELETE /compute/v2.1/flavors/903807819 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:04:12.359082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-90450d0f-ba18-4b8b-bf1f-afb2e690aab1 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.380352 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-90450d0f-ba18-4b8b-bf1f-afb2e690aab1 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024874 Sep 08 11:04:12.380951 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3290/6808] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 11:04:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:12.402799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e57d8790-7995-40a1-a151-5031491a10bb tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Calling method '.version_select at 0x7f23513f09d0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.483616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e57d8790-7995-40a1-a151-5031491a10bb tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "GET /compute/v2.1/os-quota-sets/e824c69c385843f8a2e6cbff276c49a8" status: 200 len: 371 microversion: 2.1 time: 0.084839 Sep 08 11:04:12.484245 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3519/6809] 10.222.0.59 () {58 vars in 1242 bytes} [Thu Sep 8 11:04:12 2022] GET /compute/v2.1/os-quota-sets/e824c69c385843f8a2e6cbff276c49a8 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:12.496369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c5bdc94-0771-48d9-b19c-d7eec7e205b4 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1284328566", "id": 1636877170, "os-flavor-access:is_public": "True"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:12.515338 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c5bdc94-0771-48d9-b19c-d7eec7e205b4 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022791 Sep 08 11:04:12.516001 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3291/6810] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:04:12 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:12.529025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1636877170"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:12.531426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:12.539127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.539820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.540072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.540783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.541236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.541890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.630954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3770b24961064179b24f8a73e59b9161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e824c69c385843f8a2e6cbff276c49a8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:12.637369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1284328566 {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:04:12.644450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.645467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.645875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.646607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.647064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.647516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.671696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Getting quotas for project f570cfceb5014615a67f3d8d153aa95c. Resources: {'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:04:12.677058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Getting quotas for user 4c42c2b503814da7bb00c31056d620f5 and project f570cfceb5014615a67f3d8d153aa95c. Resources: {'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:04:12.691546 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.compute.api [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] cores quota exceeded for e824c69c385843f8a2e6cbff276c49a8, tried to resize instance. Sep 08 11:04:12.692835 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Request method failure captured: Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a/action HTTP/1.1 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 39 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcweNxqsM3ZJGrQ_6gOwVaJQ6dbFhZOJO0-w_t-7dbqkh-b2_VDpGMuxz2Dy3uzwhKdCKJb2EzVKm0uPb81HCZgocgf2UhxY4I6n2VGp0oaEDDDxz2Ipk4Y2ao8BQ-I-ZzJBUkUFRvV-tSKmKBFnq6_OC4ONMYUtzeKI7yocV7a5B1s Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: e824c69c385843f8a2e6cbff276c49a8 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1407046066 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,admin,member Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,admin,member Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e824c69c385843f8a2e6cbff276c49a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e824c69c385843f8a2e6cbff276c49a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e824c69c385843f8a2e6cbff276c49a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e824c69c385843f8a2e6cbff276c49a8", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1407046066 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: e824c69c385843f8a2e6cbff276c49a8 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1407046066 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersAdminNegativeTestJSON-1407046066-project-admin Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3770b24961064179b24f8a73e59b9161 Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1407046066-project-admin Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: {"resize": {"flavorRef": "1636877170"}} Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7461b785-6587-4f36-a246-579c62c8b65a', 'body': {'resize': {'flavorRef': '1636877170'}}} Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:04:12.711694 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-89b9bd88-d60b-4874-a73a-027bb98d14c9 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "POST /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a/action" status: 403 len: 113 microversion: 2.1 time: 0.188247 Sep 08 11:04:12.715078 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3520/6811] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:04:12 2022] POST /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a/action => generated 113 bytes in 190 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:04:12.724258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dfca25a5-a4e6-42d8-bd43-be1c7c5895c6 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.744153 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dfca25a5-a4e6-42d8-bd43-be1c7c5895c6 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "DELETE /compute/v2.1/flavors/1636877170" status: 202 len: 0 microversion: 2.1 time: 0.024562 Sep 08 11:04:12.744751 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3292/6812] 10.222.0.59 () {58 vars in 1161 bytes} [Thu Sep 8 11:04:12 2022] DELETE /compute/v2.1/flavors/1636877170 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:04:12.753072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6929c94b-916c-419f-b81a-9edba6c5bd41 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.775079 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6929c94b-916c-419f-b81a-9edba6c5bd41 tempest-ServersAdminNegativeTestJSON-1407046066 tempest-ServersAdminNegativeTestJSON-1407046066-project-admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025619 Sep 08 11:04:12.775702 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3521/6813] 10.222.0.59 () {58 vars in 1146 bytes} [Thu Sep 8 11:04:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:12.796824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.797352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:12.803983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.804489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.804946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.805666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.806141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.806585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.837337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:04:12.915291 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9229aaba-f7d6-4da4-9770-9ddf6820f649 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 204 len: 0 microversion: 2.1 time: 0.122369 Sep 08 11:04:12.916141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3293/6814] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:04:12 2022] DELETE /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:04:12.925072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:12.925694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:12.932646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.933165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.933604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:12.934296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:12.934752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:12.935180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:13.076047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:13.084518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ec2b2f1-beec-4359-8592-b5ea79200de6 tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1476 microversion: 2.1 time: 0.163843 Sep 08 11:04:13.085094 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3522/6815] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:12 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:14.108656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:14.109353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:14.116241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:14.116739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:14.117188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:14.117921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:14.118387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:14.118826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:14.252529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:14.260949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac2c619f-a3ce-46b8-896a-fb6cb4509d2d tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1476 microversion: 2.1 time: 0.156894 Sep 08 11:04:14.261536 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3294/6816] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:14 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:14.927481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e0c70068-0cba-4cf7-ad04-f4fff00f1781 req-096e8409-4eff-497c-9f87-575a600bac87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7461b785-6587-4f36-a246-579c62c8b65a", "name": "network-vif-deleted", "tag": "4b880d66-40ce-45bc-b5ca-a5d4ad399903"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:14.940237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e0c70068-0cba-4cf7-ad04-f4fff00f1781 req-096e8409-4eff-497c-9f87-575a600bac87 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:14.940893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e0c70068-0cba-4cf7-ad04-f4fff00f1781 req-096e8409-4eff-497c-9f87-575a600bac87 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:14.941335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e0c70068-0cba-4cf7-ad04-f4fff00f1781 req-096e8409-4eff-497c-9f87-575a600bac87 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:14.954804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e0c70068-0cba-4cf7-ad04-f4fff00f1781 req-096e8409-4eff-497c-9f87-575a600bac87 service nova] Creating event network-vif-deleted:4b880d66-40ce-45bc-b5ca-a5d4ad399903 for instance 7461b785-6587-4f36-a246-579c62c8b65a on n-h2-833090-19 Sep 08 11:04:14.960358 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e0c70068-0cba-4cf7-ad04-f4fff00f1781 req-096e8409-4eff-497c-9f87-575a600bac87 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044083 Sep 08 11:04:14.963637 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3523/6817] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:15.284569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:15.285211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:15.292207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:15.292704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:15.293158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:15.293858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:15.294326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:15.294763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:15.326766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:15.327288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:15.327774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:15.328413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lazy-loading 'fault' on Instance uuid 7461b785-6587-4f36-a246-579c62c8b65a {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:04:15.372026 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c42c2b503814da7bb00c31056d620f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f570cfceb5014615a67f3d8d153aa95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:15.380655 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-beed5f81-4832-4907-be2c-c68d4090d19f tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 200 len: 1312 microversion: 2.1 time: 0.099459 Sep 08 11:04:15.381243 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3295/6818] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:15 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:16.405316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:16.407267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] [instance: 7461b785-6587-4f36-a246-579c62c8b65a] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:16.412637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:16.413122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:16.413555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:16.414255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:16.414801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:16.415226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:16.429178 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] HTTP exception thrown: Instance 7461b785-6587-4f36-a246-579c62c8b65a could not be found. Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Request method failure captured: Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a HTTP/1.1 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcweFPnWIlfVyAJiWiOUGwbbogJhO8LUQA9Afd7eurxoveDD4JES7ehiV1x54KE3PQaAC4tX-C55-f_PKmIqQPC76hAeFRUfpK5gU38ia3jInMLgp7D7nfWRfzSbl7ASWk_t7Rrios-LtU3IjpvjdjXODsz2EjtaIws-0ZHYDrqb6QA Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f570cfceb5014615a67f3d8d153aa95c Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-75051503 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f570cfceb5014615a67f3d8d153aa95c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f570cfceb5014615a67f3d8d153aa95c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f570cfceb5014615a67f3d8d153aa95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f570cfceb5014615a67f3d8d153aa95c", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersAdminNegativeTestJSON-75051503 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f570cfceb5014615a67f3d8d153aa95c Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-75051503 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersAdminNegativeTestJSON-75051503-project Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4c42c2b503814da7bb00c31056d620f5 Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersAdminNegativeTestJSON-75051503-project Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 7461b785-6587-4f36-a246-579c62c8b65a could not be found. Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '7461b785-6587-4f36-a246-579c62c8b65a'} Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7461b785-6587-4f36-a246-579c62c8b65a could not be found. Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7461b785-6587-4f36-a246-579c62c8b65a could not be found. Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:16.430836 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7461b785-6587-4f36-a246-579c62c8b65a could not be found. Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] Returning 404 to user: Instance 7461b785-6587-4f36-a246-579c62c8b65a could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db866a0b-cd65-4896-a8be-1c82539584fe tempest-ServersAdminNegativeTestJSON-75051503 tempest-ServersAdminNegativeTestJSON-75051503-project] 10.222.0.59 "GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a" status: 404 len: 111 microversion: 2.1 time: 0.032197 Sep 08 11:04:16.435665 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3524/6819] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:16 2022] GET /compute/v2.1/servers/7461b785-6587-4f36-a246-579c62c8b65a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:04:22.584915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:22.586251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:22.752022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-474405065", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "209954f7-0428-44b2-a266-c2e55171f7e5"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:22.811328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] validate_networks() for [('209954f7-0428-44b2-a266-c2e55171f7e5', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:04:23.294102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:04:23.294551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:04:23.295068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:04:23.295530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:04:23.295962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:04:23.305785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:23.306316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:23.306844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:23.307732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:23.308277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:23.308795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:23.327185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Getting quotas for project 083f1bb7424f4ba6b31af30e11e6e447. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:04:23.333523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Getting quotas for user 7e97da58c46647e99f8485fb66d76e04 and project 083f1bb7424f4ba6b31af30e11e6e447. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:04:23.346828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:04:23.349374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:04:23.398234 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-78512f38-d048-4ca8-b5ae-029c2b5f2633 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820130 Sep 08 11:04:23.399092 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3296/6820] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:04:23.410079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bef9746d-9962-4f76-bf10-18e8a5aedfed tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:23.410718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bef9746d-9962-4f76-bf10-18e8a5aedfed tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:23.414256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:23.414949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:23.476691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bef9746d-9962-4f76-bf10-18e8a5aedfed tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:23.485269 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bef9746d-9962-4f76-bf10-18e8a5aedfed tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1214 microversion: 2.1 time: 0.079028 Sep 08 11:04:23.486289 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3525/6821] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:23 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:24.510962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:24.511904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:24.522669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.523561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.524029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.524985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:24.525618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:24.526322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:24.617334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:24.626258 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb77ac9f-06dc-44e8-9e65-059cb0ab98b1 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1284 microversion: 2.1 time: 0.121774 Sep 08 11:04:24.626882 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3297/6822] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:24 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:25.672142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:25.672843 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:25.682035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:25.682637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:25.683153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:25.684145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:25.684879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:25.685347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:25.935597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:25.945431 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f6512fff-61a9-4905-90fd-736e9310bf80 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1314 microversion: 2.1 time: 0.277251 Sep 08 11:04:25.964364 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3526/6823] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:25 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:26.111510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1a2e3db1-32c7-4ddc-b539-c4199e5c8657 req-846e9b5d-eff1-46ac-9f85-711e09f48d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59eed3b5-ac9b-4191-9094-a04a8ba88352", "tag": "fbf3f164-ecca-4971-b701-40ef435f6930"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:26.141699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1a2e3db1-32c7-4ddc-b539-c4199e5c8657 req-846e9b5d-eff1-46ac-9f85-711e09f48d3d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.142338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1a2e3db1-32c7-4ddc-b539-c4199e5c8657 req-846e9b5d-eff1-46ac-9f85-711e09f48d3d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.145682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1a2e3db1-32c7-4ddc-b539-c4199e5c8657 req-846e9b5d-eff1-46ac-9f85-711e09f48d3d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:26.163809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1a2e3db1-32c7-4ddc-b539-c4199e5c8657 req-846e9b5d-eff1-46ac-9f85-711e09f48d3d service nova] Creating event network-changed:fbf3f164-ecca-4971-b701-40ef435f6930 for instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 on n-h1-833090-19 Sep 08 11:04:26.168987 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1a2e3db1-32c7-4ddc-b539-c4199e5c8657 req-846e9b5d-eff1-46ac-9f85-711e09f48d3d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062765 Sep 08 11:04:26.170212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3298/6824] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:26.977201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:26.977848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:26.984716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.985202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.985643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:26.986376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:26.986832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:26.987261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:27.124321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:27.137899 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e40bc1f-0d27-4847-8de0-685b7bc1df27 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1314 microversion: 2.1 time: 0.164361 Sep 08 11:04:27.140441 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3527/6825] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:26 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:28.164815 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:28.165545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:28.171836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:28.172341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:28.172804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:28.173521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:28.173995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:28.174446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:28.312598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:28.321131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9ee4fff-86c6-430e-b7d7-0553515b57ef tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1314 microversion: 2.1 time: 0.161528 Sep 08 11:04:28.321735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3299/6826] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:28 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:29.343656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:29.344281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:29.351414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:29.351997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:29.352393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:29.353201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:29.353664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:29.354103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:29.483576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:29.491365 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-73f63a8f-45c6-4569-a716-569606678715 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1314 microversion: 2.1 time: 0.151783 Sep 08 11:04:29.491983 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3528/6827] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:29 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:30.514537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:30.515190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:30.518117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:30.524446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:30.524958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:30.525416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:30.526138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:30.526614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:30.527057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:30.532679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:30.662247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3db81845-1f95-42a8-a84e-dbe7540a7b27 req-ed3b85de-8923-42d5-bd1f-80415430bc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59eed3b5-ac9b-4191-9094-a04a8ba88352", "name": "network-vif-plugged", "status": "completed", "tag": "fbf3f164-ecca-4971-b701-40ef435f6930"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:30.674334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:30.675967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:30.678345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3db81845-1f95-42a8-a84e-dbe7540a7b27 req-ed3b85de-8923-42d5-bd1f-80415430bc17 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:30.679110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3db81845-1f95-42a8-a84e-dbe7540a7b27 req-ed3b85de-8923-42d5-bd1f-80415430bc17 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:30.679738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3db81845-1f95-42a8-a84e-dbe7540a7b27 req-ed3b85de-8923-42d5-bd1f-80415430bc17 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:30.688167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=78 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:30.689557 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-25cbb922-36aa-47e1-89da-7f7b2c589efb tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1314 microversion: 2.1 time: 0.178893 Sep 08 11:04:30.697182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3db81845-1f95-42a8-a84e-dbe7540a7b27 req-ed3b85de-8923-42d5-bd1f-80415430bc17 service nova] Creating event network-vif-plugged:fbf3f164-ecca-4971-b701-40ef435f6930 for instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 on n-h1-833090-19 Sep 08 11:04:30.702684 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3db81845-1f95-42a8-a84e-dbe7540a7b27 req-ed3b85de-8923-42d5-bd1f-80415430bc17 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045789 Sep 08 11:04:30.703412 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3529/6828] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:04:30.710473 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3300/6829] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:30 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:31.717077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:31.717782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:31.725543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:31.726030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:31.726472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:31.727167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:31.727651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:31.728084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:31.877108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:31.890033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-417530e9-5416-4544-b9b5-435359fb5465 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1314 microversion: 2.1 time: 0.177936 Sep 08 11:04:31.890738 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3530/6830] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:31 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:32.915038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:32.915630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:32.922714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:32.923222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:32.923733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:32.924454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:32.924923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:32.925365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:33.057576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:33.066542 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-98603b48-de41-4e15-81e0-a49eff22e5a2 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1499 microversion: 2.1 time: 0.155054 Sep 08 11:04:33.067135 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3301/6831] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:32 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:33.089619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:04:33.091943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:33.099081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:33.099588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:33.100053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:33.100800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:33.101276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:33.101725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:33.178594 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:33.184114 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Old instance type m1.heat2, new instance type m1.heat {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:04:33.190480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:04:33.190900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:04:33.191895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:04:33.192302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:04:33.192709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:04:33.298441 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [28f1ac15-ac9d-4b40-9b96-c88db3e77c67] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:04:33.484819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:34.305884 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [28f1ac15-ac9d-4b40-9b96-c88db3e77c67] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45728. Sep 08 11:04:34.309508 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-674981a6-7f34-4028-a087-db8b42d9ef65 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "POST /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352/action" status: 202 len: 0 microversion: 2.1 time: 1.223936 Sep 08 11:04:34.310126 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3531/6832] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:04:33 2022] POST /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:04:34.318187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:34.318817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:34.320715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:34.321761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:04:34.328679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:34.329188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:34.329644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:34.330396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:34.331116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:34.332056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:34.506226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:34.516092 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-241eaf13-b10a-472a-afe7-3a6bded3fc22 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1508 microversion: 2.1 time: 0.201738 Sep 08 11:04:34.516992 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3302/6833] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:34 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:35.543499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:35.544120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:35.550476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:35.551692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:35.552140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:35.552852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:35.553307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:35.553731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:35.689099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:35.696788 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fd07026-436d-4e0e-8017-2513c83ff364 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1508 microversion: 2.1 time: 0.159430 Sep 08 11:04:35.697372 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3532/6834] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:35 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:04:36.720577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:36.721228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:36.728606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:36.729103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:36.729556 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:36.730265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:36.731126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:36.731243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:36.868420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:36.876225 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6cc6172e-a2c6-4991-8a65-918a0c3f1a75 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.159631 Sep 08 11:04:36.876804 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3303/6835] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:36 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:37.899799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:37.900415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:37.907742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:37.908236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:37.908686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:37.909388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:37.909847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:37.910656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:38.057427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:38.065522 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f04f41fc-5b01-4d3e-9114-411182dd0dbf tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.169592 Sep 08 11:04:38.066114 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3533/6836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:37 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:39.089133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:39.089767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:39.096352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:39.096858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:39.097315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:39.098518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:39.099031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:39.099504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:39.229167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:39.237010 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-55d95504-18d2-432c-851f-d3a0daea2ccc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.151988 Sep 08 11:04:39.237587 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3304/6837] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:39 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:40.261468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:40.262095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:40.269215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.269707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.270154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.270847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:40.271310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:40.271767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:40.405881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:40.414020 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-680483a0-74e9-4db3-a8bc-85e598f00510 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.156521 Sep 08 11:04:40.414598 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3534/6838] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:40 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:41.437649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:41.438272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:41.445726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:41.446226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:41.446676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:41.447380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:41.447884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:41.448323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:41.583571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:41.591386 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bc2966be-076f-4cb5-9837-70084f3d7d42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.157763 Sep 08 11:04:41.592008 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3305/6839] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:41 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:42.614240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:42.614846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:42.621730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:42.622213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:42.622648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:42.623330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:42.623885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:42.624310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:42.762057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:42.770872 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-34cc051d-b829-41b0-a074-95855999a9b7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.160564 Sep 08 11:04:42.771453 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3535/6840] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:42 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:43.794429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:43.795119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:43.802693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:43.803205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:43.803697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:43.804418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:43.804897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:43.805348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:43.938453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:43.946280 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08d4ec41-9d65-4163-9d1d-267be0e893b8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.155837 Sep 08 11:04:43.946860 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3306/6841] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:43 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:44.969825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:44.970458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:44.978913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:44.979391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:44.979854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:44.980543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:44.980992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:44.981703 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:45.117657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:45.125848 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9f0bbf6d-3aa9-4157-ba4e-02a7964742e3 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.159910 Sep 08 11:04:45.126423 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3536/6842] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:44 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:46.149191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:46.149826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:46.157052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:46.157557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:46.158019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:46.158737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:46.159217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:46.159703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:46.624856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:46.634137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b77ce156-5fad-40b0-973c-506c2f5df7ea tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.488802 Sep 08 11:04:46.634735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3307/6843] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:46 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:47.658036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:47.658658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:47.665856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:47.666345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:47.666786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:47.667509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:47.667970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:47.668399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:47.801890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:47.809853 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-20e44469-beaf-415d-8f59-536d6edcae95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.156233 Sep 08 11:04:47.810451 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3537/6844] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:47 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:48.835150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:48.835805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:48.842702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:48.843203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:48.843687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:48.844394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:48.844862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:48.845302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:48.980216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:48.987896 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5fc5f427-11d6-4499-8b50-c999fcf9ab47 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.157397 Sep 08 11:04:48.988468 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3308/6845] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:48 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:50.010331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:50.010942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:50.017835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:50.018318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:50.019006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:50.020233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:50.020685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:50.021111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:50.152062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:50.159761 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5e1a1a9f-5244-453f-8012-459215acc17d tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.153407 Sep 08 11:04:50.160886 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3538/6846] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:50 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:51.183283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:51.183944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:51.190734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:51.191258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:51.191732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:51.192433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:51.192902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:51.193340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:51.326202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:51.334540 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-012613e0-25d0-4372-ac23-818897423744 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.155212 Sep 08 11:04:51.335124 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3309/6847] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:51 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:52.358366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:52.358926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:52.365813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.366306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.366750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:52.367451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:52.367946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:52.368373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:52.500314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:52.508456 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a26dfad3-f02c-41ce-9c70-625b79a7b4ba tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.154139 Sep 08 11:04:52.509033 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3539/6848] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:52 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:53.532454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:53.533106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:53.540512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:53.541027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:53.541494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.542263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:53.542742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:53.543196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:53.681765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:53.690191 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1eb1bc3e-5a2f-45f4-a393-240bd96bc635 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.161864 Sep 08 11:04:53.690757 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3310/6849] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:53 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:54.713611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:54.714235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:54.721034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.721519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.721961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:54.722653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:54.723117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:54.724144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:54.861560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:54.870031 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78ace501-6b02-4f78-b0b8-1c34948410e8 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.160312 Sep 08 11:04:54.870602 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3540/6850] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:54 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:55.893223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:55.894115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:55.901168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:55.901673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:55.902135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:55.902859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:55.903330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:55.903881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:56.039263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:56.048400 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e12733a-6889-47b7-940d-c56d8ef5c80a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.159050 Sep 08 11:04:56.049205 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3311/6851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:55 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:57.072834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:57.073450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:57.080462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:57.080951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:57.081396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:57.082096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:57.082553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:57.082987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:57.218827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:57.226673 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7ac12671-0261-49d4-aa60-3d3de9b3a90f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.157782 Sep 08 11:04:57.227248 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3541/6852] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:57 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:58.249769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:58.250291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:58.257856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:58.258420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:58.258914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:58.259651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:58.260129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:58.260573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:58.393525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:58.401557 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fb0cab9b-1c0c-4f26-82c0-27a59f4b1eb7 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.155776 Sep 08 11:04:58.402152 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3312/6853] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:58 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:04:59.424920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:04:59.425564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:04:59.432393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.432882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.433324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.434015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:04:59.434505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:04:59.434939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:04:59.570372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:04:59.578200 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8542308c-64b2-4eb4-91f9-733498bf6a42 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.157262 Sep 08 11:04:59.578779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3542/6854] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:04:59 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:00.601980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:00.602607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:00.605432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=26 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:00.611239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:00.611776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:00.612239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:00.612965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:00.613447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:00.613899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:00.616819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=78 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:00.753303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:00.762344 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb5de701-665d-4e5b-91de-e1e1c10846a9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.164953 Sep 08 11:05:00.762931 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3313/6855] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:00 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:01.786362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:01.787517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:01.790248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=32 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:01.795963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:01.796489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:01.796933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:01.797639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:01.798098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:01.798531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:01.801183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:01.932379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:01.940172 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-95441e44-e42a-4900-9f62-527bc166ea23 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.157728 Sep 08 11:05:01.940742 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3543/6856] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:01 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:02.963564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:02.964210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:02.972602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:02.973127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:02.973593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:02.974522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:02.974861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:02.975385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:03.118346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:03.126172 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8b6513ed-2c40-441e-9ad6-e96ef6a67b66 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.167737 Sep 08 11:05:03.126756 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3314/6857] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:02 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:04.151913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:04.152535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:04.158623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:04.159214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:04.159701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:04.160410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:04.161765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:04.162207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:04.381332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:04.389138 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2abebae6-4fe5-4493-accf-f46f611d86b6 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.242796 Sep 08 11:05:04.389724 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3544/6858] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:04 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:05.413141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:05.413804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:05.421098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:05.421846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:05.422078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:05.422797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:05.423277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:05.423749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:05.562927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:05.570837 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97a825d5-3a40-407b-aadb-34fc50ae00c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.161762 Sep 08 11:05:05.571415 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3315/6859] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:05 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:06.593667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:06.594263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:06.600816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:06.601299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:06.601746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:06.602436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:06.602891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:06.603319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:06.736073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:06.744390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb53e545-3945-463a-b465-deaa7bbc97ae tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.154775 Sep 08 11:05:06.745014 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3545/6860] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:06 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:07.768753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:07.769415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:07.776858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.777354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.777804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:07.778510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:07.778972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:07.779413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:07.914550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:07.922672 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cc60d5f5-ffc0-4461-8384-5c2cd95764e0 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1513 microversion: 2.1 time: 0.158095 Sep 08 11:05:07.923307 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3316/6861] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:07 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:08.946291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:08.946905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:08.954188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:08.954706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:08.955170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:08.955926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:08.956391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:08.956815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:09.162559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:09.170428 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-818ec644-cf2b-4587-aff1-875b65d318d9 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1512 microversion: 2.1 time: 0.227954 Sep 08 11:05:09.170930 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3546/6862] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:08 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:09.248551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59eed3b5-ac9b-4191-9094-a04a8ba88352", "name": "network-vif-unplugged", "status": "completed", "tag": "fbf3f164-ecca-4971-b701-40ef435f6930"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:09.259068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:09.273891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:09.274424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:09.291564 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] Creating event network-vif-unplugged:fbf3f164-ecca-4971-b701-40ef435f6930 for instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 on n-h2-833090-19 Sep 08 11:05:09.299073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:05:09.317207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9b0e01b5-0da6-4a4d-9a71-ce89dfba16cb req-0b01d539-af68-4406-8e91-0be84f766864 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071998 Sep 08 11:05:09.318436 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3317/6863] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:10.193790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:10.194411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:10.202827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:10.203317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:10.203782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:10.204476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:10.204928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:10.205356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:10.336123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:10.343956 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-abd01d89-51aa-455d-94bd-4318efa6de8f tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1510 microversion: 2.1 time: 0.154213 Sep 08 11:05:10.344532 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3547/6864] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:10 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:11.342703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59eed3b5-ac9b-4191-9094-a04a8ba88352", "tag": "fbf3f164-ecca-4971-b701-40ef435f6930"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:11.353327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.353817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.354264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.368162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:11.368788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:11.369377 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] Creating event network-changed:fbf3f164-ecca-4971-b701-40ef435f6930 for instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 on n-h2-833090-19 Sep 08 11:05:11.375048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:05:11.375618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.376115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.376565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.377270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:11.377892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:11.378328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:11.387008 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ef402472-ca8d-4b90-9472-7462fd5b088b req-550e6c05-c3e0-445a-9b6b-bb52536ace74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049330 Sep 08 11:05:11.388021 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3318/6865] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:11.602183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:11.610379 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0341d934-43b0-4c53-8752-3f5c9ccd4397 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1510 microversion: 2.1 time: 0.246583 Sep 08 11:05:11.610994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3548/6866] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:11 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:05:12.634654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:12.635384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:12.642699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:12.643480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:12.643954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:12.644675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:12.645150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:12.645630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:12.870308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:12.878094 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c510e8d3-d4a8-43ad-b638-ecdbd762c1c4 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1510 microversion: 2.1 time: 0.247791 Sep 08 11:05:12.878685 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3319/6867] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:12 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:13.902730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:13.903385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:13.910076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:13.910563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:13.911002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:13.911781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:13.912241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:13.912673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:14.070811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:14.078732 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ca4d5efc-22f0-4aa9-9b41-89a1eee77add tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1507 microversion: 2.1 time: 0.179949 Sep 08 11:05:14.079313 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3549/6868] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:13 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:14.101468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:14.102098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:14.108459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:14.108955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:14.109403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:14.110104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:14.110572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:14.111009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:14.137146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:05:14.188628 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Found an unconfirmed migration during delete, id: 16, status: finished Sep 08 11:05:15.940447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8292ab71-e0b1-4027-99df-610d783dbd40 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "DELETE /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 204 len: 0 microversion: 2.1 time: 1.842210 Sep 08 11:05:15.941595 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3320/6869] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:05:14 2022] DELETE /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 0 bytes in 1845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:05:15.950327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:15.950942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:15.957918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:15.958449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:15.958891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:15.959635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:15.960094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:15.960521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:16.099877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:16.107754 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e052103c-4d1f-4c05-8ae0-db378c86597c tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1499 microversion: 2.1 time: 0.161279 Sep 08 11:05:16.108337 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3550/6870] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:15 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:17.132504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:17.133233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:17.140384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.140903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.141364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:17.142098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.142579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.143029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:17.285673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e97da58c46647e99f8485fb66d76e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083f1bb7424f4ba6b31af30e11e6e447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:17.287241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-179bbf0f-dca8-4e22-accf-a61b89f89f87 req-928f7887-5321-4ca7-871e-983c95bd37b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59eed3b5-ac9b-4191-9094-a04a8ba88352", "name": "network-vif-plugged", "status": "completed", "tag": "fbf3f164-ecca-4971-b701-40ef435f6930"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:17.294493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e5cd9835-3657-46e6-a1c1-22ad3166e06a tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 200 len: 1499 microversion: 2.1 time: 0.166628 Sep 08 11:05:17.295495 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3321/6871] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:17 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:17.298056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-179bbf0f-dca8-4e22-accf-a61b89f89f87 req-928f7887-5321-4ca7-871e-983c95bd37b4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:17.298542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-179bbf0f-dca8-4e22-accf-a61b89f89f87 req-928f7887-5321-4ca7-871e-983c95bd37b4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:17.298971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-179bbf0f-dca8-4e22-accf-a61b89f89f87 req-928f7887-5321-4ca7-871e-983c95bd37b4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:17.314945 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-179bbf0f-dca8-4e22-accf-a61b89f89f87 req-928f7887-5321-4ca7-871e-983c95bd37b4 service nova] Creating event network-vif-plugged:fbf3f164-ecca-4971-b701-40ef435f6930 for instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 on n-h2-833090-19 Sep 08 11:05:17.320666 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-179bbf0f-dca8-4e22-accf-a61b89f89f87 req-928f7887-5321-4ca7-871e-983c95bd37b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037556 Sep 08 11:05:17.321358 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3551/6872] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:05:18.023289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3398a724-0f5b-4094-aba0-72eb05f8332f req-025a8e13-63ce-45e0-b6b1-5091e664446e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59eed3b5-ac9b-4191-9094-a04a8ba88352", "name": "network-vif-deleted", "tag": "fbf3f164-ecca-4971-b701-40ef435f6930"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:18.034487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3398a724-0f5b-4094-aba0-72eb05f8332f req-025a8e13-63ce-45e0-b6b1-5091e664446e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.035219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3398a724-0f5b-4094-aba0-72eb05f8332f req-025a8e13-63ce-45e0-b6b1-5091e664446e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.035866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3398a724-0f5b-4094-aba0-72eb05f8332f req-025a8e13-63ce-45e0-b6b1-5091e664446e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.049238 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3398a724-0f5b-4094-aba0-72eb05f8332f req-025a8e13-63ce-45e0-b6b1-5091e664446e service nova] Creating event network-vif-deleted:fbf3f164-ecca-4971-b701-40ef435f6930 for instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 on n-h2-833090-19 Sep 08 11:05:18.056603 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3398a724-0f5b-4094-aba0-72eb05f8332f req-025a8e13-63ce-45e0-b6b1-5091e664446e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037497 Sep 08 11:05:18.060658 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3322/6873] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:18.326329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:18.327047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:18.335964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.336452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.336891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.337601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.338055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.338527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.367987 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] HTTP exception thrown: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Request method failure captured: Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 HTTP/1.1 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcw2N03Y3OSsItAiMAax2d0CKe2cHyzmuH97OIt0Eih9uDvY7SU2IOn27bCxn6N8kVUFqG64GRzSn9V22y2EbXg8PD_vOm6vXdzi3Dmbw7wQKPHjdP1hS-7S1h45utD56vuAmrrsIxAkYAlDsw-03h1D7gbIlnHJ4qSwqLja94oQjgQ Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 083f1bb7424f4ba6b31af30e11e6e447 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_083f1bb7424f4ba6b31af30e11e6e447", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 083f1bb7424f4ba6b31af30e11e6e447 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-90017675-project Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7e97da58c46647e99f8485fb66d76e04 Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-90017675-project Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '59eed3b5-ac9b-4191-9094-a04a8ba88352'} Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:18.369665 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Returning 404 to user: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78cb78ec-5e56-421c-bcd7-756400f5180b tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 404 len: 111 microversion: 2.1 time: 0.056145 Sep 08 11:05:18.373952 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3552/6874] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:18 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:05:18.389144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:18.389763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:18.396430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.396909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.397346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.398059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.398534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.398974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.412953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] HTTP exception thrown: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Request method failure captured: Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 HTTP/1.1 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcw2N03Y3OSsItAiMAax2d0CKe2cHyzmuH97OIt0Eih9uDvY7SU2IOn27bCxn6N8kVUFqG64GRzSn9V22y2EbXg8PD_vOm6vXdzi3Dmbw7wQKPHjdP1hS-7S1h45utD56vuAmrrsIxAkYAlDsw-03h1D7gbIlnHJ4qSwqLja94oQjgQ Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 083f1bb7424f4ba6b31af30e11e6e447 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_083f1bb7424f4ba6b31af30e11e6e447", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 083f1bb7424f4ba6b31af30e11e6e447 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-DeleteServersTestJSON-90017675-project Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7e97da58c46647e99f8485fb66d76e04 Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-DeleteServersTestJSON-90017675-project Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '59eed3b5-ac9b-4191-9094-a04a8ba88352'} Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:05:18.414565 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Returning 404 to user: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c33cdb3-0072-4318-8527-f642d747ff95 tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "DELETE /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 404 len: 111 microversion: 2.1 time: 0.032146 Sep 08 11:05:18.418654 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3323/6875] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:05:18 2022] DELETE /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:05:18.424666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:18.425286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] [instance: 59eed3b5-ac9b-4191-9094-a04a8ba88352] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:18.431883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.432366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.432816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.433506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:18.433965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:18.434400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:18.447984 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] HTTP exception thrown: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Request method failure captured: Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 HTTP/1.1 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcw2N03Y3OSsItAiMAax2d0CKe2cHyzmuH97OIt0Eih9uDvY7SU2IOn27bCxn6N8kVUFqG64GRzSn9V22y2EbXg8PD_vOm6vXdzi3Dmbw7wQKPHjdP1hS-7S1h45utD56vuAmrrsIxAkYAlDsw-03h1D7gbIlnHJ4qSwqLja94oQjgQ Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 083f1bb7424f4ba6b31af30e11e6e447 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/083f1bb7424f4ba6b31af30e11e6e447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_083f1bb7424f4ba6b31af30e11e6e447", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 083f1bb7424f4ba6b31af30e11e6e447 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-DeleteServersTestJSON-90017675 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-DeleteServersTestJSON-90017675-project Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7e97da58c46647e99f8485fb66d76e04 Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-DeleteServersTestJSON-90017675-project Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '59eed3b5-ac9b-4191-9094-a04a8ba88352'} Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:05:18.449507 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] Returning 404 to user: Instance 59eed3b5-ac9b-4191-9094-a04a8ba88352 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57e240af-6719-4f64-b722-435a353260fc tempest-DeleteServersTestJSON-90017675 tempest-DeleteServersTestJSON-90017675-project] 10.222.0.59 "GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352" status: 404 len: 111 microversion: 2.1 time: 0.030101 Sep 08 11:05:18.456459 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3553/6876] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:18 2022] GET /compute/v2.1/servers/59eed3b5-ac9b-4191-9094-a04a8ba88352 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:05:26.943179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1096318258", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "efcda757-8e94-4083-a152-9a2cba7fecad"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:27.003160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] validate_networks() for [('efcda757-8e94-4083-a152-9a2cba7fecad', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:05:27.382078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:05:27.382850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:05:27.383348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:05:27.383809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:05:27.384244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:05:27.394013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:27.394513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:27.394972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:27.396331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:27.396809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:27.397247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:27.414941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Getting quotas for project 61f940d92c7e4451becb55926ab815f8. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:05:27.420387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Getting quotas for user 7abb28627d264536895ba4468e7d0f5e and project 61f940d92c7e4451becb55926ab815f8. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:05:27.433605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:05:27.435976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:05:27.482663 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-07a21961-f2a9-4b38-9f73-7e598708444f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667671 Sep 08 11:05:27.483542 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3324/6877] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:05:27.494710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-41b21d20-ad3d-4c57-982e-f83574c29e64 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:27.495330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-41b21d20-ad3d-4c57-982e-f83574c29e64 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:27.554078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-41b21d20-ad3d-4c57-982e-f83574c29e64 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:27.561480 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-41b21d20-ad3d-4c57-982e-f83574c29e64 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1218 microversion: 2.1 time: 0.070591 Sep 08 11:05:27.562061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3554/6878] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:27 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:28.586501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:28.588590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:28.601073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:28.601956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:28.602640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:28.603622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:28.604308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:28.604956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:28.690594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:28.700419 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f1438a4-0bac-4ce7-969b-7f0ce56453d1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1288 microversion: 2.1 time: 0.118902 Sep 08 11:05:28.701353 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3325/6879] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:28 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:29.725303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:29.725923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:29.728900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=53 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:29.736014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:29.736507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:29.736942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:29.737708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:29.738164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:29.738587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:29.952018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:29.970656 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6605773c-1fae-40b4-a0ae-801be865b149 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1318 microversion: 2.1 time: 0.246722 Sep 08 11:05:29.971553 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3555/6880] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:29 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:30.144488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-40c003c4-a9d6-4a24-884d-db84b5b3836e req-788d31b3-69f7-49c4-96d3-6d6a7bec62ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7a05fd-49df-4c90-8d65-99a80bac874d", "tag": "2422fcc4-2b9b-418d-a91b-19440108152f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:30.157275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-40c003c4-a9d6-4a24-884d-db84b5b3836e req-788d31b3-69f7-49c4-96d3-6d6a7bec62ab service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:30.158075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-40c003c4-a9d6-4a24-884d-db84b5b3836e req-788d31b3-69f7-49c4-96d3-6d6a7bec62ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:30.158746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-40c003c4-a9d6-4a24-884d-db84b5b3836e req-788d31b3-69f7-49c4-96d3-6d6a7bec62ab service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:30.172916 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-40c003c4-a9d6-4a24-884d-db84b5b3836e req-788d31b3-69f7-49c4-96d3-6d6a7bec62ab service nova] Creating event network-changed:2422fcc4-2b9b-418d-a91b-19440108152f for instance ef7a05fd-49df-4c90-8d65-99a80bac874d on n-h1-833090-19 Sep 08 11:05:30.179274 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-40c003c4-a9d6-4a24-884d-db84b5b3836e req-788d31b3-69f7-49c4-96d3-6d6a7bec62ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038710 Sep 08 11:05:30.180057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3326/6881] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:30.995686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:30.996299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:31.003311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:31.003836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:31.004282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:31.005347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:31.005810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:31.006264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:31.141720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:31.152804 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-949f8f1f-3a81-4ae9-8b7b-a36deb13f5e2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1318 microversion: 2.1 time: 0.160963 Sep 08 11:05:31.153464 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3556/6882] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:30 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:32.178444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:32.179196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:32.181221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:32.186864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:32.187370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:32.187855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:32.188574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:32.189052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:32.189501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:32.194603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:32.329838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:32.338127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ea94259f-c9d4-4f85-8cb8-8b7968850ae4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1318 microversion: 2.1 time: 0.165462 Sep 08 11:05:32.338700 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3327/6883] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:32 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:33.361138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:33.361666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:33.365048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=30 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:33.370713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:33.371199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:33.371668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:33.372369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:33.372823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:33.373250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:33.503134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:33.512918 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f52f2d3f-38aa-4103-ba7a-f9263333074f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1318 microversion: 2.1 time: 0.155745 Sep 08 11:05:33.513498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3557/6884] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:33 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:34.537892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:34.538518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:34.545394 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:34.545892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:34.546381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:34.547087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:34.547577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:34.548015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:34.681044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:34.691827 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a0dfb2cd-7118-4dc3-bf6f-63356faf332a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1318 microversion: 2.1 time: 0.158460 Sep 08 11:05:34.692660 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3328/6885] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:34 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:34.854230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-00fa1927-201a-4b3f-8044-9fcfa0a00aec req-a141de51-b1b5-43dc-a76d-ebe86d9d2667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7a05fd-49df-4c90-8d65-99a80bac874d", "name": "network-vif-plugged", "status": "completed", "tag": "2422fcc4-2b9b-418d-a91b-19440108152f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:34.866925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-00fa1927-201a-4b3f-8044-9fcfa0a00aec req-a141de51-b1b5-43dc-a76d-ebe86d9d2667 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:34.867417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-00fa1927-201a-4b3f-8044-9fcfa0a00aec req-a141de51-b1b5-43dc-a76d-ebe86d9d2667 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:34.868710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-00fa1927-201a-4b3f-8044-9fcfa0a00aec req-a141de51-b1b5-43dc-a76d-ebe86d9d2667 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:34.881570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-00fa1927-201a-4b3f-8044-9fcfa0a00aec req-a141de51-b1b5-43dc-a76d-ebe86d9d2667 service nova] Creating event network-vif-plugged:2422fcc4-2b9b-418d-a91b-19440108152f for instance ef7a05fd-49df-4c90-8d65-99a80bac874d on n-h1-833090-19 Sep 08 11:05:34.886868 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-00fa1927-201a-4b3f-8044-9fcfa0a00aec req-a141de51-b1b5-43dc-a76d-ebe86d9d2667 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036815 Sep 08 11:05:34.887480 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3558/6886] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:05:35.716327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:35.717126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:35.726888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:35.727393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:35.727958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:35.728585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:35.729054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:35.729495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:35.859367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:35.867844 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dc185615-9db4-47a5-b97d-b81f0809f3f8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1318 microversion: 2.1 time: 0.155442 Sep 08 11:05:35.868425 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3329/6887] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:35 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:05:36.891003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:36.891644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:36.898601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:36.899084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:36.899556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:36.900255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:36.900714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:36.901143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.034928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:37.043319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b4477b5d-0d01-4f9c-bbaf-9082cec5ea51 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1509 microversion: 2.1 time: 0.156829 Sep 08 11:05:37.043934 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3559/6888] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:36 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:37.066881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:37.067598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.074620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.075120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.075604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.076347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.076822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.077265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.209367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:37.218829 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f5e6f48-98d0-4085-a7bd-9b59c3e171bd tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1509 microversion: 2.1 time: 0.155891 Sep 08 11:05:37.219415 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3330/6889] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:37 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:37.242124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:37.244562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.250941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.251420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.251888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.252599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.253045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.253465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.330063 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e59d4e28-6e62-4f1f-b062-750056050639 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "PUT /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1081 microversion: 2.1 time: 0.092395 Sep 08 11:05:37.330704 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3560/6890] 10.222.0.59 () {60 vars in 1256 bytes} [Thu Sep 8 11:05:37 2022] PUT /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1081 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:37.349512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:37.350151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.356177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.356682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.357140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.357854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.358331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.358778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.404974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:37.427803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:37.495385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:37.503265 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-715463bc-0d3d-46cf-be86-3466f460927a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1507 microversion: 2.1 time: 0.158094 Sep 08 11:05:37.503897 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3331/6891] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:37 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:37.525605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:37.526226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.532499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.532987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.533429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.534117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.534573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.535003 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.559525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:37.671250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:37.679144 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9e8ef86d-d4e4-44ec-ab04-74e900d614f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1507 microversion: 2.1 time: 0.157312 Sep 08 11:05:37.679676 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3561/6892] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:37 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:37.702986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:05:37.705300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.711774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.712270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.712717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.713419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.713880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.714319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.743129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:37.749093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:05:37.756401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:05:37.756840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:05:37.757323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:05:37.757741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:05:37.758165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:05:37.829805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-da222ae4-a509-4df6-825c-154701ec48e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d/action" status: 202 len: 0 microversion: 2.1 time: 0.130673 Sep 08 11:05:37.830429 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3332/6893] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:05:37 2022] POST /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:05:37.839379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:37.840029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:37.846622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.847123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.847592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:37.848454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:37.848927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:37.849347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:38.018652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:38.028263 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7874d1ef-e20f-4bd1-9031-509f12261790 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1518 microversion: 2.1 time: 0.192915 Sep 08 11:05:38.028866 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3562/6894] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:37 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:05:39.052602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:39.052967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:39.060130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:39.060645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:39.061106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:39.061838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:39.062314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:39.062766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:39.636551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:39.650561 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac2c0157-8376-4528-8de6-2763851c4fd3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1518 microversion: 2.1 time: 0.604023 Sep 08 11:05:39.651183 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3333/6895] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:39 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1518 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:40.674250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:40.674875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:40.681771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:40.682257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:40.682696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:40.683384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:40.683889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:40.684320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:40.817113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:40.824919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-012b0029-6dd7-4f4e-8074-737e92870aaf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.154612 Sep 08 11:05:40.825494 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3563/6896] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:40 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:41.849744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:41.850297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:41.857292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:41.858332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:41.858803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:41.859549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:41.860030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:41.860479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:41.991060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:41.998962 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa26b1d8-bce8-4a0d-8985-400857732a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.153802 Sep 08 11:05:41.999570 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3334/6897] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:41 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:43.022304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:43.022916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:43.030027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:43.030557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:43.031002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:43.031757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:43.032216 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:43.032650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:43.169955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:43.178573 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e471cc2-e3ca-46de-9b7f-e862ffda5bcf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.160482 Sep 08 11:05:43.179163 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3564/6898] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:43 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:44.201790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:44.202353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:44.209165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:44.209669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:44.210125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:44.210835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:44.211304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:44.211780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:44.340827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:44.348637 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f36c743-8e1b-4d69-a9ba-8a166b82c8f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.150867 Sep 08 11:05:44.349217 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3335/6899] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:44 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:45.374328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:45.374999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:45.381900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:45.382386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:45.382829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:45.383556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:45.384014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:45.384446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:45.517374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:45.525915 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4c5dddce-0942-420f-9d56-9dacf9fa07ce tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.155868 Sep 08 11:05:45.526491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3565/6900] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:45 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:46.548558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:46.549208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:46.556256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:46.556762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:46.557218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:46.557936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:46.558415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:46.558859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:46.688760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:46.696649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a67489dd-0b79-4784-b49e-8fe863485c26 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.152094 Sep 08 11:05:46.697232 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3336/6901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:46 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:47.720070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:47.720674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:47.728400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:47.728887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:47.729329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:47.730030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:47.730486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:47.730920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:47.870387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:47.878185 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-da576a67-a93c-4fea-a2fa-3ec884f22046 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.161988 Sep 08 11:05:47.878767 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3566/6902] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:47 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:48.901131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:48.901764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:48.908862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:48.909367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:48.909827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:48.910551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:48.911029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:48.911480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:49.062406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:49.070630 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dd30ee0a-81f6-44e2-8270-4804764ccf56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.173779 Sep 08 11:05:49.071616 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3337/6903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:48 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:50.093725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:50.094373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:50.101205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:50.101696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:50.102143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:50.102840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:50.103299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:50.103756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:50.233233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:50.241720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-06f77a10-4216-4c79-aaf8-1ce6e9626c03 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.151927 Sep 08 11:05:50.242307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3567/6904] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:50 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:51.265538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:51.266073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:51.273911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.274427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.274877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.275635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:51.276112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:51.276561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:51.412157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:51.419897 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a1ac0c62-720a-4dce-8238-4699e0f056af tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.158366 Sep 08 11:05:51.420480 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3338/6905] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:51 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:52.442945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:52.443617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:52.450582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:52.451068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:52.451676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:52.452377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:52.452834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:52.453262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:52.583334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:52.591110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3947e2c9-ab98-45fb-a675-422fd0e838e8 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.152255 Sep 08 11:05:52.591715 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3568/6906] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:52 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:53.615060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:53.615717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:53.622624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:53.623120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:53.623614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:53.624330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:53.624806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:53.625249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:53.759806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:53.767974 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-644ace4c-83d8-4c38-8995-dab7568d1ecc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.157212 Sep 08 11:05:53.768559 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3339/6907] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:53 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:54.790311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:54.790921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:54.797857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:54.798278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:54.798720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:54.799406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:54.799886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:54.800312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:54.932509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:54.940611 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3120a30-b3c2-4df0-b1d6-8df8b7ca4775 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.154245 Sep 08 11:05:54.941199 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3569/6908] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:54 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:55.964246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:55.964927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:55.971801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:55.972296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:55.972746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:55.973447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:55.973913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:55.974347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:56.111238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:56.119014 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2294c29a-18a8-40d8-854e-356f72b6603d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.158726 Sep 08 11:05:56.119612 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3340/6909] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:55 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:57.143256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:57.143933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:57.150842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:57.151322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:57.151800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:57.152500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:57.152957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:57.153390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:57.288505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:57.296369 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-326959aa-a96e-4ec7-8827-f96b0422d9b1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.157315 Sep 08 11:05:57.296959 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3570/6910] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:57 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:58.321071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:58.321641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:58.328944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:58.329448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:58.329934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:58.330650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:58.331117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:58.331627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:58.462925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:58.470749 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3bb5a4d2-6aa2-4c2d-a777-20c801f31fea tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.154257 Sep 08 11:05:58.471326 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3341/6911] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:58 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:05:59.492782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:05:59.493370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:05:59.500335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:59.500807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:59.501268 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:59.501955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:05:59.502407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:05:59.502828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:05:59.522414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:05:59.639602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:05:59.648756 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cd62d7c3-2ee4-4d48-87f0-73122f09fba9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.159796 Sep 08 11:05:59.649362 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3571/6912] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:05:59 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:00.674398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:00.675024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:00.682113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:00.682609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:00.683066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:00.683803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:00.684283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:00.684726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:00.699617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:00.820831 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:00.828904 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e84745cd-54c7-43e6-b88e-2b66e9b23991 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.158494 Sep 08 11:06:00.829482 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3342/6913] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:00 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:01.853133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:01.853752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:01.860681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:01.861172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:01.861615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:01.862317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:01.862773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:01.863227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:02.000458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:02.008286 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ab6e2b9-59ed-4e11-abfc-38beefb38979 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.159099 Sep 08 11:06:02.008877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3572/6914] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:01 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:03.031877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:03.032494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:03.035166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:03.040467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:03.040963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:03.041411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:03.042151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:03.042616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:03.043053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:03.179372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:03.187241 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-91e41f66-f321-4357-b542-50bb55cc172a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.159319 Sep 08 11:06:03.187870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3343/6915] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:03 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:04.212279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:04.212812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:04.214633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=32 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:04.220348 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:04.220840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:04.221285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:04.221982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:04.222440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:04.222870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:04.364406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:04.372208 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3e06a133-3384-4c16-aa94-5d771d7791ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.165397 Sep 08 11:06:04.372784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3573/6916] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:04 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:05.395963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:05.396523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:05.403407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:05.403942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:05.404401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:05.405121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:05.405596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:05.406043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:05.546754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:05.555400 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81e0924c-9e3e-43c7-94b7-876ae31a33f3 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.163701 Sep 08 11:06:05.556003 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3344/6917] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:05 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:06.578338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:06.578982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:06.586452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:06.586942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:06.587386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:06.588106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:06.588567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:06.588997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:06.720972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:06.728796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b353fc87-a6ce-4ffc-abac-7943422658f0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.154361 Sep 08 11:06:06.729377 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3574/6918] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:06 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:07.753098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:07.754490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:07.761884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:07.762610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:07.762832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:07.763576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:07.764067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:07.764501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:07.904451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:07.912318 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5e08dcaa-617d-4d95-ae57-3bc899477891 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.163193 Sep 08 11:06:07.912902 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3345/6919] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:07 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:08.935952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:08.936565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:08.943522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:08.944006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:08.944443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:08.945132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:08.945586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:08.946012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:09.081237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:09.089522 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b3a62a8-8f66-444e-afd5-99831e9d7059 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.157481 Sep 08 11:06:09.090093 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3575/6920] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:08 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:10.114317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:10.114981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:10.121576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:10.122083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:10.122546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:10.123265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:10.123771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:10.124224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:10.252963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:10.260750 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6529deb-abc6-49fb-bcaf-1fa6a3ace1ae tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.151191 Sep 08 11:06:10.261325 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3346/6921] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:10 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:11.284468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:11.285056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:11.291974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:11.292448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:11.292884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:11.293571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:11.294020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:11.294445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:11.427418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:11.435984 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e8ca7ccc-4ccd-49bd-99ad-14430d0927a4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1523 microversion: 2.1 time: 0.155689 Sep 08 11:06:11.436571 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3576/6922] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:11 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:12.459837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:12.460437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:12.467958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:12.468449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:12.468956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:12.469671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:12.470164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:12.470605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:12.667385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7a05fd-49df-4c90-8d65-99a80bac874d", "name": "network-vif-unplugged", "status": "completed", "tag": "2422fcc4-2b9b-418d-a91b-19440108152f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:12.677907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:12.678388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:12.678819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:12.682102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:12.691263 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] Creating event network-vif-unplugged:2422fcc4-2b9b-418d-a91b-19440108152f for instance ef7a05fd-49df-4c90-8d65-99a80bac874d on n-h2-833090-19 Sep 08 11:06:12.692066 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1265a0c4-3cad-4086-ab50-c6d020619e56 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1522 microversion: 2.1 time: 0.236322 Sep 08 11:06:12.693044 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3347/6923] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:12 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:12.697994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] Instance ef7a05fd-49df-4c90-8d65-99a80bac874d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:06:12.709689 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ec80d9dc-87da-4bd9-859e-07d61143b641 req-231d39d4-86cd-4234-bebb-59137ee264b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046021 Sep 08 11:06:12.710392 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3577/6924] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:06:13.716121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:13.716755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:13.724656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:13.725167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:13.725739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:13.726464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:13.726939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:13.727388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:13.860414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:13.869439 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bec05c32-ee28-4726-a0bb-760eb95368d2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1520 microversion: 2.1 time: 0.157277 Sep 08 11:06:13.870010 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3348/6925] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:13 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:14.737726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef7a05fd-49df-4c90-8d65-99a80bac874d", "tag": "2422fcc4-2b9b-418d-a91b-19440108152f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:14.747828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:14.748298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:14.748725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:14.760259 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] Creating event network-changed:2422fcc4-2b9b-418d-a91b-19440108152f for instance ef7a05fd-49df-4c90-8d65-99a80bac874d on n-h2-833090-19 Sep 08 11:06:14.765546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] Instance ef7a05fd-49df-4c90-8d65-99a80bac874d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:06:14.776698 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-a2e099ce-dd7f-48c6-9e21-05d3b18b539e req-0a8b9ff3-4a6e-44c6-8335-9f70fdfcd1e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043904 Sep 08 11:06:14.777309 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3578/6926] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:06:14.893199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:14.893859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:14.901016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:14.901525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:14.901984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:14.902708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:14.903183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:14.903664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:15.139075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:15.147133 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-323b2abf-07ed-4a9f-b626-56a5af7e218a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1520 microversion: 2.1 time: 0.258326 Sep 08 11:06:15.147746 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3349/6927] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:14 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:16.171104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:16.171825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:16.178584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:16.179070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:16.179536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:16.180228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:16.180687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:16.181115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:16.354982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:16.363076 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-efe81b90-c7da-41f4-a879-b55f0d834c12 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1520 microversion: 2.1 time: 0.197065 Sep 08 11:06:16.364303 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3579/6928] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:16 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:17.386523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:17.387308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:17.394914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.395428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.395917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.396653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.397468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.397927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.602364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:17.610726 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-05cec604-cb3b-4892-b547-3025dfe2bb7f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1517 microversion: 2.1 time: 0.228013 Sep 08 11:06:17.611645 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3350/6929] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:17 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:17.634228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:17.635392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:17.642180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.642921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.643355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.644384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.644803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.645228 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.709531 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a4ae5a7-85ee-4446-9f21-a0024b718209 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d/action" status: 204 len: 0 microversion: 2.1 time: 0.078964 Sep 08 11:06:17.710269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3580/6930] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:06:17 2022] POST /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:06:17.718372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:17.719008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:17.725549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.726176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.726658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:17.727476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:17.727974 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:17.728416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:18.303806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:18.311785 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-84edc8f8-b0e5-4d3d-afd7-7cc2bf8d5451 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1517 microversion: 2.1 time: 0.597253 Sep 08 11:06:18.312374 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3351/6931] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:17 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1517 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:19.335719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:19.336464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:19.344555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.345097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.345599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:19.346318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.346776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.347210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:19.504735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:19.512811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-507be6c9-9053-4dc3-a588-cdb2776cccbf tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1509 microversion: 2.1 time: 0.182013 Sep 08 11:06:19.513489 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3581/6932] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:19 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:19.536522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:19.538136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:19.544877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.545383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.545838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:19.546564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.547031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.547487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:19.604822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-5e9c7cb6-c672-4208-93c8-f3b5e4b9f311 req-c2b1aacf-7bda-4dbe-9783-773885f24f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7a05fd-49df-4c90-8d65-99a80bac874d", "name": "network-vif-plugged", "status": "completed", "tag": "2422fcc4-2b9b-418d-a91b-19440108152f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:19.616146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5e9c7cb6-c672-4208-93c8-f3b5e4b9f311 req-c2b1aacf-7bda-4dbe-9783-773885f24f03 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:19.616635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5e9c7cb6-c672-4208-93c8-f3b5e4b9f311 req-c2b1aacf-7bda-4dbe-9783-773885f24f03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:19.617315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-5e9c7cb6-c672-4208-93c8-f3b5e4b9f311 req-c2b1aacf-7bda-4dbe-9783-773885f24f03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:19.628811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-5e9c7cb6-c672-4208-93c8-f3b5e4b9f311 req-c2b1aacf-7bda-4dbe-9783-773885f24f03 service nova] Creating event network-vif-plugged:2422fcc4-2b9b-418d-a91b-19440108152f for instance ef7a05fd-49df-4c90-8d65-99a80bac874d on n-h2-833090-19 Sep 08 11:06:19.634390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-5e9c7cb6-c672-4208-93c8-f3b5e4b9f311 req-c2b1aacf-7bda-4dbe-9783-773885f24f03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033618 Sep 08 11:06:19.635357 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3582/6933] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:06:19.690423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:19.699012 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b705eccb-1ac9-4c17-8989-6e1e4569b0d4 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1509 microversion: 2.1 time: 0.166397 Sep 08 11:06:19.699630 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3352/6934] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:19 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:19.725229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0d750c87-dd07-493d-a654-7b1035642253 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'create', calling method: .version_select at 0x7f2350987160>, body: {"keypair": {"name": "tempest-keypair-1073173472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxjzmGfmmJ+Aq70wdivMylnPkcBFDC5Di1Y3lhYr+c/qUW8en2eDH102/CHi1Gxzgz6d6uCUGhO2UhvbFqM2zWLDj12LP0xHU1YEsSMDDntXb5yQSeFMoEe6d6hC+B5og=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:19.741574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0d750c87-dd07-493d-a654-7b1035642253 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Getting quotas for project 61f940d92c7e4451becb55926ab815f8. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:06:19.746699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-0d750c87-dd07-493d-a654-7b1035642253 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Getting quotas for user 7abb28627d264536895ba4468e7d0f5e and project 61f940d92c7e4451becb55926ab815f8. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:06:19.761000 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d750c87-dd07-493d-a654-7b1035642253 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [dcede2e2-00be-4640-97df-519dabdb8975] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:06:20.771847 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d750c87-dd07-493d-a654-7b1035642253 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [dcede2e2-00be-4640-97df-519dabdb8975] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 46058. Sep 08 11:06:20.789251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0d750c87-dd07-493d-a654-7b1035642253 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.068695 Sep 08 11:06:20.789865 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3583/6935] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:06:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:06:22.023420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:22.024064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:22.026860 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:06:22.027012 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:06:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d (ip 10.222.0.59) !!! Sep 08 11:06:22.036210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.036711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.037166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.037883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.038362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.038808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.178641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:22.186570 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f0a29b4-cd06-440a-969c-723f15b2c3c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 200 len: 1509 microversion: 2.1 time: 0.167725 Sep 08 11:06:22.187155 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3353/6936] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:22 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:22.209423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:22.210037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:22.217670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.218148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.218581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.219270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.219753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.220204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.244813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:06:22.327041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-838fffce-8f99-4934-9b64-8309ee6056e6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 204 len: 0 microversion: 2.1 time: 0.121793 Sep 08 11:06:22.328061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3584/6937] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:06:22 2022] DELETE /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:06:22.392708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-435931837", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "efcda757-8e94-4083-a152-9a2cba7fecad"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:22.445498 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] validate_networks() for [('efcda757-8e94-4083-a152-9a2cba7fecad', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:06:22.818128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:06:22.818573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:06:22.819070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:06:22.819527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:06:22.819963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:06:22.829365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.829877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.830340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.831121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:22.831640 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:22.832092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:22.848846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Getting quotas for project 61f940d92c7e4451becb55926ab815f8. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:06:22.854673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Getting quotas for user 7abb28627d264536895ba4468e7d0f5e and project 61f940d92c7e4451becb55926ab815f8. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:06:22.867617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:06:22.869943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:06:22.915834 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cb4e8464-2a5b-4505-a90e-83e89fdca17f tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527189 Sep 08 11:06:22.916421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3354/6938] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:06:22.928961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-31735872-c8cf-464d-9208-708aea14bd1a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:22.929666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-31735872-c8cf-464d-9208-708aea14bd1a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:22.989098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-31735872-c8cf-464d-9208-708aea14bd1a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:22.996751 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-31735872-c8cf-464d-9208-708aea14bd1a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1217 microversion: 2.1 time: 0.072967 Sep 08 11:06:22.997340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3585/6939] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:22 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:24.021457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:24.022102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:24.028983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:24.029489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:24.029948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:24.030666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:24.031306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:24.031797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:24.108209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:24.116551 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-78c220eb-5b18-4aaa-af11-25a62366b3d9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1269 microversion: 2.1 time: 0.100920 Sep 08 11:06:24.117325 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3355/6940] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:24 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:24.590492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8722636c-82df-4efd-ac5c-e7e31c1c2c64 req-2d5dbfa5-5625-43ce-ac7b-eada35f03ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef7a05fd-49df-4c90-8d65-99a80bac874d", "name": "network-vif-deleted", "tag": "2422fcc4-2b9b-418d-a91b-19440108152f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:24.602108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8722636c-82df-4efd-ac5c-e7e31c1c2c64 req-2d5dbfa5-5625-43ce-ac7b-eada35f03ba2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:24.602723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8722636c-82df-4efd-ac5c-e7e31c1c2c64 req-2d5dbfa5-5625-43ce-ac7b-eada35f03ba2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:24.603227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8722636c-82df-4efd-ac5c-e7e31c1c2c64 req-2d5dbfa5-5625-43ce-ac7b-eada35f03ba2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:24.614441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8722636c-82df-4efd-ac5c-e7e31c1c2c64 req-2d5dbfa5-5625-43ce-ac7b-eada35f03ba2 service nova] Creating event network-vif-deleted:2422fcc4-2b9b-418d-a91b-19440108152f for instance ef7a05fd-49df-4c90-8d65-99a80bac874d on n-h2-833090-19 Sep 08 11:06:24.619753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8722636c-82df-4efd-ac5c-e7e31c1c2c64 req-2d5dbfa5-5625-43ce-ac7b-eada35f03ba2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128079 Sep 08 11:06:24.620601 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3586/6941] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:06:25.141292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:25.143064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:25.153701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:25.154217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:25.154662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:25.155377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:25.155870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:25.156311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:25.348613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:25.356623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-327237bc-da15-4e0b-a7f2-ccceac18ba9c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.219704 Sep 08 11:06:25.357207 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3356/6942] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:25 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:26.383831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:26.384529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:26.391491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:26.392002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:26.392704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:26.393429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:26.393887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:26.394319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:26.609575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:26.618036 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b5a83b0-5b79-42f1-bf55-7f222273e186 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.241249 Sep 08 11:06:26.633375 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3587/6943] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:26 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:26.644828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c3a63dfa-6af7-485d-91e8-c59ebe01ec45 req-9cb9315e-d963-46fa-b60f-b1af015cd94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d46dae7-2482-4906-83ec-6923a6b91881", "tag": "ec80cd14-49e1-4293-be04-52718ff50e89"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:26.655727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c3a63dfa-6af7-485d-91e8-c59ebe01ec45 req-9cb9315e-d963-46fa-b60f-b1af015cd94e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:26.656230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c3a63dfa-6af7-485d-91e8-c59ebe01ec45 req-9cb9315e-d963-46fa-b60f-b1af015cd94e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:26.656680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c3a63dfa-6af7-485d-91e8-c59ebe01ec45 req-9cb9315e-d963-46fa-b60f-b1af015cd94e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:26.669618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c3a63dfa-6af7-485d-91e8-c59ebe01ec45 req-9cb9315e-d963-46fa-b60f-b1af015cd94e service nova] Creating event network-changed:ec80cd14-49e1-4293-be04-52718ff50e89 for instance 3d46dae7-2482-4906-83ec-6923a6b91881 on n-h2-833090-19 Sep 08 11:06:26.674774 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c3a63dfa-6af7-485d-91e8-c59ebe01ec45 req-9cb9315e-d963-46fa-b60f-b1af015cd94e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033919 Sep 08 11:06:26.675483 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3357/6944] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:06:27.642078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:27.642971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:27.650181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:27.650665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:27.651105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:27.651905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:27.652359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:27.652789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:27.787294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:27.795011 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c66d528f-e57e-4bc9-98d5-b21226fd0cd6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.156976 Sep 08 11:06:27.795633 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3588/6945] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:27 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:28.819583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:28.820313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:28.826874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:28.827385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:28.827890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:28.828604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:28.829123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:28.829536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:29.066891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:29.075205 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17d497a6-4a50-4e41-aad9-89a86b6e159d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.261149 Sep 08 11:06:29.075895 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3358/6946] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:28 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:06:30.098764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:30.099369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:30.106495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:30.106984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:30.107425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:30.108150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:30.108604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:30.109030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:30.111698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:30.241972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:30.250700 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf106d13-4b27-44d1-a76d-c915fcc9a929 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.155859 Sep 08 11:06:30.251278 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3589/6947] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:30 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:31.274682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:31.275300 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:31.282207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:31.282711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:31.283166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:31.283902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:31.284370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:31.284814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:31.287493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=92 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:31.417190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:31.425003 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce1f7683-507c-41db-9d9a-6972fefab3eb tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.154916 Sep 08 11:06:31.425584 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3359/6948] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:31 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:32.448395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:32.449014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:32.456094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:32.456583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:32.457026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:32.457721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:32.458672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:32.459099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:32.588741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:32.596435 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-93f0db87-d722-426f-8666-4c2231447853 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.151954 Sep 08 11:06:32.597013 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3590/6949] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:32 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:33.618923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:33.623830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:33.623830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:33.623830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:33.623830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:33.630984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:33.631521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:33.631988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:33.632723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:33.633201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:33.633703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:33.647957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-89a756cb-e408-49d1-a2ff-bc6b9c2bd04b req-35e9c87f-f2c3-40a1-89ca-288b7e40fcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d46dae7-2482-4906-83ec-6923a6b91881", "name": "network-vif-plugged", "status": "completed", "tag": "ec80cd14-49e1-4293-be04-52718ff50e89"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:33.655377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:33.661459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89a756cb-e408-49d1-a2ff-bc6b9c2bd04b req-35e9c87f-f2c3-40a1-89ca-288b7e40fcb6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:33.661953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89a756cb-e408-49d1-a2ff-bc6b9c2bd04b req-35e9c87f-f2c3-40a1-89ca-288b7e40fcb6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:33.662391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-89a756cb-e408-49d1-a2ff-bc6b9c2bd04b req-35e9c87f-f2c3-40a1-89ca-288b7e40fcb6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:33.674101 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-89a756cb-e408-49d1-a2ff-bc6b9c2bd04b req-35e9c87f-f2c3-40a1-89ca-288b7e40fcb6 service nova] Creating event network-vif-plugged:ec80cd14-49e1-4293-be04-52718ff50e89 for instance 3d46dae7-2482-4906-83ec-6923a6b91881 on n-h2-833090-19 Sep 08 11:06:33.680294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-89a756cb-e408-49d1-a2ff-bc6b9c2bd04b req-35e9c87f-f2c3-40a1-89ca-288b7e40fcb6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037021 Sep 08 11:06:33.681624 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3591/6950] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:06:33.779987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:33.787888 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dd9ff98-bd2b-46d4-b3e8-78ae29140e78 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.173494 Sep 08 11:06:33.788491 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3360/6951] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:33 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:34.813458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:34.814166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:34.816164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:06:34.822486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:34.822978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:34.823422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:34.824151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:34.824609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:34.825046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:34.960708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:34.968604 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e56e21f-c903-4bf8-9dad-9a7d027fb2c2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1317 microversion: 2.1 time: 0.160402 Sep 08 11:06:34.969176 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3592/6952] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:34 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:35.992114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:35.993563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:36.003612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.004127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.004627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.005322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.005799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.006251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.139754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:36.148333 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b992f8ac-a8c9-4120-b0bc-e46f833ce5ec tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1507 microversion: 2.1 time: 0.160591 Sep 08 11:06:36.148916 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3361/6953] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:35 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:36.171576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:36.172205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:36.178724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.179207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.179677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.180367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.180820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.181245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.307307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:36.315407 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a0309438-9812-4381-9638-b2e0d7a96d52 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1507 microversion: 2.1 time: 0.147928 Sep 08 11:06:36.316029 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3593/6954] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:36 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:36.338569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:06:36.341085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:36.347270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.347803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.348277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.348967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.349439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.349883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.380912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:36.387323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:06:36.394255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:06:36.394694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:06:36.395799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:06:36.396257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:06:36.396689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:06:36.459994 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-413e4317-86d8-45b6-8caf-c0d036712b59 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881/action" status: 202 len: 0 microversion: 2.1 time: 0.124934 Sep 08 11:06:36.460773 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3362/6955] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:06:36 2022] POST /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:06:36.469387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:36.470188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:36.477882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.478718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.479302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.480291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:36.481006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:36.481653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:36.643574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:36.651745 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ed6e960-ae4d-450c-8e1b-5b7cb0e1503b tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1514 microversion: 2.1 time: 0.186434 Sep 08 11:06:36.652127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3594/6956] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:36 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:37.676443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:37.677079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:37.684474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:37.684990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:37.685608 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:37.686567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:37.687046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:37.687584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:37.904090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:37.912817 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c6f448d-cef0-4efc-8d3b-cceb61528e8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1514 microversion: 2.1 time: 0.241711 Sep 08 11:06:37.913512 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3363/6957] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:37 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:38.936916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:38.937529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:38.945045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:38.945541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:38.945979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:38.946681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:38.947132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:38.947587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:39.085088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:39.093071 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b681547-d625-4b92-845c-33f3e7098b35 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.160050 Sep 08 11:06:39.093631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3595/6958] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:38 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:40.117354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:40.118018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:40.124518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:40.125022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:40.125482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:40.126196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:40.126671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:40.127119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:40.256673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:40.264692 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f6874bd5-23cb-4396-b759-f16b28d06056 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.152101 Sep 08 11:06:40.265419 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3364/6959] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:40 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:41.288130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:41.288751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:41.295631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:41.296113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:41.296549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:41.297239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:41.297692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:41.298118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:41.438004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:41.446337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7eab6f89-857a-4cbd-aa74-aa05c3ae6d9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.162127 Sep 08 11:06:41.446912 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3596/6960] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:41 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:42.469522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:42.470188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:42.477105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:42.477613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:42.478078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:42.478797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:42.479271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:42.479748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:42.613714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:42.622054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2ed32fbe-f1a6-4b00-905b-2632ce2c8606 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.156495 Sep 08 11:06:42.622632 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3365/6961] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:42 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:43.645495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:43.646131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:43.653019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:43.653494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:43.653928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:43.654608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:43.655054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:43.655502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:43.795761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:43.804211 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3cb18137-dbf4-4eba-b0f2-0b52686518bc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.162923 Sep 08 11:06:43.804784 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3597/6962] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:43 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:44.827968 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:44.828623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:44.835582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:44.836088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:44.836548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:44.837259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:44.837732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:44.838177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:44.972056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:44.979936 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2041bdf4-4912-4645-94ca-db3c78b93bf9 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.155906 Sep 08 11:06:44.980511 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3366/6963] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:44 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:46.003684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:46.004301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:46.011412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:46.011924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:46.012367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:46.013063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:46.013514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:46.013941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:46.144056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:46.152595 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a516b9d-98ce-4240-a0c9-a75c8dc552f1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.153065 Sep 08 11:06:46.153175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3598/6964] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:45 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:47.175109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:47.175773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:47.182732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:47.183237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:47.183724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:47.184441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:47.184972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:47.185422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:47.319928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:47.327741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e21a95b8-3302-4508-81de-f1b7fd60478d tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.156533 Sep 08 11:06:47.328327 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3367/6965] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:47 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:48.351743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:48.352256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:48.359033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:48.359544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:48.360004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:48.360692 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:48.361178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:48.361605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:48.490584 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:48.498413 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-be1e746e-28d3-43db-a9c0-683bb62eeaa2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.151203 Sep 08 11:06:48.498998 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3599/6966] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:48 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:49.521906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:49.522543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:49.529520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:49.530024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:49.530486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:49.531210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:49.531721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:49.532176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:49.667808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:49.675662 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3dadcf89-688e-4477-b4bf-ef94045009c1 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.157739 Sep 08 11:06:49.676241 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3368/6967] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:49 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:50.698959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:50.699591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:50.706392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:50.706871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:50.707303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:50.708011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:50.708458 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:50.708918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:50.848787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:50.857212 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-40a6791f-9eef-44d3-9077-a440354e6b1c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.162117 Sep 08 11:06:50.857785 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3600/6968] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:50 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:51.879254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:51.879930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:51.887610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:51.888121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:51.888579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:51.889299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:51.889770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:51.890221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:52.023589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:52.031805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-14f2d427-2009-4c72-a843-76e3a793450c tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.156525 Sep 08 11:06:52.032390 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3369/6969] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:51 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:53.055926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:53.056544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:53.063610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:53.064107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:53.064547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:53.065253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:53.065713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:53.066141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:53.199636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:53.207372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c5f0367f-c716-4f67-b52d-1c28c4ded865 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.155937 Sep 08 11:06:53.207975 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3601/6970] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:53 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:54.230978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:54.231548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:54.238469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:54.238981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:54.239444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:54.240192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:54.240667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:54.241117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:54.370818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:54.378935 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d63d4db-1104-41a5-9690-9b2b437fad0a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.152041 Sep 08 11:06:54.379538 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3370/6971] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:54 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:55.402958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:55.403522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:55.410521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:55.411009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:55.411449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:55.412166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:55.412625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:55.413055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:55.545757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:55.554207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7034502f-f498-4143-93fc-b5065917c064 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.154792 Sep 08 11:06:55.554774 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3602/6972] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:55 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:56.579487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:56.580119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:56.587239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:56.588475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:56.588940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:56.589671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:56.590144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:56.590596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:56.718841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:56.726646 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-75e99351-39f1-4a2d-85aa-c3ad47eaf40e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.151568 Sep 08 11:06:56.727224 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3371/6973] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:56 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:57.749545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:57.750307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:57.757061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:57.757549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:57.757993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:57.758728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:57.759182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:57.759650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:57.893640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:57.902629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b2dcbbc-09f2-4ea3-a575-ce19bbf259ff tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.156976 Sep 08 11:06:57.903823 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3603/6974] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:57 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:06:58.927395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:06:58.928050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:06:58.935001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:58.935527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:58.935980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:58.936685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:06:58.937152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:06:58.937592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:06:59.069379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:06:59.078586 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5dd3671a-ab68-4be6-bfc1-85f9ecd09a76 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.155072 Sep 08 11:06:59.079182 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3372/6975] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:06:58 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:00.102288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:00.102909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:00.110407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:00.110898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:00.111341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:00.112067 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:00.112527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:00.112961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:00.240535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:00.242754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=90 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:00.250279 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4368fff0-9f22-4e26-aaca-130d0f3a6bbc tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.151938 Sep 08 11:07:00.250849 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3604/6976] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:00 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:01.273939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:01.274572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:01.281821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:01.282337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:01.282794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:01.283548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:01.284024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:01.284467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:01.299479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:01.420107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:01.427996 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58c5a4f5-1c00-43b9-837c-7e7decd13b6a tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.158000 Sep 08 11:07:01.428577 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3373/6977] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:01 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:02.452109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:02.452783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:02.459961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:02.460442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:02.460886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:02.461581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:02.462042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:02.462470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:02.593150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:02.600926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4eaf4b95-d97a-478e-ad11-efee4d4b3961 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.153381 Sep 08 11:07:02.601502 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3605/6978] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:02 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:03.623351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:03.624050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:03.631034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:03.631586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:03.632046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:03.632765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:03.633239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:03.633687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:03.769934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:03.779843 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d75499d-a654-4db9-9951-0731ee251843 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.158696 Sep 08 11:07:03.780445 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3374/6979] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:03 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:04.802767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:04.803407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:04.810803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:04.811307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:04.811751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:04.813189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:04.813189 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:04.813392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:04.957784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:04.966284 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbc5ff07-ba79-4c0a-a72a-1f79ee2f4a9e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1519 microversion: 2.1 time: 0.167439 Sep 08 11:07:04.966880 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3606/6980] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:04 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:05.990158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:05.990798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:05.993832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=34 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:06.000263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:06.000774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:06.001265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:06.002007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:06.002480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:06.002923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:06.336953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:06.344780 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e9cb03b-0301-4407-8a94-be079e0c0fd0 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1518 microversion: 2.1 time: 0.358697 Sep 08 11:07:06.345376 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3375/6981] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:05 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1518 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:06.430531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d46dae7-2482-4906-83ec-6923a6b91881", "name": "network-vif-unplugged", "status": "completed", "tag": "ec80cd14-49e1-4293-be04-52718ff50e89"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:06.436063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=30 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:06.442135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:06.442633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:06.443048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:06.455171 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] Creating event network-vif-unplugged:ec80cd14-49e1-4293-be04-52718ff50e89 for instance 3d46dae7-2482-4906-83ec-6923a6b91881 on n-h1-833090-19 Sep 08 11:07:06.460629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] Instance 3d46dae7-2482-4906-83ec-6923a6b91881 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:07:06.472320 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-18413666-2895-4cc0-bfa8-26ddb530af4a req-5c9ee794-ae8c-4924-bbcf-90a1667a89f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045881 Sep 08 11:07:06.473200 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3607/6982] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:07.369386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:07.370021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:07.377258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:07.377767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:07.378224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:07.378947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:07.379419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:07.379886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:07.513245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:07.521390 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a7afe7f5-f81f-4121-9f17-5a21c6813ec2 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1516 microversion: 2.1 time: 0.155961 Sep 08 11:07:07.521971 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3376/6983] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:07 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:08.503147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d46dae7-2482-4906-83ec-6923a6b91881", "tag": "ec80cd14-49e1-4293-be04-52718ff50e89"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:08.512713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:08.513179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:08.513603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:08.525367 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] Creating event network-changed:ec80cd14-49e1-4293-be04-52718ff50e89 for instance 3d46dae7-2482-4906-83ec-6923a6b91881 on n-h1-833090-19 Sep 08 11:07:08.530559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] Instance 3d46dae7-2482-4906-83ec-6923a6b91881 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:07:08.541836 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7e23b346-e36a-43a4-8c55-dabd85853163 req-810be0f5-ced1-4494-b503-09dc6fb643fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043432 Sep 08 11:07:08.542658 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3608/6984] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:08.547121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:08.548172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:08.554752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:08.555266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:08.555759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:08.556495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:08.556966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:08.557421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:08.876891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:08.884904 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e289e281-4bbe-46ef-8881-3f4522a5c135 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1516 microversion: 2.1 time: 0.343751 Sep 08 11:07:08.885631 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3377/6985] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:08 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:09.910478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:09.911176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:09.917444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:09.917874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:09.918313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:09.919011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:09.919477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:09.919976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:10.054141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:10.063223 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a5a4d17b-5887-48cd-b868-f7884c7c0f19 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1513 microversion: 2.1 time: 0.158080 Sep 08 11:07:10.063862 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3609/6986] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:09 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:10.088954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:10.089510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:10.096944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:10.097449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:10.097903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:10.098621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:10.099143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:10.099638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:10.159353 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2bdee74-5e70-4b0f-ad73-769bfd75e941 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "POST /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881/action" status: 204 len: 0 microversion: 2.1 time: 0.074355 Sep 08 11:07:10.160161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3378/6987] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:07:10 2022] POST /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:07:10.168464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:10.169015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:10.175635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:10.176172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:10.176656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:10.177425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:10.177982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:10.178379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:10.390720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:10.399111 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ecab2ff-2102-45e6-8a6f-e31987aac822 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1513 microversion: 2.1 time: 0.234564 Sep 08 11:07:10.399738 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3610/6988] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:10 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:11.423997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:11.424732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:11.433783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.434298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.434755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.435494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.435973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.436415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.583642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:11.592306 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5aeb4107-9f20-47e5-9850-270a08c11d48 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1505 microversion: 2.1 time: 0.173321 Sep 08 11:07:11.593324 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3379/6989] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:11 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:11.616390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:11.617103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:11.624914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.625404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.625848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.626548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.627002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.627432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.758236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:11.766241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-400c34e4-422d-4d0a-92c4-e5cef5064668 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1505 microversion: 2.1 time: 0.153977 Sep 08 11:07:11.767418 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3611/6990] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:11 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:11.788382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:11.789049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:11.796391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.796920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.797381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.798162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.798639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.799087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.938167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:11.945934 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c7ea0d3-8759-40ed-b913-5e8a26b46b16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1505 microversion: 2.1 time: 0.161504 Sep 08 11:07:11.946506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3380/6991] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:11 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:11.967510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:11.968437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:11.975327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.975853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.976290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:11.976985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:11.977434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:11.977856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:12.003723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:07:12.084605 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b939d794-b243-4963-89f1-5efadbc2cb61 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 204 len: 0 microversion: 2.1 time: 0.120614 Sep 08 11:07:12.088756 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3612/6992] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:07:11 2022] DELETE /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:07:12.103252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:12.103806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:12.110721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:12.111285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:12.111776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:12.112504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:12.112981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:12.113427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:12.138760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:07:12.184737 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.compute.api [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Instance is already in deleting state, ignoring this request Sep 08 11:07:12.185594 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-624e9691-f500-43d3-8bd8-011501703707 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 204 len: 0 microversion: 2.1 time: 0.087964 Sep 08 11:07:12.186162 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3381/6993] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:07:12 2022] DELETE /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:07:12.194752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:12.195453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:12.201318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:12.202107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:12.202784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:12.203702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:12.204301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:12.204941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:12.339599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:12.350520 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a6919810-a596-4b5c-8698-3483e99daa85 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1511 microversion: 2.1 time: 0.159921 Sep 08 11:07:12.351557 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3613/6994] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:12 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:13.308859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-8903ce8f-641c-43b2-ad1a-18e2d3b7fedf req-507acdb5-503c-4578-b986-5e93a299ab59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d46dae7-2482-4906-83ec-6923a6b91881", "name": "network-vif-plugged", "status": "completed", "tag": "ec80cd14-49e1-4293-be04-52718ff50e89"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:13.318610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8903ce8f-641c-43b2-ad1a-18e2d3b7fedf req-507acdb5-503c-4578-b986-5e93a299ab59 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:13.319083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8903ce8f-641c-43b2-ad1a-18e2d3b7fedf req-507acdb5-503c-4578-b986-5e93a299ab59 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:13.319550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-8903ce8f-641c-43b2-ad1a-18e2d3b7fedf req-507acdb5-503c-4578-b986-5e93a299ab59 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:13.331127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-8903ce8f-641c-43b2-ad1a-18e2d3b7fedf req-507acdb5-503c-4578-b986-5e93a299ab59 service nova] Creating event network-vif-plugged:ec80cd14-49e1-4293-be04-52718ff50e89 for instance 3d46dae7-2482-4906-83ec-6923a6b91881 on n-h1-833090-19 Sep 08 11:07:13.336145 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-8903ce8f-641c-43b2-ad1a-18e2d3b7fedf req-507acdb5-503c-4578-b986-5e93a299ab59 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100231 Sep 08 11:07:13.336728 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3382/6995] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:07:13.377316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:13.377925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:13.384765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:13.385239 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:13.385672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:13.386360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:13.386805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:13.387224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:13.557614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abb28627d264536895ba4468e7d0f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f940d92c7e4451becb55926ab815f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:13.565957 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-451d4aee-6a7b-4bac-a775-b526d6ed0902 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 200 len: 1511 microversion: 2.1 time: 0.192757 Sep 08 11:07:13.574119 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3614/6996] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:13 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:13.978479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-99f6334a-936f-452a-9aa9-93f92819f97f req-04aef710-abe2-49cd-b42c-dc584f0ebd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d46dae7-2482-4906-83ec-6923a6b91881", "name": "network-vif-deleted", "tag": "ec80cd14-49e1-4293-be04-52718ff50e89"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:13.989262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-99f6334a-936f-452a-9aa9-93f92819f97f req-04aef710-abe2-49cd-b42c-dc584f0ebd26 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:13.989723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-99f6334a-936f-452a-9aa9-93f92819f97f req-04aef710-abe2-49cd-b42c-dc584f0ebd26 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:13.990166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-99f6334a-936f-452a-9aa9-93f92819f97f req-04aef710-abe2-49cd-b42c-dc584f0ebd26 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:14.003384 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-99f6334a-936f-452a-9aa9-93f92819f97f req-04aef710-abe2-49cd-b42c-dc584f0ebd26 service nova] Creating event network-vif-deleted:ec80cd14-49e1-4293-be04-52718ff50e89 for instance 3d46dae7-2482-4906-83ec-6923a6b91881 on n-h1-833090-19 Sep 08 11:07:14.009213 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-99f6334a-936f-452a-9aa9-93f92819f97f req-04aef710-abe2-49cd-b42c-dc584f0ebd26 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034808 Sep 08 11:07:14.009841 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3383/6997] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:14.589763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:14.590366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: 3d46dae7-2482-4906-83ec-6923a6b91881] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:14.597765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:14.598243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:14.598680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:14.599396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:14.599898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:14.600344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:14.614206 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] HTTP exception thrown: Instance 3d46dae7-2482-4906-83ec-6923a6b91881 could not be found. Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Request method failure captured: Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 HTTP/1.1 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcx2nQ6b0g4V6ba38IGkCA8lWLeHBheEpphlyxFNXQOFbyisgT3JZsWR_7d6nlXn-sf8FghL5HYjFEnKpBWBrMwCcQVtK6a4d6c-rPw7Cr25-cmVBvFbIwej4yLEcmqcAHx1gCpQ5dsfRJCYtl6mJo566exFDmkylQu1gWWkwDjVMcw Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 61f940d92c7e4451becb55926ab815f8 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61f940d92c7e4451becb55926ab815f8", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 61f940d92c7e4451becb55926ab815f8 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerDiskConfigTestJSON-522642737-project Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7abb28627d264536895ba4468e7d0f5e Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerDiskConfigTestJSON-522642737-project Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3d46dae7-2482-4906-83ec-6923a6b91881 could not be found. Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3d46dae7-2482-4906-83ec-6923a6b91881'} Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d46dae7-2482-4906-83ec-6923a6b91881 could not be found. Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d46dae7-2482-4906-83ec-6923a6b91881 could not be found. Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:14.615929 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d46dae7-2482-4906-83ec-6923a6b91881 could not be found. Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Returning 404 to user: Instance 3d46dae7-2482-4906-83ec-6923a6b91881 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-179f19cf-9be1-4630-bc99-ef5a8efe12f6 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881" status: 404 len: 111 microversion: 2.1 time: 0.031630 Sep 08 11:07:14.620643 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3615/6998] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:14 2022] GET /compute/v2.1/servers/3d46dae7-2482-4906-83ec-6923a6b91881 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:07:14.627538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8a112d4-550d-431d-94bb-72536c270d16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '.version_select at 0x7f23554c5d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:14.651752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8a112d4-550d-431d-94bb-72536c270d16 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073173472" status: 202 len: 0 microversion: 2.1 time: 0.029203 Sep 08 11:07:14.652255 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3384/6999] 10.222.0.59 () {58 vars in 1221 bytes} [Thu Sep 8 11:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073173472 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:07:15.278867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:15.279363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:15.285633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:15.286110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:15.286856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:15.287577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:15.288028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:15.288452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:15.301702 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] HTTP exception thrown: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Request method failure captured: Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d HTTP/1.1 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGcx2nQ6b0g4V6ba38IGkCA8lWLeHBheEpphlyxFNXQOFbyisgT3JZsWR_7d6nlXn-sf8FghL5HYjFEnKpBWBrMwCcQVtK6a4d6c-rPw7Cr25-cmVBvFbIwej4yLEcmqcAHx1gCpQ5dsfRJCYtl6mJo566exFDmkylQu1gWWkwDjVMcw Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 61f940d92c7e4451becb55926ab815f8 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61f940d92c7e4451becb55926ab815f8", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 61f940d92c7e4451becb55926ab815f8 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerDiskConfigTestJSON-522642737-project Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7abb28627d264536895ba4468e7d0f5e Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerDiskConfigTestJSON-522642737-project Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'ef7a05fd-49df-4c90-8d65-99a80bac874d'} Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:07:15.303217 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Returning 404 to user: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-35542c8f-7452-43d8-9c6b-50f81a72bc8e tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 404 len: 111 microversion: 2.1 time: 0.029685 Sep 08 11:07:15.307041 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3616/7000] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:07:15 2022] DELETE /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:07:15.313567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:15.314314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] [instance: ef7a05fd-49df-4c90-8d65-99a80bac874d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:15.321544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:15.322126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:15.322589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:15.323317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:15.323853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:15.324328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:15.338667 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] HTTP exception thrown: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Request method failure captured: Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d HTTP/1.1 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGcx2nQ6b0g4V6ba38IGkCA8lWLeHBheEpphlyxFNXQOFbyisgT3JZsWR_7d6nlXn-sf8FghL5HYjFEnKpBWBrMwCcQVtK6a4d6c-rPw7Cr25-cmVBvFbIwej4yLEcmqcAHx1gCpQ5dsfRJCYtl6mJo566exFDmkylQu1gWWkwDjVMcw Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 61f940d92c7e4451becb55926ab815f8 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/61f940d92c7e4451becb55926ab815f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_61f940d92c7e4451becb55926ab815f8", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 61f940d92c7e4451becb55926ab815f8 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-522642737 Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerDiskConfigTestJSON-522642737-project Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 7abb28627d264536895ba4468e7d0f5e Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerDiskConfigTestJSON-522642737-project Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ef7a05fd-49df-4c90-8d65-99a80bac874d'} Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:07:15.340380 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] Returning 404 to user: Instance ef7a05fd-49df-4c90-8d65-99a80bac874d could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b87d6327-4600-49d8-acdd-1d5d18e97c91 tempest-ServerDiskConfigTestJSON-522642737 tempest-ServerDiskConfigTestJSON-522642737-project] 10.222.0.59 "GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d" status: 404 len: 111 microversion: 2.1 time: 0.032634 Sep 08 11:07:15.344854 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3385/7001] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:15 2022] GET /compute/v2.1/servers/ef7a05fd-49df-4c90-8d65-99a80bac874d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:07:24.173658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-98ef61c9-403b-4241-bd19-b367a6f9a533 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'create', calling method: .version_select at 0x7f23517118b0>, body: {"keypair": {"name": "tempest-keypair-132749164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgS7jbK/zQu2vKCZQlrg0ZgoF0m+kynP8La9QBu2xny1QBLdId5IDRMaVwdioziH9QxB6Rvl3wl0jUxShLl/KsTGBc1RwDkFCHEDwZ1vVRa805Fb19lE5/NjphTTP72sA=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:24.191908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-98ef61c9-403b-4241-bd19-b367a6f9a533 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:24.198832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-98ef61c9-403b-4241-bd19-b367a6f9a533 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:24.227950 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-98ef61c9-403b-4241-bd19-b367a6f9a533 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194443 Sep 08 11:07:24.228677 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3617/7002] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:07:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:25.634327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-273724491", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e74a738-12d7-44b0-92e9-df858e591bd6"}], "security_groups": [{"name": "tempest-securitygroup--368825094"}], "key_name": "tempest-keypair-132749164", "user_data": "}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:25.656828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:25.657559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:25.749912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] validate_networks() for [('2e74a738-12d7-44b0-92e9-df858e591bd6', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:07:26.191894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:07:26.192339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:07:26.192833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:07:26.193279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:07:26.193711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:07:26.203716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:26.204233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:26.204685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:26.205430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:26.206085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:26.206534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:26.226297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:07:26.232438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:07:26.246238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:07:26.249084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:07:26.306532 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d53cdb04-217e-4b9a-9738-6003e34b288e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.676117 Sep 08 11:07:26.308322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3386/7003] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:07:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:07:26.317676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:26.336497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7d6a9c4-e061-4042-9121-6efa251d996e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:26.337240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a7d6a9c4-e061-4042-9121-6efa251d996e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:26.409253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a7d6a9c4-e061-4042-9121-6efa251d996e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:26.420482 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7d6a9c4-e061-4042-9121-6efa251d996e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1237 microversion: 2.1 time: 0.103667 Sep 08 11:07:26.423509 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3618/7004] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:26 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:27.445903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:27.446933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:27.453895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:27.454413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:27.454875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:27.455636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:27.456113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:27.457079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:27.551092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:27.564493 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ba2c499c-d1bd-4374-953b-2ba0c21d44ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1297 microversion: 2.1 time: 0.123155 Sep 08 11:07:27.565373 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3387/7005] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:27 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:28.589484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:28.590928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:28.598700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:28.599624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:28.600103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:28.600940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:28.601491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:28.602013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:28.808643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:28.817326 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-744c9d4a-0f8e-4567-a46e-852e202e2011 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.231728 Sep 08 11:07:28.817916 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3619/7006] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:28 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:29.168452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-494e3414-a505-4ba2-8228-68a5aa36bbf2 req-181ec5ad-76bd-48e8-813a-68c502160c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:29.180981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-494e3414-a505-4ba2-8228-68a5aa36bbf2 req-181ec5ad-76bd-48e8-813a-68c502160c85 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:29.181781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-494e3414-a505-4ba2-8228-68a5aa36bbf2 req-181ec5ad-76bd-48e8-813a-68c502160c85 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.182337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-494e3414-a505-4ba2-8228-68a5aa36bbf2 req-181ec5ad-76bd-48e8-813a-68c502160c85 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:29.193857 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-494e3414-a505-4ba2-8228-68a5aa36bbf2 req-181ec5ad-76bd-48e8-813a-68c502160c85 service nova] Creating event network-changed:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h2-833090-19 Sep 08 11:07:29.199104 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-494e3414-a505-4ba2-8228-68a5aa36bbf2 req-181ec5ad-76bd-48e8-813a-68c502160c85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034481 Sep 08 11:07:29.201030 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3388/7007] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:29.841987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:29.843130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:29.850312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:29.850798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.851238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:29.851968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:29.852428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:29.852868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:29.986384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:29.994539 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b8b9bfb3-5a3a-4877-aeb3-3d44ecb06f1d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.156440 Sep 08 11:07:29.995111 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3620/7008] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:29 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:07:31.020066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:31.020801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:31.026998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:31.027562 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:31.028027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:31.028743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:31.029219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:31.030155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:31.165592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:31.173508 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82252a34-30b2-4ed7-9c76-1103850b8bcb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.158877 Sep 08 11:07:31.174091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3389/7009] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:31 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:32.196099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:32.196724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:32.203763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:32.204265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:32.204709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:32.205457 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:32.205885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:32.206316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:32.366062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:32.373854 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-499f3b17-4a91-461f-8a79-b599e320483a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.181695 Sep 08 11:07:32.374435 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3621/7010] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:32 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:33.397080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:33.397621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:33.404545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:33.405044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:33.405491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:33.406198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:33.406661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:33.407094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:33.537039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:33.545439 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b39adb35-670e-425a-941e-309c0740c4c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.151941 Sep 08 11:07:33.546016 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3390/7011] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:33 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:34.568167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:34.568794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:34.575925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:34.577087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:34.577530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:34.578232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:34.578690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:34.579131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:34.713555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:34.721467 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-743c58e6-554b-49f9-83d8-a83a60a18820 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.157300 Sep 08 11:07:34.722055 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3622/7012] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:34 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:35.744147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:35.744786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:35.751929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.752372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.752833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:35.753555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.754030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.754485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:35.884527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-283d79ad-91f8-4542-a550-07ce5f56bda7 req-2fa72a56-83e7-4e14-90a2-27d39e8907ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "name": "network-vif-plugged", "status": "completed", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:35.898949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-283d79ad-91f8-4542-a550-07ce5f56bda7 req-2fa72a56-83e7-4e14-90a2-27d39e8907ad service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:35.899589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-283d79ad-91f8-4542-a550-07ce5f56bda7 req-2fa72a56-83e7-4e14-90a2-27d39e8907ad service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:35.906846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-283d79ad-91f8-4542-a550-07ce5f56bda7 req-2fa72a56-83e7-4e14-90a2-27d39e8907ad service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:35.919319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-283d79ad-91f8-4542-a550-07ce5f56bda7 req-2fa72a56-83e7-4e14-90a2-27d39e8907ad service nova] Creating event network-vif-plugged:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h2-833090-19 Sep 08 11:07:35.925170 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-283d79ad-91f8-4542-a550-07ce5f56bda7 req-2fa72a56-83e7-4e14-90a2-27d39e8907ad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044541 Sep 08 11:07:35.926307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3623/7013] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:36.213323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:36.240894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:36.307868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:36.316643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0fd341a7-a874-4eaa-ad39-ebf90d334e9c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.576452 Sep 08 11:07:36.317237 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3391/7014] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:35 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:37.337022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:37.342103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:37.342810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:37.344604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:07:37.350871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:37.351355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:37.351826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:37.352539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:37.353120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:37.353428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:37.487124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:37.494806 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e37d6b6-9f1a-466a-98ab-40b54128a641 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1362 microversion: 2.1 time: 0.158821 Sep 08 11:07:37.495379 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3624/7015] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:37 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:38.519221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:38.519874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:38.525868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:38.526361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:38.526812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:38.527536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:38.528006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:38.528452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:38.658975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:07:38.666826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-97714ec1-7550-4e36-932c-f190e737d7b7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1549 microversion: 2.1 time: 0.153129 Sep 08 11:07:38.667406 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3392/7016] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:07:38 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:07:38.690166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:07:38.690767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:07:38.697649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:38.698139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:38.698581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:38.699282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:38.699774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:38.700207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:38.780605 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3514b8d2-8463-44e8-9d19-8e926f96302e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095006 Sep 08 11:07:38.781215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3625/7017] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 11:07:38 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:07:39.740985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-97d0ea80-6368-4609-9bc2-738cf052ee28 req-43a86a03-c30e-41f2-b20b-a9022df0e415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:07:39.751542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-97d0ea80-6368-4609-9bc2-738cf052ee28 req-43a86a03-c30e-41f2-b20b-a9022df0e415 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:07:39.752042 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-97d0ea80-6368-4609-9bc2-738cf052ee28 req-43a86a03-c30e-41f2-b20b-a9022df0e415 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:07:39.752482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-97d0ea80-6368-4609-9bc2-738cf052ee28 req-43a86a03-c30e-41f2-b20b-a9022df0e415 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:07:39.763740 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-97d0ea80-6368-4609-9bc2-738cf052ee28 req-43a86a03-c30e-41f2-b20b-a9022df0e415 service nova] Creating event network-changed:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h2-833090-19 Sep 08 11:07:39.769420 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-97d0ea80-6368-4609-9bc2-738cf052ee28 req-43a86a03-c30e-41f2-b20b-a9022df0e415 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032080 Sep 08 11:07:39.770033 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3393/7018] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:08:44.559641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:44.560400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:44.561612 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:08:44.561807 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:08:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 (ip 10.222.0.59) !!! Sep 08 11:08:44.568285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:44.568894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:44.577020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.577498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.577930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.578621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.579069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.580135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.715619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:44.724041 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6bb6ba78-14f4-409d-ac1c-00a7e2c6888a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1668 microversion: 2.1 time: 0.166947 Sep 08 11:08:44.724613 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3626/7019] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:44 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:44.745183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:44.745941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:08:44.751823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:44.752549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:44.760299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.760834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.761293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.762014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.762490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.762939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.897713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:44.905470 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-eb1fffbc-27f0-470c-a938-86845c224cd1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1668 microversion: 2.1 time: 0.163054 Sep 08 11:08:44.906045 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3394/7020] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:44 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:44.927473 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:44.928097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:44.934045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.934528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.934960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:44.935674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:44.936128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:44.936564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.082866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:45.090551 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4999d258-70c0-436e-8185-07cd3c673bbb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1668 microversion: 2.1 time: 0.166935 Sep 08 11:08:45.091118 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3627/7021] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:44 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:45.112532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:45.114716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:45.121183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.121456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.121700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.123729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.123729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.123729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.156154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:45.161749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:08:45.168333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:08:45.168764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:08:45.169249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:08:45.169669 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:08:45.170094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:08:45.232623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-113736f1-0dbd-4e74-bfdf-1e7b0cd6779b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45/action" status: 202 len: 0 microversion: 2.1 time: 0.124035 Sep 08 11:08:45.233250 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3395/7022] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:08:45 2022] POST /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:08:45.241993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:45.242611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:45.249396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.249890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.250441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.251181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:45.252173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:45.252603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:45.417194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:45.425886 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c595fd0a-7161-4931-a6f7-768375e7887e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1677 microversion: 2.1 time: 0.187775 Sep 08 11:08:45.426602 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3628/7023] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:45 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:46.452923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:46.453546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:46.460984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:46.461670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:46.462152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:46.462893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:46.464029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:46.464877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:46.687615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:46.696201 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6228d98d-8710-4d0c-996d-84f894caac62 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1677 microversion: 2.1 time: 0.249377 Sep 08 11:08:46.696756 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3396/7024] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:46 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:47.719354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:47.720559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:47.727411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:47.727927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:47.728367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:47.729096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:47.729551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:47.730096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:47.871525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:47.880268 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3bb782cb-cbda-44d9-abe1-34440748d57d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.164778 Sep 08 11:08:47.881216 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3629/7025] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:47 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:48.905191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:48.905820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:48.913385 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:48.913914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:48.914371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:48.915111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:48.915616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:48.916064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:49.052024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:49.061250 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16cf4448-8759-42e6-a89c-4a7d01a7d5c3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.160138 Sep 08 11:08:49.061854 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3397/7026] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:48 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:50.085386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:50.085994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:50.092939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:50.093422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:50.093869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:50.094557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:50.095533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:50.095963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:50.226361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:50.234176 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f582a706-ada3-4ad2-b330-975dba9969ea tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.152708 Sep 08 11:08:50.234761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3630/7027] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:50 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:51.258252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:51.258874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:51.265839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.266539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.266983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.267719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:51.268190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:51.268649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:51.401825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:51.409728 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e4e93d4-fb21-4072-988e-554b1c142a19 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.155450 Sep 08 11:08:51.410308 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3398/7028] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:51 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:52.433647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:52.434240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:52.441686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:52.442170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:52.442608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:52.443432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:52.443909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:52.444339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:52.577580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:52.585930 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22af0f40-8c53-4305-8541-0e5933b72b52 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.156144 Sep 08 11:08:52.586610 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3631/7029] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:52 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:53.609298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:53.609959 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:53.616984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:53.617491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:53.617960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:53.618676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:53.619151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:53.619634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:53.752120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:53.759912 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a9deb34-4695-4208-9de7-b0914e376cd5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.154588 Sep 08 11:08:53.760496 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3399/7030] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:53 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:54.785674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:54.786390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:54.793491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:54.793979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:54.794423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:54.795119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:54.795608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:54.796041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:54.927642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:54.935645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab293135-2fb1-4995-b316-9826d3bf0099 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.154871 Sep 08 11:08:54.936314 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3632/7031] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:54 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:55.959154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:55.959850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:55.967428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:55.968040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:55.968524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:55.969245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:55.969724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:55.970195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:56.103309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:56.111346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f30c75cd-6d5c-41df-bb87-2225584c222b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.156155 Sep 08 11:08:56.112547 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3400/7032] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:55 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:57.135810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:57.136459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:57.144221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:57.144712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:57.145154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:57.145850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:57.148521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:57.148997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:57.285377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:57.293443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-853ef109-5c36-4c21-9b4d-b0b3e2cc198c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.161682 Sep 08 11:08:57.294235 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3633/7033] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:57 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:58.317194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:58.317767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:58.324732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:58.325232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:58.325686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:58.326392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:58.326863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:58.327305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:58.518476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:08:58.526686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2425cae-627e-4a3a-9f35-7b4dc402790f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1682 microversion: 2.1 time: 0.213465 Sep 08 11:08:58.527298 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3401/7034] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:58 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:08:59.553230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:08:59.553858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:08:59.560499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:59.560989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:59.561425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:59.562137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:59.562590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:59.563015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:59.636170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "name": "network-vif-unplugged", "status": "completed", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:08:59.647784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:08:59.648130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:08:59.648980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:08:59.665903 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] Creating event network-vif-unplugged:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h1-833090-19 Sep 08 11:08:59.671908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:08:59.684368 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4b1076b7-5326-4622-b72f-cd1da0bebfed req-66b860ee-f2f6-4219-8ca6-985a0e6f3121 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051861 Sep 08 11:08:59.684999 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3402/7035] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:00.002431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:00.011799 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5eb02509-9c8a-4f3a-a764-9b144b6d8416 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1681 microversion: 2.1 time: 0.465069 Sep 08 11:09:00.012402 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3634/7036] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:08:59 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1681 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:01.038779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:01.039954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:01.046465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:01.046972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:01.047435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:01.048203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:01.049230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:01.049687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:01.523152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:01.531214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c29b9551-43da-4268-97e5-039dc0662c4d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1679 microversion: 2.1 time: 0.499583 Sep 08 11:09:01.531838 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3403/7037] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:01 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:01.714800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:01.725716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:01.726119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:01.726544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:01.737993 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] Creating event network-changed:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h1-833090-19 Sep 08 11:09:01.743242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:09:01.754518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-88e0aa21-b9f3-4199-80e6-fd600a64415f req-6c5dc875-1714-4521-9a71-92ee4e73eb33 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043243 Sep 08 11:09:01.755119 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3635/7038] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:02.556476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:02.557104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:02.564883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.565403 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.565869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.566604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.567080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.567555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.781984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:02.790914 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c84d2db5-62bd-4be8-b81a-ef6683a66963 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1676 microversion: 2.1 time: 0.238312 Sep 08 11:09:02.791558 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3404/7039] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:02 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:02.815547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:02.816193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:02.823559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.824044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.824479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.825172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.825621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.826044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.883409 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-336725b0-dee9-4f95-8081-68bac02d84db tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45/action" status: 204 len: 0 microversion: 2.1 time: 0.072991 Sep 08 11:09:02.884097 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3636/7040] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:09:02 2022] POST /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:09:02.892712 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:02.893587 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:02.899535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.900039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.900490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:02.901325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:02.901667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:02.902138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:03.121693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:03.129534 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-82bb4c5c-a86b-4074-9a2f-32c42411ee27 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1676 microversion: 2.1 time: 0.240987 Sep 08 11:09:03.130113 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3405/7041] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:02 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:04.155014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:04.155664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:04.162360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:04.162901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:04.163338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:04.164076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:04.164527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:04.164978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:04.309375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:04.317422 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4dbead2a-ae6b-4b1e-8f8a-62d21669d56d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1676 microversion: 2.1 time: 0.167554 Sep 08 11:09:04.318019 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3637/7042] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:04 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:05.341833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:05.342412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:05.349740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.350252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.350717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.351444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.351955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.352412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.487287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:05.495270 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9fdc33c-2e34-4ac6-a661-6ac2253fcf0f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1668 microversion: 2.1 time: 0.157645 Sep 08 11:09:05.495890 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3406/7043] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:05 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:05.518918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:05.519556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:05.526369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.526849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.527304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.528035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.528480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.528897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.666246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:05.674042 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c096b5a-8294-4a71-b541-fef440c10fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1668 microversion: 2.1 time: 0.159770 Sep 08 11:09:05.674636 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3638/7044] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:05 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:05.696992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:05.697736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:05.704346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.705481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.706052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.706967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.707546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.708187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b12c3068-649d-4553-bdb8-7ef9d83267f8 req-33cf47ed-0710-4d5b-8213-fbca5635bc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "name": "network-vif-plugged", "status": "completed", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:05.708359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.719104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b12c3068-649d-4553-bdb8-7ef9d83267f8 req-33cf47ed-0710-4d5b-8213-fbca5635bc2a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.721032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b12c3068-649d-4553-bdb8-7ef9d83267f8 req-33cf47ed-0710-4d5b-8213-fbca5635bc2a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.721647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b12c3068-649d-4553-bdb8-7ef9d83267f8 req-33cf47ed-0710-4d5b-8213-fbca5635bc2a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.733799 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b12c3068-649d-4553-bdb8-7ef9d83267f8 req-33cf47ed-0710-4d5b-8213-fbca5635bc2a service nova] Creating event network-vif-plugged:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h1-833090-19 Sep 08 11:09:05.739207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b12c3068-649d-4553-bdb8-7ef9d83267f8 req-33cf47ed-0710-4d5b-8213-fbca5635bc2a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036795 Sep 08 11:09:05.740190 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3639/7045] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:05.849864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:05.857793 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-979981ad-7aed-4d14-a25a-131fd6767ed8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1668 microversion: 2.1 time: 0.164859 Sep 08 11:09:05.858373 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3407/7046] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:05 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:05.881082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:05.881671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:05.887975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.888464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.888900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.889613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:05.890068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:05.890494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:05.916727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:09:05.966437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:05.997187 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d89c4f5f-d93b-47f2-8080-236aa719fb94 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 204 len: 0 microversion: 2.1 time: 0.120159 Sep 08 11:09:05.998237 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3640/7047] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:09:05 2022] DELETE /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:09:06.006638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:06.007407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:06.013516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:06.014020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:06.014477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:06.015195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:06.015701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:06.016407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:06.149289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:06.157337 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-517158f6-c94e-4069-bd12-0c53dcf36512 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1674 microversion: 2.1 time: 0.154779 Sep 08 11:09:06.158550 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3408/7048] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:06 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:07.181583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:07.182279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:07.190027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:07.190509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:07.190949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:07.191678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:07.192143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:07.192569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:07.355797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:07.364255 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afadccd3-f4d1-4a64-9240-8baf44ed8331 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1674 microversion: 2.1 time: 0.186900 Sep 08 11:09:07.364845 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3641/7049] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:07 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:08.388739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:08.389578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:08.398869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:08.399393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:08.399882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:08.400854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:08.401110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:08.401553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:08.422890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:08.452139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c4e82d17-8764-462a-9d2c-11101c3da5ca req-9e841620-9043-4609-9194-571e42453668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15ff13-5b1f-4755-a4a2-2844e5b1fe45", "name": "network-vif-deleted", "tag": "d2aa2977-d523-4df5-884f-29738576aed3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:08.468893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c4e82d17-8764-462a-9d2c-11101c3da5ca req-9e841620-9043-4609-9194-571e42453668 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:08.469377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c4e82d17-8764-462a-9d2c-11101c3da5ca req-9e841620-9043-4609-9194-571e42453668 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:08.469809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c4e82d17-8764-462a-9d2c-11101c3da5ca req-9e841620-9043-4609-9194-571e42453668 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:08.486483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:08.490720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c4e82d17-8764-462a-9d2c-11101c3da5ca req-9e841620-9043-4609-9194-571e42453668 service nova] Creating event network-vif-deleted:d2aa2977-d523-4df5-884f-29738576aed3 for instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 on n-h1-833090-19 Sep 08 11:09:08.496832 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c4e82d17-8764-462a-9d2c-11101c3da5ca req-9e841620-9043-4609-9194-571e42453668 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048325 Sep 08 11:09:08.497484 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5ae47120-f407-460c-ade6-f30267a5c019 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 200 len: 1607 microversion: 2.1 time: 0.113344 Sep 08 11:09:08.498378 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3409/7051] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:08 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 1607 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:08.498562 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3642/7051] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:09:09.521711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:09.523238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:09.530610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:09.531120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:09.531719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:09.532449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:09.532924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:09.533373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:09.547454 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 HTTP/1.1 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'aa15ff13-5b1f-4755-a4a2-2844e5b1fe45'} Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:09:09.549182 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e75f999e-e63d-40c2-b77a-ffa0219c69e0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 404 len: 111 microversion: 2.1 time: 0.033584 Sep 08 11:09:09.553141 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3410/7052] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:09 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:09:09.565811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:09.566520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:09.572950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:09.573435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:09.573877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:09.574578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:09.575035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:09.575493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:09.593645 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 HTTP/1.1 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'aa15ff13-5b1f-4755-a4a2-2844e5b1fe45'} Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:09:09.595326 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:09:09.600574 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2e1bb456-def9-4204-baea-b9658bddd537 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 404 len: 111 microversion: 2.1 time: 0.037066 Sep 08 11:09:09.602887 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3643/7053] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:09 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:09:09.649003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1310425542", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "2e74a738-12d7-44b0-92e9-df858e591bd6"}], "security_groups": [{"name": "tempest-securitygroup--368825094"}], "key_name": "tempest-keypair-132749164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:09.754328 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] validate_networks() for [('2e74a738-12d7-44b0-92e9-df858e591bd6', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:09:10.131379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:09:10.131867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:09:10.132360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:09:10.132908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:09:10.133346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:09:10.143355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:10.143964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:10.144424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.145165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:10.145638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:10.146074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:10.163666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:09:10.169048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:09:10.181932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:09:10.184320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:09:10.231170 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e1a89164-a937-4dce-8f33-97334654f439 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.586128 Sep 08 11:09:10.231864 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3411/7054] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:09:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:09:10.243899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3349cb98-e0e4-44c0-8663-22598096510e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:10.244653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3349cb98-e0e4-44c0-8663-22598096510e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:10.301459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3349cb98-e0e4-44c0-8663-22598096510e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:10.308949 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3349cb98-e0e4-44c0-8663-22598096510e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1238 microversion: 2.1 time: 0.068841 Sep 08 11:09:10.313468 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3644/7055] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:10 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:11.340939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:11.342020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:11.350331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:11.350972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:11.351557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:11.352388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:11.352932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:11.353456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:11.431758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:11.440708 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c248b0bd-0bf5-4a94-9982-524ee516ed21 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1296 microversion: 2.1 time: 0.104802 Sep 08 11:09:11.441294 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3412/7056] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:11 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:12.463964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:12.464751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:12.475697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:12.476185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:12.476618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:12.477314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:12.477765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:12.478191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:12.682490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:12.690473 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8991b21f-258f-4a56-af45-021787b29c8d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1363 microversion: 2.1 time: 0.230562 Sep 08 11:09:12.691059 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3645/7057] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:12 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:12.735383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1fdfecc5-a1e6-4cd0-8fbe-34722d474290 req-062ff3d4-812d-4a34-a578-b26f79f2434f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:12.751442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1fdfecc5-a1e6-4cd0-8fbe-34722d474290 req-062ff3d4-812d-4a34-a578-b26f79f2434f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:12.752232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1fdfecc5-a1e6-4cd0-8fbe-34722d474290 req-062ff3d4-812d-4a34-a578-b26f79f2434f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:12.752762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1fdfecc5-a1e6-4cd0-8fbe-34722d474290 req-062ff3d4-812d-4a34-a578-b26f79f2434f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:12.765997 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1fdfecc5-a1e6-4cd0-8fbe-34722d474290 req-062ff3d4-812d-4a34-a578-b26f79f2434f service nova] Creating event network-changed:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h1-833090-19 Sep 08 11:09:12.771682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1fdfecc5-a1e6-4cd0-8fbe-34722d474290 req-062ff3d4-812d-4a34-a578-b26f79f2434f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041659 Sep 08 11:09:12.772421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3413/7058] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:13.713831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:13.714434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:13.721649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:13.722141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:13.722588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:13.723326 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:13.723819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:13.724252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:13.857855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:13.866246 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e782061-5cb3-464d-a022-18f708de46b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1363 microversion: 2.1 time: 0.156332 Sep 08 11:09:13.866817 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3646/7059] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:13 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:14.892779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:14.893402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:14.895342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:14.901724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:14.902229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:14.902714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:14.903453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:14.904049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:14.904497 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:15.036976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:15.044811 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f3e70481-6bc1-43a3-ae7c-612f33b14d6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1363 microversion: 2.1 time: 0.158216 Sep 08 11:09:15.045399 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3414/7060] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:14 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:16.068802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:16.069487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:16.072442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:16.078485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:16.078908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:16.079345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:16.080082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:16.080538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:16.080965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:16.209939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:16.217662 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6f4fca3f-9352-4729-84f4-c0979e8f236d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1363 microversion: 2.1 time: 0.152976 Sep 08 11:09:16.218234 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3647/7061] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:16 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:17.243551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:17.244191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:17.251824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:17.252337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:17.252801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:17.253522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:17.253997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:17.254445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:17.402002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:17.411717 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9e53f8c-ec81-4969-bbe2-96c757aa5a98 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1363 microversion: 2.1 time: 0.174532 Sep 08 11:09:17.412300 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3415/7062] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:17 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:17.754442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-aa0a73a3-08d1-4af9-b445-6c6e6ebadfdb req-6ff4ca2d-a079-4165-b3a4-e258b047d121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "name": "network-vif-plugged", "status": "completed", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:17.767574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-aa0a73a3-08d1-4af9-b445-6c6e6ebadfdb req-6ff4ca2d-a079-4165-b3a4-e258b047d121 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:17.768163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-aa0a73a3-08d1-4af9-b445-6c6e6ebadfdb req-6ff4ca2d-a079-4165-b3a4-e258b047d121 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:17.768566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-aa0a73a3-08d1-4af9-b445-6c6e6ebadfdb req-6ff4ca2d-a079-4165-b3a4-e258b047d121 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:17.780388 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-aa0a73a3-08d1-4af9-b445-6c6e6ebadfdb req-6ff4ca2d-a079-4165-b3a4-e258b047d121 service nova] Creating event network-vif-plugged:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h1-833090-19 Sep 08 11:09:17.786266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-aa0a73a3-08d1-4af9-b445-6c6e6ebadfdb req-6ff4ca2d-a079-4165-b3a4-e258b047d121 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039533 Sep 08 11:09:17.787026 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3648/7063] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:18.435662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:18.436298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:18.443641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:18.444146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:18.444628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:18.445333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:18.445808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:18.446246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:18.581470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:18.589430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42c1c555-2c1f-4c40-b3d6-8c7b4d783eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1363 microversion: 2.1 time: 0.157801 Sep 08 11:09:18.590009 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3416/7064] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:18 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:19.614970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:19.615754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:19.621993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:19.622474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:19.622907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:19.623635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:19.624084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:19.624505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:19.761188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:19.769748 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-29cf275c-4ebb-450e-9fb6-56daf2abd434 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1551 microversion: 2.1 time: 0.160689 Sep 08 11:09:19.770329 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3649/7065] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:19 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:19.796134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:19.796670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:19.806396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:19.806949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:19.807471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:19.808288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:19.808791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:19.809287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:19.900836 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-70dab194-b756-43f7-b79e-b4d0e906d818 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108621 Sep 08 11:09:19.901471 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3417/7066] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 11:09:19 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:20.886812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:20.961868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-de184ac3-bfcc-4a74-b7be-d3891787a177 req-2ab336a8-4a7b-4e22-b602-37895f4bee9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:20.971656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de184ac3-bfcc-4a74-b7be-d3891787a177 req-2ab336a8-4a7b-4e22-b602-37895f4bee9c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:20.972166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de184ac3-bfcc-4a74-b7be-d3891787a177 req-2ab336a8-4a7b-4e22-b602-37895f4bee9c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:20.972605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-de184ac3-bfcc-4a74-b7be-d3891787a177 req-2ab336a8-4a7b-4e22-b602-37895f4bee9c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:20.984376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-de184ac3-bfcc-4a74-b7be-d3891787a177 req-2ab336a8-4a7b-4e22-b602-37895f4bee9c service nova] Creating event network-changed:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h1-833090-19 Sep 08 11:09:20.989486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-de184ac3-bfcc-4a74-b7be-d3891787a177 req-2ab336a8-4a7b-4e22-b602-37895f4bee9c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107107 Sep 08 11:09:20.990101 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3650/7067] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:09:53.808642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:53.809493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:53.811400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=7 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:53.812092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:53.816758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4a4038f9-45e2-4bb5-a149-9d53ef81051b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:09:53.825067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a4038f9-45e2-4bb5-a149-9d53ef81051b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.825576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a4038f9-45e2-4bb5-a149-9d53ef81051b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.826035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4a4038f9-45e2-4bb5-a149-9d53ef81051b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:53.848543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4a4038f9-45e2-4bb5-a149-9d53ef81051b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Going to try to stop instance {{(pid=122456) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:09:53.889823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4a4038f9-45e2-4bb5-a149-9d53ef81051b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action" status: 202 len: 0 microversion: 2.1 time: 0.081600 Sep 08 11:09:53.890679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3418/7068] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:09:53 2022] POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:09:53.899353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:53.900111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:53.903446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=7 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:53.904224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=38 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:09:53.910040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.910541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.910994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:53.911732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:53.912192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:53.912626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:54.052257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:54.061418 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d29795ff-5a0c-4d11-891d-42668ff58b59 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.166083 Sep 08 11:09:54.061901 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3651/7069] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:53 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:09:55.086880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:55.087612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:55.093808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:55.094302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:55.094749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:55.095454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:55.095938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:55.096374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:55.225746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:55.233654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d7455371-f541-4267-9d8f-fcb15a816fb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.152574 Sep 08 11:09:55.234245 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3419/7070] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:55 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:56.264727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:56.265597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:56.272465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.273625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.274077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.274776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:56.275233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:56.275697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:56.406524 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:56.414390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e26e5c69-1cac-4669-a042-54f66e81e022 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.153605 Sep 08 11:09:56.414976 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3652/7071] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:56 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:57.437731 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:57.438362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:57.445282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:57.445779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:57.446236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.446939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:57.447409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:57.447874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:57.580443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:57.588741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ce9effa-7da8-47f8-aa7c-8090491d4eb1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.155001 Sep 08 11:09:57.589323 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3420/7072] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:57 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:58.613826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:58.614426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:58.621930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:58.622419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:58.622863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:58.623585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:58.624044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:58.624475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:58.755663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:58.763389 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-152589a8-0bfb-4f2f-99ac-1f37becbf5cc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.153531 Sep 08 11:09:58.763992 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3653/7073] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:58 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:09:59.786285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:09:59.786918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:09:59.794518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:59.795020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:59.795489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:59.796202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:09:59.796673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:09:59.797127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:09:59.930988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:09:59.938937 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f1333d1c-06e6-462b-bdaa-826accd8b21f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.156660 Sep 08 11:09:59.939528 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3421/7074] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:09:59 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:00.963028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:00.963673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:00.970699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:00.971191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:00.971677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:00.972374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:00.972830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:00.973260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:01.107158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:01.114923 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4f8981e5-2bfa-4f84-83aa-9e815da9ca3c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.156670 Sep 08 11:10:01.115516 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3654/7075] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:00 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:02.138774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:02.139409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:02.146664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.147162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.147647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:02.148358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:02.148827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:02.149273 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:02.284934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:02.293372 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c2c4324-d9b4-4b1f-b37c-74185ec45466 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.158565 Sep 08 11:10:02.293963 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3422/7076] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:02 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:03.317515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:03.318086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:03.325036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:03.325528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:03.326060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:03.326772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:03.327231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:03.327689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:03.461171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:03.468847 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05c6e5f9-74ba-44ee-8dd4-6784f5413971 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.155317 Sep 08 11:10:03.469421 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3655/7077] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:03 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:04.493604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:04.494247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:04.501259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:04.501761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:04.502216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:04.502921 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:04.503432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:04.503900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:04.634623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:04.642865 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-edc751ad-45fc-47cc-8a8f-64f545b7c329 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.153804 Sep 08 11:10:04.643449 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3423/7078] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:04 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:05.667224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:05.667785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:05.674603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:05.675092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:05.675560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:05.676263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:05.676715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:05.677143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:05.816416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:05.824933 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5dea5f39-e9a3-4a66-bfeb-8861e7b6ed31 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.162364 Sep 08 11:10:05.825594 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3656/7079] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:05 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:06.847310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:06.847985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:06.855262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:06.855793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:06.856239 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:06.856937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:06.857400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:06.857836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:06.986309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:06.994752 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6a998d5-da51-46ec-ab78-ea1898671c0c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.151410 Sep 08 11:10:06.995337 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3424/7080] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:06 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:08.019969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:08.020581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:08.027557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:08.028049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:08.028548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:08.029190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:08.029651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:08.030082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:08.167488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:08.175236 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c1e98874-918d-492d-b9cf-13b1c89197f6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.159240 Sep 08 11:10:08.175839 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3657/7081] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:08 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:09.199138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:09.199803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:09.206501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:09.207005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:09.207484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.208193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:09.208670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:09.209117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.341663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:09.349374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17c3d679-0ff7-4775-a383-b9f92a520357 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1657 microversion: 2.1 time: 0.154176 Sep 08 11:10:09.349947 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3425/7082] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:09 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:09.372262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:09.374560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:09.381449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:09.381936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:09.382372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.383059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:09.383528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:09.384215 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.418034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:09.423506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122457) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:10:09.429956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:10:09.430446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:10:09.430915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:10:09.431319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:10:09.431751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:10:09.495743 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a62fa069-6ab6-4664-8610-d7de481d788c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action" status: 202 len: 0 microversion: 2.1 time: 0.127269 Sep 08 11:10:09.496385 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3658/7083] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:09 2022] POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:09.504503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:09.505123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:09.511656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:09.512155 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:09.512604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.513310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:09.513775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:09.514211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:09.681657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:09.690535 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-44b095dc-b11f-4596-9b59-66113cb1808d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.189768 Sep 08 11:10:09.691124 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3426/7084] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:09 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:10.721193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:10.721980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:10.731307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:10.731833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:10.732277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:10.732990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:10.733447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:10.733876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:10.885119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:10.893930 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5033172f-15de-4949-8f17-e6369fab3716 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1680 microversion: 2.1 time: 0.179642 Sep 08 11:10:10.894503 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3659/7085] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:10 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:11.918743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:11.919291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:11.926290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:11.926790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:11.927249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:11.927992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:11.928464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:11.928910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:12.065143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:12.073275 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d1d45f4-dae3-4086-b177-aedc13d1bae3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1685 microversion: 2.1 time: 0.159114 Sep 08 11:10:12.074153 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3427/7086] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:11 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:13.097953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:13.098567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:13.105482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:13.105971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:13.106417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:13.107117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:13.107617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:13.108052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:13.238086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:13.246356 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97e9a480-5199-4ac6-a114-e2f6da10fde6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1685 microversion: 2.1 time: 0.152368 Sep 08 11:10:13.246930 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3660/7087] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:13 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:14.270817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:14.271510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:14.278175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.278713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.279169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:14.279914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.280383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.280827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:14.291069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "name": "network-vif-unplugged", "status": "completed", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:14.302416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:14.303100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:14.303570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:14.323198 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] Creating event network-vif-unplugged:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h2-833090-19 Sep 08 11:10:14.329153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] Instance 18d6c656-f5b1-4848-88b1-3330543cb39f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:10:14.339979 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ec783f24-9d25-4524-8907-53e8bf1bdfbc req-b3e7dc5e-d3d4-4046-a138-880bf6a0afd3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053050 Sep 08 11:10:14.340783 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3661/7088] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:10:14.554503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:14.563106 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac7834db-12f1-4f2a-95a6-a1712987677d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1684 microversion: 2.1 time: 0.296383 Sep 08 11:10:14.563722 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3428/7089] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:14 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1684 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:15.587633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:15.588333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:15.594610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:15.595097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:15.595568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:15.596264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:15.596725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:15.597154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:15.731807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:15.739744 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0fb61965-0626-4405-89b1-658be07c9d17 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1682 microversion: 2.1 time: 0.157226 Sep 08 11:10:15.740322 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3662/7090] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:15 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:16.371740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:16.381925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.382412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.382857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.395687 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] Creating event network-changed:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h2-833090-19 Sep 08 11:10:16.401539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] Instance 18d6c656-f5b1-4848-88b1-3330543cb39f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:10:16.412330 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-38ee652f-4619-45cd-821f-49d4d7e32e7a req-21a5f63d-0550-4490-b069-208c2ce53ebf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044416 Sep 08 11:10:16.412913 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3429/7091] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:16.765324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:16.765956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:16.772852 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.773340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.774396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.775142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:16.775626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:16.776253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:16.985365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:16.993875 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb5f8cd2-2e31-4642-a7c9-317191873b9e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1682 microversion: 2.1 time: 0.232655 Sep 08 11:10:16.994695 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3663/7092] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:16 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:18.020333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:18.021052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:18.028068 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:18.028575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:18.029028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:18.029749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:18.030225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:18.030671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:18.260607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:18.270295 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9071fc5d-3b6d-403d-b533-e96831f2b729 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1682 microversion: 2.1 time: 0.255239 Sep 08 11:10:18.272593 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3430/7093] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:18 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:19.295132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:19.296024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:19.303187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.303795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.304578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.305347 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.305888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.306328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.527520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:19.535754 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d9d0e331-f42e-4c54-bea3-d557099078cd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1678 microversion: 2.1 time: 0.244396 Sep 08 11:10:19.536340 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3664/7094] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:19 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:19.560397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:19.561019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:19.568369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.568977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.569503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.570306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.571567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.571971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.634258 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e7934365-c990-4fbe-8c19-f2d4da962671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action" status: 204 len: 0 microversion: 2.1 time: 0.077754 Sep 08 11:10:19.634926 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3431/7095] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:19 2022] POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:10:19.644853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:19.645572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:19.653087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.654696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.655148 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.655983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:19.656455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:19.657086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:19.877052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:19.885616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f70cd913-a0a8-474d-a531-c231e913e478 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1678 microversion: 2.1 time: 0.245272 Sep 08 11:10:19.886209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3665/7096] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:19 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:20.824213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3e71995f-30f4-46e7-b23e-ea35d09485c8 req-dbc7d404-8ac4-444a-8be8-e9c1d517051d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "name": "network-vif-plugged", "status": "completed", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:20.838259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3e71995f-30f4-46e7-b23e-ea35d09485c8 req-dbc7d404-8ac4-444a-8be8-e9c1d517051d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:20.839176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3e71995f-30f4-46e7-b23e-ea35d09485c8 req-dbc7d404-8ac4-444a-8be8-e9c1d517051d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:20.842553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3e71995f-30f4-46e7-b23e-ea35d09485c8 req-dbc7d404-8ac4-444a-8be8-e9c1d517051d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:20.856891 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3e71995f-30f4-46e7-b23e-ea35d09485c8 req-dbc7d404-8ac4-444a-8be8-e9c1d517051d service nova] Creating event network-vif-plugged:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h2-833090-19 Sep 08 11:10:20.863523 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3e71995f-30f4-46e7-b23e-ea35d09485c8 req-dbc7d404-8ac4-444a-8be8-e9c1d517051d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043404 Sep 08 11:10:20.864268 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3432/7097] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:20.909373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:20.910945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:20.919577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:20.920083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:20.920526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:20.921242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:20.921730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:20.922168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:20.952805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:21.083410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:21.092513 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3eb5efa-d8fb-42d2-9df9-a302b1d2b0c0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1657 microversion: 2.1 time: 0.187186 Sep 08 11:10:21.093178 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3666/7098] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:20 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1657 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:21.116118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:21.116834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:21.123517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.124023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.124482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.125192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.125664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.126109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.142365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:21.271803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:21.280244 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9680ec7c-7a1f-49ab-99d8-f472ac5170c9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1657 microversion: 2.1 time: 0.168485 Sep 08 11:10:21.280822 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3433/7099] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:21 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1657 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:21.302764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccd6e4b3-3873-4e33-84ba-6b06d4392218 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:21.309534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccd6e4b3-3873-4e33-84ba-6b06d4392218 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.310031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccd6e4b3-3873-4e33-84ba-6b06d4392218 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.310476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccd6e4b3-3873-4e33-84ba-6b06d4392218 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.337775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ccd6e4b3-3873-4e33-84ba-6b06d4392218 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Going to try to start instance {{(pid=122457) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 11:10:21.386426 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ccd6e4b3-3873-4e33-84ba-6b06d4392218 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action" status: 202 len: 0 microversion: 2.1 time: 0.087474 Sep 08 11:10:21.386983 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3667/7100] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:10:21 2022] POST /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:10:21.395514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:21.396430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:21.402647 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.403161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.403824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.404725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:21.405200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:21.405825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:21.586098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:21.597704 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f0d8fa51-b83c-4f66-bd35-c888c4370ea7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1666 microversion: 2.1 time: 0.205687 Sep 08 11:10:21.598541 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3434/7101] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:21 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1666 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:22.624076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:22.624772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:22.630927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:22.631413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:22.631879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:22.632569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:22.633025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:22.633450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:22.770372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:22.778281 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e9a0da1a-05ae-463b-bfe1-517537f9e5ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1666 microversion: 2.1 time: 0.159261 Sep 08 11:10:22.778873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3668/7102] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:22 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:23.804226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:23.805432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:23.812550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.813059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.813516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.814242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.814738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.815244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.953025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:23.961011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9716125-6145-43b8-885d-767b7c31f2fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1670 microversion: 2.1 time: 0.160820 Sep 08 11:10:23.961590 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3435/7103] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:23 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:23.984134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:23.984766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:23.987410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=41 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:23.993350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.993835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.994276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:23.994974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:23.995430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:23.995890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:24.021510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:10:24.097968 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a297122-cf16-43fd-967f-a68539f6c083 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 204 len: 0 microversion: 2.1 time: 0.117444 Sep 08 11:10:24.098646 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3669/7104] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:10:23 2022] DELETE /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:10:24.107785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:24.108437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:24.110419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:24.116020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:24.116522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:24.117076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:24.118267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:24.118734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:24.119175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:24.254565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:24.262626 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80ff1ff0-5597-4077-9702-0f68cd8d6281 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1676 microversion: 2.1 time: 0.158747 Sep 08 11:10:24.263208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3436/7105] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:24 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:25.287092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:25.287808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:25.289906 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:10:25.290053 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f (ip 10.222.0.59) !!! Sep 08 11:10:25.302785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:25.303278 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:25.303776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:25.304965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:25.305427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:25.305886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:25.442492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:25.450403 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4be196d1-fa1f-4a64-9257-03126a58c78a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1676 microversion: 2.1 time: 0.167508 Sep 08 11:10:25.450994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3670/7106] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:25 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:26.387743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0723c843-3414-43dd-bddd-555897dd005c req-85331fff-ec7f-4698-b8bf-3d122a08c0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d6c656-f5b1-4848-88b1-3330543cb39f", "name": "network-vif-deleted", "tag": "e6a8dd58-414e-4cf1-b521-e8721d15f7b8"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:26.395175 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:10:26.395402 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Sep 08 11:10:26.412386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0723c843-3414-43dd-bddd-555897dd005c req-85331fff-ec7f-4698-b8bf-3d122a08c0e8 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:26.412879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0723c843-3414-43dd-bddd-555897dd005c req-85331fff-ec7f-4698-b8bf-3d122a08c0e8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:26.413396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0723c843-3414-43dd-bddd-555897dd005c req-85331fff-ec7f-4698-b8bf-3d122a08c0e8 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:26.427943 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0723c843-3414-43dd-bddd-555897dd005c req-85331fff-ec7f-4698-b8bf-3d122a08c0e8 service nova] Creating event network-vif-deleted:e6a8dd58-414e-4cf1-b521-e8721d15f7b8 for instance 18d6c656-f5b1-4848-88b1-3330543cb39f on n-h2-833090-19 Sep 08 11:10:26.437449 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0723c843-3414-43dd-bddd-555897dd005c req-85331fff-ec7f-4698-b8bf-3d122a08c0e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050862 Sep 08 11:10:26.438510 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3437/7107] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:26.476053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:26.477505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:26.484169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:26.484828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:26.485494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:26.486311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:26.486864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:26.487433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:26.522393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:26.522873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:26.523351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:26.523828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lazy-loading 'fault' on Instance uuid 18d6c656-f5b1-4848-88b1-3330543cb39f {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:10:26.576774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:26.586423 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-21478fba-df6b-40e5-8ea3-89f9363338ca tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 200 len: 1328 microversion: 2.1 time: 0.115525 Sep 08 11:10:26.587344 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3671/7108] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:26 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:27.611098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:27.611777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:27.618786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:27.619316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:27.619783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:27.620507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:27.620981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:27.621429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:27.635137 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f HTTP/1.1 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '18d6c656-f5b1-4848-88b1-3330543cb39f'} Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:27.636841 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-94082926-e8c8-441f-9efb-6652d81eb1bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 404 len: 111 microversion: 2.1 time: 0.031763 Sep 08 11:10:27.641836 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3438/7109] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:27 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:10:27.657054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:27.658207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:27.672095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:27.672601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:27.673079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:27.673795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:27.674255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:27.674689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:27.689025 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f HTTP/1.1 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '18d6c656-f5b1-4848-88b1-3330543cb39f'} Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:10:27.690671 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f4d090df-58b8-4833-874a-f7be8e3ca95f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 404 len: 111 microversion: 2.1 time: 0.040107 Sep 08 11:10:27.696196 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3672/7110] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:27 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:10:27.745087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-783281993", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "2e74a738-12d7-44b0-92e9-df858e591bd6"}], "security_groups": [{"name": "tempest-securitygroup--368825094"}], "key_name": "tempest-keypair-132749164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:27.850396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] validate_networks() for [('2e74a738-12d7-44b0-92e9-df858e591bd6', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:10:28.292414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:10:28.292847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:10:28.293332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:10:28.293750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:10:28.294175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:10:28.302824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:28.303339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:28.303814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:28.305100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:28.305565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:28.306004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:28.324125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:10:28.329624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:10:28.342421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:10:28.344864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:10:28.393578 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6eb18da6-9d49-4c82-8794-4e2c992eb10a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.652345 Sep 08 11:10:28.394256 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3439/7111] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:10:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:10:28.406126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fdf8695c-f1dc-4d86-8464-49ad1242a32a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:28.406808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fdf8695c-f1dc-4d86-8464-49ad1242a32a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:28.462455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fdf8695c-f1dc-4d86-8464-49ad1242a32a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:28.469703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fdf8695c-f1dc-4d86-8464-49ad1242a32a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1237 microversion: 2.1 time: 0.067859 Sep 08 11:10:28.470283 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3673/7112] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:28 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:29.498049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:29.499425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:29.508681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.509716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:29.510290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:29.511348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:29.511858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:29.512471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:29.595735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:29.604509 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9f23b6d-48b3-4b01-b739-2bcce3bb2671 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1295 microversion: 2.1 time: 0.114096 Sep 08 11:10:29.605088 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3440/7113] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:29 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:30.628744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:30.629295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:30.637138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:30.637633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:30.638075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:30.638779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:30.639240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:30.639695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:30.857652 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:30.865851 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e659d7bb-713e-465b-85ef-695f9adea43f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1362 microversion: 2.1 time: 0.241189 Sep 08 11:10:30.866427 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3674/7114] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:30 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:31.119366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b06745a8-0db2-42b7-930d-c1fb77c6f9ed req-d906621d-fb93-487e-b46d-f318ccbd52c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:31.131040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b06745a8-0db2-42b7-930d-c1fb77c6f9ed req-d906621d-fb93-487e-b46d-f318ccbd52c2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:31.131580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b06745a8-0db2-42b7-930d-c1fb77c6f9ed req-d906621d-fb93-487e-b46d-f318ccbd52c2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:31.132029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b06745a8-0db2-42b7-930d-c1fb77c6f9ed req-d906621d-fb93-487e-b46d-f318ccbd52c2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:31.145673 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b06745a8-0db2-42b7-930d-c1fb77c6f9ed req-d906621d-fb93-487e-b46d-f318ccbd52c2 service nova] Creating event network-changed:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h1-833090-19 Sep 08 11:10:31.150622 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b06745a8-0db2-42b7-930d-c1fb77c6f9ed req-d906621d-fb93-487e-b46d-f318ccbd52c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035984 Sep 08 11:10:31.151234 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3441/7115] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:31.889825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:31.890621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:31.897661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:31.898149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:31.899090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:31.899827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:31.900284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:31.900713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:32.037903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:32.046813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b9ae2160-d25a-4e27-8823-ffde7d61b9a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1362 microversion: 2.1 time: 0.160941 Sep 08 11:10:32.047670 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3675/7116] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:31 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:10:33.076986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:33.078000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:33.084854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:33.085359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:33.085818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:33.087190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:33.087715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:33.088169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:33.220491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:33.228267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-280a0924-7bd6-4556-a278-2e395542b536 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1362 microversion: 2.1 time: 0.157798 Sep 08 11:10:33.228846 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3442/7117] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:33 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:34.251741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:34.252345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:34.259608 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:34.260031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:34.260471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:34.261168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:34.261621 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:34.262045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:34.401708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:34.409456 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0f26b1ab-7d0f-42e0-ac41-3cce956a91ba tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1362 microversion: 2.1 time: 0.161716 Sep 08 11:10:34.410030 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3676/7118] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:34 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:35.434251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:35.434889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:35.442002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:35.442510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:35.442972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:35.443730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:35.444210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:35.444662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:35.582710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:35.590623 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87d12de3-19d5-49c2-b90d-1954df3392fd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1362 microversion: 2.1 time: 0.160701 Sep 08 11:10:35.591216 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3443/7119] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:35 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:36.171975 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-65724631-0a69-4da8-a9bb-567b692ae64e req-1a37e405-a239-49d6-9942-df234e396530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "name": "network-vif-plugged", "status": "completed", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:36.183137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-65724631-0a69-4da8-a9bb-567b692ae64e req-1a37e405-a239-49d6-9942-df234e396530 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:36.183657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-65724631-0a69-4da8-a9bb-567b692ae64e req-1a37e405-a239-49d6-9942-df234e396530 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:36.184090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-65724631-0a69-4da8-a9bb-567b692ae64e req-1a37e405-a239-49d6-9942-df234e396530 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:36.196001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-65724631-0a69-4da8-a9bb-567b692ae64e req-1a37e405-a239-49d6-9942-df234e396530 service nova] Creating event network-vif-plugged:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h1-833090-19 Sep 08 11:10:36.201196 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-65724631-0a69-4da8-a9bb-567b692ae64e req-1a37e405-a239-49d6-9942-df234e396530 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Sep 08 11:10:36.201811 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3677/7120] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:36.614486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:36.615020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:36.622575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:36.623073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:36.623557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:36.624310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:36.624783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:36.625227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:36.767275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:36.775050 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-99fcd4ac-c34a-4219-875e-85c4d912148a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1362 microversion: 2.1 time: 0.164626 Sep 08 11:10:36.775675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3444/7121] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:36 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:37.800188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:37.800947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:37.807680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:37.808195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:37.808665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:37.809419 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:37.809908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:37.810380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:37.947984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:10:37.956394 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5d2cc051-7c8c-4ca0-8ca6-49ad62a77b46 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1549 microversion: 2.1 time: 0.161741 Sep 08 11:10:37.956983 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3678/7122] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:10:37 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:10:37.980002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:10:37.980496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:10:37.987357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:37.987891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:37.988344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:37.989049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:37.989516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:37.989956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:38.084908 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-beb766d3-503c-4cf2-b856-0d05f6c81f90 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108853 Sep 08 11:10:38.085531 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3445/7123] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 11:10:37 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:10:39.325063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-f27018ef-b761-4729-a56e-299a057dc90b req-de032cec-7fb6-4072-bc59-f0e74fe6ec26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:10:39.330006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:10:39.336981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f27018ef-b761-4729-a56e-299a057dc90b req-de032cec-7fb6-4072-bc59-f0e74fe6ec26 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:10:39.337466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f27018ef-b761-4729-a56e-299a057dc90b req-de032cec-7fb6-4072-bc59-f0e74fe6ec26 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:10:39.337902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-f27018ef-b761-4729-a56e-299a057dc90b req-de032cec-7fb6-4072-bc59-f0e74fe6ec26 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:10:39.351251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-f27018ef-b761-4729-a56e-299a057dc90b req-de032cec-7fb6-4072-bc59-f0e74fe6ec26 service nova] Creating event network-changed:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h1-833090-19 Sep 08 11:10:39.359056 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-f27018ef-b761-4729-a56e-299a057dc90b req-de032cec-7fb6-4072-bc59-f0e74fe6ec26 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037971 Sep 08 11:10:39.359787 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3679/7124] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:07.848491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.849293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.851887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.852652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=57 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.858353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:07.860719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:07.869143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:07.869652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:07.870115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:07.870859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:07.871330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:07.871812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:07.901929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:07.907581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:11:07.914148 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:11:07.914588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:11:07.915081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:11:07.915571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:11:07.916528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:11:07.980457 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49cd0701-cf4c-473f-a25c-68bee12f0bd8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667/action" status: 202 len: 0 microversion: 2.1 time: 0.132727 Sep 08 11:11:07.981078 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3446/7125] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:11:07 2022] POST /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:11:07.988123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.988938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:07.993528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:07.994284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:08.002570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:08.003134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:08.003744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:08.004572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:08.005166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:08.005670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:08.164804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:08.172986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba57424b-0083-4f37-b311-74ce2417bde8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1677 microversion: 2.1 time: 0.187278 Sep 08 11:11:08.173647 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3680/7126] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:07 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:09.197170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:09.197801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:09.205025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:09.205532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:09.205995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:09.206710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:09.207184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:09.207665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:09.356859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:09.365308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a2ce8c84-8fe5-4f38-bdef-f3004751e0a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1677 microversion: 2.1 time: 0.173020 Sep 08 11:11:09.365993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3447/7127] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:09 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:10.389375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:10.390184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:10.396989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:10.397471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:10.397910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:10.398600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:10.399055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:10.399503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:10.528567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:10.536319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3f219c06-f568-419b-9317-6d627a5780d1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.150952 Sep 08 11:11:10.536887 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3681/7128] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:10 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:11.561093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:11.561723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:11.568733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.569238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.569699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.570414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:11.570897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:11.571339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:11.706772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:11.718350 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-581b472a-108d-4f84-b296-6a463eb8dfda tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.161139 Sep 08 11:11:11.718986 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3448/7129] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:11 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:12.743179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:12.743805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:12.750699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:12.751187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:12.751670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:12.752377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:12.752832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:12.753261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:12.886945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:12.895021 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9a73eaf4-8011-4cf8-b2b4-61f45e9b7691 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.155833 Sep 08 11:11:12.895631 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3682/7130] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:12 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:13.918710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:13.919341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:13.926307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:13.926810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:13.927268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:13.928008 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:13.928483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:13.928924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:14.063523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:14.072458 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-016c84a8-07c0-4ca7-9d40-c40f5607e1f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.156953 Sep 08 11:11:14.073054 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3449/7131] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:13 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:15.097132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:15.097752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:15.106337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:15.106829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:15.107276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:15.108008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:15.108472 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:15.108903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:15.238568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:15.246830 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7c6afd77-d577-4339-92b9-4c1938cb0cfe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.153664 Sep 08 11:11:15.247413 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3683/7132] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:15 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:16.270395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:16.271025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:16.278124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:16.278631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:16.279103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:16.279829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:16.280307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:16.280804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:16.412377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:16.422378 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51ac993c-7057-4397-af46-278b90be34a0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.155723 Sep 08 11:11:16.423445 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3450/7133] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:16 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:17.445696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:17.446772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:17.453592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:17.454069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:17.454502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:17.455185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:17.455659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:17.456082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:17.591571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:17.599236 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c5ee3c4-6a22-4162-bc10-ec02d04a610c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.157455 Sep 08 11:11:17.599919 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3684/7134] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:17 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:18.623623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:18.624252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:18.631236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:18.631765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:18.632220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:18.633408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:18.634448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:18.634772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:18.773966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:18.782772 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-368418c4-39fa-4c9e-bcec-bd6b82b0887b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.163184 Sep 08 11:11:18.783369 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3451/7135] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:18 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:19.805915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:19.806538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:19.813628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.814102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.814530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.815221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:19.815694 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:19.816117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:19.951077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:19.958778 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f56f5e83-a2ce-4a0e-92df-b57563bd7a95 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.156739 Sep 08 11:11:19.959344 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3685/7136] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:19 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:20.981869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:20.982616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:20.989537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:20.990037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:20.990494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:20.991204 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:20.991721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:20.992145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:21.152858 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:21.163224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8bb3456a-32a4-4e04-bc87-30d6dd224f29 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1682 microversion: 2.1 time: 0.184795 Sep 08 11:11:21.164297 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3452/7137] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:20 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:22.191575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:22.192183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:22.200418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:22.200953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:22.201400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:22.202118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:22.202572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:22.203028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:22.460560 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:22.468873 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04bb8a24-7e0a-4609-82b2-e2a08b5e2a8c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1681 microversion: 2.1 time: 0.281936 Sep 08 11:11:22.469471 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3686/7138] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:22 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:22.557927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "name": "network-vif-unplugged", "status": "completed", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:22.569139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:22.569700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:22.570377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:22.584456 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] Creating event network-vif-unplugged:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h2-833090-19 Sep 08 11:11:22.590802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] Instance 45b39adf-22cf-423a-a157-c2780be75667 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:11:22.603248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a2f86a54-2dd2-4682-b2c1-11f31c96df05 req-04037775-71cf-40bc-8e61-4fbede973a70 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049625 Sep 08 11:11:22.604288 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3453/7139] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:23.494441 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:23.495055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:23.502187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:23.502674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:23.503117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:23.503847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:23.504442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:23.504985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:23.724700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:23.732598 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5afc26e-aa46-4b03-bcde-60535a24a2f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1681 microversion: 2.1 time: 0.242542 Sep 08 11:11:23.733192 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3687/7140] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:23 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:24.757264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:24.757980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:24.766036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:24.766548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:24.767003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:24.767767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:24.768240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:24.768685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:24.912283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:24.921051 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-36a3251a-d237-4752-9344-ec81f42fdc96 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1679 microversion: 2.1 time: 0.168111 Sep 08 11:11:24.921648 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3454/7141] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:24 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:24.990427 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:25.000708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:25.001185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:25.001616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:25.013245 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] Creating event network-changed:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h2-833090-19 Sep 08 11:11:25.018752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] Instance 45b39adf-22cf-423a-a157-c2780be75667 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:11:25.030443 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-03c3c305-8ab7-40bb-9789-5c70017eb758 req-1ba0d159-0db6-4193-884f-6878cae14297 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153933 Sep 08 11:11:25.031058 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3688/7142] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:11:25.945859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:25.946479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:25.953346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:25.953841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:25.954286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:25.954986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:25.955448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:25.955922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:26.093675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:26.102845 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-31649935-5dcc-4dc0-868b-26f755ea26b5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1679 microversion: 2.1 time: 0.160185 Sep 08 11:11:26.103372 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3455/7143] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:25 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:27.128651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:27.130361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:27.140130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:27.141199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:27.141869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:27.142795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:27.143490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:27.144725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:27.381881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:27.390125 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3fbe0b4c-2193-4cff-8d84-044ecfe33ed7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1679 microversion: 2.1 time: 0.267279 Sep 08 11:11:27.390719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3689/7144] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:27 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:28.414299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:28.415329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:28.422372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.422874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.423325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.424071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.424538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.424977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.627043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:28.635210 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-65767f12-9dad-4ccf-bcd3-9e42bfa6c5eb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1676 microversion: 2.1 time: 0.224968 Sep 08 11:11:28.635803 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3456/7145] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:28 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:28.658020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:28.658549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:28.665970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.666404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.666842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.667550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.668005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.668431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.705523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.706000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.706433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.707152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.707649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.708075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.729013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:11:28.734505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:11:28.839800 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03c0fb6e-5793-449c-903a-3ced5029f17e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667/action" status: 202 len: 0 microversion: 2.1 time: 0.185743 Sep 08 11:11:28.840500 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3690/7146] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:11:28 2022] POST /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:11:28.849666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:28.850295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:28.857299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.857809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.858494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:28.859292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:28.859897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:28.860335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.067157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:29.076654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-129ef23b-fa7b-479c-abde-4469456b16ab tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1675 microversion: 2.1 time: 0.231559 Sep 08 11:11:29.077724 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3457/7147] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:28 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:29.118699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "name": "network-vif-plugged", "status": "completed", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:29.129756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:29.130249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:29.130822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:29.144560 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] Creating event network-vif-plugged:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h2-833090-19 Sep 08 11:11:29.151165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] Instance 45b39adf-22cf-423a-a157-c2780be75667 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:11:29.162066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-49589c6f-85df-480c-b0ba-6d649c3ad6e0 req-fe1c7b01-17b9-4e4d-b92b-be18b9634c11 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048842 Sep 08 11:11:29.162682 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3691/7148] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:30.100956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:30.101619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:30.108508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:30.109014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:30.109468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.110178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:30.110656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:30.111131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:30.248915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:30.256616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0dba1ff-e396-40cc-bf6c-c3f0cec69ee1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1675 microversion: 2.1 time: 0.159551 Sep 08 11:11:30.257198 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3458/7149] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:30 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:31.282695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:31.283403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:31.290152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:31.290714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:31.291080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:31.291811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:31.292363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:31.292792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:31.476082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:31.484652 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e095da00-3508-42ab-8db9-7ce60fffe21a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1675 microversion: 2.1 time: 0.207196 Sep 08 11:11:31.485231 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3692/7150] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:31 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:32.508809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:32.509503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:32.517196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:32.517693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:32.518142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:32.518856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:32.519316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:32.519783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:32.817973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "name": "network-vif-unplugged", "status": "completed", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:32.829336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:32.829738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:32.830174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:32.839942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:32.842859 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] Creating event network-vif-unplugged:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h1-833090-19 Sep 08 11:11:32.848659 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5bd8259f-a142-4b8d-a2bc-fdc1d0ba6bf8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1675 microversion: 2.1 time: 0.343710 Sep 08 11:11:32.848925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] Instance 45b39adf-22cf-423a-a157-c2780be75667 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:11:32.849260 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3459/7151] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:32 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1675 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:32.872022 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9a0ead24-0aaf-45b4-81ef-746257fc3b8d req-b1debb9e-f57a-4352-8892-bcc01bdec2ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057911 Sep 08 11:11:32.872840 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3693/7152] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:33.873417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:33.874044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:33.880926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:33.881423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:33.881872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:33.882579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:33.883105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:33.883558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:34.099190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:34.107054 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ed4cef8-1f13-412c-b780-fa2fec8d34ee tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1675 microversion: 2.1 time: 0.237489 Sep 08 11:11:34.107706 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3460/7153] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:33 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:34.900796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:34.910619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:34.911098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:34.911563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:34.923561 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] Creating event network-changed:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h1-833090-19 Sep 08 11:11:34.926021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:34.929822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] Instance 45b39adf-22cf-423a-a157-c2780be75667 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:11:34.940518 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3222cce8-22dd-468e-8124-a6ef91e3a1fe req-6b129d3b-127d-4447-85bd-b80b347144cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045592 Sep 08 11:11:34.941195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3694/7154] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:35.134015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:35.135192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:35.143366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.144007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.144621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.145354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:35.145936 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:35.146552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:35.166733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:35.458774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:35.476218 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce7e65e6-7c64-4634-9afe-d065fd6429dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1675 microversion: 2.1 time: 0.346071 Sep 08 11:11:35.476822 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3461/7155] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:35 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1675 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:36.505079 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.505770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.512383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.512864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.513300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.513992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.514700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.515120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.667635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:36.677812 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a933aa5-1e05-4ea9-b615-57cc12169574 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1668 microversion: 2.1 time: 0.178878 Sep 08 11:11:36.678394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3695/7156] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:11:36.700539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.701190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.707997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.708486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.708932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.709634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.710096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.710532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.846387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:36.854141 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18b37ab4-1146-4c40-9945-feb201bc978d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1668 microversion: 2.1 time: 0.157942 Sep 08 11:11:36.854711 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3462/7157] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:36.876246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:36.876863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:36.882924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.883411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.883920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:36.885142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:36.885600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:36.886027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.022316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:37.030227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02f7dbfb-5b7a-4025-9740-f34936d4a062 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1668 microversion: 2.1 time: 0.157831 Sep 08 11:11:37.030801 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3696/7158] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:36 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:37.052884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:37.053396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:37.060062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:37.060565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:37.061016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.061723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:37.062187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:37.062620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.091817 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:11:37.166870 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f9c55cff-b0d2-4a1a-8630-598baa53fe2a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 204 len: 0 microversion: 2.1 time: 0.117990 Sep 08 11:11:37.167587 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3463/7159] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:11:37 2022] DELETE /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 11:11:37.176463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:37.177081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:37.183578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:37.184072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:37.184517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.185208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:37.185665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:37.186098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:37.400970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:37.408771 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-03acc2f0-f4b7-40fe-866b-77a20676b299 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1674 microversion: 2.1 time: 0.236374 Sep 08 11:11:37.409335 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3697/7160] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:37 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:38.435133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:38.435737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:38.438673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:38.445543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:38.445811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:38.446446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:38.447925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:38.448873 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:38.449443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:38.709779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:38.717720 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-87ec9a46-097e-4f44-94aa-1a0f8ac92f66 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1674 microversion: 2.1 time: 0.288014 Sep 08 11:11:38.718304 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3464/7161] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:38 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1674 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:39.573803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3e2c5950-304b-406c-9622-cf225cb54b35 req-3b374abc-6a18-4a39-aa6d-d2fe89d3b9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b39adf-22cf-423a-a157-c2780be75667", "name": "network-vif-deleted", "tag": "fabd1dfb-2fdf-4886-83dc-8ee9e0321869"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:39.581011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:39.581815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:39.599776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3e2c5950-304b-406c-9622-cf225cb54b35 req-3b374abc-6a18-4a39-aa6d-d2fe89d3b9b7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.600209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3e2c5950-304b-406c-9622-cf225cb54b35 req-3b374abc-6a18-4a39-aa6d-d2fe89d3b9b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.600618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3e2c5950-304b-406c-9622-cf225cb54b35 req-3b374abc-6a18-4a39-aa6d-d2fe89d3b9b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.613319 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3e2c5950-304b-406c-9622-cf225cb54b35 req-3b374abc-6a18-4a39-aa6d-d2fe89d3b9b7 service nova] Creating event network-vif-deleted:fabd1dfb-2fdf-4886-83dc-8ee9e0321869 for instance 45b39adf-22cf-423a-a157-c2780be75667 on n-h1-833090-19 Sep 08 11:11:39.618115 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3e2c5950-304b-406c-9622-cf225cb54b35 req-3b374abc-6a18-4a39-aa6d-d2fe89d3b9b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048830 Sep 08 11:11:39.618762 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3698/7162] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:39.742666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:39.743531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:39.750807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.751543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.751997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.752709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.753179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.753637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.786193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:39.786694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:39.787146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:39.787639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lazy-loading 'fault' on Instance uuid 45b39adf-22cf-423a-a157-c2780be75667 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:11:39.829554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:39.838185 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cab46ad9-8a24-46f9-a36f-04d51c1622aa tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 200 len: 1327 microversion: 2.1 time: 0.099816 Sep 08 11:11:39.838823 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3465/7163] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:39 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:40.863294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:40.864021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:40.870768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.871305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.871768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.872453 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.872903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.873324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.887282 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 HTTP/1.1 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '45b39adf-22cf-423a-a157-c2780be75667'} Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:40.888938 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-09deb8d7-2de4-4407-a497-4d3ed1a1568d tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 404 len: 111 microversion: 2.1 time: 0.032339 Sep 08 11:11:40.893826 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3699/7164] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:40 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:40.907724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:40.908373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:40.915268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.915788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.916236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.916944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:40.917393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:40.917830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:40.936553 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 HTTP/1.1 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '45b39adf-22cf-423a-a157-c2780be75667'} Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:11:40.938642 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-42163ec2-0a06-4834-852e-431a5a6a5761 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 404 len: 111 microversion: 2.1 time: 0.036454 Sep 08 11:11:40.942649 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3466/7165] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:40 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:11:41.006993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1927174538", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "2e74a738-12d7-44b0-92e9-df858e591bd6"}], "security_groups": [{"name": "tempest-securitygroup--368825094"}], "key_name": "tempest-keypair-132749164", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:41.125917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] validate_networks() for [('2e74a738-12d7-44b0-92e9-df858e591bd6', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:11:41.559708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:11:41.560129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:11:41.560601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:11:41.561006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:11:41.561415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:11:41.570231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:41.570706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:41.571139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:41.571913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:41.572366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:41.572829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:41.590069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:11:41.595273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:11:41.608119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:11:41.610413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:11:41.657037 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a15963c-ad40-4856-8f12-921145fb2871 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653948 Sep 08 11:11:41.657695 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3700/7166] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:11:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:11:41.669705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f67a393b-6f24-4405-bb1e-1f52e51c0575 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:41.670391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f67a393b-6f24-4405-bb1e-1f52e51c0575 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:41.724505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f67a393b-6f24-4405-bb1e-1f52e51c0575 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:41.732127 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f67a393b-6f24-4405-bb1e-1f52e51c0575 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1238 microversion: 2.1 time: 0.067028 Sep 08 11:11:41.732703 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3467/7167] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:41 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:42.755760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:42.756538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:42.766208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:42.766698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:42.767132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:42.767899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:42.768350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:42.768776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:42.856485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:42.864326 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9228965f-03af-48ed-97f2-40f4938aeb42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1308 microversion: 2.1 time: 0.113552 Sep 08 11:11:42.864998 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3701/7168] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:42 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:43.889852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:43.890515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:43.898439 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:43.898948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:43.899404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:43.900152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:43.900666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:43.901114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:44.141629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:44.149685 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-19b26799-b8f5-4c64-b1d7-03680ec5e53e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.264591 Sep 08 11:11:44.150272 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3468/7169] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:43 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:44.332865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-00e97f3f-8d84-4efb-9404-8a7924facbcc req-ad1ee7bf-6099-46bb-a1d2-34cc303b847a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:44.345398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-00e97f3f-8d84-4efb-9404-8a7924facbcc req-ad1ee7bf-6099-46bb-a1d2-34cc303b847a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:44.346026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-00e97f3f-8d84-4efb-9404-8a7924facbcc req-ad1ee7bf-6099-46bb-a1d2-34cc303b847a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:44.346469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-00e97f3f-8d84-4efb-9404-8a7924facbcc req-ad1ee7bf-6099-46bb-a1d2-34cc303b847a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:44.359277 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-00e97f3f-8d84-4efb-9404-8a7924facbcc req-ad1ee7bf-6099-46bb-a1d2-34cc303b847a service nova] Creating event network-changed:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h1-833090-19 Sep 08 11:11:44.364289 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-00e97f3f-8d84-4efb-9404-8a7924facbcc req-ad1ee7bf-6099-46bb-a1d2-34cc303b847a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035149 Sep 08 11:11:44.365061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3702/7170] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:45.173619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:45.174301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:45.181244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:45.182613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:45.182613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:45.182883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:45.183349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:45.183851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:45.314876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:45.322676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-63373e61-a07e-4f5e-9042-74aeaeee05c1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.153072 Sep 08 11:11:45.323257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3469/7171] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:45 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:46.354183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:46.354800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:46.361092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:46.361580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:46.362025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:46.362721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:46.363181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:46.363642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:46.492916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:46.500736 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-74d757c7-0ca0-4444-9652-1f9b6ea199b4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.151745 Sep 08 11:11:46.501299 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3703/7172] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:46 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:47.524313 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:47.524933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:47.532475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:47.532969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:47.533413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:47.534110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:47.534575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:47.535010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:47.675375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:47.683346 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-134b66f3-1c4c-4c54-af68-c84798863668 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.163193 Sep 08 11:11:47.684038 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3470/7173] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:47 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:48.709529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:48.711520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:48.719655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:48.720096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:48.720817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:48.721857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:48.722204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:48.722630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:48.861396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:48.869221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cfec8148-76b2-4612-af18-dc92060c72c6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.164598 Sep 08 11:11:48.869807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3704/7174] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:48 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:49.893053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:49.893682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:49.900678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:49.901185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:49.901642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:49.902357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:49.902832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:49.903279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:50.036507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:50.044843 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6b0dc108-8258-4352-bde5-efc81ef83869 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.155881 Sep 08 11:11:50.045430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3471/7175] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:49 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:50.616333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-40627585-a61e-4541-b4fd-ab58f7d01ad9 req-45f4f29e-7767-4152-a98e-215a4d145472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "name": "network-vif-plugged", "status": "completed", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:50.630014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-40627585-a61e-4541-b4fd-ab58f7d01ad9 req-45f4f29e-7767-4152-a98e-215a4d145472 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:50.630495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-40627585-a61e-4541-b4fd-ab58f7d01ad9 req-45f4f29e-7767-4152-a98e-215a4d145472 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:50.630921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-40627585-a61e-4541-b4fd-ab58f7d01ad9 req-45f4f29e-7767-4152-a98e-215a4d145472 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:50.643086 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-40627585-a61e-4541-b4fd-ab58f7d01ad9 req-45f4f29e-7767-4152-a98e-215a4d145472 service nova] Creating event network-vif-plugged:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h1-833090-19 Sep 08 11:11:50.648342 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-40627585-a61e-4541-b4fd-ab58f7d01ad9 req-45f4f29e-7767-4152-a98e-215a4d145472 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035662 Sep 08 11:11:50.649328 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3705/7176] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:51.067961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:51.068596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:51.075738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:51.076251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:51.076709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:51.077428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:51.077904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:51.078384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:51.213472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:51.222143 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-105e0853-f471-44d3-86fc-815896699770 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1363 microversion: 2.1 time: 0.158126 Sep 08 11:11:51.222722 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3472/7177] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:51 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:52.247665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:52.248370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:52.250335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:52.251001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:52.257864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:52.258353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:52.258796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:52.259585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:52.260049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:52.260480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:52.399317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:11:52.407434 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8ca8d053-7acf-4783-a349-e7bdb71fcfd4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1551 microversion: 2.1 time: 0.164674 Sep 08 11:11:52.408049 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3706/7178] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:11:52 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:11:52.431226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:11:52.431757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:11:52.433602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:11:52.440482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:52.440979 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:52.441425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:52.442122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:52.442591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:52.443027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:52.520004 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ce383d98-a3fc-4a25-9402-198e68ef05a3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092595 Sep 08 11:11:52.520622 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3473/7179] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 11:11:52 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:11:53.553706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-88341006-760d-445a-8f55-96bd4d4ab1c9 req-e67a413d-8ba3-45da-a1b1-51ea3383692e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:11:53.563730 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88341006-760d-445a-8f55-96bd4d4ab1c9 req-e67a413d-8ba3-45da-a1b1-51ea3383692e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:11:53.564208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88341006-760d-445a-8f55-96bd4d4ab1c9 req-e67a413d-8ba3-45da-a1b1-51ea3383692e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:11:53.564639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-88341006-760d-445a-8f55-96bd4d4ab1c9 req-e67a413d-8ba3-45da-a1b1-51ea3383692e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:11:53.576570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-88341006-760d-445a-8f55-96bd4d4ab1c9 req-e67a413d-8ba3-45da-a1b1-51ea3383692e service nova] Creating event network-changed:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h1-833090-19 Sep 08 11:11:53.581513 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-88341006-760d-445a-8f55-96bd4d4ab1c9 req-e67a413d-8ba3-45da-a1b1-51ea3383692e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084461 Sep 08 11:11:53.582130 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3707/7180] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:12:27.869249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=23 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:27.870007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:27.875322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:27.876558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:27.886659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:27.887172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:27.888307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:27.889260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:27.890129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:27.890887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.028714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:28.037095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7be61b37-d752-479f-baac-7921339d9879 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1670 microversion: 2.1 time: 0.170097 Sep 08 11:12:28.037671 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3474/7181] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:27 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:28.058822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:28.059622 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=54 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:28.065093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05036c5d-ba4a-48a4-94f8-bd5ba77ec1fc"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:28.067508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:28.078601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:28.079108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:28.079570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.080265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:28.080715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:28.081141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:28.320948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85721f4a-e8de-4bd8-a66b-13ca9815de11 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264648 Sep 08 11:12:28.321599 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3708/7182] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 11:12:28 2022] POST /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:12:39.049289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:12:39.051772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:39.054163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:39.054988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:39.061179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:39.061681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:39.062146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:39.062945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:39.063301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:39.063759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:39.093792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:39.099373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:12:39.106353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:12:39.106778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:12:39.107260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:12:39.107703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:12:39.108124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:12:39.173350 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4770b228-3c75-4c62-a31c-29c7b2e57991 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/action" status: 202 len: 0 microversion: 2.1 time: 0.128555 Sep 08 11:12:39.174408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3475/7183] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:12:39 2022] POST /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:12:39.180411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:39.181127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:12:39.185939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:39.186722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:39.194420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:39.194917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:39.195362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:39.196221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:39.196885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:39.197539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:39.366598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:39.375511 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-19faf9bb-36d7-4d84-8edc-5d257b5305fb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1725 microversion: 2.1 time: 0.196838 Sep 08 11:12:39.376341 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3709/7184] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:39 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:12:40.401197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:40.401744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:40.408758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:40.409261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:40.409714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:40.410434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:40.410982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:40.411440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:40.627307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:40.635771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d9353ecd-9694-46f9-adcc-b1bbf3c12709 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1725 microversion: 2.1 time: 0.239741 Sep 08 11:12:40.636360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3476/7185] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:40 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:41.659442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:41.660082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:41.666955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:41.667444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:41.667916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:41.668612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:41.669071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:41.669505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:41.803872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:41.812240 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bbcee311-2322-41b7-9ea0-944654b08fc3 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.156723 Sep 08 11:12:41.812843 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3710/7186] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:41 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:42.836517 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:42.837147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:42.844366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:42.844868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:42.845323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:42.846035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:42.846510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:42.846953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:42.977036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:42.985543 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f6231e5-c896-431e-9e0d-f38e5b7efeb6 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.153004 Sep 08 11:12:42.986128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3477/7187] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:42 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:44.009321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:44.009932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:44.017625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:44.018115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:44.018562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:44.019261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:44.019746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:44.020174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:44.157119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:44.165948 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ab11e41-930d-433f-9a4c-dc95a1404b4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.160586 Sep 08 11:12:44.166515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3711/7188] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:44 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:45.189851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:45.190481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:45.197161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:45.197660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:45.198106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:45.198811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:45.199279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:45.199751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:45.350826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:45.359067 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3bc6e36a-323f-48cf-89ff-a4c58d37f86e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.173988 Sep 08 11:12:45.359671 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3478/7189] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:45 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:46.382873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:46.383418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:46.390291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:46.390778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:46.391484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:46.392181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:46.392640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:46.393070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:46.525627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:46.534462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb33648c-c870-4601-830f-2e1927a5a3a7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.155605 Sep 08 11:12:46.535044 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3712/7190] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:46 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:47.558200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:47.558832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:47.568619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:47.569121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:47.569579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:47.570288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:47.570761 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:47.571205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:47.712150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:47.720799 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b3aadbd9-807f-47d8-822e-cb251c35df4c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.166492 Sep 08 11:12:47.721387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3479/7191] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:47 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:48.743976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:48.744623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:48.751724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:48.752211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:48.753138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:48.753833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:48.754290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:48.754718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:48.895413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:48.904730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8c5a0d5f-0e5e-45d6-996c-d1a905dce141 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.164590 Sep 08 11:12:48.907497 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3713/7192] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:48 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:49.928285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:49.928943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:49.936052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:49.936559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:49.937018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:49.937734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:49.938209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:49.938652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:50.075186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:50.084056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2918813d-cac8-41d3-bd02-4a4c66d748d9 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.159760 Sep 08 11:12:50.084737 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3480/7193] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:49 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:51.108839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:51.109386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:51.116333 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:51.116850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:51.117310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:51.117977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:51.118432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:51.118854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:51.247307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:51.256553 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa02689e-c643-4080-8012-d7438f58b5f7 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.151609 Sep 08 11:12:51.257127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3714/7194] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:51 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:52.281411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:52.282039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:52.289503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:52.289999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:52.290450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:52.291162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:52.291663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:52.292104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:52.427281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:52.435696 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7260a05c-6d8c-4337-874a-9b62a0a74079 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.158923 Sep 08 11:12:52.436279 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3481/7195] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:52 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:53.459629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:53.460233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:53.467577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:53.468076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:53.468528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:53.469257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:53.469713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:53.470145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:53.614817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:53.624487 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8d792ac1-6e89-4638-b097-b413e55976b8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.168826 Sep 08 11:12:53.625084 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3715/7196] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:53 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:54.648341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:54.649000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:54.656028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:54.656538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:54.656997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:54.657706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:54.658193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:54.658623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:54.803658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:54.812142 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0c322a60-97de-4a0e-96c8-cb4b7410e1a4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.167755 Sep 08 11:12:54.812817 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3482/7197] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:54 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:55.835504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:55.836144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:55.842970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:55.843451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:55.843925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:55.844614 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:55.845071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:55.845500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:55.979847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:55.988342 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0fcdf5de-67e8-4110-8085-04612cf80ea8 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.156874 Sep 08 11:12:55.989491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3716/7198] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:55 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:57.012271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:57.012926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:57.020758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:57.021339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:57.021793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:57.022507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:57.022980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:57.023422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:57.153980 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:57.162349 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fd16b7f3-0288-4d0b-b4ba-c5cab1b17a07 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.153966 Sep 08 11:12:57.162946 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3483/7199] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:57 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:58.185252 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:58.185863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:58.192996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:58.193487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:58.193944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:58.194679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:58.195113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:58.195573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:58.335025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:58.343600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48027f9f-c9e4-4b57-9818-35b450ec0911 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.162390 Sep 08 11:12:58.344195 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3717/7200] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:58 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:12:59.367928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:12:59.368887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:12:59.378305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.378808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.379264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.380145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:12:59.380628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:12:59.381071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:12:59.522809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:12:59.532713 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a9bb1ed2-ec3c-4775-9f6b-cac2cdad52be tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1730 microversion: 2.1 time: 0.169946 Sep 08 11:12:59.533309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3484/7201] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:12:59 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:00.557824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:00.558435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:00.565469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:00.565958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:00.566397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:00.567104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:00.568125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:00.568556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:00.765714 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:00.775005 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-656c4139-48d0-46f0-8898-7b913eb8b9dd tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1729 microversion: 2.1 time: 0.221082 Sep 08 11:13:00.775708 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3718/7202] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:00 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:00.814488 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "name": "network-vif-unplugged", "status": "completed", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:00.825850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:00.826469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:00.826989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:00.839764 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] Creating event network-vif-unplugged:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h2-833090-19 Sep 08 11:13:00.845917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] Instance 5457336f-5dcc-4798-a499-531c3f9b8fae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:13:00.860881 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-80edbbbf-5418-4ec6-a904-08d8fc12a924 req-a2b5026f-6f5f-4fb7-a4f2-aa28b0dba97c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111192 Sep 08 11:13:00.862748 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3485/7203] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:01.800026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:01.800667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:01.818923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:01.819327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:01.819798 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:01.820564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:01.821016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:01.822139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:01.967640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:01.976342 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ecd080bf-e03c-4fb7-a9f3-b5224ffd9d7a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1729 microversion: 2.1 time: 0.180232 Sep 08 11:13:01.977169 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3719/7204] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:01 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:02.878618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:02.889389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:02.889878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:02.890318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:02.904934 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] Creating event network-changed:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h2-833090-19 Sep 08 11:13:02.910661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] Instance 5457336f-5dcc-4798-a499-531c3f9b8fae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:13:02.922055 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-12a2ebdc-0357-45bd-a790-6c34550f7dc0 req-929f1850-559f-4ce5-be1d-3d09d3e94d13 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048346 Sep 08 11:13:02.922864 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3486/7205] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:13:02.999534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:03.000366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:03.009244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:03.009867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:03.010438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:03.011407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:03.012146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:03.012849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:03.579619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:03.590900 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5cae486d-6778-42ee-bcb7-2e95cfb9d36c tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.595208 Sep 08 11:13:03.591530 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3720/7206] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:02 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:04.618077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:04.618924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:04.625258 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:04.625824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:04.626342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:04.627111 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:04.627684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:04.628189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:04.763851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:04.773281 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fdd1710f-730c-4884-9f30-54064bd7feb5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.160898 Sep 08 11:13:04.773870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3487/7207] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:04 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:05.795988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:05.796708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:05.804142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:05.804728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:05.805168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:05.805863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:05.806315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:05.806735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:05.953751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:05.962175 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-49d9d3fe-2a3a-42b6-87e9-dc89a1f34047 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.170072 Sep 08 11:13:05.962769 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3721/7208] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:05 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:06.987360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:06.988017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:06.994137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.994683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.995120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:06.995850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:06.996318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:06.996757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:07.133716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:07.142001 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5056ec01-fffb-4ba2-a334-d1b16529665a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.159478 Sep 08 11:13:07.142574 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3488/7209] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:06 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:08.168718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:08.168718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:08.173691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:08.174186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:08.174638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:08.175484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:08.175941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:08.176375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:08.314543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:08.323552 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83da9cd5-411e-46bf-8957-6bb768b194e2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.161757 Sep 08 11:13:08.324132 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3722/7210] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:08 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:09.347760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:09.348407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:09.351621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=33 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:09.357245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:09.357739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:09.358193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:09.358916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:09.359376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:09.359837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:09.362422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:09.501885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:09.511773 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6f59b291-58a7-4a81-8b6d-f5dc8124676a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.167845 Sep 08 11:13:09.512822 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3489/7211] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:09 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:10.537095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:10.537704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:10.540967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=29 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:10.546299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:10.546790 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:10.547231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.547953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:10.548414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:10.548845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:10.552994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=85 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:10.682463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:10.690848 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-917c70b7-b0f1-463c-b0b2-fa696790e727 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.157772 Sep 08 11:13:10.691426 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3723/7212] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:10 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:11.714728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:11.715349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:11.722291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:11.722788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:11.723240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:11.723975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:11.724444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:11.724883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:11.858438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:11.867416 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24798b5b-4c5d-4ecf-b15a-e8489a5138d5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.156967 Sep 08 11:13:11.868032 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3490/7213] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:11 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:12.891992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:12.892600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:12.900358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:12.900834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:12.901262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:12.901942 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:12.902390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:12.902810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:13.033105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:13.041915 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42c2e79b-8459-4c4b-a172-bf9ce3969e03 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.154517 Sep 08 11:13:13.042578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3724/7214] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:12 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:14.065242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:14.065864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:14.072777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:14.073271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:14.073719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:14.074421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:14.074888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:14.075318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:14.206105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:14.214954 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-274650d6-f95c-469c-83ab-3c2d8275a228 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.153730 Sep 08 11:13:14.215549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3491/7215] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:14 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:15.238781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:15.240760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:15.246323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:15.246750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:15.247193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:15.247918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:15.248379 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:15.248807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:15.393030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:15.401730 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d86cba44-a493-4131-a288-967c5924f65b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1727 microversion: 2.1 time: 0.166814 Sep 08 11:13:15.402563 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3725/7216] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:15 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:16.426106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:16.426736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:16.434117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.434615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.435098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.435852 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.436320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.436758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.567289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:16.576666 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0dd7fa1f-dfc8-457b-938c-3ee8592dfe5a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1724 microversion: 2.1 time: 0.154432 Sep 08 11:13:16.577283 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3492/7217] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:16 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:16.601555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:16.602141 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:16.609500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.609984 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.610417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.611104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.611578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.611999 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.656529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.656994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.657423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.658139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.658579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.658996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.682601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for project 860e1d73f73f467fb6f1773f94206386. Resources: {'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:13:16.687650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Getting quotas for user ea36b6b186d24a789f26775f9f508f74 and project 860e1d73f73f467fb6f1773f94206386. Resources: {'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:13:16.787821 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7c47a2b-43f5-4e43-b250-ed1edbaf1c5e tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "POST /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/action" status: 202 len: 0 microversion: 2.1 time: 0.190353 Sep 08 11:13:16.788807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3726/7218] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:13:16 2022] POST /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:13:16.797691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:16.798330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:16.804487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.804988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.806112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:16.806840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:16.807404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:16.807949 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:17.021600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:17.029927 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7d58cbe4-8fc7-4f7b-84f7-4d1a5865b510 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.236223 Sep 08 11:13:17.030503 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3493/7219] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:16 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:17.740771 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "name": "network-vif-plugged", "status": "completed", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:17.751263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:17.751753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:17.752188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:17.763602 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] Creating event network-vif-plugged:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h2-833090-19 Sep 08 11:13:17.769157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] Instance 5457336f-5dcc-4798-a499-531c3f9b8fae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:13:17.780796 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-d7939ad3-f4fe-4a26-ba22-10b7a0d5d17b req-e542394a-b938-4a09-86ba-6edc84097063 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095968 Sep 08 11:13:17.781334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3727/7220] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:18.054144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:18.054856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:18.062441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:18.062951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:18.063412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:18.064174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:18.064649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:18.065093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:18.201581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:18.209877 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-135a2e21-8134-4624-a2d2-2a0dc296c5ed tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.159710 Sep 08 11:13:18.210452 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3494/7221] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:18 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:19.234147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:19.234842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:19.241061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:19.241542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:19.241981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:19.242672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:19.243125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:19.243570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:19.374740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:19.383001 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4803ab70-697c-4df9-8ae0-4f6b9edf6e42 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.154105 Sep 08 11:13:19.383604 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3728/7222] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:19 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:20.407128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:20.407751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:20.415776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:20.416881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:20.417350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:20.418096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:20.418836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:20.419285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:20.565905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:20.575714 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee0c7f0f-9826-4c82-83da-d7eecc6e39cb tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.172769 Sep 08 11:13:20.576501 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3495/7223] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:20 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:21.599973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:21.600511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:21.607854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:21.608344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:21.608787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:21.609494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:21.609943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:21.610372 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:21.746086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:21.754663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-025fc52c-49d5-49ab-a867-83e088472bbe tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.158767 Sep 08 11:13:21.755269 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3729/7224] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:21 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:22.456424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "name": "network-vif-unplugged", "status": "completed", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:22.468145 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.468641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.469094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:22.482106 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] Creating event network-vif-unplugged:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h1-833090-19 Sep 08 11:13:22.487877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] Instance 5457336f-5dcc-4798-a499-531c3f9b8fae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:13:22.500616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-2e6281e6-a5b5-4463-ab89-38188c1749c9 req-c4be5900-3cf6-41f0-a06e-0be5af2ec391 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048212 Sep 08 11:13:22.501242 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3496/7225] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:22.779485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:22.780116 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:22.787551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.788040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.788552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:22.789186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:22.789642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:22.790068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:23.039159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:23.047932 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c095dea3-4b8a-4cb4-9232-2bdb53c733af tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.272933 Sep 08 11:13:23.048522 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3730/7226] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:22 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:24.073827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:24.074642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:24.087117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:24.087660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:24.088193 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:24.088957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:24.090118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:24.090596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:24.231758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:24.240388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9293653e-e3f6-4379-9abd-42257f1ee591 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.172168 Sep 08 11:13:24.240977 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3497/7227] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:24 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:24.538600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:24.550898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:24.551377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:24.551846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:24.564372 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] Creating event network-changed:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h1-833090-19 Sep 08 11:13:24.569850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] Instance 5457336f-5dcc-4798-a499-531c3f9b8fae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:13:24.580870 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-41bece3e-eec2-4b73-8b68-6483dd60c810 req-caaad059-2399-4371-8a4b-172b721e3f4e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045943 Sep 08 11:13:24.581490 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3731/7228] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:25.265196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:25.266588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:25.275179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:25.275829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:25.276895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:25.277736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:25.278292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:25.278750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:25.592986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:25.602920 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0e391b51-9ef8-41a0-99ee-e911bea225bc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.342330 Sep 08 11:13:25.603865 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3498/7229] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:25 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:26.627877 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:26.628579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:26.634745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.635231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.636214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.636904 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:26.637849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:26.637849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:26.673525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:26.782384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:26.791094 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db451ec6-b142-4489-b612-46e22fe79a6a tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.168369 Sep 08 11:13:26.791747 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3732/7230] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:26 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:27.814461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:27.815082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:27.822274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:27.822780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:27.823261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:27.824017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:27.824484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:27.824925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:27.957838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:27.966995 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b2677790-34ba-42da-8058-78530ed29910 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.156566 Sep 08 11:13:27.967620 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3499/7231] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:27 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:28.992286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:28.992937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:29.000552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:29.001039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:29.001481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:29.002177 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:29.002637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:29.003070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:29.138536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:29.147108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aa550f88-30be-4633-ba54-ed8e4aacd0ec tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.158770 Sep 08 11:13:29.147721 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3733/7232] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:28 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:30.170380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:30.171039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:30.180692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:30.181202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:30.181660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:30.182383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:30.183337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:30.183816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:30.315052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:30.323373 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a3ac639-273e-4ac4-a379-aa35d8b43cc2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.157024 Sep 08 11:13:30.323992 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3500/7233] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:30 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:31.346830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:31.347391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:31.354218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.354706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.355620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.356324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:31.356814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:31.357244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:31.502540 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:31.510860 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a39f683-7007-44a0-b223-bf7608d97e37 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.167998 Sep 08 11:13:31.512052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3734/7234] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:31 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:32.534906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:32.535545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:32.545835 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:32.546487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:32.546857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:32.547610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:32.548116 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:32.548559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:32.690234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:32.698577 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3da99bc-03da-4b92-a6c7-fa605a592f8b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.167572 Sep 08 11:13:32.699721 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3501/7235] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:32 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:13:33.723391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:33.724048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:33.730167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:33.730657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:33.731102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:33.731844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:33.732302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:33.732734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:33.873163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:33.881629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e25f96ea-f173-47e6-85ea-b409485e6fdc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.163277 Sep 08 11:13:33.882226 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3735/7236] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:33 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:34.905917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:34.906544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:34.913431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:34.913925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:34.914369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:34.915066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:34.915567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:34.916006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:35.057241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:35.066437 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9126dbd7-c127-4e37-b6e6-8079cb609f4b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1723 microversion: 2.1 time: 0.164459 Sep 08 11:13:35.067043 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3502/7237] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:34 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:36.089876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:36.090493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:36.099821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.100316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.101573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.101573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.102159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.102324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.243328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.252524 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-303427ba-6443-4e31-bf3c-54d4b35d5fe1 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1716 microversion: 2.1 time: 0.166747 Sep 08 11:13:36.253122 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3736/7238] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:36 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:36.275256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:36.275925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:36.285137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.285631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.286083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.286803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.287264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.287740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.418571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.427568 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-81a95005-8747-4960-b49d-46afa0cf8b88 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1716 microversion: 2.1 time: 0.156473 Sep 08 11:13:36.428147 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3503/7239] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:36 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:36.451390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:36.452030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:36.457944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.458429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.458866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.459591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.460048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.460474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.475057 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:36.594547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.602882 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0e06fa8b-22b0-423c-afd2-9495ebfb9b6b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1716 microversion: 2.1 time: 0.155367 Sep 08 11:13:36.603481 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3737/7240] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:36 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:36.626157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:36.626594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:36.632560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.633052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.633500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.634189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.634648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.635113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.660674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:13:36.705231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:36.739823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-59af958f-8e25-4950-9836-b2792a16682b tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 204 len: 0 microversion: 2.1 time: 0.118057 Sep 08 11:13:36.740742 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3504/7241] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:13:36 2022] DELETE /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:13:36.750831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:36.751438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:36.757455 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.757932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.758439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.759121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:36.759605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:36.760025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:36.895026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:36.904236 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-733b4e68-b553-489e-8043-28ab22be3ee5 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1722 microversion: 2.1 time: 0.156990 Sep 08 11:13:36.904813 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3738/7242] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:36 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:37.929415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:37.930140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:37.937942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:37.938454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:37.938909 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:37.939672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:37.940152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:37.940618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:38.075297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:38.083859 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49412e9e-e164-42f3-8b19-f02dfe9f1891 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1722 microversion: 2.1 time: 0.159147 Sep 08 11:13:38.084438 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3505/7243] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:37 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:39.080194 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e967922f-5380-466a-bb75-1dfeef63497b req-9cae1d5b-19ef-4e1f-b1cf-93f20cca2a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5457336f-5dcc-4798-a499-531c3f9b8fae", "name": "network-vif-deleted", "tag": "cd0b658d-5e56-41d5-b396-4566405080ab"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:39.102649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e967922f-5380-466a-bb75-1dfeef63497b req-9cae1d5b-19ef-4e1f-b1cf-93f20cca2a72 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:39.102649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e967922f-5380-466a-bb75-1dfeef63497b req-9cae1d5b-19ef-4e1f-b1cf-93f20cca2a72 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:39.102649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e967922f-5380-466a-bb75-1dfeef63497b req-9cae1d5b-19ef-4e1f-b1cf-93f20cca2a72 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:39.108616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:39.109371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:39.119673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:39.121670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:39.125167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:39.126122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:39.126788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:39.127251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:39.149251 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e967922f-5380-466a-bb75-1dfeef63497b req-9cae1d5b-19ef-4e1f-b1cf-93f20cca2a72 service nova] Creating event network-vif-deleted:cd0b658d-5e56-41d5-b396-4566405080ab for instance 5457336f-5dcc-4798-a499-531c3f9b8fae on n-h1-833090-19 Sep 08 11:13:39.159225 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e967922f-5380-466a-bb75-1dfeef63497b req-9cae1d5b-19ef-4e1f-b1cf-93f20cca2a72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083742 Sep 08 11:13:39.159994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3739/7244] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:13:39.226668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:39.241442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d8c69f0a-f3cb-48a0-a22a-5afc0d75f8c4 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1369 microversion: 2.1 time: 0.136723 Sep 08 11:13:39.243941 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3506/7245] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:39 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1369 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:40.268309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:40.269026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:40.276210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:40.277059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:40.277796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:40.278733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:40.280176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:40.280826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:40.349828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:40.358180 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bb9cfee7-039b-4af1-92e2-e9a6ed729524 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1369 microversion: 2.1 time: 0.095950 Sep 08 11:13:40.358760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3740/7246] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:40 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:41.382513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:41.383060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:41.386009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:41.391926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:41.392419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:41.392868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:41.393574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:41.394036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:41.394469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:41.462702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:41.475887 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7383913-82b5-479e-b7f8-7ede9dc0b887 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1369 microversion: 2.1 time: 0.097402 Sep 08 11:13:41.476487 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3507/7247] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:41 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:42.500869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:42.501609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:42.504575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:42.509987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:42.510477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:42.510918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:42.511670 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:42.512125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:42.512547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:42.578029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea36b6b186d24a789f26775f9f508f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '860e1d73f73f467fb6f1773f94206386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:13:42.586680 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-17c34d4c-640c-44c4-8b3c-90fa49febeb0 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 200 len: 1369 microversion: 2.1 time: 0.090353 Sep 08 11:13:42.587270 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3741/7248] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:42 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:13:43.610981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:43.611535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:43.618453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.618950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.619405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:43.620144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.620617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.621054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:43.634642 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae HTTP/1.1 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '5457336f-5dcc-4798-a499-531c3f9b8fae'} Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:43.636323 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9dcb035b-216c-4a1f-9a2b-81bced5a5751 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 404 len: 111 microversion: 2.1 time: 0.031472 Sep 08 11:13:43.641046 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3508/7249] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:43 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:43.699864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:43.702028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:43.708914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.709395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.709836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:43.710533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:43.710988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:43.711416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:43.724588 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-volume_attachments HTTP/1.1 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '5457336f-5dcc-4798-a499-531c3f9b8fae'} Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:43.726265 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-694a7f18-2db6-4776-8c14-e57c9c2bcc64 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032093 Sep 08 11:13:43.730471 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3742/7250] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:13:43 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.055544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.056062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.062924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.063430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.063904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.064620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.065086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.065526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.080799 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae HTTP/1.1 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '5457336f-5dcc-4798-a499-531c3f9b8fae'} Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.082374 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-996f4cfa-5bbb-4900-aa56-66fbab9d8188 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 404 len: 111 microversion: 2.1 time: 0.032662 Sep 08 11:13:47.086526 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3509/7251] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:13:47 2022] DELETE /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.095386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.096019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 5457336f-5dcc-4798-a499-531c3f9b8fae] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.102001 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.102482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.102910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.103623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.104069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.104511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.121150 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae HTTP/1.1 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '5457336f-5dcc-4798-a499-531c3f9b8fae'} Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.122755 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 5457336f-5dcc-4798-a499-531c3f9b8fae could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b873c027-c2a5-4245-8e54-e6b52e5e59c2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae" status: 404 len: 111 microversion: 2.1 time: 0.035687 Sep 08 11:13:47.127873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3743/7252] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:47 2022] GET /compute/v2.1/servers/5457336f-5dcc-4798-a499-531c3f9b8fae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.133767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.134287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.143883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.144392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.144850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.145573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.146043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.146484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.167809 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 HTTP/1.1 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '45b39adf-22cf-423a-a157-c2780be75667'} Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.169319 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-163a7f01-3604-4a5f-9576-c2fe8112ff45 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 404 len: 111 microversion: 2.1 time: 0.041039 Sep 08 11:13:47.173558 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3510/7253] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:13:47 2022] DELETE /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.180532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.181232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 45b39adf-22cf-423a-a157-c2780be75667] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.188312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.188812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.189251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.189958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.190413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.190841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.207349 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 HTTP/1.1 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '45b39adf-22cf-423a-a157-c2780be75667'} Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.208936 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 45b39adf-22cf-423a-a157-c2780be75667 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6120dab-5bee-4b7c-b2e8-89d11dd114fc tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667" status: 404 len: 111 microversion: 2.1 time: 0.034000 Sep 08 11:13:47.214500 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3744/7254] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:47 2022] GET /compute/v2.1/servers/45b39adf-22cf-423a-a157-c2780be75667 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.219399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.219948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.226428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.227027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.227845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.228711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.229499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.230019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.246452 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f HTTP/1.1 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '18d6c656-f5b1-4848-88b1-3330543cb39f'} Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.248079 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9babc3e8-162a-4a44-b46d-f717751392b2 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 404 len: 111 microversion: 2.1 time: 0.034916 Sep 08 11:13:47.253178 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3511/7255] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:13:47 2022] DELETE /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.258789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.259396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: 18d6c656-f5b1-4848-88b1-3330543cb39f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.265882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.266358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.266788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.267491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.267938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.268356 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.282469 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f HTTP/1.1 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '18d6c656-f5b1-4848-88b1-3330543cb39f'} Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.283976 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance 18d6c656-f5b1-4848-88b1-3330543cb39f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f52b0a1a-9654-4cf8-ab04-c49b6cd4bd8f tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f" status: 404 len: 111 microversion: 2.1 time: 0.030394 Sep 08 11:13:47.288742 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3745/7256] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:47 2022] GET /compute/v2.1/servers/18d6c656-f5b1-4848-88b1-3330543cb39f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.293780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.294289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.300353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.300843 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.301301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.301989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.302451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.302888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.317236 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 HTTP/1.1 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'aa15ff13-5b1f-4755-a4a2-2844e5b1fe45'} Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.318796 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.323513 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d29249c2-3b6d-4cd1-834a-bfcea6b08543 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 404 len: 111 microversion: 2.1 time: 0.030336 Sep 08 11:13:47.324597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3512/7257] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:13:47 2022] DELETE /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.330337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.330950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [instance: aa15ff13-5b1f-4755-a4a2-2844e5b1fe45] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:13:47.337187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.337671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.338130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.338891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:47.339339 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:47.339795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:47.353587 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] HTTP exception thrown: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Request method failure captured: Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 HTTP/1.1 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGczrOz1uLlZLH6PqiogGMKtTu6ikpoaFp8a8bDKhAFRVYme0dpjxY4rKRcrWQuhlg_bve1KSI0hD-zM2LRS9lQ_j6yxqtV_hwR7Q7ApOeHcB4dpAMSch3FrYFKROtVOgtT82E8hhVz10DYkeVIrZszKgecONzmZhDumtt64i6H7ywVY Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/860e1d73f73f467fb6f1773f94206386"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_860e1d73f73f467fb6f1773f94206386", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 860e1d73f73f467fb6f1773f94206386 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServerActionsTestJSON-70350162 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: ea36b6b186d24a789f26775f9f508f74 Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServerActionsTestJSON-70350162-project Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'aa15ff13-5b1f-4755-a4a2-2844e5b1fe45'} Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:13:47.355128 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Returning 404 to user: Instance aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-715c432d-9f71-48f2-9570-6157fc372988 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45" status: 404 len: 111 microversion: 2.1 time: 0.030570 Sep 08 11:13:47.360417 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3746/7258] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:47 2022] GET /compute/v2.1/servers/aa15ff13-5b1f-4755-a4a2-2844e5b1fe45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:13:47.365249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-90f55942-d559-4db4-8a72-261c97d7e333 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] Calling method '.version_select at 0x7f2350209d30>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:13:47.369614 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90f55942-d559-4db4-8a72-261c97d7e333 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:13:48.377681 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [None req-90f55942-d559-4db4-8a72-261c97d7e333 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] [c5fbd577-e50a-4185-9d20-188f198d1d26] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 47212. Sep 08 11:13:48.398586 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-90f55942-d559-4db4-8a72-261c97d7e333 tempest-ServerActionsTestJSON-70350162 tempest-ServerActionsTestJSON-70350162-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132749164" status: 202 len: 0 microversion: 2.1 time: 1.037120 Sep 08 11:13:48.399179 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3513/7259] 10.222.0.59 () {58 vars in 1218 bytes} [Thu Sep 8 11:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132749164 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:13:57.911740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=11 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:57.913096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=33 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:58.038669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1643684159", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "bc59b6d5-e73a-4ac9-afff-10c9bc71b9f3"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:13:58.098578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] validate_networks() for [('bc59b6d5-e73a-4ac9-afff-10c9bc71b9f3', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:13:58.869023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:13:58.869454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:13:58.869936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:13:58.870377 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:13:58.870874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:13:58.883302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:58.883859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:58.884304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:58.885041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:13:58.885500 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:13:58.885934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:13:58.903631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Getting quotas for project 9ea67cdb94934a1fba8ada5b66b36379. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:13:58.909596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Getting quotas for user 4bf4312c881f40dbaa4fb55cf0ea49db and project 9ea67cdb94934a1fba8ada5b66b36379. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:13:58.923570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:13:58.925884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:13:58.971687 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [28f1ac15-ac9d-4b40-9b96-c88db3e77c67] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:13:59.979684 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [28f1ac15-ac9d-4b40-9b96-c88db3e77c67] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 47312. Sep 08 11:13:59.985581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fe2c2f33-fca0-4b92-801d-0a14d2ba90ef tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.078978 Sep 08 11:13:59.985581 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3747/7260] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:13:59.994676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:13:59.995445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:00.000639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cf95686a-9650-4a90-84a5-cb1a259b049a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:00.001808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cf95686a-9650-4a90-84a5-cb1a259b049a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:00.077422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-cf95686a-9650-4a90-84a5-cb1a259b049a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:00.089711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cf95686a-9650-4a90-84a5-cb1a259b049a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1217 microversion: 2.1 time: 0.096689 Sep 08 11:14:00.091591 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3514/7261] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:13:59 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:01.116115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:01.116801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:01.123119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.123678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.124270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.124977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:01.125492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:01.125921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:01.206875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:01.215821 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e58111b6-48df-4e6c-a88a-5517e12013c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1269 microversion: 2.1 time: 0.104434 Sep 08 11:14:01.216617 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3748/7262] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:01 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:02.240671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:02.241301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:02.248747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:02.249474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:02.250092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:02.251016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:02.251601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:02.252206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:02.476019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:02.485261 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83c47c1d-52e1-4475-87ca-5f23ca0e21c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.248303 Sep 08 11:14:02.486502 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3515/7263] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:02 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:02.789701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-170545cc-5db5-4527-9507-9bf23fa7f220 req-bdbedbc5-30a6-4cbe-ad1a-ab4e37608ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc43fae7-3201-4ea1-9f6d-46851fd6dbf6", "tag": "0617116e-de40-4d99-920e-19afc68874a0"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:02.803649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-170545cc-5db5-4527-9507-9bf23fa7f220 req-bdbedbc5-30a6-4cbe-ad1a-ab4e37608ac6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:02.804134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-170545cc-5db5-4527-9507-9bf23fa7f220 req-bdbedbc5-30a6-4cbe-ad1a-ab4e37608ac6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:02.804569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-170545cc-5db5-4527-9507-9bf23fa7f220 req-bdbedbc5-30a6-4cbe-ad1a-ab4e37608ac6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:02.815824 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-170545cc-5db5-4527-9507-9bf23fa7f220 req-bdbedbc5-30a6-4cbe-ad1a-ab4e37608ac6 service nova] Creating event network-changed:0617116e-de40-4d99-920e-19afc68874a0 for instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 on n-h2-833090-19 Sep 08 11:14:02.822321 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-170545cc-5db5-4527-9507-9bf23fa7f220 req-bdbedbc5-30a6-4cbe-ad1a-ab4e37608ac6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037396 Sep 08 11:14:02.823559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3749/7264] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:03.511947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:03.512579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:03.519443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:03.519981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:03.520441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.521154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:03.521623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:03.522067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:03.651301 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:03.659926 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62d16853-60ec-4f90-bc72-e3dd5f49dcb0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.151967 Sep 08 11:14:03.660516 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3516/7265] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:03 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:04.683845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:04.684556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:04.692229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.692710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.693153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.693842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:04.694305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:04.694735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:04.838456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:04.846202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a67d01f-5d4b-4158-8712-2fff640296b6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.166615 Sep 08 11:14:04.846782 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3750/7266] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:04 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:05.869299 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:05.869932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:05.877611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:05.878122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:05.878585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:05.879317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:05.879820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:05.880269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:06.020265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:06.028771 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1dc8d62d-acbf-4956-8245-677306103617 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.163123 Sep 08 11:14:06.029450 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3517/7267] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:05 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:07.052746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:07.053366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:07.059991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.060481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.060928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.061623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:07.062088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:07.062552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:07.191095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:07.198889 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2bbcbaa4-d192-44a8-841a-910c9822fd94 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.150378 Sep 08 11:14:07.199552 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3751/7268] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:07 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:08.013619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0bebd438-d14a-4687-b7b5-b24314e557b8 req-e99a58b8-96e3-435c-b4d9-1c32bfe60981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc43fae7-3201-4ea1-9f6d-46851fd6dbf6", "name": "network-vif-plugged", "status": "completed", "tag": "0617116e-de40-4d99-920e-19afc68874a0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:08.026312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0bebd438-d14a-4687-b7b5-b24314e557b8 req-e99a58b8-96e3-435c-b4d9-1c32bfe60981 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.026809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0bebd438-d14a-4687-b7b5-b24314e557b8 req-e99a58b8-96e3-435c-b4d9-1c32bfe60981 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.027254 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0bebd438-d14a-4687-b7b5-b24314e557b8 req-e99a58b8-96e3-435c-b4d9-1c32bfe60981 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.039805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0bebd438-d14a-4687-b7b5-b24314e557b8 req-e99a58b8-96e3-435c-b4d9-1c32bfe60981 service nova] Creating event network-vif-plugged:0617116e-de40-4d99-920e-19afc68874a0 for instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 on n-h2-833090-19 Sep 08 11:14:08.045069 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0bebd438-d14a-4687-b7b5-b24314e557b8 req-e99a58b8-96e3-435c-b4d9-1c32bfe60981 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035458 Sep 08 11:14:08.046033 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3518/7269] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:08.222823 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:08.223445 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:08.226732 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:14:08.226896 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 (ip 10.222.0.59) !!! Sep 08 11:14:08.239706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.240205 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.240649 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.241360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:08.241936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:08.242253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:08.374817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:08.382763 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d4a2133b-ce49-4db5-bc70-5683eb24e5c6 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.164438 Sep 08 11:14:08.383345 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3752/7270] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:08 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:09.407455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:09.408329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:09.414512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.415024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.415485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.416215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:09.416688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:09.417132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:09.551900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:09.559857 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6146675a-7e31-4890-8908-16a5f7473b84 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1317 microversion: 2.1 time: 0.157904 Sep 08 11:14:09.560442 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3519/7271] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:09 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:10.583101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:10.583758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:10.585743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:10.586432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:10.593459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:10.593946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:10.594385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:10.595085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:10.595565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:10.595996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:10.729676 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:10.738222 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3b2df6a4-0dd6-4f01-91d2-5eae581643de tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.159214 Sep 08 11:14:10.738787 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3753/7272] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:10 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:10.802995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1967220859", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "bc59b6d5-e73a-4ac9-afff-10c9bc71b9f3"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:10.811786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:10.859653 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] validate_networks() for [('bc59b6d5-e73a-4ac9-afff-10c9bc71b9f3', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:14:11.323080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:14:11.323565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:14:11.324063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:14:11.324493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:14:11.324924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:14:11.334146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:11.334577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:11.335030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.335809 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:11.336282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:11.336730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:11.356398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Getting quotas for project 9ea67cdb94934a1fba8ada5b66b36379. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:14:11.361776 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Getting quotas for user 4bf4312c881f40dbaa4fb55cf0ea49db and project 9ea67cdb94934a1fba8ada5b66b36379. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:14:11.374773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:14:11.377144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:14:11.423824 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-80198568-07a6-4427-952d-fb47d1a3318b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626123 Sep 08 11:14:11.424492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3520/7273] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:14:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:14:11.436307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e80fd0d-b71f-4fbc-8113-93de61fb404e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:11.436935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e80fd0d-b71f-4fbc-8113-93de61fb404e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:11.491611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e80fd0d-b71f-4fbc-8113-93de61fb404e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:11.499035 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e80fd0d-b71f-4fbc-8113-93de61fb404e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1217 microversion: 2.1 time: 0.066679 Sep 08 11:14:11.499688 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3754/7274] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:11 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:12.521918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:12.522543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:12.531159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:12.531892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:12.532443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:12.533290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:12.533930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:12.535277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:12.629643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:12.637644 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-543ac534-a5ee-43aa-973a-4e5a63b22b49 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1287 microversion: 2.1 time: 0.120171 Sep 08 11:14:12.638420 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3521/7275] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:12 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:13.663097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:13.663707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:13.673523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.674045 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.674492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.675310 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.676309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.676776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.891420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-70c44d5d-65e6-4179-b896-874d4d6b3f43 req-678ce2df-494b-446a-b38c-4bcceca3ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c5c54d-7ca7-4a54-b137-445a67c39363", "tag": "204c49c1-84c5-4759-ad3f-fadd179affd3"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:13.903143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-70c44d5d-65e6-4179-b896-874d4d6b3f43 req-678ce2df-494b-446a-b38c-4bcceca3ed97 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:13.903684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-70c44d5d-65e6-4179-b896-874d4d6b3f43 req-678ce2df-494b-446a-b38c-4bcceca3ed97 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:13.904206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-70c44d5d-65e6-4179-b896-874d4d6b3f43 req-678ce2df-494b-446a-b38c-4bcceca3ed97 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:13.913506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:13.918106 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-70c44d5d-65e6-4179-b896-874d4d6b3f43 req-678ce2df-494b-446a-b38c-4bcceca3ed97 service nova] Creating event network-changed:204c49c1-84c5-4759-ad3f-fadd179affd3 for instance 65c5c54d-7ca7-4a54-b137-445a67c39363 on n-h1-833090-19 Sep 08 11:14:13.921639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9333f04f-b16f-4eff-8e6a-8a1fb6aebe90 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1317 microversion: 2.1 time: 0.263905 Sep 08 11:14:13.922472 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3755/7276] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:13 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:13.923848 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-70c44d5d-65e6-4179-b896-874d4d6b3f43 req-678ce2df-494b-446a-b38c-4bcceca3ed97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036491 Sep 08 11:14:13.924567 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3522/7277] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:14.945279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:14.945932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:14.952782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:14.953270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:14.953713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:14.954412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:14.954870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:14.955299 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:15.091993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:15.100256 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-550a7577-c8de-47ce-a200-36c8f84a89f7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1317 microversion: 2.1 time: 0.159424 Sep 08 11:14:15.100845 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3756/7278] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:14 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:16.124506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:16.125218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:16.132024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.132515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.132967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.133666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:16.134126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:16.134557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:16.268333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:16.276078 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9239d7a-9963-4448-a6ee-94ced3d99a4b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1317 microversion: 2.1 time: 0.156790 Sep 08 11:14:16.276656 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3523/7279] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:16 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:17.298304 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:17.298883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:17.305922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:17.306410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:17.306850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:17.307586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:17.308044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:17.308474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:17.453858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:17.462724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9586986e-9016-4d07-ae72-9e7d7d84c613 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1317 microversion: 2.1 time: 0.168385 Sep 08 11:14:17.463311 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3757/7280] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:17 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:18.486213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:18.486846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:18.498271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:18.498780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:18.499244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:18.499998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:18.502406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:18.502855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:18.633785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:18.641764 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ba75dc5a-9c01-476c-bd26-c3078a4c92ba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1317 microversion: 2.1 time: 0.159529 Sep 08 11:14:18.642345 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3524/7281] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:18 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:19.374036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c7be9710-86b2-4757-8311-65ae334d84f9 req-5da8e339-cc73-4408-8609-81f0313ca58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c5c54d-7ca7-4a54-b137-445a67c39363", "name": "network-vif-plugged", "status": "completed", "tag": "204c49c1-84c5-4759-ad3f-fadd179affd3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:19.384801 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c7be9710-86b2-4757-8311-65ae334d84f9 req-5da8e339-cc73-4408-8609-81f0313ca58b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:19.385292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c7be9710-86b2-4757-8311-65ae334d84f9 req-5da8e339-cc73-4408-8609-81f0313ca58b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:19.385724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c7be9710-86b2-4757-8311-65ae334d84f9 req-5da8e339-cc73-4408-8609-81f0313ca58b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:19.397149 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c7be9710-86b2-4757-8311-65ae334d84f9 req-5da8e339-cc73-4408-8609-81f0313ca58b service nova] Creating event network-vif-plugged:204c49c1-84c5-4759-ad3f-fadd179affd3 for instance 65c5c54d-7ca7-4a54-b137-445a67c39363 on n-h1-833090-19 Sep 08 11:14:19.402462 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c7be9710-86b2-4757-8311-65ae334d84f9 req-5da8e339-cc73-4408-8609-81f0313ca58b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Sep 08 11:14:19.403353 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3758/7282] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:19.666094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:19.666651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:19.673409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:19.673899 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:19.674632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:19.675330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:19.675818 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:19.676802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:19.808532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:19.816403 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd398c5a-45e0-4679-a106-79cf30726081 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1317 microversion: 2.1 time: 0.154378 Sep 08 11:14:19.816995 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3525/7283] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:19 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:20.840588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:20.842800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:20.851009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:20.851516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:20.851963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:20.852681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:20.853142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:20.853573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:20.988218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:20.996145 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-41f80b5e-3f68-4785-b30b-a6e5e010c403 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1507 microversion: 2.1 time: 0.159884 Sep 08 11:14:20.996719 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3759/7284] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:20 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:21.020387 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:21.020941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:21.027824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:21.028355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:21.028796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:21.029507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:21.029971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:21.030405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:21.057727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:14:21.143471 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3e0508a-387f-4c5c-a2e9-3352f7ed4db0 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "DELETE /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 204 len: 0 microversion: 2.1 time: 0.127538 Sep 08 11:14:21.148195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3526/7285] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:14:21 2022] DELETE /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:14:21.154837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:21.155486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:21.162275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:21.162758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:21.163185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:21.163902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:21.164358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:21.164782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:21.299186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:21.307612 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d476dbb4-f701-446d-a429-ed1463d0d336 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1513 microversion: 2.1 time: 0.157836 Sep 08 11:14:21.308276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3760/7286] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:21 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:22.331759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:22.332878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:22.334819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:22.335523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:22.342898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:22.343428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:22.343904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:22.344621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:22.345090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:22.345530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:22.544795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:22.553121 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e106ab3-1f75-40e2-9246-90ca540ec0cd tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 200 len: 1513 microversion: 2.1 time: 0.225625 Sep 08 11:14:22.553787 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3527/7287] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:22 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:22.913424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9abe2dc0-c0dd-48ec-9b29-e16695b6ca01 req-cb27a922-d117-45bf-ad0b-23e3eee7475d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c5c54d-7ca7-4a54-b137-445a67c39363", "name": "network-vif-deleted", "tag": "204c49c1-84c5-4759-ad3f-fadd179affd3"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:22.924055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:22.931255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9abe2dc0-c0dd-48ec-9b29-e16695b6ca01 req-cb27a922-d117-45bf-ad0b-23e3eee7475d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:22.932430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9abe2dc0-c0dd-48ec-9b29-e16695b6ca01 req-cb27a922-d117-45bf-ad0b-23e3eee7475d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:22.933163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9abe2dc0-c0dd-48ec-9b29-e16695b6ca01 req-cb27a922-d117-45bf-ad0b-23e3eee7475d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:22.948123 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9abe2dc0-c0dd-48ec-9b29-e16695b6ca01 req-cb27a922-d117-45bf-ad0b-23e3eee7475d service nova] Creating event network-vif-deleted:204c49c1-84c5-4759-ad3f-fadd179affd3 for instance 65c5c54d-7ca7-4a54-b137-445a67c39363 on n-h1-833090-19 Sep 08 11:14:22.955030 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9abe2dc0-c0dd-48ec-9b29-e16695b6ca01 req-cb27a922-d117-45bf-ad0b-23e3eee7475d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045645 Sep 08 11:14:22.956430 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3761/7288] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:14:23.580039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:23.582165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:23.589168 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.589673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.590132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.590853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.591327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.591805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.605526 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] HTTP exception thrown: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 HTTP/1.1 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '65c5c54d-7ca7-4a54-b137-445a67c39363'} Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:23.607203 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 404 to user: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bb0c745a-f127-4d87-a574-c39c368b5f0a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 404 len: 111 microversion: 2.1 time: 0.034832 Sep 08 11:14:23.612205 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3528/7289] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:23 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:14:23.619070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:23.619788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:23.626149 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.626634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.627102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.627853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.628340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.628767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.765281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:23.773226 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3561c2b1-af68-4d43-b6c9-b992b342471b tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.158350 Sep 08 11:14:23.773803 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3762/7290] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:23 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:23.795732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a268bb2-2522-4094-b235-5a84330f7bba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:23.798153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0a268bb2-2522-4094-b235-5a84330f7bba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: b2743089-602b-4c3a-8f8f-e937e14bd1cb] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:23.804432 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-0a268bb2-2522-4094-b235-5a84330f7bba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] HTTP exception thrown: Instance b2743089-602b-4c3a-8f8f-e937e14bd1cb could not be found. Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a268bb2-2522-4094-b235-5a84330f7bba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/b2743089-602b-4c3a-8f8f-e937e14bd1cb/action HTTP/1.1 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 32 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: {"resize": {"flavorRef": "452"}} Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance b2743089-602b-4c3a-8f8f-e937e14bd1cb could not be found. Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'b2743089-602b-4c3a-8f8f-e937e14bd1cb', 'body': {'resize': {'flavorRef': '452'}}} Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2743089-602b-4c3a-8f8f-e937e14bd1cb could not be found. Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:23.806004 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2743089-602b-4c3a-8f8f-e937e14bd1cb could not be found. Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2743089-602b-4c3a-8f8f-e937e14bd1cb could not be found. Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0a268bb2-2522-4094-b235-5a84330f7bba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 404 to user: Instance b2743089-602b-4c3a-8f8f-e937e14bd1cb could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0a268bb2-2522-4094-b235-5a84330f7bba tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "POST /compute/v2.1/servers/b2743089-602b-4c3a-8f8f-e937e14bd1cb/action" status: 404 len: 111 microversion: 2.1 time: 0.015835 Sep 08 11:14:23.810664 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3529/7291] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:23 2022] POST /compute/v2.1/servers/b2743089-602b-4c3a-8f8f-e937e14bd1cb/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:14:23.816061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:23.816709 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:23.823446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.823967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.824410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.825113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:23.825571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:23.826007 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:23.962106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:23.969861 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afb6718f-3d8d-4318-a606-b8f3dd8be346 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.157642 Sep 08 11:14:23.970438 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3763/7292] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:23 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:23.993788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:23.994434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:24.001452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.001954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.002404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.003112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.003612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.004060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.134478 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:24.142878 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-de039fa1-b702-40da-9a56-9c5ab1ca48b7 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.152920 Sep 08 11:14:24.143480 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3530/7293] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:23 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:24.166575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "964fd5af-6557-4aa2-a73d-6ede29c85178"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:24.168836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:24.174873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.175362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.175835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.177101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.177534 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.177960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.233332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:24.239768 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] HTTP exception thrown: Flavor 964fd5af-6557-4aa2-a73d-6ede29c85178 could not be found. Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: request: POST /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6/action HTTP/1.1 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 65 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: {"resize": {"flavorRef": "964fd5af-6557-4aa2-a73d-6ede29c85178"}} Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: exception: Flavor 964fd5af-6557-4aa2-a73d-6ede29c85178 could not be found. Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'bc43fae7-3201-4ea1-9f6d-46851fd6dbf6', 'body': {'resize': {'flavorRef': '964fd5af-6557-4aa2-a73d-6ede29c85178'}}} Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:24.251557 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 964fd5af-6557-4aa2-a73d-6ede29c85178 could not be found. Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 964fd5af-6557-4aa2-a73d-6ede29c85178 could not be found. Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 964fd5af-6557-4aa2-a73d-6ede29c85178 could not be found. Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 400 to user: Flavor 964fd5af-6557-4aa2-a73d-6ede29c85178 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e33a0b69-8a84-4942-892e-61ecc73629b3 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "POST /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6/action" status: 400 len: 107 microversion: 2.1 time: 0.090702 Sep 08 11:14:24.256964 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3764/7294] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:24 2022] POST /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6/action => generated 107 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:14:24.267947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:24.269363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:24.280885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.282153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.282989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.284329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.285150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.286552 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.491256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:24.499331 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ec52af3e-fb0f-41c5-acf1-af7c256ec8f4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.238816 Sep 08 11:14:24.499961 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3531/7295] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:24 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:24.523712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:24.524454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:24.530756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.531512 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.531948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.532711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.533165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.533602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.767381 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:24.776509 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0c3d57de-776d-4490-81bb-9967281d7d13 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.257539 Sep 08 11:14:24.777092 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3765/7296] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:24 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:24.799383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cc01c24-a422-4a2a-8066-e6bab90cf34a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cc01c24-a422-4a2a-8066-e6bab90cf34a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: request: POST /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6/action HTTP/1.1 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 29 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: {"resize": {"flavorRef": ""}} Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'bc43fae7-3201-4ea1-9f6d-46851fd6dbf6', 'body': {'resize': {'flavorRef': ''}}} Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise error Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi '' Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.803286 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5cc01c24-a422-4a2a-8066-e6bab90cf34a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5cc01c24-a422-4a2a-8066-e6bab90cf34a tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "POST /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6/action" status: 400 len: 113 microversion: 2.1 time: 0.009336 Sep 08 11:14:24.807734 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3532/7297] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:14:24 2022] POST /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 11:14:24.813774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:24.814386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:24.824018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.825810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.826312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:24.828499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:24.828994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:24.829439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.073198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:25.082093 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51afbb36-3240-482f-8256-a6509e3184b2 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1507 microversion: 2.1 time: 0.272073 Sep 08 11:14:25.083177 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3766/7298] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:24 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:25.110158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:25.110674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:25.120548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.121055 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.121510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.122236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.122710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.123156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.136825 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] HTTP exception thrown: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 HTTP/1.1 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '65c5c54d-7ca7-4a54-b137-445a67c39363'} Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:25.138440 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 404 to user: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6dae2133-9584-4003-a724-12d86b021030 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "DELETE /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 404 len: 111 microversion: 2.1 time: 0.034640 Sep 08 11:14:25.143090 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3533/7299] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:14:25 2022] DELETE /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:14:25.149273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:25.149908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: 65c5c54d-7ca7-4a54-b137-445a67c39363] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:25.155926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.156659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.157089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.157769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.158219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.158639 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.173159 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] HTTP exception thrown: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 HTTP/1.1 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '65c5c54d-7ca7-4a54-b137-445a67c39363'} Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:25.174695 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 404 to user: Instance 65c5c54d-7ca7-4a54-b137-445a67c39363 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5cfcb5b2-6456-4137-9ccb-789208970a99 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363" status: 404 len: 111 microversion: 2.1 time: 0.031247 Sep 08 11:14:25.179886 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3767/7300] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:25 2022] GET /compute/v2.1/servers/65c5c54d-7ca7-4a54-b137-445a67c39363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:14:25.184945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:25.185467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:25.192004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.192525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.192985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.193727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.194205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.194656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.223912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:14:25.239398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:25.311618 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-407f245b-42e9-41d6-abf6-ddc00f399c3e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 204 len: 0 microversion: 2.1 time: 0.130332 Sep 08 11:14:25.312554 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3534/7301] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:14:25 2022] DELETE /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:14:25.322745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:25.323365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:25.329395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.329879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.330601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.331305 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:25.331781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:25.332207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:25.337005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=100 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:14:25.467103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:25.474953 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bfe12d27-bbfe-4c05-8d71-bf6b37d6dce9 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1513 microversion: 2.1 time: 0.158222 Sep 08 11:14:25.475553 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3768/7302] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:25 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:26.499056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:26.499810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:26.506845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:26.507352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:26.507839 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:26.508551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:26.509088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:26.509472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:26.646784 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:26.654547 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d0269651-6e10-4bd6-94a6-79bfdd60e42e tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1513 microversion: 2.1 time: 0.159979 Sep 08 11:14:26.655114 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3535/7303] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:26 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:27.679134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:27.679856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:27.687139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.687959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.688395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.689284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.689738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.690161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.724218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-08f528e8-6e4a-4157-a231-ebb290af2d4c req-a96c2dfd-be6f-418f-ada1-c076e90b040d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc43fae7-3201-4ea1-9f6d-46851fd6dbf6", "name": "network-vif-deleted", "tag": "0617116e-de40-4d99-920e-19afc68874a0"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:14:27.735050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08f528e8-6e4a-4157-a231-ebb290af2d4c req-a96c2dfd-be6f-418f-ada1-c076e90b040d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:27.735583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08f528e8-6e4a-4157-a231-ebb290af2d4c req-a96c2dfd-be6f-418f-ada1-c076e90b040d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:27.736033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-08f528e8-6e4a-4157-a231-ebb290af2d4c req-a96c2dfd-be6f-418f-ada1-c076e90b040d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:27.751379 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-08f528e8-6e4a-4157-a231-ebb290af2d4c req-a96c2dfd-be6f-418f-ada1-c076e90b040d service nova] Creating event network-vif-deleted:0617116e-de40-4d99-920e-19afc68874a0 for instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 on n-h2-833090-19 Sep 08 11:14:27.757018 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-08f528e8-6e4a-4157-a231-ebb290af2d4c req-a96c2dfd-be6f-418f-ada1-c076e90b040d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 Sep 08 11:14:27.758028 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3536/7304] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:14:27.779058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bf4312c881f40dbaa4fb55cf0ea49db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea67cdb94934a1fba8ada5b66b36379', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:14:27.788376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e4dc5dc3-011a-49c8-8c96-806259d31365 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 200 len: 1471 microversion: 2.1 time: 0.113952 Sep 08 11:14:27.788965 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3769/7305] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:27 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 1471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:14:28.815446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:14:28.816197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] [instance: bc43fae7-3201-4ea1-9f6d-46851fd6dbf6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:14:28.823058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:28.823610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:28.824441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:28.824797 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:14:28.825265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:14:28.825711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:14:28.843214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] HTTP exception thrown: Instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 could not be found. Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Request method failure captured: Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 HTTP/1.1 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc51kC6dqCZ5h8YVRBmmyBIZjumnEwdwS1K07yyCwrqdayeAHPYLx9_SanHWiV_1fZZY0IbBU3hxPOj68uBBGmoNIjUL-bqsOlEDLgng9Xx38K0vBZh6fKk_2An2K0uXSVqKW_PS7PYcebPy-4j42_1wvZik2Ybp3pVznMJi2EwnZ-4 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9ea67cdb94934a1fba8ada5b66b36379"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9ea67cdb94934a1fba8ada5b66b36379", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 9ea67cdb94934a1fba8ada5b66b36379 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1684066767 Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 4bf4312c881f40dbaa4fb55cf0ea49db Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-ServersNegativeTestJSON-1684066767-project Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 could not be found. Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'bc43fae7-3201-4ea1-9f6d-46851fd6dbf6'} Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 could not be found. Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 could not be found. Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:14:28.845592 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 could not be found. Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] Returning 404 to user: Instance bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0fceaba-fc1a-41fa-8315-4f2e7bb034d4 tempest-ServersNegativeTestJSON-1684066767 tempest-ServersNegativeTestJSON-1684066767-project] 10.222.0.59 "GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6" status: 404 len: 111 microversion: 2.1 time: 0.037410 Sep 08 11:14:28.850456 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3537/7306] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:14:28 2022] GET /compute/v2.1/servers/bc43fae7-3201-4ea1-9f6d-46851fd6dbf6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:15:01.999903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:02.000647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=10 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:02.202821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9066fea2-8f5f-4e36-8606-a8ee665bc1dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: .version_select at 0x7f235066b0d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1749774045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMPwvjDROjiNk4pA2CbaQsCOd8i+IrMMcjkD5aT2Y9cgLjmEJmqDYaujIEO+Uj/vj312emHfcRjFTr+cwfmNMk4UXIUbIxVK7ltEP3myaJRfJV5yCnpPbFlcxZ/nADgHg=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:02.219140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-9066fea2-8f5f-4e36-8606-a8ee665bc1dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for project d5c2d50883274763bf7cbc3860f09183. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:02.224391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-9066fea2-8f5f-4e36-8606-a8ee665bc1dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for user 3d7dcfbd6d1f4529a1606324547947d6 and project d5c2d50883274763bf7cbc3860f09183. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:02.270643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9066fea2-8f5f-4e36-8606-a8ee665bc1dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.275740 Sep 08 11:15:02.275653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3770/7307] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:15:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:02.333154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1059578552", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1749774045", "networks": [{"uuid": "d6ba3e07-80cc-4f46-b9cc-866d58254ff3"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:02.342732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:02.343540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:02.402083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] validate_networks() for [('d6ba3e07-80cc-4f46-b9cc-866d58254ff3', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:15:02.812986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:15:02.813428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:15:02.813919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:15:02.814350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:15:02.814782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:15:02.825010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:02.825885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:02.826338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:02.827076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:02.827821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:02.828264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:02.845648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for project d5c2d50883274763bf7cbc3860f09183. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:02.851066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for user 3d7dcfbd6d1f4529a1606324547947d6 and project d5c2d50883274763bf7cbc3860f09183. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:02.864124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:15:02.866492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:15:02.917558 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a0a3a0f-068d-4b3e-98c9-b8e5af47719d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588992 Sep 08 11:15:02.918585 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3538/7308] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:15:02.929842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-761a7969-3cb7-4ebd-aa00-fcf2ca5e1638 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:02.931171 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-761a7969-3cb7-4ebd-aa00-fcf2ca5e1638 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:03.003349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-761a7969-3cb7-4ebd-aa00-fcf2ca5e1638 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:03.022867 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-761a7969-3cb7-4ebd-aa00-fcf2ca5e1638 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1263 microversion: 2.1 time: 0.097038 Sep 08 11:15:03.023485 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3771/7309] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:02 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1263 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:04.046570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:04.047834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:04.058782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:04.064110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:04.064868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:04.069153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:04.069886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:04.072249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:04.178255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:04.187084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a0bfb82-5704-4b6a-af31-f2bd71f53b36 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1333 microversion: 2.1 time: 0.144544 Sep 08 11:15:04.187840 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3539/7310] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:04 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:05.219241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:05.220311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:05.227489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:05.233817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:05.235661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:05.236563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:05.237287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:05.237902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:05.437557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:05.445702 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b26774c2-28b1-47c4-b93c-ea36f102932a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.236365 Sep 08 11:15:05.446846 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3772/7311] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:05 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:05.583404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-91a48cbd-1397-4d76-90be-806e04a61aa1 req-aa39aa64-8a45-4f7c-ab49-8b039ddb4c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f23221-c9a7-4d35-b730-0f0b3c59f737", "tag": "5df815ab-086d-45f0-9b6d-8f92cad8a1f6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:05.594388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-91a48cbd-1397-4d76-90be-806e04a61aa1 req-aa39aa64-8a45-4f7c-ab49-8b039ddb4c38 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:05.594887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-91a48cbd-1397-4d76-90be-806e04a61aa1 req-aa39aa64-8a45-4f7c-ab49-8b039ddb4c38 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:05.595335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-91a48cbd-1397-4d76-90be-806e04a61aa1 req-aa39aa64-8a45-4f7c-ab49-8b039ddb4c38 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:05.611872 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-91a48cbd-1397-4d76-90be-806e04a61aa1 req-aa39aa64-8a45-4f7c-ab49-8b039ddb4c38 service nova] Creating event network-changed:5df815ab-086d-45f0-9b6d-8f92cad8a1f6 for instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 on n-h1-833090-19 Sep 08 11:15:05.618442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-91a48cbd-1397-4d76-90be-806e04a61aa1 req-aa39aa64-8a45-4f7c-ab49-8b039ddb4c38 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038162 Sep 08 11:15:05.619217 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3540/7312] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:06.471229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:06.471751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:06.479522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:06.480202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:06.480749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:06.481630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:06.482168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:06.482695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:06.621186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:06.629102 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2a8f93bc-39c2-4ece-9ce2-c35ca2a15920 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.163014 Sep 08 11:15:06.629679 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3773/7313] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:06 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:07.654428 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:07.655135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:07.661260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:07.661996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:07.662447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:07.663137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:07.663628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:07.664060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:07.802637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:07.810747 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c2b942f7-1293-40ea-a1dc-928ece3601e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.161438 Sep 08 11:15:07.811320 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3541/7314] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:07 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:08.833733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:08.834355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:08.841485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.841978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.842431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.843143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:08.843635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:08.844068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:08.976144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:08.985269 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-311675bf-e68c-47e1-b699-d09d4ce21335 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.155486 Sep 08 11:15:08.985846 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3774/7315] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:08 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:10.010871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:10.011622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:10.017614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.018108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.018554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.019253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:10.019741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:10.020174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:10.161611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:10.169645 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-00044624-2f0c-461e-a900-26f11e69c6f0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.164069 Sep 08 11:15:10.170215 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3542/7316] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:10 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:11.192731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:11.193373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:11.200916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:11.201403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:11.201847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:11.202544 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:11.203000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:11.203430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:11.332365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:11.340602 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-aff4bb69-ad4a-4b59-9e20-c8ff26341aab tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.151737 Sep 08 11:15:11.341168 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3775/7317] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:11 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:11.587994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-31d1418f-ee5f-4154-8053-fcf303083bea req-97c80d0b-1376-487d-8917-a7330d28d3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f23221-c9a7-4d35-b730-0f0b3c59f737", "name": "network-vif-plugged", "status": "completed", "tag": "5df815ab-086d-45f0-9b6d-8f92cad8a1f6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:11.599908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-31d1418f-ee5f-4154-8053-fcf303083bea req-97c80d0b-1376-487d-8917-a7330d28d3fb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:11.599908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-31d1418f-ee5f-4154-8053-fcf303083bea req-97c80d0b-1376-487d-8917-a7330d28d3fb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:11.600445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-31d1418f-ee5f-4154-8053-fcf303083bea req-97c80d0b-1376-487d-8917-a7330d28d3fb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:11.612447 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-31d1418f-ee5f-4154-8053-fcf303083bea req-97c80d0b-1376-487d-8917-a7330d28d3fb service nova] Creating event network-vif-plugged:5df815ab-086d-45f0-9b6d-8f92cad8a1f6 for instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 on n-h1-833090-19 Sep 08 11:15:11.617876 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-31d1418f-ee5f-4154-8053-fcf303083bea req-97c80d0b-1376-487d-8917-a7330d28d3fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Sep 08 11:15:11.619111 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3543/7318] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:12.363382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:12.364034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:12.370992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:12.371502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:12.371950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:12.372654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:12.373110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:12.373541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:12.532605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:12.541959 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48ce9175-1873-4aa3-83d1-06b566cfdb3d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1363 microversion: 2.1 time: 0.182441 Sep 08 11:15:12.542584 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3776/7319] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:12 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:13.563354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:13.564192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:13.568468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:13.569176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:13.576118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:13.576606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:13.577051 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:13.577748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:13.578210 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:13.578644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:13.710282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:13.718933 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26bab43c-0542-4809-bce8-c1ed051fdfb2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1555 microversion: 2.1 time: 0.157374 Sep 08 11:15:13.719549 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3544/7320] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:13 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:13.741193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:13.741811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:13.743698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:13.750489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:13.750983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:13.751429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:13.752159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:13.752612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:13.753046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:13.897574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:13.905401 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6099b850-6357-4536-8f60-864256e5fb1e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1555 microversion: 2.1 time: 0.168066 Sep 08 11:15:13.905963 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3777/7321] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:13 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:15.555248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efbfb6db-8c7c-4781-8cd4-abc05791df3b"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:15.558252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:15.565035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.565546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.566032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.566754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:15.567228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:15.567711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:15.815654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5406a633-dc9e-4d01-9df6-d7565374386a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264248 Sep 08 11:15:15.816295 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3545/7322] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 11:15:15 2022] POST /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:26.548898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:26.549515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:26.552351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:26.553078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:26.559392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:26.559912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:26.560358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:26.561064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:26.561566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:26.561955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:26.642066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lazy-loading 'services' on Instance uuid d4f23221-c9a7-4d35-b730-0f0b3c59f737 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:15:26.713057 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b86dce4-345d-4982-9911-c4d5f7adf6b8 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments/efbfb6db-8c7c-4781-8cd4-abc05791df3b" status: 202 len: 0 microversion: 2.1 time: 0.167983 Sep 08 11:15:26.713668 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3778/7323] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:15:26 2022] DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments/efbfb6db-8c7c-4781-8cd4-abc05791df3b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:26.721200 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:26.722049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:26.727177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:26.730863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:26.741390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:26.742238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:26.742701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:26.743431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:26.743927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:26.744374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:26.778063 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-425bf263-80b4-413a-95fd-6383675dd24b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058822 Sep 08 11:15:26.778639 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3546/7324] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:15:26 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:27.792970 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:27.795318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:27.801596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:27.802075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:27.802505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:27.803195 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:27.803667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:27.804088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:27.835317 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9bb5911a-40cf-499a-9932-b69154a5c5e3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048393 Sep 08 11:15:27.835938 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3779/7325] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:15:27 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:28.849445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:28.851702 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:28.858530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:28.859022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:28.859490 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:28.860209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:28.860671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:28.861112 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:28.894632 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ed443ef-db72-49a5-85a2-345389085099 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049186 Sep 08 11:15:28.895210 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3547/7326] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:15:28 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:29.907785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:29.909969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:29.917096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:29.917744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:29.918179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:29.918968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:29.919420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:29.923276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:29.955802 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f951cfef-203e-4ab9-b8ea-c5d3d2922e33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052090 Sep 08 11:15:29.956380 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3780/7327] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:15:29 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:30.969018 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:30.971339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:30.978410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:30.978914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:30.979368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:30.980131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:30.980607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:30.981054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:31.013448 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8dd9e24b-7822-40eb-870d-7bbd342ecf9a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048978 Sep 08 11:15:31.014235 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3548/7328] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:15:30 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:32.026577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:32.028846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:32.035722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.036211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.036655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.037352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.037809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.038237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.069440 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-db1edfe2-531d-4906-b044-c38b4deb3781 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046853 Sep 08 11:15:32.070019 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3781/7329] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:15:32 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:15:32.081196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:32.081713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:32.088453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.088946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.089391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.090088 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:32.090555 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:32.090982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:32.168097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] HTTP exception thrown: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 is not attached to volume efbfb6db-8c7c-4781-8cd4-abc05791df3b Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Request method failure captured: Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: request: DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments/efbfb6db-8c7c-4781-8cd4-abc05791df3b HTTP/1.1 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc6wmzocxYGc0O8-TVMP8bkbIACYb9O1rc1p-PL0P0VazMP2RHuFVaEhNZORkX7k2Pjf3KLEBPCrOiZrdeBrxiiyPQ1d3WtvlJf36Q-wlTppp9zwCWJg0UFnbHV9_tkPCEf6q-9EN4khuMUy6lLT8xhbnc-drmyVqc8-Ceyl_Zm7OYA Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5c2d50883274763bf7cbc3860f09183", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3d7dcfbd6d1f4529a1606324547947d6 Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 is not attached to volume efbfb6db-8c7c-4781-8cd4-abc05791df3b Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'server_id': 'd4f23221-c9a7-4d35-b730-0f0b3c59f737', 'id': 'efbfb6db-8c7c-4781-8cd4-abc05791df3b'} Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id efbfb6db-8c7c-4781-8cd4-abc05791df3b. Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 is not attached to volume efbfb6db-8c7c-4781-8cd4-abc05791df3b Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:32.176806 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 is not attached to volume efbfb6db-8c7c-4781-8cd4-abc05791df3b Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Returning 404 to user: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 is not attached to volume efbfb6db-8c7c-4781-8cd4-abc05791df3b {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8cfb39a9-0430-4e44-84cd-54b009bc1864 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments/efbfb6db-8c7c-4781-8cd4-abc05791df3b" status: 404 len: 154 microversion: 2.1 time: 0.101152 Sep 08 11:15:32.181739 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3549/7330] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:15:32 2022] DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737/os-volume_attachments/efbfb6db-8c7c-4781-8cd4-abc05791df3b => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 11:15:35.562765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:35.563307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:35.570681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:35.571176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:35.571909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.572834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:35.573294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:35.573728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.601218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:15:35.701266 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9ffad40c-1db3-4439-8eef-89851fd00f34 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 204 len: 0 microversion: 2.1 time: 0.142613 Sep 08 11:15:35.701916 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3782/7331] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:15:35 2022] DELETE /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:15:35.710643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:35.711275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:35.719518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:35.721153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:35.721624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.722717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:35.723224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:35.723697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:35.863511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:35.872613 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-26b97c40-8597-4138-a7c5-d6ccc6b7ab15 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1561 microversion: 2.1 time: 0.165877 Sep 08 11:15:35.873195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3550/7332] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:35 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:36.896530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:36.897226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:36.904266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:36.904751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:36.905191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:36.905880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:36.906332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:36.906754 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:37.043966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:37.053385 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b8f7b42-c15e-4885-9ad5-5b7c5c0ddbbf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1561 microversion: 2.1 time: 0.161084 Sep 08 11:15:37.053964 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3783/7333] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:36 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:37.626891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-43347479-f882-4729-96aa-c00d1bd27752 req-a31e8952-f1a3-4286-908d-f456f8ae14df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f23221-c9a7-4d35-b730-0f0b3c59f737", "name": "network-vif-deleted", "tag": "5df815ab-086d-45f0-9b6d-8f92cad8a1f6"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:37.641281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43347479-f882-4729-96aa-c00d1bd27752 req-a31e8952-f1a3-4286-908d-f456f8ae14df service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:37.641882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43347479-f882-4729-96aa-c00d1bd27752 req-a31e8952-f1a3-4286-908d-f456f8ae14df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:37.642338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43347479-f882-4729-96aa-c00d1bd27752 req-a31e8952-f1a3-4286-908d-f456f8ae14df service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:37.656804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-43347479-f882-4729-96aa-c00d1bd27752 req-a31e8952-f1a3-4286-908d-f456f8ae14df service nova] Creating event network-vif-deleted:5df815ab-086d-45f0-9b6d-8f92cad8a1f6 for instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 on n-h1-833090-19 Sep 08 11:15:37.662085 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-43347479-f882-4729-96aa-c00d1bd27752 req-a31e8952-f1a3-4286-908d-f456f8ae14df service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Sep 08 11:15:37.662699 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3551/7334] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:38.079582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:38.080513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:38.092153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.092644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.093082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.093786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.094233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.094721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.129756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:38.130235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:38.130818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:38.131279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lazy-loading 'fault' on Instance uuid d4f23221-c9a7-4d35-b730-0f0b3c59f737 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:15:38.175527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:38.182630 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a2de7aae-9840-4e21-8446-2dc0ef94f4dc tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 200 len: 1353 microversion: 2.1 time: 0.109755 Sep 08 11:15:38.183200 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3784/7335] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:38 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:39.206940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:39.208345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: d4f23221-c9a7-4d35-b730-0f0b3c59f737] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:39.215572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:39.216077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:39.216531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.217248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:39.217729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:39.218173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.231724 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] HTTP exception thrown: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 could not be found. Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Request method failure captured: Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 HTTP/1.1 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGc6wmzocxYGc0O8-TVMP8bkbIACYb9O1rc1p-PL0P0VazMP2RHuFVaEhNZORkX7k2Pjf3KLEBPCrOiZrdeBrxiiyPQ1d3WtvlJf36Q-wlTppp9zwCWJg0UFnbHV9_tkPCEf6q-9EN4khuMUy6lLT8xhbnc-drmyVqc8-Ceyl_Zm7OYA Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5c2d50883274763bf7cbc3860f09183", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 3d7dcfbd6d1f4529a1606324547947d6 Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 could not be found. Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'd4f23221-c9a7-4d35-b730-0f0b3c59f737'} Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 could not be found. Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 could not be found. Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:15:39.233371 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 could not be found. Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Returning 404 to user: Instance d4f23221-c9a7-4d35-b730-0f0b3c59f737 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b635d209-05af-43f1-97b8-3ab64dd320e1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737" status: 404 len: 111 microversion: 2.1 time: 0.032316 Sep 08 11:15:39.238029 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3552/7336] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:39 2022] GET /compute/v2.1/servers/d4f23221-c9a7-4d35-b730-0f0b3c59f737 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:15:39.243612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a6e6cc18-7a94-4113-8fb1-6731c4dcddce tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '.version_select at 0x7f234bb39790>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:39.264797 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a6e6cc18-7a94-4113-8fb1-6731c4dcddce tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1749774045" status: 202 len: 0 microversion: 2.1 time: 0.024353 Sep 08 11:15:39.265419 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3785/7337] 10.222.0.59 () {58 vars in 1278 bytes} [Thu Sep 8 11:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1749774045 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:15:39.283090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fb2da90f-8e2f-46f5-9a76-080820840d02 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: .version_select at 0x7f23500e8160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1510675232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc3vdiM0KgUhr8QDcnGGa0KnXywgb8YQnz/hXtHqyE0K71Qsj2BLflIM5n5phTPjfWTxJbnDcBfl1ioS02HRkmmNYPjIDtmsTiDmLEh/s2JmdxNB/OqEWLD8b/gq4OJNA=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:39.298634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-fb2da90f-8e2f-46f5-9a76-080820840d02 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for project d5c2d50883274763bf7cbc3860f09183. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:39.304583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-fb2da90f-8e2f-46f5-9a76-080820840d02 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for user 3d7dcfbd6d1f4529a1606324547947d6 and project d5c2d50883274763bf7cbc3860f09183. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:39.328675 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fb2da90f-8e2f-46f5-9a76-080820840d02 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049655 Sep 08 11:15:39.329281 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3553/7338] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:15:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:39.379748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1885769091", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1510675232", "networks": [{"uuid": "d6ba3e07-80cc-4f46-b9cc-866d58254ff3"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:39.432587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] validate_networks() for [('d6ba3e07-80cc-4f46-b9cc-866d58254ff3', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:15:39.809535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:15:39.810091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:15:39.810638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:15:39.811654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:15:39.812074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:15:39.821016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:39.821487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:39.821917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.822635 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:39.823082 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:39.823529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:39.845058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for project d5c2d50883274763bf7cbc3860f09183. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:15:39.850513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for user 3d7dcfbd6d1f4529a1606324547947d6 and project d5c2d50883274763bf7cbc3860f09183. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:15:39.862995 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:15:39.865399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:15:39.916162 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ba9818dd-38de-4e58-a160-53d116d9a4b1 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540122 Sep 08 11:15:39.916827 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3786/7339] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:15:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:15:39.928367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58af666d-1ffa-4cd8-af7f-d22fe967f170 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:39.929022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-58af666d-1ffa-4cd8-af7f-d22fe967f170 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:39.987827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58af666d-1ffa-4cd8-af7f-d22fe967f170 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:39.995199 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58af666d-1ffa-4cd8-af7f-d22fe967f170 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1263 microversion: 2.1 time: 0.070699 Sep 08 11:15:39.995820 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3554/7340] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:39 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:41.019888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:41.020505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:41.028395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:41.028887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:41.029708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:41.030521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:41.031066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:41.031590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:41.133915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:41.143321 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51b5e8af-d0f5-4f97-a11d-55210c22fdfd tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1323 microversion: 2.1 time: 0.128824 Sep 08 11:15:41.144127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3787/7341] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:41 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1323 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:42.166592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:42.167219 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:42.174611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:42.175124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:42.175610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:42.176324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:42.176792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:42.177228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:42.406371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:42.414128 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-234f8b79-9c59-48b5-96bd-22aaf7ff6206 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.251822 Sep 08 11:15:42.414710 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3555/7342] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:42 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:42.608552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-0016738a-6a27-4d7e-b3de-a4f4cdac4507 req-7d375294-3a20-48ea-9919-25bd8f4850b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cd5530-3bb6-4441-816c-953f8e182349", "tag": "629114ad-d1dc-488b-bbca-412444b9eed9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:42.618946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0016738a-6a27-4d7e-b3de-a4f4cdac4507 req-7d375294-3a20-48ea-9919-25bd8f4850b7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:42.619349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0016738a-6a27-4d7e-b3de-a4f4cdac4507 req-7d375294-3a20-48ea-9919-25bd8f4850b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:42.619906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-0016738a-6a27-4d7e-b3de-a4f4cdac4507 req-7d375294-3a20-48ea-9919-25bd8f4850b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:42.635388 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-0016738a-6a27-4d7e-b3de-a4f4cdac4507 req-7d375294-3a20-48ea-9919-25bd8f4850b7 service nova] Creating event network-changed:629114ad-d1dc-488b-bbca-412444b9eed9 for instance 59cd5530-3bb6-4441-816c-953f8e182349 on n-h2-833090-19 Sep 08 11:15:42.640807 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-0016738a-6a27-4d7e-b3de-a4f4cdac4507 req-7d375294-3a20-48ea-9919-25bd8f4850b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036598 Sep 08 11:15:42.641440 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3788/7343] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:15:43.439751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:43.440431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:43.447247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.447783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.448237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.448948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:43.449422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:43.449866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:43.582156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:43.589978 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e588f105-1b20-4368-8341-05659419a37a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.155606 Sep 08 11:15:43.590564 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3556/7344] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:43 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:44.614028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:44.614738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:44.621573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.622026 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.622460 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.623146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:44.623624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:44.624123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:44.761059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:44.768878 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-afc5ee08-68b6-4165-a791-a1d1baa58e06 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.159059 Sep 08 11:15:44.769463 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3789/7345] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:44 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:15:45.791994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:45.792620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:45.799674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:45.800180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:45.800720 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:45.801351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:45.801822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:45.802269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:45.932990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:45.941437 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2285ac12-45c5-4925-927f-c1215834dd33 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.153863 Sep 08 11:15:45.942022 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3557/7346] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:45 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:46.964322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:46.964933 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:46.971998 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:46.972481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:46.972917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:46.973602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:46.974060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:46.974482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:47.109486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:47.117233 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-22a1c897-6dc8-41a5-98b8-96aaea276eaf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.156855 Sep 08 11:15:47.117811 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3790/7347] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:46 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:48.141755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:48.142375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:48.149782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.150277 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.150733 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.151480 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.151970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.152409 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.290766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:48.299260 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fbd4add0-085e-46ab-8be6-432bb85f301f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.162055 Sep 08 11:15:48.299867 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3558/7348] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:48 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:48.393286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b534e097-e026-405b-b50a-3fad4602786b req-bfba37dc-2053-4a4e-b6a5-dc5330522b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cd5530-3bb6-4441-816c-953f8e182349", "name": "network-vif-plugged", "status": "completed", "tag": "629114ad-d1dc-488b-bbca-412444b9eed9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:48.404463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b534e097-e026-405b-b50a-3fad4602786b req-bfba37dc-2053-4a4e-b6a5-dc5330522b75 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:48.404945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b534e097-e026-405b-b50a-3fad4602786b req-bfba37dc-2053-4a4e-b6a5-dc5330522b75 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:48.405497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b534e097-e026-405b-b50a-3fad4602786b req-bfba37dc-2053-4a4e-b6a5-dc5330522b75 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:48.418268 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b534e097-e026-405b-b50a-3fad4602786b req-bfba37dc-2053-4a4e-b6a5-dc5330522b75 service nova] Creating event network-vif-plugged:629114ad-d1dc-488b-bbca-412444b9eed9 for instance 59cd5530-3bb6-4441-816c-953f8e182349 on n-h2-833090-19 Sep 08 11:15:48.423313 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b534e097-e026-405b-b50a-3fad4602786b req-bfba37dc-2053-4a4e-b6a5-dc5330522b75 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Sep 08 11:15:48.423989 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3791/7349] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:15:49.322777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:49.323438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:49.330753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:49.331248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:49.331727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:49.332430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:49.332897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:49.333336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:49.469777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:49.477504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-677a1fce-673c-4ac0-80c1-e98fb8d6e80e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1363 microversion: 2.1 time: 0.158633 Sep 08 11:15:49.478085 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3559/7350] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:49 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:50.498982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:50.499828 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:50.504435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:50.505129 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:50.512094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.512561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.512991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.513666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.514110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.514529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.644693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:50.652418 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2d158e3d-bf2c-4ab7-a6f3-9d41a9229eff tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1556 microversion: 2.1 time: 0.155246 Sep 08 11:15:50.652994 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3792/7351] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:50 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:50.676174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:15:50.676808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:50.678824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:50.684947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.685452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.685910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.686625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:50.687132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:50.687661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:50.820029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:15:50.828746 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-361f7638-d383-4160-a7f0-f15904fe2216 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1556 microversion: 2.1 time: 0.157105 Sep 08 11:15:50.829351 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3560/7352] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:15:50 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:15:52.362168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:15:52.364447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:15:52.371284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.371816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.372248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.372944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:15:52.373401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:15:52.373832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:15:52.621853 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:15:52.642135 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9ffe7641-6cc0-42df-a44e-bf63020f9386 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283927 Sep 08 11:15:52.642767 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3793/7353] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 11:15:52 2022] POST /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:03.367607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:03.368211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:03.370972 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:03.371737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=70 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:03.378807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:03.379312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:03.379790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:03.380511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:03.380962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:03.381395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:03.463948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lazy-loading 'services' on Instance uuid 59cd5530-3bb6-4441-816c-953f8e182349 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:16:03.537058 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4f0e090c-b7c6-4b94-8084-e08b653fad81 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments/cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb" status: 202 len: 0 microversion: 2.1 time: 0.173063 Sep 08 11:16:03.537670 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3561/7354] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:16:03 2022] DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments/cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:16:03.544656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:03.545529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:03.550773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:03.553504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:03.562238 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:03.562663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:03.563677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:03.564386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:03.564878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:03.565307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:03.600820 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c4aad1f7-668c-4020-8b72-72fdf37740c0 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058269 Sep 08 11:16:03.601568 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3794/7355] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:03 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:04.614255 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:04.616547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:04.623564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:04.624056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:04.624505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:04.625203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:04.625665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:04.626099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:04.657748 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b407f4c5-8b20-46d9-83a5-34500f92dc08 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047227 Sep 08 11:16:04.658385 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3562/7356] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:04 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:05.670988 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:05.673894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:05.681561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:05.682056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:05.682497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:05.683210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:05.683699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:05.684136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:05.717227 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d025b64d-4438-4054-a268-c146673408fb tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050437 Sep 08 11:16:05.717836 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3795/7357] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:05 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:06.730441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:06.732804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:06.740445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:06.740954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:06.741410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:06.742133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:06.742609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:06.743050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:06.774896 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e761795-641a-478a-b00b-9378f5aad6d5 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 Sep 08 11:16:06.775396 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3563/7358] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:06 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:07.787185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:07.790724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:07.800940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:07.801509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:07.802220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:07.803383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:07.804135 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:07.805122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:07.870182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8c6ebe2e-7e3b-479d-ab3f-f7019f64af62 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087263 Sep 08 11:16:07.871290 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3796/7359] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:07 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:08.882574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:08.885103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:08.892756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:08.893257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:08.893709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:08.894419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:08.894888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:08.895349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:08.925023 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-219748b6-450a-433c-ab27-97129959780c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046564 Sep 08 11:16:08.925597 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3564/7360] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:08 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:16:08.936279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:08.936816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:08.943753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:08.944231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:08.944662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:08.945343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:08.945793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:08.946213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:09.022009 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] HTTP exception thrown: Instance 59cd5530-3bb6-4441-816c-953f8e182349 is not attached to volume cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Request method failure captured: Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments/cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb HTTP/1.1 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc6wmzocxYGc0O8-TVMP8bkbIACYb9O1rc1p-PL0P0VazMP2RHuFVaEhNZORkX7k2Pjf3KLEBPCrOiZrdeBrxiiyPQ1d3WtvlJf36Q-wlTppp9zwCWJg0UFnbHV9_tkPCEf6q-9EN4khuMUy6lLT8xhbnc-drmyVqc8-Ceyl_Zm7OYA Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5c2d50883274763bf7cbc3860f09183", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3d7dcfbd6d1f4529a1606324547947d6 Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 59cd5530-3bb6-4441-816c-953f8e182349 is not attached to volume cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '59cd5530-3bb6-4441-816c-953f8e182349', 'id': 'cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb'} Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb. Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cd5530-3bb6-4441-816c-953f8e182349 is not attached to volume cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:09.023951 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cd5530-3bb6-4441-816c-953f8e182349 is not attached to volume cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Returning 404 to user: Instance 59cd5530-3bb6-4441-816c-953f8e182349 is not attached to volume cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3596cc6-fb99-44bc-b302-2030a6cca5b4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments/cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb" status: 404 len: 154 microversion: 2.1 time: 0.093165 Sep 08 11:16:09.028354 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3797/7361] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:16:08 2022] DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349/os-volume_attachments/cb840d58-f2ad-43a3-8cb5-7dfbc8239cdb => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:16:12.414691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:12.415292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:12.422787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:12.423343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:12.423827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:12.424586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:12.425040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:12.425489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:12.455025 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:16:12.537168 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8a358f10-a09f-4c32-802d-8564e6d5166f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 204 len: 0 microversion: 2.1 time: 0.125982 Sep 08 11:16:12.538572 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3565/7362] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:16:12 2022] DELETE /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:16:12.547016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:12.547745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:12.555281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:12.555794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:12.556230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:12.556922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:12.557371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:12.557791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:12.695035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:12.703104 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d4328a0b-e01f-4bed-8957-21d4766d0aca tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1562 microversion: 2.1 time: 0.160236 Sep 08 11:16:12.718758 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3798/7363] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:12 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:13.727320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:13.728061 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:13.735073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:13.735644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:13.736098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:13.736807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:13.737275 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:13.737756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:13.874291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:13.882161 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-abb5a7ae-4889-43ab-a4ee-3c761af9e71a tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1562 microversion: 2.1 time: 0.159120 Sep 08 11:16:13.882739 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3566/7364] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:13 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:14.905672 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:14.912384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:14.925599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:14.926093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:14.926527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:14.927235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:14.927716 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:14.928396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:15.006248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:15.008894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b6233f45-362a-4017-ab65-0084d30f4d1f req-88587801-7402-4163-869d-f2cc3926050a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cd5530-3bb6-4441-816c-953f8e182349", "name": "network-vif-deleted", "tag": "629114ad-d1dc-488b-bbca-412444b9eed9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:15.014935 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-88219ac8-cbd6-4e0b-ab48-2258332ccb12 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 200 len: 1520 microversion: 2.1 time: 0.113281 Sep 08 11:16:15.015537 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3799/7365] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:14 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 1520 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:15.020567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b6233f45-362a-4017-ab65-0084d30f4d1f req-88587801-7402-4163-869d-f2cc3926050a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:15.021288 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b6233f45-362a-4017-ab65-0084d30f4d1f req-88587801-7402-4163-869d-f2cc3926050a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:15.021920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b6233f45-362a-4017-ab65-0084d30f4d1f req-88587801-7402-4163-869d-f2cc3926050a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:15.038959 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b6233f45-362a-4017-ab65-0084d30f4d1f req-88587801-7402-4163-869d-f2cc3926050a service nova] Creating event network-vif-deleted:629114ad-d1dc-488b-bbca-412444b9eed9 for instance 59cd5530-3bb6-4441-816c-953f8e182349 on n-h2-833090-19 Sep 08 11:16:15.046103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b6233f45-362a-4017-ab65-0084d30f4d1f req-88587801-7402-4163-869d-f2cc3926050a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043142 Sep 08 11:16:15.047055 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3567/7366] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:16:16.037683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:16.038292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 59cd5530-3bb6-4441-816c-953f8e182349] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:16.046037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:16.046531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:16.047006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:16.047746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:16.048729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:16.049164 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:16.063252 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] HTTP exception thrown: Instance 59cd5530-3bb6-4441-816c-953f8e182349 could not be found. Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Request method failure captured: Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 HTTP/1.1 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc6wmzocxYGc0O8-TVMP8bkbIACYb9O1rc1p-PL0P0VazMP2RHuFVaEhNZORkX7k2Pjf3KLEBPCrOiZrdeBrxiiyPQ1d3WtvlJf36Q-wlTppp9zwCWJg0UFnbHV9_tkPCEf6q-9EN4khuMUy6lLT8xhbnc-drmyVqc8-Ceyl_Zm7OYA Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5c2d50883274763bf7cbc3860f09183", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3d7dcfbd6d1f4529a1606324547947d6 Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 59cd5530-3bb6-4441-816c-953f8e182349 could not be found. Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '59cd5530-3bb6-4441-816c-953f8e182349'} Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cd5530-3bb6-4441-816c-953f8e182349 could not be found. Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cd5530-3bb6-4441-816c-953f8e182349 could not be found. Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:16.065414 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cd5530-3bb6-4441-816c-953f8e182349 could not be found. Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Returning 404 to user: Instance 59cd5530-3bb6-4441-816c-953f8e182349 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f68e197d-7e88-45ff-a30f-77173143d058 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349" status: 404 len: 111 microversion: 2.1 time: 0.033022 Sep 08 11:16:16.070997 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3800/7367] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:16 2022] GET /compute/v2.1/servers/59cd5530-3bb6-4441-816c-953f8e182349 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:16:16.076829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9ebdb827-3277-4778-806b-7f6227689175 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '.version_select at 0x7f23553df9d0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:16.097750 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9ebdb827-3277-4778-806b-7f6227689175 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1510675232" status: 202 len: 0 microversion: 2.1 time: 0.025381 Sep 08 11:16:16.098346 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3568/7368] 10.222.0.59 () {58 vars in 1278 bytes} [Thu Sep 8 11:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1510675232 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:16:16.117314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3ce027d8-728a-4e6f-b1dc-dc729ddddb97 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: .version_select at 0x7f234bdaf040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-967215320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGCoWgo0MwMfdz818dd2KN+83kgiLHyn9kg0U09I4yC0nwyTl5Vf+fRn+cy8XYxZC2hervX3bSJo0KvhKKPvTeB/05s3weETWFSDbVGAulcrW2k2yAo3B2SYzQdjCz8Rw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:16.133480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-3ce027d8-728a-4e6f-b1dc-dc729ddddb97 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for project d5c2d50883274763bf7cbc3860f09183. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:16:16.138624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-3ce027d8-728a-4e6f-b1dc-dc729ddddb97 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for user 3d7dcfbd6d1f4529a1606324547947d6 and project d5c2d50883274763bf7cbc3860f09183. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:16:16.162205 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3ce027d8-728a-4e6f-b1dc-dc729ddddb97 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048761 Sep 08 11:16:16.162845 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3801/7369] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:16:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:16.213348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1431572686", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-967215320", "networks": [{"uuid": "d6ba3e07-80cc-4f46-b9cc-866d58254ff3"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:16.269950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] validate_networks() for [('d6ba3e07-80cc-4f46-b9cc-866d58254ff3', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:16:16.905091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:16:16.905538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:16:16.906033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:16:16.906462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:16:16.906895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:16:16.916408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:16.916908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:16.917361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:16.918108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:16.918579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:16.919024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:16.936987 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for project d5c2d50883274763bf7cbc3860f09183. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:16:16.942203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Getting quotas for user 3d7dcfbd6d1f4529a1606324547947d6 and project d5c2d50883274763bf7cbc3860f09183. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:16:16.955122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:16:16.957609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:16:17.003828 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-485cf52a-ea7e-4b17-b50e-503c84fe2e6b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794478 Sep 08 11:16:17.004689 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3569/7370] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:16:17.017903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5517397c-fbbc-473f-b303-d9771e3cac95 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:17.018650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5517397c-fbbc-473f-b303-d9771e3cac95 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:17.075892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5517397c-fbbc-473f-b303-d9771e3cac95 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:17.083437 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5517397c-fbbc-473f-b303-d9771e3cac95 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1262 microversion: 2.1 time: 0.070552 Sep 08 11:16:17.084051 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3802/7371] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:17 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:18.108248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:18.108883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:18.116124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:18.116643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:18.117142 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:18.118066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:18.118534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:18.119646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:18.197794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:18.205695 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7dcd24bb-abda-4f09-b388-28eb2a11b135 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1322 microversion: 2.1 time: 0.103160 Sep 08 11:16:18.206283 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3570/7372] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:18 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1322 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:19.230244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:19.231407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:19.241173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:19.241791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:19.242343 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:19.243193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:19.243946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:19.244557 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:19.462229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:19.470093 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1de4ca6b-4ea2-4c4e-aed6-54df9b2fba6c tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1362 microversion: 2.1 time: 0.244883 Sep 08 11:16:19.470669 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3803/7373] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:19 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:19.617907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9d566a60-4958-4348-a53a-9003a53d60c4 req-491976f0-5e59-441a-ab6c-05c91f9747ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be64049-5e04-4758-b20b-a061d8d6f273", "tag": "53534fbe-602a-429b-9124-2417108cfc32"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:19.630003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9d566a60-4958-4348-a53a-9003a53d60c4 req-491976f0-5e59-441a-ab6c-05c91f9747ed service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:19.630787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9d566a60-4958-4348-a53a-9003a53d60c4 req-491976f0-5e59-441a-ab6c-05c91f9747ed service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:19.631379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9d566a60-4958-4348-a53a-9003a53d60c4 req-491976f0-5e59-441a-ab6c-05c91f9747ed service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:19.644065 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9d566a60-4958-4348-a53a-9003a53d60c4 req-491976f0-5e59-441a-ab6c-05c91f9747ed service nova] Creating event network-changed:53534fbe-602a-429b-9124-2417108cfc32 for instance 0be64049-5e04-4758-b20b-a061d8d6f273 on n-h2-833090-19 Sep 08 11:16:19.648840 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9d566a60-4958-4348-a53a-9003a53d60c4 req-491976f0-5e59-441a-ab6c-05c91f9747ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034788 Sep 08 11:16:19.649453 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3571/7374] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:20.493571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:20.494295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:20.501470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:20.501987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:20.502462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:20.503163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:20.503642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:20.504069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:20.639411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:20.647926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a3390242-aa43-4f11-9373-15692555e660 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1362 microversion: 2.1 time: 0.158196 Sep 08 11:16:20.648778 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3804/7375] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:20 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:21.673510 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:21.674290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:21.680626 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:21.681124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:21.681583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:21.682296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:21.682768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:21.683211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:21.814358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:21.822158 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-83e53cfb-832f-4475-8411-ca4af87f9e41 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1362 microversion: 2.1 time: 0.154055 Sep 08 11:16:21.822738 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3572/7376] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:21 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:22.845864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:22.846576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:22.854501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:22.854990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:22.855431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:22.856161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:22.856612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:22.857039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:22.993715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:23.001375 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbc2bb73-5297-4d02-9eeb-3f0a563b36cf tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1362 microversion: 2.1 time: 0.159832 Sep 08 11:16:23.001941 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3805/7377] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:22 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:24.025576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:24.026220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:24.033158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:24.033645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:24.034109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:24.034854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:24.035346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:24.035876 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:24.167482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:24.176339 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e16130e0-a41a-41aa-a0c3-1efa88af01b7 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1362 microversion: 2.1 time: 0.154657 Sep 08 11:16:24.176926 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3573/7378] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:24 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:24.668821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-473b5844-6e13-48bc-935c-bf8443629956 req-d3b3d92f-fec9-4d6d-8f5a-23716753f9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be64049-5e04-4758-b20b-a061d8d6f273", "name": "network-vif-plugged", "status": "completed", "tag": "53534fbe-602a-429b-9124-2417108cfc32"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:24.681817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-473b5844-6e13-48bc-935c-bf8443629956 req-d3b3d92f-fec9-4d6d-8f5a-23716753f9de service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:24.682312 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-473b5844-6e13-48bc-935c-bf8443629956 req-d3b3d92f-fec9-4d6d-8f5a-23716753f9de service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:24.683098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-473b5844-6e13-48bc-935c-bf8443629956 req-d3b3d92f-fec9-4d6d-8f5a-23716753f9de service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:24.695160 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-473b5844-6e13-48bc-935c-bf8443629956 req-d3b3d92f-fec9-4d6d-8f5a-23716753f9de service nova] Creating event network-vif-plugged:53534fbe-602a-429b-9124-2417108cfc32 for instance 0be64049-5e04-4758-b20b-a061d8d6f273 on n-h2-833090-19 Sep 08 11:16:24.700557 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-473b5844-6e13-48bc-935c-bf8443629956 req-d3b3d92f-fec9-4d6d-8f5a-23716753f9de service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035464 Sep 08 11:16:24.701201 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3806/7379] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:25.199036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:25.199746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:25.207046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:25.207585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:25.208045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:25.208783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:25.209257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:25.209700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:25.366397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:25.374408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-79b0d6b6-b8a8-4fbb-a83b-4484ac3a8169 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1362 microversion: 2.1 time: 0.179351 Sep 08 11:16:25.374993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3574/7380] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:25 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:26.401737 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:26.402383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:26.410561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:26.411053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:26.411520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:26.412242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:26.412700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:26.413128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:26.544811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:26.553075 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e2a7c955-9854-463a-ad1a-0114b8965bd2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1554 microversion: 2.1 time: 0.156187 Sep 08 11:16:26.553658 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3807/7381] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:26 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:26.575633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:26.576287 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:26.583672 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:26.584172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:26.584625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:26.585331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:26.585799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:26.586305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:26.720696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:26.729224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d62a2dd-5a89-4818-9474-075d3ad812f2 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1554 microversion: 2.1 time: 0.157584 Sep 08 11:16:26.729842 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3575/7382] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:26 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:28.231868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b054b62e-dc27-4094-9f41-20c9cde4b745"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:28.234259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:28.236288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:28.242845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:28.243331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:28.243788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:28.244513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:28.244989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:28.245390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:28.519687 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-808242b9-e80a-4294-96b6-081e16e8c293 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "POST /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291674 Sep 08 11:16:28.520307 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3808/7383] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 11:16:28 2022] POST /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:39.243167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:39.243736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:39.245886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.246708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.248322 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.249071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.257484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.258052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.258501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.259212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.259740 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.260180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.404391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lazy-loading 'services' on Instance uuid 0be64049-5e04-4758-b20b-a061d8d6f273 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:16:39.477512 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-18011df8-dab0-4141-a21d-c5ee005dea27 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments/b054b62e-dc27-4094-9f41-20c9cde4b745" status: 202 len: 0 microversion: 2.1 time: 0.238660 Sep 08 11:16:39.478185 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3576/7384] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:16:39 2022] DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments/b054b62e-dc27-4094-9f41-20c9cde4b745 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:16:39.487102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:39.490043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:39.493013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.494166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:16:39.501539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.502064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.502507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.503219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:39.503707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:39.504144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:39.538316 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9c9d23e3-709e-4a6e-8fce-ee5c767c8ad4 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055429 Sep 08 11:16:39.538887 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3809/7385] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:39 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:40.553569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:40.555942 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:40.562191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:40.562681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:40.563126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:40.563865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:40.564333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:40.564770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:40.595549 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6432a505-4f35-4f5d-99e4-7953b868eae3 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048793 Sep 08 11:16:40.596123 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3577/7386] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:40 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:41.608941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:41.611201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:41.618881 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:41.619244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:41.619702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:41.620410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:41.620868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:41.621276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:41.656396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0b4c36f3-005d-4afe-815f-7b9d3e53e50f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051411 Sep 08 11:16:41.657185 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3810/7387] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:41 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:42.669227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:42.671754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:42.678896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.679395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.679911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.680634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:42.681107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:42.681550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:42.712793 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1862c280-137c-40d6-bf93-c72d097b1f8e tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Sep 08 11:16:42.713267 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3578/7388] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:42 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:43.725825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:43.727972 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:43.735442 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.735966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.736412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.737134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:43.737591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:43.738022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:43.772602 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-578da9d0-0d20-454f-92f5-15d5b27c6f4b tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051317 Sep 08 11:16:43.773193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3811/7389] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:43 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:44.785187 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:44.787362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:44.794036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.794557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.795012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.795751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.796220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.796661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.826464 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-89c62de2-9cfb-425a-b86b-3a736e6bbf8f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045291 Sep 08 11:16:44.827044 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3579/7390] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:16:44 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:16:44.838292 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:44.838826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:44.845580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.846072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.846518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.847218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:44.847706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:44.848146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:44.975017 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] HTTP exception thrown: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 is not attached to volume b054b62e-dc27-4094-9f41-20c9cde4b745 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Request method failure captured: Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments/b054b62e-dc27-4094-9f41-20c9cde4b745 HTTP/1.1 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc6wmzocxYGc0O8-TVMP8bkbIACYb9O1rc1p-PL0P0VazMP2RHuFVaEhNZORkX7k2Pjf3KLEBPCrOiZrdeBrxiiyPQ1d3WtvlJf36Q-wlTppp9zwCWJg0UFnbHV9_tkPCEf6q-9EN4khuMUy6lLT8xhbnc-drmyVqc8-Ceyl_Zm7OYA Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5c2d50883274763bf7cbc3860f09183", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3d7dcfbd6d1f4529a1606324547947d6 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 is not attached to volume b054b62e-dc27-4094-9f41-20c9cde4b745 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '0be64049-5e04-4758-b20b-a061d8d6f273', 'id': 'b054b62e-dc27-4094-9f41-20c9cde4b745'} Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b054b62e-dc27-4094-9f41-20c9cde4b745. Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 is not attached to volume b054b62e-dc27-4094-9f41-20c9cde4b745 Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:44.976685 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 is not attached to volume b054b62e-dc27-4094-9f41-20c9cde4b745 Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Returning 404 to user: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 is not attached to volume b054b62e-dc27-4094-9f41-20c9cde4b745 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8f4492e3-7f60-41b4-a6db-f9b94c1ad8d6 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments/b054b62e-dc27-4094-9f41-20c9cde4b745" status: 404 len: 154 microversion: 2.1 time: 0.144525 Sep 08 11:16:44.981875 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3812/7391] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:16:44 2022] DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273/os-volume_attachments/b054b62e-dc27-4094-9f41-20c9cde4b745 => generated 154 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:16:48.349186 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:48.349775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:48.357502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.357997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.358442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.359156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.359659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.360094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.388883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:16:48.470668 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f73a1713-8491-40b0-8ca9-4d4de483d10f tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 204 len: 0 microversion: 2.1 time: 0.124679 Sep 08 11:16:48.471215 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3580/7392] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:16:48 2022] DELETE /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:16:48.483117 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:48.483872 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:48.492338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.492987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.493432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.494365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:48.494792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:48.495225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:48.630498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:48.638770 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7fd4d6a-af59-4555-8bd8-dee7aa1c8e21 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1560 microversion: 2.1 time: 0.161778 Sep 08 11:16:48.639344 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3813/7393] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:48 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:16:49.663228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:49.663927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:49.671235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.671777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.672236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.672952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:49.673421 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:49.674118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:49.819917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:49.827839 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a21289c8-e4f6-4f6e-bffd-73530f98c67d tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1560 microversion: 2.1 time: 0.169013 Sep 08 11:16:49.828421 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3581/7394] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:49 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:50.685159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e4db6f93-10d4-405d-adf4-e13128ed0ff3 req-246fcd39-8b53-4960-a0d9-5a1a0cda70f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be64049-5e04-4758-b20b-a061d8d6f273", "name": "network-vif-deleted", "tag": "53534fbe-602a-429b-9124-2417108cfc32"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:16:50.698997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e4db6f93-10d4-405d-adf4-e13128ed0ff3 req-246fcd39-8b53-4960-a0d9-5a1a0cda70f4 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.699725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e4db6f93-10d4-405d-adf4-e13128ed0ff3 req-246fcd39-8b53-4960-a0d9-5a1a0cda70f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.700179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e4db6f93-10d4-405d-adf4-e13128ed0ff3 req-246fcd39-8b53-4960-a0d9-5a1a0cda70f4 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.716154 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e4db6f93-10d4-405d-adf4-e13128ed0ff3 req-246fcd39-8b53-4960-a0d9-5a1a0cda70f4 service nova] Creating event network-vif-deleted:53534fbe-602a-429b-9124-2417108cfc32 for instance 0be64049-5e04-4758-b20b-a061d8d6f273 on n-h2-833090-19 Sep 08 11:16:50.722906 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e4db6f93-10d4-405d-adf4-e13128ed0ff3 req-246fcd39-8b53-4960-a0d9-5a1a0cda70f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041986 Sep 08 11:16:50.723873 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3814/7395] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:16:50.850917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:50.851962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:50.860257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.860769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.861230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.861951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.862542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.862994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.897090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:50.897537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:50.897994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:50.898474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lazy-loading 'fault' on Instance uuid 0be64049-5e04-4758-b20b-a061d8d6f273 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:16:50.944928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7dcfbd6d1f4529a1606324547947d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c2d50883274763bf7cbc3860f09183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:16:50.953156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7af5b8ea-4e8e-4b3c-a696-724ddd2c7223 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 200 len: 1352 microversion: 2.1 time: 0.106759 Sep 08 11:16:50.953734 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3582/7396] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:50 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:16:51.977197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:51.977891 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] [instance: 0be64049-5e04-4758-b20b-a061d8d6f273] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:16:51.984916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:51.985391 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:51.985821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:51.986501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:16:51.986952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:16:51.987367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:16:52.000737 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] HTTP exception thrown: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 could not be found. Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Request method failure captured: Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 HTTP/1.1 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc6wmzocxYGc0O8-TVMP8bkbIACYb9O1rc1p-PL0P0VazMP2RHuFVaEhNZORkX7k2Pjf3KLEBPCrOiZrdeBrxiiyPQ1d3WtvlJf36Q-wlTppp9zwCWJg0UFnbHV9_tkPCEf6q-9EN4khuMUy6lLT8xhbnc-drmyVqc8-Ceyl_Zm7OYA Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5c2d50883274763bf7cbc3860f09183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5c2d50883274763bf7cbc3860f09183", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: d5c2d50883274763bf7cbc3860f09183 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-136737668 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 3d7dcfbd6d1f4529a1606324547947d6 Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestEncryptedCinderVolumes-136737668-project Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 could not be found. Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '0be64049-5e04-4758-b20b-a061d8d6f273'} Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 could not be found. Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 could not be found. Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:16:52.002243 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 could not be found. Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Returning 404 to user: Instance 0be64049-5e04-4758-b20b-a061d8d6f273 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e1a3da63-ad84-45ce-aa8c-43af4a8b9a22 tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273" status: 404 len: 111 microversion: 2.1 time: 0.031074 Sep 08 11:16:52.008014 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3815/7397] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:16:51 2022] GET /compute/v2.1/servers/0be64049-5e04-4758-b20b-a061d8d6f273 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:16:52.012969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c212f19e-a2d5-4927-8896-c52220ec3dae tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] Calling method '.version_select at 0x7f23553df280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:16:52.035584 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c212f19e-a2d5-4927-8896-c52220ec3dae tempest-TestEncryptedCinderVolumes-136737668 tempest-TestEncryptedCinderVolumes-136737668-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-967215320" status: 202 len: 0 microversion: 2.1 time: 0.026416 Sep 08 11:16:52.036195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3583/7398] 10.222.0.59 () {58 vars in 1275 bytes} [Thu Sep 8 11:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-967215320 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:17:19.261488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-05bb86bc-0c60-4b7e-ba13-856c053cbf5d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'create', calling method: .version_select at 0x7f234bd18280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-26779079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHJ+lB08THE3dQEz8TYG4GJjcrKaHjNsGjxvA/Fmjlv8nhyGfdyl9Xt4/5kcaq+gxbbBGMmNqcACb2eQ3FvJw9whXVa4ND3XeGKcrJiIseLK6WF0KTXEhOkb9iYKtqqXA=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:19.267334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=14 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:19.268014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=34 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:19.281722 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-05bb86bc-0c60-4b7e-ba13-856c053cbf5d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for project 076737c518a24e2aacff14cb7467cb85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:17:19.288794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-05bb86bc-0c60-4b7e-ba13-856c053cbf5d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for user 7c4a1066fff149bf8df2d9e75e481a0c and project 076737c518a24e2aacff14cb7467cb85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:17:19.317935 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-05bb86bc-0c60-4b7e-ba13-856c053cbf5d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.060414 Sep 08 11:17:19.318460 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3816/7399] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:17:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:19.369404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:19.370683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:19.374888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-358215578", "imageRef": "8c4b9b84-7419-4a1d-a44d-1b7aadb87238", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-26779079", "networks": [{"uuid": "482e7ff3-46a5-430f-9fc6-aa9a48e392df"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:19.429235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] validate_networks() for [('482e7ff3-46a5-430f-9fc6-aa9a48e392df', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:17:19.806771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:17:19.807205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:17:19.807753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:17:19.808175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:17:19.808600 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:17:19.817422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:19.817910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:19.818359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:19.819087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:19.819586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:19.820024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:19.838231 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for project 076737c518a24e2aacff14cb7467cb85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:17:19.843599 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for user 7c4a1066fff149bf8df2d9e75e481a0c and project 076737c518a24e2aacff14cb7467cb85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:17:19.856501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:17:19.858783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8c4b9b84-7419-4a1d-a44d-1b7aadb87238',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:17:19.905178 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2f48b717-6815-4c7d-bbe1-973df4170b5a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537834 Sep 08 11:17:19.905749 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3584/7400] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:17:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:17:19.916655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b1b56d8c-37dc-4fe3-8e91-cf54d42c3869 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:19.917293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b1b56d8c-37dc-4fe3-8e91-cf54d42c3869 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:19.974536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b1b56d8c-37dc-4fe3-8e91-cf54d42c3869 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:19.983581 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b1b56d8c-37dc-4fe3-8e91-cf54d42c3869 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1256 microversion: 2.1 time: 0.070779 Sep 08 11:17:19.984279 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3817/7401] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:19 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:21.007610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:21.008175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:21.015875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:21.016284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:21.016917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:21.017897 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:21.018832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:21.019420 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:21.102923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:21.111056 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4884197c-5f3a-4969-8a3e-9fae0469f7d3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1308 microversion: 2.1 time: 0.108491 Sep 08 11:17:21.111987 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3585/7402] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:21 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:22.135409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:22.136291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:22.149830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:22.152679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:22.156495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:22.157456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:22.158125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:22.158673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:22.369204 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:22.378857 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b2fa304c-af2e-4069-8e9d-7f5e76c50767 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.247851 Sep 08 11:17:22.391052 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3818/7403] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:22 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:23.406172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:23.406713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:23.413670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:23.414176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:23.414633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:23.415353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:23.415850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:23.416295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:23.571629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:23.579610 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8dfac001-581b-4916-aca2-62b5bf18e00a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.177507 Sep 08 11:17:23.580210 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3586/7404] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:23 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:24.602597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:24.603173 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:24.610291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:24.610781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:24.611450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:24.612193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:24.612650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:24.613078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:24.765142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:24.773602 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1a7fedb4-2681-4e8f-9c75-96130d757b8c tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.175033 Sep 08 11:17:24.774416 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3819/7405] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:24 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:25.798666 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:25.799500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:25.807139 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:25.808012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:25.808804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:25.809568 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:25.810295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:25.810807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:25.975180 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:25.983343 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c0d8ddae-ae26-4921-862d-b0ccfb562613 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.188647 Sep 08 11:17:25.983970 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3587/7406] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:25 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:27.009559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:27.010169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:27.018066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:27.018890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:27.019713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:27.020648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:27.021363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:27.021791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:27.170170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:27.178780 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c6f5c69-e534-477c-8bfa-84bf902e26c0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.174664 Sep 08 11:17:27.179491 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3820/7407] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:27 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:28.203236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:28.203917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:28.211424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:28.212532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:28.212989 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:28.213717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:28.214189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:28.214632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:28.357487 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:28.365711 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-477f8395-fdd6-4614-b931-9b8be50a96f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.166345 Sep 08 11:17:28.367127 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3588/7408] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:28 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:29.388522 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:29.389131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:29.396896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:29.397384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:29.397816 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:29.398508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:29.398956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:29.399905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:29.531315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:29.539051 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b30dbb5a-ab2c-4754-8fc2-0a55138851d1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.154481 Sep 08 11:17:29.539774 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3821/7409] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:29 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:30.518764 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7e7dcc72-9467-49ac-816b-352c8973227a req-a4e3b06c-c28e-4ee8-88c9-e4795f2b53f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:30.524938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:30.525614 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:30.531696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e7dcc72-9467-49ac-816b-352c8973227a req-a4e3b06c-c28e-4ee8-88c9-e4795f2b53f0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:30.532184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e7dcc72-9467-49ac-816b-352c8973227a req-a4e3b06c-c28e-4ee8-88c9-e4795f2b53f0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:30.532622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7e7dcc72-9467-49ac-816b-352c8973227a req-a4e3b06c-c28e-4ee8-88c9-e4795f2b53f0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:30.545096 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7e7dcc72-9467-49ac-816b-352c8973227a req-a4e3b06c-c28e-4ee8-88c9-e4795f2b53f0 service nova] Creating event network-changed:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:17:30.550553 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7e7dcc72-9467-49ac-816b-352c8973227a req-a4e3b06c-c28e-4ee8-88c9-e4795f2b53f0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035596 Sep 08 11:17:30.552307 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3589/7410] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:30.563323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:30.564531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:30.566707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:30.573728 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:30.574219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:30.574660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:30.575378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:30.575863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:30.576296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:30.811826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:30.821179 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df66b8d1-18a9-40ef-98cf-a4a41f2abe81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.261965 Sep 08 11:17:30.835667 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3822/7411] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:30 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:31.847685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:31.848412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:31.855244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:31.855786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:31.856233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:31.857029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:31.857427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:31.857857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:32.069659 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:32.077985 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3941494a-1018-4c25-a37a-d33db966650b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.235388 Sep 08 11:17:32.078582 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3590/7412] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:31 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:33.105456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:33.106073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:33.113031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.113629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.114154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.115053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:33.115644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:33.116196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:33.250570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:33.258460 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-94b86bc6-5159-4315-8b78-d2f61b1cca83 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.156937 Sep 08 11:17:33.259082 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3823/7413] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:33 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:34.282014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:34.282750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:34.289904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:34.290404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:34.290853 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:34.291634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:34.292107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:34.292543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:34.424000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:34.432513 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e5393413-52db-4f90-b17c-b416cc5a05a4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.153922 Sep 08 11:17:34.433099 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3591/7414] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:34 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:35.456064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:35.456678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:35.464025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:35.464515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:35.464953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:35.465680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:35.466137 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:35.466567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:35.599674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:35.607481 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f64a84a8-04a3-4d28-9ca9-3b80c874f175 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.155476 Sep 08 11:17:35.608070 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3824/7415] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:35 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:36.309248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7c5374fe-30b1-4cf5-af39-fd3a7fe1bad5 req-3aa46808-34c2-446e-91ba-534b9c79f22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "name": "network-vif-plugged", "status": "completed", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:36.321209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7c5374fe-30b1-4cf5-af39-fd3a7fe1bad5 req-3aa46808-34c2-446e-91ba-534b9c79f22a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:36.321913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7c5374fe-30b1-4cf5-af39-fd3a7fe1bad5 req-3aa46808-34c2-446e-91ba-534b9c79f22a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:36.322376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7c5374fe-30b1-4cf5-af39-fd3a7fe1bad5 req-3aa46808-34c2-446e-91ba-534b9c79f22a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:36.333947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7c5374fe-30b1-4cf5-af39-fd3a7fe1bad5 req-3aa46808-34c2-446e-91ba-534b9c79f22a service nova] Creating event network-vif-plugged:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:17:36.338826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7c5374fe-30b1-4cf5-af39-fd3a7fe1bad5 req-3aa46808-34c2-446e-91ba-534b9c79f22a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Sep 08 11:17:36.339638 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3592/7416] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:36.629953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:36.630514 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:36.637394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:36.637880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:36.638321 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:36.639015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:36.639499 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:36.639929 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:36.770814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:36.779260 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bd74832e-09b2-4ecc-b6c1-5fbf388debec tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1356 microversion: 2.1 time: 0.153270 Sep 08 11:17:36.779868 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3825/7417] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:36 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:37.805046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:37.805679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:37.812675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:37.813175 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:37.813628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:37.814470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:37.815103 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:37.815592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:37.950312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:37.958166 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-20ec206d-ea44-4970-9db0-b62a16514140 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1546 microversion: 2.1 time: 0.158626 Sep 08 11:17:37.958754 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3593/7418] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:37 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:37.980725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:37.981337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:37.988413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:37.988900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:37.989340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:37.990035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:37.990488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:37.990916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.125281 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:38.132989 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3d8189f4-79f8-49af-baf3-69fef120246a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1546 microversion: 2.1 time: 0.156631 Sep 08 11:17:38.133692 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3826/7419] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:37 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:38.155202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:38.159912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:38.160693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Searching by: {'deleted': False, 'project_id': '076737c518a24e2aacff14cb7467cb85'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 11:17:38.166423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:38.167453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:38.167963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.168705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:38.169178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:38.169648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.193824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 11:17:38.220900 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-890afcfc-572a-487c-945a-4bdc28f781a0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069937 Sep 08 11:17:38.221492 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3594/7420] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 11:17:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:38.233974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:38.234726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:38.241617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:38.242111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:38.242548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.243244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:38.243734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:38.244160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:38.378980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:38.386765 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5571f3fa-9465-4492-bd7d-8b8ef1b4b298 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1546 microversion: 2.1 time: 0.156737 Sep 08 11:17:38.387341 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3827/7421] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:38 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:39.950546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c0bf062-3fa9-41f7-9dd5-6461f314392f"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:39.952919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:39.959245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:39.959771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:39.960214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:39.960907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:39.961369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:39.961801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:40.201192 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c9732e7b-ee96-464e-a423-7137cdbabfd4 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255145 Sep 08 11:17:40.201856 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3595/7422] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 11:17:39 2022] POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:53.246140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:53.246763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:53.249992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:53.250658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=60 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:53.256958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:53.257448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:53.257892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:53.258592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:53.259052 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:53.259506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:53.389791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:53.398161 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-27d3baa1-66d0-4ca3-bbbd-a5d88b004458 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1592 microversion: 2.1 time: 0.155915 Sep 08 11:17:53.398743 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3828/7423] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:53 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1592 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:17:55.351407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:55.352318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:55.353228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:17:55.491932 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7586eb02-3b61-460d-8a2d-fa804f832a52 req-6a37f4ce-9be4-4f76-88d1-57692aa1f94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:55.502035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7586eb02-3b61-460d-8a2d-fa804f832a52 req-6a37f4ce-9be4-4f76-88d1-57692aa1f94e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:55.502622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7586eb02-3b61-460d-8a2d-fa804f832a52 req-6a37f4ce-9be4-4f76-88d1-57692aa1f94e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:55.503069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7586eb02-3b61-460d-8a2d-fa804f832a52 req-6a37f4ce-9be4-4f76-88d1-57692aa1f94e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:55.515571 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7586eb02-3b61-460d-8a2d-fa804f832a52 req-6a37f4ce-9be4-4f76-88d1-57692aa1f94e service nova] Creating event network-changed:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:17:55.520891 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7586eb02-3b61-460d-8a2d-fa804f832a52 req-6a37f4ce-9be4-4f76-88d1-57692aa1f94e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171446 Sep 08 11:17:55.521519 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3596/7424] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:17:56.866420 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1202181460"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:56.867847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:56.875049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:56.875606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:56.876051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:56.876753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:56.877201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:56.877632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:57.008110 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Adding security group d9603ef2-15d0-4f32-81a5-8d613d2ffbe2 to port 10aa440a-56e3-4e25-8dd8-0a57715691fc Sep 08 11:17:57.329099 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fbfc6797-ab27-4b2b-911f-30307b630b7b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/action" status: 202 len: 0 microversion: 2.1 time: 0.467481 Sep 08 11:17:57.333277 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3829/7425] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:17:56 2022] POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:17:57.338328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:17:57.339012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:17:57.339341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-9ac87ebb-530b-49f6-812b-2ccc0ee379e5 req-b85d7346-1cd4-4d25-aa3b-5d1ff87b6488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:17:57.347814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:57.348631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:57.349259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:57.350269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:57.350914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:57.351548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:57.351695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9ac87ebb-530b-49f6-812b-2ccc0ee379e5 req-b85d7346-1cd4-4d25-aa3b-5d1ff87b6488 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:17:57.353017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9ac87ebb-530b-49f6-812b-2ccc0ee379e5 req-b85d7346-1cd4-4d25-aa3b-5d1ff87b6488 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:17:57.353606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-9ac87ebb-530b-49f6-812b-2ccc0ee379e5 req-b85d7346-1cd4-4d25-aa3b-5d1ff87b6488 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:17:57.372438 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-9ac87ebb-530b-49f6-812b-2ccc0ee379e5 req-b85d7346-1cd4-4d25-aa3b-5d1ff87b6488 service nova] Creating event network-changed:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:17:57.379875 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-9ac87ebb-530b-49f6-812b-2ccc0ee379e5 req-b85d7346-1cd4-4d25-aa3b-5d1ff87b6488 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045821 Sep 08 11:17:57.381716 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3597/7426] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:17:57.630996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:17:57.642282 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-982d6435-ae11-4b78-8884-9741a9162ef8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1758 microversion: 2.1 time: 0.307906 Sep 08 11:17:57.642884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3830/7427] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:17:57 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1758 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:35.277961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:35.278796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:35.280018 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 11:19:35.281510 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 11:19:35.286463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:19:35.288810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:35.299368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:35.299892 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:35.300374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:35.301089 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:35.301616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:35.302012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:35.378565 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-cabd35b3-1284-4865-95b0-6451f2237c40 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/action" status: 202 len: 0 microversion: 2.1 time: 0.102448 Sep 08 11:19:35.379223 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3598/7428] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:19:35 2022] POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:19:35.385637 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:19:35.389400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:35.390010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:35.392244 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:35.392949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:19:35.394183 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 11:19:35.395059 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:19:35.395194 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:19:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab (ip 10.222.0.59) !!! Sep 08 11:19:35.407113 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:35.408151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:35.408637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:35.409341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:35.409785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:35.410209 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:35.653293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:35.663097 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18f013ac-01fd-498d-ad87-7a276e24f471 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1760 microversion: 2.1 time: 0.279446 Sep 08 11:19:35.667506 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3831/7429] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:35 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1760 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:19:36.691306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:19:36.692053 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:19:36.698253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:36.698756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:36.699213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:36.699969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:19:36.700436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:19:36.700878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:19:36.846316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:19:36.854662 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0b4525c1-8429-4ad1-b9ee-ab3eeebfd57a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1758 microversion: 2.1 time: 0.169598 Sep 08 11:19:36.855227 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3599/7430] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:19:36 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:20:49.548408 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:20:49.549545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:49.550218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:49.554251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1202181460"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:49.554787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:49.563713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:49.564199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:49.564664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:49.565365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:49.565818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:49.566242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:49.571811 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48586. Sep 08 11:20:49.701829 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Removing security group d9603ef2-15d0-4f32-81a5-8d613d2ffbe2 from port 10aa440a-56e3-4e25-8dd8-0a57715691fc Sep 08 11:20:50.015826 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5bc3eafb-e1f2-4907-a591-5611cc1fc03b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/action" status: 202 len: 0 microversion: 2.1 time: 0.469296 Sep 08 11:20:50.016770 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3832/7431] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:20:49 2022] POST /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 11:20:50.027392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:50.030349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:20:50.127941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c8a6e1da-4641-4f3b-8056-48acb8d3fc06 req-df3c3ce5-a992-491a-818c-e3c353da9150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:50.141314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c8a6e1da-4641-4f3b-8056-48acb8d3fc06 req-df3c3ce5-a992-491a-818c-e3c353da9150 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:50.142020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c8a6e1da-4641-4f3b-8056-48acb8d3fc06 req-df3c3ce5-a992-491a-818c-e3c353da9150 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:50.143436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c8a6e1da-4641-4f3b-8056-48acb8d3fc06 req-df3c3ce5-a992-491a-818c-e3c353da9150 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:50.156317 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c8a6e1da-4641-4f3b-8056-48acb8d3fc06 req-df3c3ce5-a992-491a-818c-e3c353da9150 service nova] Creating event network-changed:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:20:50.161652 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c8a6e1da-4641-4f3b-8056-48acb8d3fc06 req-df3c3ce5-a992-491a-818c-e3c353da9150 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138884 Sep 08 11:20:50.162594 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3600/7432] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:51.153725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-076f2e74-18e6-49b0-96c1-b214b786246b req-fb326454-ea8a-4b5d-8cb1-f12c3236d65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:20:51.170552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-076f2e74-18e6-49b0-96c1-b214b786246b req-fb326454-ea8a-4b5d-8cb1-f12c3236d65a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.171878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-076f2e74-18e6-49b0-96c1-b214b786246b req-fb326454-ea8a-4b5d-8cb1-f12c3236d65a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.172502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-076f2e74-18e6-49b0-96c1-b214b786246b req-fb326454-ea8a-4b5d-8cb1-f12c3236d65a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.186912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-076f2e74-18e6-49b0-96c1-b214b786246b req-fb326454-ea8a-4b5d-8cb1-f12c3236d65a service nova] Creating event network-changed:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:20:51.195081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:51.196137 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 48606. Sep 08 11:20:51.196747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:51.198128 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-076f2e74-18e6-49b0-96c1-b214b786246b req-fb326454-ea8a-4b5d-8cb1-f12c3236d65a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051490 Sep 08 11:20:51.200332 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3833/7433] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:51.208743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.209208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.209723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.210463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.211245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.211400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.317146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lazy-loading 'services' on Instance uuid 4e370302-836d-49a1-b67d-a0b147c657ab {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:20:51.408844 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-30ad124d-6c81-4912-9565-d9acd7b6c448 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments/3c0bf062-3fa9-41f7-9dd5-6461f314392f" status: 202 len: 0 microversion: 2.1 time: 0.220349 Sep 08 11:20:51.409491 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3601/7434] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:20:51 2022] DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments/3c0bf062-3fa9-41f7-9dd5-6461f314392f => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:20:51.418943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:51.421263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:51.428668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.429158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.429596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.430303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:51.430824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:51.431200 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:51.483018 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-df9ef199-0991-467e-bc0c-1c65eb8a1d48 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068909 Sep 08 11:20:51.484082 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3834/7435] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:20:51 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:52.497606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:52.500046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:52.506368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:52.506871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:52.507323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:52.508201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:52.508588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:52.509029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:52.543095 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d6257ae6-8abd-488a-a6e0-c7de250578f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050677 Sep 08 11:20:52.543792 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3602/7436] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:20:52 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:53.556093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:53.558810 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:53.565981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:53.566469 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:53.566905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:53.567778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:53.568236 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:53.568665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:53.601390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-18caa141-0a0c-49c1-bd04-4651f9cb1a7a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049223 Sep 08 11:20:53.601964 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3835/7437] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:20:53 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:54.614346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:54.616590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:54.623651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.624150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.624601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.625312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:54.625778 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:54.626218 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:54.657081 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-54fe8b79-a4d8-489f-a6aa-0b4c20b4e279 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Sep 08 11:20:54.657654 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3603/7438] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:20:54 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:55.669710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:55.672118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:55.679154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:55.679757 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:55.680197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:55.680909 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:55.681365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:55.681795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:55.714034 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3147d50-a117-4644-86ce-c891fd8ef7ad tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048241 Sep 08 11:20:55.714617 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3836/7439] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:20:55 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:20:56.726997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:56.729229 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:56.736570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:56.737072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:56.737533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:56.738505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:56.738988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:56.739434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:56.768765 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16b64e16-a2e1-4285-a1f7-7f914d64e1c2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046072 Sep 08 11:20:56.769340 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3604/7440] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:20:56 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:20:56.779916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:20:56.780454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:20:56.787070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:56.787578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:56.788017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:56.788693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:20:56.789172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:20:56.789595 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:20:56.864905 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] HTTP exception thrown: Instance 4e370302-836d-49a1-b67d-a0b147c657ab is not attached to volume 3c0bf062-3fa9-41f7-9dd5-6461f314392f Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Request method failure captured: Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments/3c0bf062-3fa9-41f7-9dd5-6461f314392f HTTP/1.1 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc8wtSZc1gpw-XrXlk5o1Ql1oYOwf_b8-aXi3UpUXZg3jmYretQ9SdZgIO4M9ptOlVprGWDB1pP05e24L1Y4CB1WaBTrgkuhYhFRx7_ktZuC1ZrSfNd11tU2vcn-h7GNWTX2j4VFM1zGenAUNroI05_6YDBeF1DGRi6TxpMg05zyGTk Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_076737c518a24e2aacff14cb7467cb85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7c4a1066fff149bf8df2d9e75e481a0c Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 4e370302-836d-49a1-b67d-a0b147c657ab is not attached to volume 3c0bf062-3fa9-41f7-9dd5-6461f314392f Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': '4e370302-836d-49a1-b67d-a0b147c657ab', 'id': '3c0bf062-3fa9-41f7-9dd5-6461f314392f'} Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3c0bf062-3fa9-41f7-9dd5-6461f314392f. Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e370302-836d-49a1-b67d-a0b147c657ab is not attached to volume 3c0bf062-3fa9-41f7-9dd5-6461f314392f Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:20:56.866527 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e370302-836d-49a1-b67d-a0b147c657ab is not attached to volume 3c0bf062-3fa9-41f7-9dd5-6461f314392f Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Returning 404 to user: Instance 4e370302-836d-49a1-b67d-a0b147c657ab is not attached to volume 3c0bf062-3fa9-41f7-9dd5-6461f314392f {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-70fd51d8-d8d7-4a3c-a130-b5819d3c005a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments/3c0bf062-3fa9-41f7-9dd5-6461f314392f" status: 404 len: 154 microversion: 2.1 time: 0.092188 Sep 08 11:20:56.871753 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3837/7441] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:20:56 2022] DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab/os-volume_attachments/3c0bf062-3fa9-41f7-9dd5-6461f314392f => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:21:00.121679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:00.122243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:00.129134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:00.129624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:00.130064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:00.130762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:00.131225 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:00.131685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:00.156775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:21:00.243380 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e60920e3-10c0-4cb1-bc1e-e13352066dd7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 204 len: 0 microversion: 2.1 time: 0.125362 Sep 08 11:21:00.244075 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3605/7442] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:21:00 2022] DELETE /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:21:00.254143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:00.254902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:00.265552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:00.266317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:00.267006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:00.267956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:00.268605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:00.269080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:00.406150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:00.414126 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc491564-2289-44e9-8708-8d51d52e3b51 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1552 microversion: 2.1 time: 0.164965 Sep 08 11:21:00.414700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3838/7443] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:00 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:21:01.437830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:01.438539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:01.445406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:01.446154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:01.446603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:01.447304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:01.447801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:01.448233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:01.579633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:01.587426 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-12ffcdc8-1a76-4a3f-9c57-3c2b4b580a39 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1552 microversion: 2.1 time: 0.153915 Sep 08 11:21:01.588033 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3606/7444] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:01 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:02.306395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-1f177cab-8926-48b3-9afc-51d56a72139a req-aa1175e4-aeb6-497b-bc5a-9cb31f049f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e370302-836d-49a1-b67d-a0b147c657ab", "name": "network-vif-deleted", "tag": "10aa440a-56e3-4e25-8dd8-0a57715691fc"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:02.317687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1f177cab-8926-48b3-9afc-51d56a72139a req-aa1175e4-aeb6-497b-bc5a-9cb31f049f07 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:02.318174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1f177cab-8926-48b3-9afc-51d56a72139a req-aa1175e4-aeb6-497b-bc5a-9cb31f049f07 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:02.318613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-1f177cab-8926-48b3-9afc-51d56a72139a req-aa1175e4-aeb6-497b-bc5a-9cb31f049f07 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:02.331066 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-1f177cab-8926-48b3-9afc-51d56a72139a req-aa1175e4-aeb6-497b-bc5a-9cb31f049f07 service nova] Creating event network-vif-deleted:10aa440a-56e3-4e25-8dd8-0a57715691fc for instance 4e370302-836d-49a1-b67d-a0b147c657ab on n-h1-833090-19 Sep 08 11:21:02.336106 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-1f177cab-8926-48b3-9afc-51d56a72139a req-aa1175e4-aeb6-497b-bc5a-9cb31f049f07 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Sep 08 11:21:02.336727 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3839/7445] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:21:02.610408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:02.611049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:02.618339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:02.618845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:02.619307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:02.620062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:02.621037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:02.621486 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:02.654861 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:02.655365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:02.655923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:02.656397 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lazy-loading 'fault' on Instance uuid 4e370302-836d-49a1-b67d-a0b147c657ab {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:21:02.706483 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:02.716949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68c28b2b-7529-43a3-8851-ab54684a51e8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 200 len: 1346 microversion: 2.1 time: 0.109647 Sep 08 11:21:02.717740 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3607/7446] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:02 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:21:03.743058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:03.743795 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: 4e370302-836d-49a1-b67d-a0b147c657ab] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:03.750626 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:03.751107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:03.751576 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:03.752263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:03.752741 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:03.753169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:03.766306 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] HTTP exception thrown: Instance 4e370302-836d-49a1-b67d-a0b147c657ab could not be found. Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Request method failure captured: Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab HTTP/1.1 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc8wtSZc1gpw-XrXlk5o1Ql1oYOwf_b8-aXi3UpUXZg3jmYretQ9SdZgIO4M9ptOlVprGWDB1pP05e24L1Y4CB1WaBTrgkuhYhFRx7_ktZuC1ZrSfNd11tU2vcn-h7GNWTX2j4VFM1zGenAUNroI05_6YDBeF1DGRi6TxpMg05zyGTk Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_076737c518a24e2aacff14cb7467cb85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7c4a1066fff149bf8df2d9e75e481a0c Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 4e370302-836d-49a1-b67d-a0b147c657ab could not be found. Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '4e370302-836d-49a1-b67d-a0b147c657ab'} Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e370302-836d-49a1-b67d-a0b147c657ab could not be found. Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e370302-836d-49a1-b67d-a0b147c657ab could not be found. Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:21:03.767973 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e370302-836d-49a1-b67d-a0b147c657ab could not be found. Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Returning 404 to user: Instance 4e370302-836d-49a1-b67d-a0b147c657ab could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9172f4f4-1bc1-4ef8-bfb8-1b38374f7ace tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab" status: 404 len: 111 microversion: 2.1 time: 0.031394 Sep 08 11:21:03.773058 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3840/7447] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:03 2022] GET /compute/v2.1/servers/4e370302-836d-49a1-b67d-a0b147c657ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:21:03.778211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f5deaf20-8f2d-4e20-8610-4a83f00b013d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '.version_select at 0x7f235003d280>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:03.802565 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f5deaf20-8f2d-4e20-8610-4a83f00b013d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-26779079" status: 202 len: 0 microversion: 2.1 time: 0.028131 Sep 08 11:21:03.803156 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3608/7448] 10.222.0.59 () {58 vars in 1266 bytes} [Thu Sep 8 11:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-26779079 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:21:13.037155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c29e9638-3133-4bb5-ba7e-aa3b1c4118e0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'create', calling method: .version_select at 0x7f234ba528b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-886082169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEELGQhSOmNHEflJ5/Mo+8xAg7PDARgwNr665QejP9c7l1DmAHQ61w8CzmPcirEKL+NmhVNlcmOR6TbcX30AElttUggw1b0Gq1QkDDQxgcdYIsHvhZ8UwNIgzKZZN2e4KQ=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:13.055773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c29e9638-3133-4bb5-ba7e-aa3b1c4118e0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for project 076737c518a24e2aacff14cb7467cb85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:21:13.061399 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-c29e9638-3133-4bb5-ba7e-aa3b1c4118e0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for user 7c4a1066fff149bf8df2d9e75e481a0c and project 076737c518a24e2aacff14cb7467cb85. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:21:13.089856 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c29e9638-3133-4bb5-ba7e-aa3b1c4118e0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056667 Sep 08 11:21:13.090978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3841/7449] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:21:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:21:13.142141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:13.146570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-309853242", "imageRef": "cc3ae667-05f8-430b-b5ca-67b5c3c1dfc1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-886082169", "networks": [{"uuid": "482e7ff3-46a5-430f-9fc6-aa9a48e392df"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:13.199662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] validate_networks() for [('482e7ff3-46a5-430f-9fc6-aa9a48e392df', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:21:13.623240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:21:13.623769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:21:13.624278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:21:13.624697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:21:13.625121 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:21:13.633834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:13.634325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:13.634766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:13.635520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:13.635985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:13.636418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:13.654701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for project 076737c518a24e2aacff14cb7467cb85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:21:13.660526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Getting quotas for user 7c4a1066fff149bf8df2d9e75e481a0c and project 076737c518a24e2aacff14cb7467cb85. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:21:13.673507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:21:13.675786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cc3ae667-05f8-430b-b5ca-67b5c3c1dfc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:21:13.723641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11f5aa27-051c-4e23-af17-e2ca170276d0 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583751 Sep 08 11:21:13.724297 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3609/7450] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:21:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:21:13.736107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7421146e-c433-40f5-9514-4f5f3f13d0ee tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:13.736850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7421146e-c433-40f5-9514-4f5f3f13d0ee tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:13.759334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=40 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:13.792624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7421146e-c433-40f5-9514-4f5f3f13d0ee tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:13.800269 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7421146e-c433-40f5-9514-4f5f3f13d0ee tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1257 microversion: 2.1 time: 0.068156 Sep 08 11:21:13.800847 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3842/7451] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:13 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:14.823485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ddbdf56-71c4-4206-9509-e16fa13aba3e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:14.824126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ddbdf56-71c4-4206-9509-e16fa13aba3e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:14.885937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ddbdf56-71c4-4206-9509-e16fa13aba3e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:14.892912 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ddbdf56-71c4-4206-9509-e16fa13aba3e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1257 microversion: 2.1 time: 0.074605 Sep 08 11:21:14.893574 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3610/7452] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:14 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:15.915764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-719a6d7f-3a1b-4dd9-a46b-683970eb37cd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:15.916382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-719a6d7f-3a1b-4dd9-a46b-683970eb37cd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:15.920164 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:21:15.920305 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 (ip 10.222.0.59) !!! Sep 08 11:21:15.976196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-719a6d7f-3a1b-4dd9-a46b-683970eb37cd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:15.983559 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-719a6d7f-3a1b-4dd9-a46b-683970eb37cd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1257 microversion: 2.1 time: 0.071851 Sep 08 11:21:15.984455 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3843/7453] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:15 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:17.006358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-16c06817-bcaf-4982-b222-c0e7b61689f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:17.006976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-16c06817-bcaf-4982-b222-c0e7b61689f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:17.062212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-16c06817-bcaf-4982-b222-c0e7b61689f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:17.070104 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-16c06817-bcaf-4982-b222-c0e7b61689f7 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1257 microversion: 2.1 time: 0.067681 Sep 08 11:21:17.070674 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3611/7454] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:17 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:18.094261 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:18.094952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:18.101932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:18.102418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:18.102854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:18.103570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:18.104023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:18.104477 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:18.165760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:18.174297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7e0b9576-36c4-4997-ad22-a9c794de864d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1261 microversion: 2.1 time: 0.084470 Sep 08 11:21:18.174879 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3844/7455] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:18 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:19.197190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:19.197920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:19.205289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:19.205895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:19.206245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:19.206944 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:19.207553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:19.208050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:19.281456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:19.293515 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c162cb4-2ccc-4818-a5dd-249af384d030 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1315 microversion: 2.1 time: 0.100356 Sep 08 11:21:19.295265 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3612/7456] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:19 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1315 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:20.322022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:20.322688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:20.325409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:20.331845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:20.332490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:20.333032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:20.333848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:20.334401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:20.335048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:20.540087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:20.550491 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-46a7b6e1-0419-4e55-b95a-6eb4965c7f81 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.233165 Sep 08 11:21:20.566540 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3845/7457] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:20 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:21.574639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:21.575580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:21.579079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:21.588064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:21.589029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:21.590948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:21.592379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:21.592871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:21.593320 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:21.768753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:21.776993 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-693a28d2-a3b5-445a-8d5c-7e60766cac33 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.206593 Sep 08 11:21:21.777586 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3613/7458] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:21 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:22.801156 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:22.802876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:22.809965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:22.810969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:22.811401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:22.812138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:22.812760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:22.813985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:22.980503 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:22.990185 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-15e6c66b-92cd-476a-8edb-dc3436e655e3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.192932 Sep 08 11:21:22.990780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3846/7459] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:22 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:24.015753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:24.017085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:24.020030 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:24.026628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:24.027143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:24.027637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:24.028392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:24.029076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:24.029522 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:24.181087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:24.189616 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4e7f2cdf-939f-48c0-98ca-1c726ef30c77 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.178936 Sep 08 11:21:24.190392 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3614/7460] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:24 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:25.213997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:25.214683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:25.223374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:25.223374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:25.224010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:25.224796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:25.225323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:25.225874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:25.380459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:25.390093 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-077470a6-c094-46e1-b579-19f343d46152 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.179876 Sep 08 11:21:25.390796 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3847/7461] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:25 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:26.414202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:26.414791 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:26.422693 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:26.423203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:26.423687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:26.424419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:26.424891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:26.425338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:26.567114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:26.575725 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d166fe04-d126-428a-9159-0841cd75b16e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.165474 Sep 08 11:21:26.576891 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3615/7462] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:26 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:27.599518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:27.600131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:27.602034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=8 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:27.608510 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:27.608991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:27.609432 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:27.610125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:27.610580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:27.611008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:27.747352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:27.755825 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-042ccdcf-58c1-434a-a0da-005b76ee80ff tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.160196 Sep 08 11:21:27.756407 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3848/7463] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:27 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:28.779919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:28.780479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:28.782362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=10 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:28.788534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:28.789043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:28.789499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:28.790216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:28.790689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:28.791134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:28.920122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:28.927826 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4999ef4e-568a-409b-a3d0-2304af73336d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.152487 Sep 08 11:21:28.928398 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3616/7464] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:28 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:29.950589 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:29.951286 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:29.958225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:29.958710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:29.959147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:29.959857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:29.960314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:29.960831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:30.106623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:30.114981 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d98524bc-ed22-45f0-952b-b61114437d9a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.168602 Sep 08 11:21:30.115570 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3849/7465] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:29 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:30.851080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ed3802e6-0bda-4885-8b72-643b81f32794 req-dde65ae2-f926-4b8b-82e8-f31da2f9fb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:30.863427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ed3802e6-0bda-4885-8b72-643b81f32794 req-dde65ae2-f926-4b8b-82e8-f31da2f9fb1d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:30.864194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ed3802e6-0bda-4885-8b72-643b81f32794 req-dde65ae2-f926-4b8b-82e8-f31da2f9fb1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:30.864715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ed3802e6-0bda-4885-8b72-643b81f32794 req-dde65ae2-f926-4b8b-82e8-f31da2f9fb1d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:30.884285 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ed3802e6-0bda-4885-8b72-643b81f32794 req-dde65ae2-f926-4b8b-82e8-f31da2f9fb1d service nova] Creating event network-changed:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:21:30.889908 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ed3802e6-0bda-4885-8b72-643b81f32794 req-dde65ae2-f926-4b8b-82e8-f31da2f9fb1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042372 Sep 08 11:21:30.891696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3617/7466] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:21:31.139374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:31.140245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:31.147243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:31.147772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:31.148240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:31.148936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:31.149426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:31.149857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:31.363832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:31.371560 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8acafafb-c010-4e7c-be60-851c3df3532e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.236817 Sep 08 11:21:31.372157 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3850/7467] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:31 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:32.397392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:32.398019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:32.404473 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:32.404999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:32.405443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:32.406144 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:32.406605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:32.407038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:32.568576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:32.576731 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-56a56100-132c-408d-81dc-148e226dd5dd tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.184949 Sep 08 11:21:32.577326 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3618/7468] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:32 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:33.600837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:33.601456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:33.609083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:33.609702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:33.610145 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:33.610855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:33.611316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:33.611769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:33.814018 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:33.821905 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64ff8a96-55b4-4e5d-afbe-a26f641167fa tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.225121 Sep 08 11:21:33.822597 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3851/7469] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:33 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:34.845793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:34.846491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:34.853514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:34.854019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:34.854476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:34.855286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:34.855802 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:34.856252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:34.991082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:34.999582 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac63240d-af17-4ed6-9a80-214485d6a58d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.157790 Sep 08 11:21:35.000170 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3619/7470] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:34 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:36.023992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:36.024653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:36.033659 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:36.034161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:36.034604 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:36.035314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:36.035800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:36.036232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:36.185335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:36.194629 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b7e8e5b7-8474-428d-9372-6a94d39e778f tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.174898 Sep 08 11:21:36.195162 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3852/7471] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:36 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:36.228692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-497df86c-b0d8-4fa1-a079-94930bd86943 req-2e168fb5-7b24-42ab-bdce-fb96b52d6e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "name": "network-vif-plugged", "status": "completed", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:36.241267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-497df86c-b0d8-4fa1-a079-94930bd86943 req-2e168fb5-7b24-42ab-bdce-fb96b52d6e0f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:36.241765 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-497df86c-b0d8-4fa1-a079-94930bd86943 req-2e168fb5-7b24-42ab-bdce-fb96b52d6e0f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:36.242214 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-497df86c-b0d8-4fa1-a079-94930bd86943 req-2e168fb5-7b24-42ab-bdce-fb96b52d6e0f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:36.254062 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-497df86c-b0d8-4fa1-a079-94930bd86943 req-2e168fb5-7b24-42ab-bdce-fb96b52d6e0f service nova] Creating event network-vif-plugged:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:21:36.258950 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-497df86c-b0d8-4fa1-a079-94930bd86943 req-2e168fb5-7b24-42ab-bdce-fb96b52d6e0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121112 Sep 08 11:21:36.259581 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3620/7472] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:21:37.218438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:37.219043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:37.225831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:37.226311 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:37.226745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:37.227425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:37.227908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:37.228331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:37.368296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:37.376079 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b73e8e4f-6d5b-46f9-a395-d8d680f6d65a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1357 microversion: 2.1 time: 0.162154 Sep 08 11:21:37.376657 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3853/7473] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:37 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:38.400372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:38.401094 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:38.407314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.407844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.408298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.408998 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.409465 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.409903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.538962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:38.547222 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b41b8c5-5151-4118-af28-7b043c7b1a0a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1547 microversion: 2.1 time: 0.152035 Sep 08 11:21:38.547827 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3621/7474] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:38 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:38.569960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:38.570587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:38.577708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.578192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.578628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.579318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.579797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.580226 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.713620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:38.721988 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0194aa8e-5857-4edb-b701-3a61f1e8d8f5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1547 microversion: 2.1 time: 0.155880 Sep 08 11:21:38.722583 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3854/7475] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:38 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:38.744709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:38.749527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:38.750302 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Searching by: {'deleted': False, 'project_id': '076737c518a24e2aacff14cb7467cb85'} {{(pid=122456) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 11:21:38.755723 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.756215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.756665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.757398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.757884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.758359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.782714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.multi_cell_list [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122456) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 11:21:38.810641 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0429846a-b900-4ebb-9c3c-8e8d88eccef1 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069701 Sep 08 11:21:38.811237 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3622/7476] 10.222.0.59 () {58 vars in 1125 bytes} [Thu Sep 8 11:21:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:21:38.823246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:38.823876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:38.830418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.830894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.831324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.832038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:38.832482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:38.832900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:38.960968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:38.969186 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-64fd14f4-bf7d-4146-adfa-9a57a3b84e9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1547 microversion: 2.1 time: 0.150074 Sep 08 11:21:38.969760 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3855/7477] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:38 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:40.499410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d608b55d-1382-4c5d-9787-dfc067f09f90"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:40.501866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:40.508999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.509505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.509966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.510686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:40.511156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:40.511667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:40.882500 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6faafc7b-730b-481c-94cf-937a7835a74d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387060 Sep 08 11:21:40.883064 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3623/7478] 10.222.0.59 () {60 vars in 1323 bytes} [Thu Sep 8 11:21:40 2022] POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:21:51.664071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:51.664688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:51.667074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=21 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:51.667759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=72 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:51.674759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:51.675257 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:51.675804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:51.676504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:51.676960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:51.677393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:51.891185 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:51.899486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44c24870-0080-441d-b550-d505c2544d6a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1593 microversion: 2.1 time: 0.239319 Sep 08 11:21:51.900078 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3856/7479] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:51 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1593 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:53.805681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-43bee138-37eb-4abb-b2c4-c232b266dcea req-32557a5b-d302-4a6f-9293-59a59ee19158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:53.815623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:53.816771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=21 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:53.817551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:21:53.820336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43bee138-37eb-4abb-b2c4-c232b266dcea req-32557a5b-d302-4a6f-9293-59a59ee19158 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:53.821100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43bee138-37eb-4abb-b2c4-c232b266dcea req-32557a5b-d302-4a6f-9293-59a59ee19158 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:53.821767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-43bee138-37eb-4abb-b2c4-c232b266dcea req-32557a5b-d302-4a6f-9293-59a59ee19158 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:53.837327 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-43bee138-37eb-4abb-b2c4-c232b266dcea req-32557a5b-d302-4a6f-9293-59a59ee19158 service nova] Creating event network-changed:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:21:53.843086 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-43bee138-37eb-4abb-b2c4-c232b266dcea req-32557a5b-d302-4a6f-9293-59a59ee19158 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041807 Sep 08 11:21:53.844062 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3624/7480] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:21:54.937653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1000487035"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:54.938187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:54.946426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:54.946917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:54.947353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:54.948076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:54.948519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:54.948947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:55.083617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.network.security_group_api [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Adding security group ff2a2a8f-9fea-42f2-8b12-5cb0cb6f1df2 to port 8dd2c9ca-47d8-4113-9867-f34770125f90 Sep 08 11:21:55.412241 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6468e29f-abae-4cca-81c6-e5501a869ad3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/action" status: 202 len: 0 microversion: 2.1 time: 0.478550 Sep 08 11:21:55.413002 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3857/7481] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:21:54 2022] POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:21:55.423243 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:21:55.424752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:21:55.431244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:55.431767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:55.432241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:55.432973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:55.433429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:55.433880 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:55.598388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:21:55.607097 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-15e73acf-ef5b-4c82-9eb0-6cd8a2d07dc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1759 microversion: 2.1 time: 0.189226 Sep 08 11:21:55.607924 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3625/7482] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:21:55 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1759 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:21:55.860050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-9496a84a-a109-4f62-8b4d-c315ee7a3a61 req-5c5fe0e9-6e3e-41ae-a3cd-1ba57d6622dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:21:55.870078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9496a84a-a109-4f62-8b4d-c315ee7a3a61 req-5c5fe0e9-6e3e-41ae-a3cd-1ba57d6622dc service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:21:55.870661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9496a84a-a109-4f62-8b4d-c315ee7a3a61 req-5c5fe0e9-6e3e-41ae-a3cd-1ba57d6622dc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:21:55.871718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-9496a84a-a109-4f62-8b4d-c315ee7a3a61 req-5c5fe0e9-6e3e-41ae-a3cd-1ba57d6622dc service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:21:55.884074 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-9496a84a-a109-4f62-8b4d-c315ee7a3a61 req-5c5fe0e9-6e3e-41ae-a3cd-1ba57d6622dc service nova] Creating event network-changed:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:21:55.889565 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-9496a84a-a109-4f62-8b4d-c315ee7a3a61 req-5c5fe0e9-6e3e-41ae-a3cd-1ba57d6622dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Sep 08 11:21:55.890864 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3858/7483] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:22:53.041540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:53.042312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=8 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:53.116603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:22:53.118938 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:53.125628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:53.126131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:53.126588 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:53.127298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:53.127810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:53.128257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:53.201698 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68818215-34c9-4ef0-9ddc-bfcbf492852a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/action" status: 202 len: 0 microversion: 2.1 time: 0.161078 Sep 08 11:22:53.202362 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3626/7484] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:22:53 2022] POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:22:53.212400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:53.213094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:53.216047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:53.216688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:22:53.223160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:53.223774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:53.224273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:53.225345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:53.225800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:53.226223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:53.470384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:53.479100 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b46f2fa8-8451-459f-bc42-5e280e88d7e2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1751 microversion: 2.1 time: 0.270852 Sep 08 11:22:53.479850 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3859/7485] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:53 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1751 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:54.510048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:54.511339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:54.521274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:54.521779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:54.522240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:54.523084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:54.523596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:54.524075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:54.670037 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:54.678427 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c24d5fb6-3036-4fa4-9831-3358aefed2ba tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.177024 Sep 08 11:22:54.679003 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3627/7486] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:54 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:22:55.702306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:55.703192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:55.710056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:55.710537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:55.710971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:55.711689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:55.712142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:55.712565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:55.857752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:55.866005 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb04d6a2-cb85-46d3-9058-bd4bdac84365 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.168128 Sep 08 11:22:55.866579 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3860/7487] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:55 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:56.889312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:56.889841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:56.896819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:56.897314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:56.897762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:56.898462 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:56.898922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:56.899354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:57.053472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:57.061947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68e5921a-b273-47af-8eb0-15d082f1a114 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.176627 Sep 08 11:22:57.063257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3628/7488] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:56 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:58.086903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:58.087542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:58.095277 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:58.095796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:58.096243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:58.096936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:58.097392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:58.097821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:58.243166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:58.252151 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1874869c-6c8d-49b7-82b1-ea9da5e74743 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.169404 Sep 08 11:22:58.252738 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3861/7489] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:58 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:22:59.275530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:22:59.276185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:22:59.282961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:59.283475 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:59.283939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:59.284643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:22:59.285108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:22:59.285542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:22:59.440444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:22:59.448788 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ab2f134a-debd-431d-9201-0e3ad3a6ec90 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.177298 Sep 08 11:22:59.449364 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3629/7490] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:22:59 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:00.472243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:00.472885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:00.479962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:00.480575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:00.480935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:00.481665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:00.482125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:00.482556 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:00.623084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:00.631608 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-982991fa-8ae9-42f7-95f3-3dbee7a76416 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.163252 Sep 08 11:23:00.632189 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3862/7491] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:00 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:01.655800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:01.656416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:01.663083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:01.663605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:01.664054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:01.664743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:01.665211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:01.665642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:01.820419 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:01.829806 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a182a64-e12f-42b9-b221-d4f32e0097c9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.178418 Sep 08 11:23:01.830430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3630/7492] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:01 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:02.853985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:02.854624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:02.862191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:02.862681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:02.863119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:02.863839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:02.864296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:02.864724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:03.016385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:03.024724 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b3f4dd31-b331-400f-99fe-e985edb7a7af tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.174866 Sep 08 11:23:03.025292 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3863/7493] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:02 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:04.048838 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:04.049579 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:04.056543 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:04.057035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:04.057482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:04.058181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:04.058714 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:04.059118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:04.206926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:04.215967 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-56b3057e-e1db-42a8-9aca-ab168cc0d3a2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1756 microversion: 2.1 time: 0.171122 Sep 08 11:23:04.216545 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3631/7494] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:04 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:23:05.239627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:23:05.240259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:23:05.247166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:05.247674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:05.248105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:05.248783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:23:05.249230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:23:05.249657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:23:05.400092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:23:05.408902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-50c60af4-5bf4-4737-b599-7bd68b65b55d tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1759 microversion: 2.1 time: 0.173206 Sep 08 11:23:05.409477 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3864/7495] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:23:05 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:08.742402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:08.743179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:08.747515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1000487035"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:08.748109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:08.755732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:08.756241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:08.756696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:08.757404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:08.757875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:08.758318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:08.895237 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.network.security_group_api [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Removing security group ff2a2a8f-9fea-42f2-8b12-5cb0cb6f1df2 from port 8dd2c9ca-47d8-4113-9867-f34770125f90 Sep 08 11:24:09.239694 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c94c2b3-bb62-4f63-ae9c-76cc021fe275 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/action" status: 202 len: 0 microversion: 2.1 time: 0.498705 Sep 08 11:24:09.240322 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3632/7496] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:24:08 2022] POST /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:09.245856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:09.246603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:09.250624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ccbbbe8f-fc73-4963-b673-55dda10e6568 req-fd5734fa-2014-4015-817c-1e162a1cf83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:09.277163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ccbbbe8f-fc73-4963-b673-55dda10e6568 req-fd5734fa-2014-4015-817c-1e162a1cf83c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:09.277658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ccbbbe8f-fc73-4963-b673-55dda10e6568 req-fd5734fa-2014-4015-817c-1e162a1cf83c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:09.278088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ccbbbe8f-fc73-4963-b673-55dda10e6568 req-fd5734fa-2014-4015-817c-1e162a1cf83c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:09.299673 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ccbbbe8f-fc73-4963-b673-55dda10e6568 req-fd5734fa-2014-4015-817c-1e162a1cf83c service nova] Creating event network-changed:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:24:09.311373 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ccbbbe8f-fc73-4963-b673-55dda10e6568 req-fd5734fa-2014-4015-817c-1e162a1cf83c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067186 Sep 08 11:24:09.320175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3865/7497] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:24:10.334031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:10.334548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:10.341878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:10.342380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:10.342834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:10.343611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:10.344077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:10.344515 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:10.395020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-4cdf146a-7a83-4166-a6fa-0be56e900b35 req-5f975e07-6d1e-418d-9c6d-f969593debda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:10.405513 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4cdf146a-7a83-4166-a6fa-0be56e900b35 req-5f975e07-6d1e-418d-9c6d-f969593debda service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:10.405695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4cdf146a-7a83-4166-a6fa-0be56e900b35 req-5f975e07-6d1e-418d-9c6d-f969593debda service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:10.406335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-4cdf146a-7a83-4166-a6fa-0be56e900b35 req-5f975e07-6d1e-418d-9c6d-f969593debda service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:10.419169 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-4cdf146a-7a83-4166-a6fa-0be56e900b35 req-5f975e07-6d1e-418d-9c6d-f969593debda service nova] Creating event network-changed:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:24:10.424733 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-4cdf146a-7a83-4166-a6fa-0be56e900b35 req-5f975e07-6d1e-418d-9c6d-f969593debda service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105669 Sep 08 11:24:10.425898 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3866/7498] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:10.439099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lazy-loading 'services' on Instance uuid df710a2e-1f75-4c51-bf81-d9e499dc40e8 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:24:10.522336 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8242ea59-9a07-4a9f-b998-9e2ef73647b3 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments/d608b55d-1382-4c5d-9787-dfc067f09f90" status: 202 len: 0 microversion: 2.1 time: 0.205877 Sep 08 11:24:10.524318 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3633/7499] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:24:10 2022] DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments/d608b55d-1382-4c5d-9787-dfc067f09f90 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:10.532890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:10.535308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:10.545330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:10.546072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:10.546509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:10.548785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:10.549280 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:10.549697 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:10.585871 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-72b3e4b1-5773-4135-b2b4-5a0d3cd80fc2 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057307 Sep 08 11:24:10.591716 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3867/7500] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:24:10 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:11.604440 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:11.606796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:11.613217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:11.613721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:11.614177 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:11.614893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:11.615367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:11.615848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:11.647043 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-45619345-12a9-48fc-be4a-2ed7734bcd01 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047949 Sep 08 11:24:11.647662 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3634/7501] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:24:11 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:12.659740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:12.662645 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:12.669736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:12.670256 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:12.670688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:12.671416 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:12.671886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:12.672306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:12.708370 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5b7cd2bd-0705-406d-b874-2cc493241db8 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052021 Sep 08 11:24:12.708933 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3868/7502] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:24:12 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:13.720965 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:13.723201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:13.730760 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:13.731251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:13.731735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:13.732443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:13.732904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:13.733337 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:13.766283 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8c3c5bbf-5072-4d0b-bcfd-e7362561a41b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049141 Sep 08 11:24:13.766752 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3635/7503] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:24:13 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:14.779799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:14.781982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:14.788957 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:14.789440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:14.789882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:14.790597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:14.791037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:14.791486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:15.099139 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5932a794-a55b-4560-9ce9-74b19ae65b9e tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.322472 Sep 08 11:24:15.099797 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3869/7504] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:24:14 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:16.112511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:16.115353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:16.121820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.122310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.122753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:16.123452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.123937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.124370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:16.152430 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1e50cbc9-5287-406b-ad5d-7a60acf464e5 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044090 Sep 08 11:24:16.152993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3636/7505] 10.222.0.59 () {58 vars in 1302 bytes} [Thu Sep 8 11:24:16 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 11:24:16.164219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:16.164743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:16.171667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.172158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.172601 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:16.173483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:16.173971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:16.174407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:16.250603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] HTTP exception thrown: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 is not attached to volume d608b55d-1382-4c5d-9787-dfc067f09f90 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Request method failure captured: Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: request: DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments/d608b55d-1382-4c5d-9787-dfc067f09f90 HTTP/1.1 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc8wtSZc1gpw-XrXlk5o1Ql1oYOwf_b8-aXi3UpUXZg3jmYretQ9SdZgIO4M9ptOlVprGWDB1pP05e24L1Y4CB1WaBTrgkuhYhFRx7_ktZuC1ZrSfNd11tU2vcn-h7GNWTX2j4VFM1zGenAUNroI05_6YDBeF1DGRi6TxpMg05zyGTk Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_076737c518a24e2aacff14cb7467cb85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7c4a1066fff149bf8df2d9e75e481a0c Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 is not attached to volume d608b55d-1382-4c5d-9787-dfc067f09f90 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'server_id': 'df710a2e-1f75-4c51-bf81-d9e499dc40e8', 'id': 'd608b55d-1382-4c5d-9787-dfc067f09f90'} Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d608b55d-1382-4c5d-9787-dfc067f09f90. Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 is not attached to volume d608b55d-1382-4c5d-9787-dfc067f09f90 Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:16.252254 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 is not attached to volume d608b55d-1382-4c5d-9787-dfc067f09f90 Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Returning 404 to user: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 is not attached to volume d608b55d-1382-4c5d-9787-dfc067f09f90 {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c88c7724-7b43-46ca-9b32-453a8a4ca810 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments/d608b55d-1382-4c5d-9787-dfc067f09f90" status: 404 len: 154 microversion: 2.1 time: 0.094020 Sep 08 11:24:16.256982 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3870/7506] 10.222.0.59 () {58 vars in 1416 bytes} [Thu Sep 8 11:24:16 2022] DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8/os-volume_attachments/d608b55d-1382-4c5d-9787-dfc067f09f90 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:24:19.509732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:19.510295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:19.517377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.517882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.518338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.519047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.519558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.520005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.549789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:24:19.632341 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d2558efa-1e4f-43f1-ad4b-23aac390c78a tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 204 len: 0 microversion: 2.1 time: 0.125868 Sep 08 11:24:19.632978 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3637/7507] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:24:19 2022] DELETE /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:24:19.641578 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:19.642198 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:19.649465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.649954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.650424 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.651124 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:19.651617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:19.652049 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:19.790971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:19.799739 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07dd8898-0117-48b4-b5b9-749c07f73ec9 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1553 microversion: 2.1 time: 0.162138 Sep 08 11:24:19.800306 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3871/7508] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:19 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:20.824625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:20.825642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:20.833554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:20.834093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:20.834549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:20.835289 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:20.835795 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:20.836242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:20.978528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:20.986700 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4bfa9a63-ca91-426b-9563-858dfe4d1167 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1553 microversion: 2.1 time: 0.166634 Sep 08 11:24:20.987293 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3638/7509] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:20 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:22.008559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-e1299462-4ab6-4f76-a2ba-38488ca2b1ae req-5c247df6-0a07-4612-9d53-fd0693a70f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df710a2e-1f75-4c51-bf81-d9e499dc40e8", "name": "network-vif-deleted", "tag": "8dd2c9ca-47d8-4113-9867-f34770125f90"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:22.012266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:22.013401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:22.020126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:22.020526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e1299462-4ab6-4f76-a2ba-38488ca2b1ae req-5c247df6-0a07-4612-9d53-fd0693a70f52 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:22.020675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:22.021022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e1299462-4ab6-4f76-a2ba-38488ca2b1ae req-5c247df6-0a07-4612-9d53-fd0693a70f52 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:22.021167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.021745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-e1299462-4ab6-4f76-a2ba-38488ca2b1ae req-5c247df6-0a07-4612-9d53-fd0693a70f52 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.021901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:22.022294 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:22.022739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:22.039754 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-e1299462-4ab6-4f76-a2ba-38488ca2b1ae req-5c247df6-0a07-4612-9d53-fd0693a70f52 service nova] Creating event network-vif-deleted:8dd2c9ca-47d8-4113-9867-f34770125f90 for instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 on n-h2-833090-19 Sep 08 11:24:22.044992 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-e1299462-4ab6-4f76-a2ba-38488ca2b1ae req-5c247df6-0a07-4612-9d53-fd0693a70f52 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041648 Sep 08 11:24:22.045732 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3872/7510] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:22.096176 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4a1066fff149bf8df2d9e75e481a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076737c518a24e2aacff14cb7467cb85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:22.104982 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dc6edcde-30ce-445b-bf12-1c6df63174dc tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 200 len: 1511 microversion: 2.1 time: 0.098102 Sep 08 11:24:22.105674 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3639/7511] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:22 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:23.129636 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:23.130443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] [instance: df710a2e-1f75-4c51-bf81-d9e499dc40e8] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:23.139167 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:23.139696 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:23.140138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:23.140844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:23.141309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:23.141738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:23.156461 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] HTTP exception thrown: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 could not be found. Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Request method failure captured: Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 HTTP/1.1 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGc8wtSZc1gpw-XrXlk5o1Ql1oYOwf_b8-aXi3UpUXZg3jmYretQ9SdZgIO4M9ptOlVprGWDB1pP05e24L1Y4CB1WaBTrgkuhYhFRx7_ktZuC1ZrSfNd11tU2vcn-h7GNWTX2j4VFM1zGenAUNroI05_6YDBeF1DGRi6TxpMg05zyGTk Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/076737c518a24e2aacff14cb7467cb85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_076737c518a24e2aacff14cb7467cb85", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 076737c518a24e2aacff14cb7467cb85 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestMinimumBasicScenario-85215248 Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 7c4a1066fff149bf8df2d9e75e481a0c Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestMinimumBasicScenario-85215248-project Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 could not be found. Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'df710a2e-1f75-4c51-bf81-d9e499dc40e8'} Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 could not be found. Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 could not be found. Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:24:23.158126 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 could not be found. Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Returning 404 to user: Instance df710a2e-1f75-4c51-bf81-d9e499dc40e8 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8a44f9c6-62af-49eb-9ecb-eab4bc07b53b tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8" status: 404 len: 111 microversion: 2.1 time: 0.035139 Sep 08 11:24:23.163338 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3873/7512] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:23 2022] GET /compute/v2.1/servers/df710a2e-1f75-4c51-bf81-d9e499dc40e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:24:23.168868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fb39169c-56af-4d1c-b30f-2b24b1d6ed82 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] Calling method '.version_select at 0x7f2350683430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:23.189336 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fb39169c-56af-4d1c-b30f-2b24b1d6ed82 tempest-TestMinimumBasicScenario-85215248 tempest-TestMinimumBasicScenario-85215248-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-886082169" status: 202 len: 0 microversion: 2.1 time: 0.024188 Sep 08 11:24:23.189931 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3640/7513] 10.222.0.59 () {58 vars in 1269 bytes} [Thu Sep 8 11:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-886082169 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:24:32.637803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b6809d9d-ffbb-4b34-9358-ba8916d60680 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: .version_select at 0x7f234bacd8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1024111420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf7fTdTf3F6qnh2kDj1phIIj166ScfM91KRgtroNj/hTNn93DobRSlcZfuU2+d27QogSRbGelp+oEeoJNOXc5UcDAU2edViVx0r5Is2UvQrmgEIbhmmEm8YH51YejX15g=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:32.654587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b6809d9d-ffbb-4b34-9358-ba8916d60680 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:24:32.659786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-b6809d9d-ffbb-4b34-9358-ba8916d60680 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:24:32.683076 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b6809d9d-ffbb-4b34-9358-ba8916d60680 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.210134 Sep 08 11:24:32.683723 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3874/7514] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:24:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:24:38.972894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:38.973860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:38.988347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-257853317", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "5f018b95-e801-450f-a7af-f4a60d137c03"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1024111420", "security_groups": [{"name": "tempest-secgroup-smoke-93932369"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:39.138636 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] validate_networks() for [('5f018b95-e801-450f-a7af-f4a60d137c03', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:24:39.658511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:24:39.659012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:24:39.659540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:24:39.659975 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:24:39.660411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:24:39.669928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:39.670780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:39.671327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:39.672046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:39.672551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:39.672994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:39.693878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:24:39.700293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:24:39.716174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:24:39.719221 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:24:39.775410 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-720fa6c1-4b15-4e10-aa8f-0599a1bcbce1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.804307 Sep 08 11:24:39.776637 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3641/7515] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:24:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:24:39.785811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=38 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:39.788421 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:24:39.788626 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 (ip 10.222.0.59) !!! Sep 08 11:24:39.795448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ab783698-5a9e-4511-afd6-1db0454e3b7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:39.796527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ab783698-5a9e-4511-afd6-1db0454e3b7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:39.800885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:39.870558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ab783698-5a9e-4511-afd6-1db0454e3b7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:39.877536 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ab783698-5a9e-4511-afd6-1db0454e3b7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1266 microversion: 2.1 time: 0.092802 Sep 08 11:24:39.886339 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3875/7516] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:39 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:40.907283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:40.908570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:40.917415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:40.917694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:40.918357 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:40.919085 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:40.919643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:40.920097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:40.995976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:41.005805 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-774b64d0-cf01-48a5-b9d2-cd6aebeb816e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1318 microversion: 2.1 time: 0.103585 Sep 08 11:24:41.019540 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3642/7517] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:40 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:42.030780 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:42.031655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:42.039508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:42.040016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:42.040558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:42.041296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:42.041899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:42.042425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:42.310122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:42.318522 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9b29f0ae-6f66-4793-9537-dd9d9c660c78 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.292108 Sep 08 11:24:42.319104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3876/7518] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:42 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:42.736405 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-bdf8ffbf-a7e8-404c-a6eb-6641f94275db req-eb5243ec-dd35-4601-b31e-0765d8d901b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f215f803-c20e-4c81-89d8-ef6f5027a797", "tag": "7507f293-279a-4fbf-9da5-dca67105786f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:42.752824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bdf8ffbf-a7e8-404c-a6eb-6641f94275db req-eb5243ec-dd35-4601-b31e-0765d8d901b6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:42.753598 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bdf8ffbf-a7e8-404c-a6eb-6641f94275db req-eb5243ec-dd35-4601-b31e-0765d8d901b6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:42.754060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-bdf8ffbf-a7e8-404c-a6eb-6641f94275db req-eb5243ec-dd35-4601-b31e-0765d8d901b6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:42.766977 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-bdf8ffbf-a7e8-404c-a6eb-6641f94275db req-eb5243ec-dd35-4601-b31e-0765d8d901b6 service nova] Creating event network-changed:7507f293-279a-4fbf-9da5-dca67105786f for instance f215f803-c20e-4c81-89d8-ef6f5027a797 on n-h1-833090-19 Sep 08 11:24:42.772415 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-bdf8ffbf-a7e8-404c-a6eb-6641f94275db req-eb5243ec-dd35-4601-b31e-0765d8d901b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042958 Sep 08 11:24:42.773176 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3643/7519] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:24:43.342440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:43.343046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:43.350481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:43.350966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:43.351407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:43.352133 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:43.352588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:43.353017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:43.496821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:43.504509 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-30298740-551d-4954-a925-ee9a18b92432 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.166124 Sep 08 11:24:43.505103 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3877/7520] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:43 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:44.527721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:44.528594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:44.535657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:44.536303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:44.536787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:44.537590 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:44.538198 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:44.538732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:44.768550 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:44.777124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-09311d99-d626-43ef-a6b8-e4a5aaae8022 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.254291 Sep 08 11:24:44.777728 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3644/7521] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:44 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:45.800809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:45.801428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:45.808820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:45.809314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:45.809763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:45.810468 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:45.810927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:45.811360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:45.951956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:45.959912 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b2de434-a1b7-41e0-974c-bf35fba6a701 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.163299 Sep 08 11:24:45.960489 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3878/7522] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:45 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:46.982315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:46.982945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:46.990501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:46.990999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:46.991455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:46.992188 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:46.992658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:46.993097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:47.126782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:47.134741 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-381e2d5c-6b16-4000-8ee3-558e09cf1553 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.156419 Sep 08 11:24:47.135309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3645/7523] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:46 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:48.158570 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:48.159402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:48.166282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:48.166775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:48.167212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:48.168153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:48.168787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:48.169217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:48.246406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-eb773fc7-60d8-4775-aadc-e037773cad54 req-39f1f3cb-cde3-4f73-8311-0c559e519125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f215f803-c20e-4c81-89d8-ef6f5027a797", "name": "network-vif-plugged", "status": "completed", "tag": "7507f293-279a-4fbf-9da5-dca67105786f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:48.257820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eb773fc7-60d8-4775-aadc-e037773cad54 req-39f1f3cb-cde3-4f73-8311-0c559e519125 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:48.258332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eb773fc7-60d8-4775-aadc-e037773cad54 req-39f1f3cb-cde3-4f73-8311-0c559e519125 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:48.258766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eb773fc7-60d8-4775-aadc-e037773cad54 req-39f1f3cb-cde3-4f73-8311-0c559e519125 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:48.270328 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-eb773fc7-60d8-4775-aadc-e037773cad54 req-39f1f3cb-cde3-4f73-8311-0c559e519125 service nova] Creating event network-vif-plugged:7507f293-279a-4fbf-9da5-dca67105786f for instance f215f803-c20e-4c81-89d8-ef6f5027a797 on n-h1-833090-19 Sep 08 11:24:48.275848 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-eb773fc7-60d8-4775-aadc-e037773cad54 req-39f1f3cb-cde3-4f73-8311-0c559e519125 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Sep 08 11:24:48.276464 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3646/7524] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:24:48.314350 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:48.323563 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-342cba15-a504-427f-a971-facba3d3d9d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.168885 Sep 08 11:24:48.330415 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3879/7525] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:48 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:49.347665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:49.348401 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:49.355092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:49.355619 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:49.356067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:49.356771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:49.357230 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:49.357662 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:49.497752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:49.505943 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-11229ee0-69d2-4820-96be-c5dbb19293c9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1390 microversion: 2.1 time: 0.163413 Sep 08 11:24:49.506521 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3647/7526] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:49 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:50.530922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:50.531571 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:50.534064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:50.539507 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:50.539982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:50.540435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:50.541134 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:50.541590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:50.542019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:50.678625 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:50.686322 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7bd0b9b6-065e-40c4-aee9-eff34a18e8f6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1561 microversion: 2.1 time: 0.160829 Sep 08 11:24:50.686887 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3880/7527] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:50 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:24:50.708164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:50.709076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:50.711049 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:50.711969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:24:50.719641 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:50.720434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:50.721312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:50.721768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:50.722575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:50.723141 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:50.855194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:50.863017 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-011abc59-8bad-459e-be6a-270f3a806eb1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1561 microversion: 2.1 time: 0.158765 Sep 08 11:24:50.863620 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3648/7528] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:50 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:24:52.528915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:24:52.530395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:24:52.530617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-28364d6d-16eb-4f83-820e-8a8308c887dd req-54201b9b-d2fb-4b46-b717-57efb707bc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f215f803-c20e-4c81-89d8-ef6f5027a797", "tag": "7507f293-279a-4fbf-9da5-dca67105786f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:24:52.538074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:52.538829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:52.539518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:52.541073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:52.541934 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:52.542425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-28364d6d-16eb-4f83-820e-8a8308c887dd req-54201b9b-d2fb-4b46-b717-57efb707bc11 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:24:52.543039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:52.543167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-28364d6d-16eb-4f83-820e-8a8308c887dd req-54201b9b-d2fb-4b46-b717-57efb707bc11 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:24:52.543721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-28364d6d-16eb-4f83-820e-8a8308c887dd req-54201b9b-d2fb-4b46-b717-57efb707bc11 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:24:52.555619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-28364d6d-16eb-4f83-820e-8a8308c887dd req-54201b9b-d2fb-4b46-b717-57efb707bc11 service nova] Creating event network-changed:7507f293-279a-4fbf-9da5-dca67105786f for instance f215f803-c20e-4c81-89d8-ef6f5027a797 on n-h1-833090-19 Sep 08 11:24:52.560963 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-28364d6d-16eb-4f83-820e-8a8308c887dd req-54201b9b-d2fb-4b46-b717-57efb707bc11 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034088 Sep 08 11:24:52.561812 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3649/7529] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:24:52.774802 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:24:52.782941 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5a59a48c-f66a-41a9-8795-981003a29b1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1561 microversion: 2.1 time: 0.258956 Sep 08 11:24:52.783545 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3881/7530] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:24:52 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:14.080062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:14.082374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:14.085691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:14.086363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=38 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:14.094404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.094903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.095358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.096108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:14.096580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:14.097022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:14.158247 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0de7041a-83f9-44a0-a175-d9c908b30fd9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action" status: 200 len: 24559 microversion: 2.1 time: 0.082237 Sep 08 11:25:14.159036 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3650/7531] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:25:14 2022] POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action => generated 24559 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:25:25.231686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:25.232303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:25.234655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=15 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:25.235331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:25.241284 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:25.241786 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:25.242235 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:25.242954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:25.243417 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:25.243873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:25.317864 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7aeb8700-5f6b-4a8c-94dd-c20cb4ea71a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action" status: 202 len: 0 microversion: 2.1 time: 0.090181 Sep 08 11:25:25.318575 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3882/7532] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:25:25 2022] POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:25:25.328613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:25.329651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:25.333415 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:25.334369 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:25.343999 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:25.344537 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:25.344996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:25.345732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:25.346208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:25.346657 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:25.485250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:25.494354 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d656d07-4d87-4721-a526-e50ae4fa908f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1685 microversion: 2.1 time: 0.170607 Sep 08 11:25:25.495266 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3651/7533] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:25 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:26.519938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:26.520673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:26.527568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:26.528155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:26.528487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:26.529196 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:26.529643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:26.530065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:26.677812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:26.686337 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3953ffc3-39e5-4de1-a9c1-1aab1ce6d2dc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1665 microversion: 2.1 time: 0.171722 Sep 08 11:25:26.686906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3883/7534] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:26 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:27.782360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:27.784548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:27.792735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:27.793226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:27.793673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:27.794367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:27.794829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:27.795284 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:27.843948 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-39861382-3f0d-4ea3-b6df-5310ee173d1c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action" status: 200 len: 32637 microversion: 2.1 time: 0.065325 Sep 08 11:25:27.844849 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3652/7535] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:25:27 2022] POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:25:27.856822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:27.857349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:27.864291 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:27.864784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:27.865230 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:27.865939 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:27.866397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:27.866829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:27.937160 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1155ecc9-a9c7-4573-820d-fb979ba70aa2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action" status: 202 len: 0 microversion: 2.1 time: 0.084601 Sep 08 11:25:27.937810 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3884/7536] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:25:27 2022] POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:25:27.946903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:27.947800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:27.955377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:27.955920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:27.956441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:27.957157 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:27.957643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:27.958080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:28.104351 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:28.114094 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3bf11a1f-d72f-42dd-ac9b-a4919d1dbe85 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1672 microversion: 2.1 time: 0.171538 Sep 08 11:25:28.114696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3653/7537] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:27 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:29.139234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:29.139967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:29.146504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:29.146997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:29.147438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:29.148155 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:29.148609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:29.149040 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:29.280906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:29.288875 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8b83bf9-7142-4aef-95d9-9b7ec0b5d797 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1680 microversion: 2.1 time: 0.154726 Sep 08 11:25:29.289448 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3885/7538] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:29 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:29.389245 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:29.391450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:29.399036 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:29.400082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:29.400578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:29.401282 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:29.401749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:29.402189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:29.450429 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7c87bb78-8f17-4850-b1cc-86ebba5c5bd4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action" status: 200 len: 38410 microversion: 2.1 time: 0.064937 Sep 08 11:25:29.451098 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3654/7539] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:25:29 2022] POST /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797/action => generated 38410 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:25:30.742374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:30.742937 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:30.744703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-e8584600-66ac-4de0-bb4d-fe8922590cec req-3c896210-e80f-4cae-86e9-11ab2d50c126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f215f803-c20e-4c81-89d8-ef6f5027a797", "tag": "7507f293-279a-4fbf-9da5-dca67105786f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:30.750690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:30.751183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:30.751958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:30.752946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:30.753374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:30.753804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:30.756332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e8584600-66ac-4de0-bb4d-fe8922590cec req-3c896210-e80f-4cae-86e9-11ab2d50c126 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:30.756834 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e8584600-66ac-4de0-bb4d-fe8922590cec req-3c896210-e80f-4cae-86e9-11ab2d50c126 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:30.757285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-e8584600-66ac-4de0-bb4d-fe8922590cec req-3c896210-e80f-4cae-86e9-11ab2d50c126 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:30.769715 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-e8584600-66ac-4de0-bb4d-fe8922590cec req-3c896210-e80f-4cae-86e9-11ab2d50c126 service nova] Creating event network-changed:7507f293-279a-4fbf-9da5-dca67105786f for instance f215f803-c20e-4c81-89d8-ef6f5027a797 on n-h1-833090-19 Sep 08 11:25:30.775099 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-e8584600-66ac-4de0-bb4d-fe8922590cec req-3c896210-e80f-4cae-86e9-11ab2d50c126 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035041 Sep 08 11:25:30.775829 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3655/7540] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:30.787883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:25:30.871580 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1e0b0bbf-1015-48d9-9a72-3557eaa2d988 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 204 len: 0 microversion: 2.1 time: 0.133805 Sep 08 11:25:30.872566 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3886/7541] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:25:30 2022] DELETE /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:25:30.882381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:30.883090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:30.890118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:30.890610 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:30.891060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:30.891799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:30.892263 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:30.892705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:31.054349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:31.068224 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9dad81ca-c41a-414c-a5da-418c0e67f296 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1686 microversion: 2.1 time: 0.190343 Sep 08 11:25:31.069594 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3656/7542] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:30 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:32.095332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:32.096147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:32.103552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:32.104046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:32.104485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:32.105179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:32.105638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:32.106066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:32.240928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:32.248926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-282385a6-9770-4b60-b147-059a62fb8b3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1686 microversion: 2.1 time: 0.157991 Sep 08 11:25:32.249503 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3887/7543] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:32 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:33.219117 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-b32349e9-49e9-4a49-aef3-e9b2a94b5e21 req-29bd3ba5-6cc9-4f6d-92f0-997dc69a0223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f215f803-c20e-4c81-89d8-ef6f5027a797", "name": "network-vif-deleted", "tag": "7507f293-279a-4fbf-9da5-dca67105786f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:33.230870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b32349e9-49e9-4a49-aef3-e9b2a94b5e21 req-29bd3ba5-6cc9-4f6d-92f0-997dc69a0223 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:33.231429 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b32349e9-49e9-4a49-aef3-e9b2a94b5e21 req-29bd3ba5-6cc9-4f6d-92f0-997dc69a0223 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:33.232136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-b32349e9-49e9-4a49-aef3-e9b2a94b5e21 req-29bd3ba5-6cc9-4f6d-92f0-997dc69a0223 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:33.246919 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-b32349e9-49e9-4a49-aef3-e9b2a94b5e21 req-29bd3ba5-6cc9-4f6d-92f0-997dc69a0223 service nova] Creating event network-vif-deleted:7507f293-279a-4fbf-9da5-dca67105786f for instance f215f803-c20e-4c81-89d8-ef6f5027a797 on n-h1-833090-19 Sep 08 11:25:33.251916 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-b32349e9-49e9-4a49-aef3-e9b2a94b5e21 req-29bd3ba5-6cc9-4f6d-92f0-997dc69a0223 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036796 Sep 08 11:25:33.252543 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3657/7544] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:33.272788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:33.273410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:33.281492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:33.282075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:33.282593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:33.283396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:33.283993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:33.284749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:33.357346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:33.365273 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1933d0cf-a705-435a-8d92-b02d36911548 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 200 len: 1351 microversion: 2.1 time: 0.096423 Sep 08 11:25:33.365847 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3888/7545] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:33 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:34.389867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:34.390905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f215f803-c20e-4c81-89d8-ef6f5027a797] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:34.397173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:34.397675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:34.398129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:34.398840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:34.399311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:34.400404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:34.413738 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] HTTP exception thrown: Instance f215f803-c20e-4c81-89d8-ef6f5027a797 could not be found. Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Request method failure captured: Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 HTTP/1.1 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGdDvQ4bOagPdxMXbvY9R87pvfe5zOnpmcJ6FKLSGrdAPtLTE4sOqTISDSdYt8nwAmX-GXRhRQQqqvKN0mD9yNMqNuMv9_uwMsVuQhC-0zcpRP0G7mEdN4Pq0vFOsyVhdcUCBP72f_PDTW7puEgzAF46EN5haIFuSkoWEmDOkialksTE Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_16028a298b3c4773b0b2b225a6955ed6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dcd718e39efa44fe8b5541b58b71eb37 Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance f215f803-c20e-4c81-89d8-ef6f5027a797 could not be found. Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'f215f803-c20e-4c81-89d8-ef6f5027a797'} Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f215f803-c20e-4c81-89d8-ef6f5027a797 could not be found. Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f215f803-c20e-4c81-89d8-ef6f5027a797 could not be found. Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:25:34.416027 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f215f803-c20e-4c81-89d8-ef6f5027a797 could not be found. Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Returning 404 to user: Instance f215f803-c20e-4c81-89d8-ef6f5027a797 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8796eb88-7be8-4e9c-9e0e-ceed82a1ac4a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797" status: 404 len: 111 microversion: 2.1 time: 0.032824 Sep 08 11:25:34.420860 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3658/7546] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:34 2022] GET /compute/v2.1/servers/f215f803-c20e-4c81-89d8-ef6f5027a797 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:25:37.764397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ee800f6-0873-469b-9738-50d361caa0e3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '.version_select at 0x7f234be74dc0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:37.787852 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ee800f6-0873-469b-9738-50d361caa0e3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1024111420" status: 202 len: 0 microversion: 2.1 time: 0.027482 Sep 08 11:25:37.788578 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3889/7547] 10.222.0.59 () {58 vars in 1284 bytes} [Thu Sep 8 11:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1024111420 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:25:37.816623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c3e7c052-edb7-4857-a5b5-4d4102c62673 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: .version_select at 0x7f2350120c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-125608798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/NxldKg+cNGvcZgcYCSYUgLDdZLwnHl0l5DsTYhs/Y2A6TDm68yAaEyU76r/YYIzVEFevN6KM2k7XuvB1ZjiV6FWYS8Am7Sh52c6EWivGzlQoFA430/um8uo37jJop4A=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:37.833502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c3e7c052-edb7-4857-a5b5-4d4102c62673 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:25:37.839737 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-c3e7c052-edb7-4857-a5b5-4d4102c62673 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:25:37.871864 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c3e7c052-edb7-4857-a5b5-4d4102c62673 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059101 Sep 08 11:25:37.872474 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3659/7548] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:25:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:43.672760 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-524747774", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "83abe9c7-9bdb-4efd-9628-64b7ea610f67"}], "key_name": "tempest-TestNetworkAdvancedServerOps-125608798", "security_groups": [{"name": "tempest-secgroup-smoke-901487310"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:43.696142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:43.848009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] validate_networks() for [('83abe9c7-9bdb-4efd-9628-64b7ea610f67', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:25:44.628883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:25:44.629318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:25:44.629805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:25:44.630221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:25:44.634846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:25:44.647679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:44.648532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:44.649016 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:44.650681 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:44.651376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:44.651990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:44.669526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:25:44.674815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:25:44.687644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:25:44.689948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:25:44.740317 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-44f54a3e-c1c8-49f2-92a3-a2374c588522 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.071921 Sep 08 11:25:44.741010 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3890/7549] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:25:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:25:44.750827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=32 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:44.755692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ccde023-5ca1-4a59-a42a-0f4d4f8453d5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:44.756443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ccde023-5ca1-4a59-a42a-0f4d4f8453d5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:44.823716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ccde023-5ca1-4a59-a42a-0f4d4f8453d5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:44.831303 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ccde023-5ca1-4a59-a42a-0f4d4f8453d5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1265 microversion: 2.1 time: 0.082533 Sep 08 11:25:44.832622 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3660/7550] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:44 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:45.856484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:45.857401 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:45.864439 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:45.865103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:45.865642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:45.866483 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:45.867169 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:45.868466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:45.969151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:45.979703 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-472d690b-8b1d-4de7-814a-ef1bfbb04921 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1325 microversion: 2.1 time: 0.128302 Sep 08 11:25:45.986370 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3891/7551] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:45 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:47.008430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:47.009724 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:47.017902 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:47.018423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:47.018884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:47.019654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:47.020305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:47.020773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:47.269596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:47.279218 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7a26211c-e2c6-483e-be75-216956205c3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.275363 Sep 08 11:25:47.279957 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3661/7552] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:47 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:47.561935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-359b46ba-7c3f-437e-bb79-13652f0c1aca req-e713eeb9-98d0-49a6-bc67-639c471ae964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28f95e8-d422-49a4-b9de-b1c0cbed4551", "tag": "f1eeb2a2-2d32-478f-ab3e-2481c9e407b2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:47.578119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-359b46ba-7c3f-437e-bb79-13652f0c1aca req-e713eeb9-98d0-49a6-bc67-639c471ae964 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:47.579361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-359b46ba-7c3f-437e-bb79-13652f0c1aca req-e713eeb9-98d0-49a6-bc67-639c471ae964 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:47.579361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-359b46ba-7c3f-437e-bb79-13652f0c1aca req-e713eeb9-98d0-49a6-bc67-639c471ae964 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:47.591348 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-359b46ba-7c3f-437e-bb79-13652f0c1aca req-e713eeb9-98d0-49a6-bc67-639c471ae964 service nova] Creating event network-changed:f1eeb2a2-2d32-478f-ab3e-2481c9e407b2 for instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 on n-h2-833090-19 Sep 08 11:25:47.597600 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-359b46ba-7c3f-437e-bb79-13652f0c1aca req-e713eeb9-98d0-49a6-bc67-639c471ae964 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041358 Sep 08 11:25:47.598904 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3892/7553] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:48.304304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:48.304922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:48.311914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:48.312407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:48.312856 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:48.313553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:48.314020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:48.314455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:48.451826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:48.459516 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c12db2eb-495b-4b78-b745-8ff94f8e2759 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.159074 Sep 08 11:25:48.460091 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3662/7554] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:48 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:49.483689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:49.484412 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:49.491660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:49.492142 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:49.492582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:49.493276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:49.493732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:49.494159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:49.628886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:49.636738 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78ab381d-4989-4bef-84d4-28b8df8c6895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.157818 Sep 08 11:25:49.637317 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3893/7555] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:49 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:50.659448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:50.660135 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:50.667561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:50.668066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:50.668518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:50.669220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:50.669685 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:50.670124 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:50.801629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:50.809819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3d8d958c-6e4b-4b23-be1b-8ae79dfbc676 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.154263 Sep 08 11:25:50.810403 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3663/7556] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:50 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:51.832674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:51.833301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:51.840848 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.841344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.841794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.842504 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:51.842971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:51.843403 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:51.987157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:51.995641 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e3197bd2-ddd9-4734-980d-b166cd413f66 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.166876 Sep 08 11:25:51.996218 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3894/7557] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:51 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:53.018192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:53.018823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:53.025741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:53.026240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:53.026697 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:53.027402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:53.028122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:53.028586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:53.163887 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:53.172265 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e721ce21-984d-4222-a86e-4441e7e39481 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.158040 Sep 08 11:25:53.173076 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3664/7558] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:53 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:53.661438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-7c8c7636-946c-44a8-a90e-488640259c86 req-e63439a3-7559-40e1-8798-da22f4fe9e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28f95e8-d422-49a4-b9de-b1c0cbed4551", "name": "network-vif-plugged", "status": "completed", "tag": "f1eeb2a2-2d32-478f-ab3e-2481c9e407b2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:53.673554 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7c8c7636-946c-44a8-a90e-488640259c86 req-e63439a3-7559-40e1-8798-da22f4fe9e81 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:53.674028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7c8c7636-946c-44a8-a90e-488640259c86 req-e63439a3-7559-40e1-8798-da22f4fe9e81 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:53.674490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-7c8c7636-946c-44a8-a90e-488640259c86 req-e63439a3-7559-40e1-8798-da22f4fe9e81 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:53.685712 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-7c8c7636-946c-44a8-a90e-488640259c86 req-e63439a3-7559-40e1-8798-da22f4fe9e81 service nova] Creating event network-vif-plugged:f1eeb2a2-2d32-478f-ab3e-2481c9e407b2 for instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 on n-h2-833090-19 Sep 08 11:25:53.691123 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-7c8c7636-946c-44a8-a90e-488640259c86 req-e63439a3-7559-40e1-8798-da22f4fe9e81 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Sep 08 11:25:53.691780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3895/7559] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:54.195917 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:54.196534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:54.204006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:54.204504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:54.204952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:54.205648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:54.206110 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:54.206544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:54.339081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:54.346847 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa967aa0-86ff-4fbc-8e10-eae2c6698aef tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1390 microversion: 2.1 time: 0.154848 Sep 08 11:25:54.347439 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3665/7560] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:54 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:55.367751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:55.369411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:55.374303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:55.375006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:55.376832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:55.383804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:55.384296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:55.384743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:55.385452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:55.385911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:55.386345 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:55.528527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:55.537508 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-51b3534d-b9d7-4def-a4a8-0a9cc601f284 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1562 microversion: 2.1 time: 0.170735 Sep 08 11:25:55.538107 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3896/7561] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:55 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:55.561010 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:55.561650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:55.563604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:55.565251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:25:55.571872 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:55.572417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:55.572943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:55.573586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:55.574059 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:55.574505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:55.708542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:55.716991 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-384bc7c0-0072-479d-ad5b-3ffa43b3562e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1562 microversion: 2.1 time: 0.160668 Sep 08 11:25:55.717563 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3666/7562] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:55 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:25:57.318994 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:25:57.319646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:25:57.322596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c9aa0fd5-89b1-45c3-b949-fab63d903aeb req-19db5718-f659-42f7-8a5c-5379ab8e6041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28f95e8-d422-49a4-b9de-b1c0cbed4551", "tag": "f1eeb2a2-2d32-478f-ab3e-2481c9e407b2"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:25:57.326955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:57.327444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:57.327919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:57.328618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:57.329446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:57.330074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:57.334102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c9aa0fd5-89b1-45c3-b949-fab63d903aeb req-19db5718-f659-42f7-8a5c-5379ab8e6041 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:25:57.334606 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c9aa0fd5-89b1-45c3-b949-fab63d903aeb req-19db5718-f659-42f7-8a5c-5379ab8e6041 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:25:57.335067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c9aa0fd5-89b1-45c3-b949-fab63d903aeb req-19db5718-f659-42f7-8a5c-5379ab8e6041 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:25:57.347411 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c9aa0fd5-89b1-45c3-b949-fab63d903aeb req-19db5718-f659-42f7-8a5c-5379ab8e6041 service nova] Creating event network-changed:f1eeb2a2-2d32-478f-ab3e-2481c9e407b2 for instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 on n-h2-833090-19 Sep 08 11:25:57.352931 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c9aa0fd5-89b1-45c3-b949-fab63d903aeb req-19db5718-f659-42f7-8a5c-5379ab8e6041 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Sep 08 11:25:57.353879 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3667/7563] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:25:57.526081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:25:57.535177 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-671f77e9-e137-4af8-832d-6a49cdd95e63 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1562 microversion: 2.1 time: 0.220616 Sep 08 11:25:57.535780 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3897/7564] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:25:57 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:26:30.843418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:30.844132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=38 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:26:30.849020 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:26:30.851268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:26:30.859251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:30.859770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:30.860228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:30.860934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:26:30.861399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:26:30.861837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:26:30.930682 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0633a0a1-71b2-4ed1-baa2-531d1bab271e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551/action" status: 200 len: 24566 microversion: 2.1 time: 0.089300 Sep 08 11:26:30.931359 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3668/7565] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:26:30 2022] POST /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:27:09.986463 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:09.987686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:09.993174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:27:09.995386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:10.002495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:10.003004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:10.003434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:10.004682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:10.005147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:10.005582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:10.080220 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-147cb16d-6a29-4fa8-8e02-7bb18d873982 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551/action" status: 202 len: 0 microversion: 2.1 time: 0.095335 Sep 08 11:27:10.080917 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3898/7566] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:27:09 2022] POST /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:27:10.090782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:10.091524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:10.093943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:10.094842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:10.102260 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:10.102755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:10.103207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:10.104048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:10.104514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:10.104948 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:10.400542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:10.408421 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9530fbba-6c8e-4c85-9fbc-39635e074442 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1672 microversion: 2.1 time: 0.322225 Sep 08 11:27:10.408999 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3669/7567] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:10 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1672 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:11.514344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:11.515048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:11.521857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:11.522353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:11.522787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:11.523506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:11.523968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:11.524402 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:11.709751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:11.717910 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-82297b39-2f75-46af-98b0-cf3938d8ec64 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.208960 Sep 08 11:27:11.718408 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3899/7568] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:11 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:12.741541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:12.742201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:12.749870 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:12.750373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:12.750832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:12.751578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:12.752056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:12.752499 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:12.884232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:12.892253 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-515be06f-c483-4da2-81cf-be8cf4770389 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.154794 Sep 08 11:27:12.892833 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3670/7569] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:12 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:13.916927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:13.917558 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:13.924467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:13.924960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:13.925406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:13.926105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:13.926588 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:13.927011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:14.343724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:14.351500 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-396eaeea-02aa-421b-a6d9-219e2d5407ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.438560 Sep 08 11:27:14.352061 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3900/7570] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:13 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:15.374729 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:15.375268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:15.382423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:15.382907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:15.383358 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:15.384087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:15.384559 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:15.385000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:15.515571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:15.523321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-49f8153b-2bbf-4f2c-a9ae-14f051165f1e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.152595 Sep 08 11:27:15.523915 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3671/7571] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:15 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:16.546953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:16.547629 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:16.554541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:16.555039 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:16.555508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:16.556208 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:16.556665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:16.557098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:16.701192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:16.709616 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e55068e8-285d-4522-8fcb-e912b02e59af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.166552 Sep 08 11:27:16.710201 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3901/7572] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:16 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:17.733234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:17.733866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:17.740656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.741165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.741618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.742323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:17.742796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:17.743246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:17.876086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:17.884512 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d5e06180-d162-4377-ada4-73a84a4b8858 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.155269 Sep 08 11:27:17.885128 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3672/7573] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:17 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:27:18.910207 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:18.911390 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:18.918351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:18.918827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:18.919269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:18.919983 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:18.920437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:18.920862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:19.058418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:19.068247 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-50366b5d-7d4a-4ba7-9f26-4acd3e15e596 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.161906 Sep 08 11:27:19.068851 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3902/7574] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:18 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:20.092539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:20.093158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:20.100926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:20.101503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:20.102031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:20.103054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:20.103604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:20.104323 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:20.235370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:20.243636 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bd469440-efaa-4a04-89f8-fc40fe3121ec tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.155322 Sep 08 11:27:20.244206 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3673/7575] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:20 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:21.267363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:21.267980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:21.274384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:21.274900 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:21.275338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:21.276063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:21.276516 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:21.276938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:21.412977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:21.420869 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-222f1246-eed3-45da-b3c0-9becdee708d9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1677 microversion: 2.1 time: 0.157829 Sep 08 11:27:21.421473 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3903/7576] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:21 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:22.445181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:27:22.445828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:22.453033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:22.453532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:22.453985 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:22.454688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:22.455158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:22.455630 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:22.597668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:27:22.605470 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-96af90b6-c2d0-44a4-a1da-dafd35e76e93 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1680 microversion: 2.1 time: 0.164733 Sep 08 11:27:22.606040 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3674/7577] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:27:22 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:27:54.828787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:27:54.831000 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:27:54.833887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:54.834542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:27:54.840563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:54.841046 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:54.841487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:54.842438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:27:54.842892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:27:54.843317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:27:54.918039 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b637516f-a2a2-48be-9a18-97d681cfae29 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551/action" status: 200 len: 68892 microversion: 2.1 time: 0.093146 Sep 08 11:27:54.918655 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3904/7578] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:27:54 2022] POST /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551/action => generated 68892 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:28:18.474616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:18.482748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:18.483628 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:18.485771 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:18.486435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:18.487627 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:28:18.487800 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:28:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 (ip 10.222.0.59) !!! Sep 08 11:28:18.488888 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:28:18.489013 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:28:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 (ip 10.222.0.59) !!! Sep 08 11:28:18.491893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:18.502788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:18.503580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:18.504038 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:18.504744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:18.505208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:18.505656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:18.533900 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:28:18.551713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6d87b8fe-0a19-4199-ba39-1d46456eac5e req-c0c9ac41-4a38-4687-9af7-21daddf1b3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28f95e8-d422-49a4-b9de-b1c0cbed4551", "tag": "f1eeb2a2-2d32-478f-ab3e-2481c9e407b2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:18.565559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6d87b8fe-0a19-4199-ba39-1d46456eac5e req-c0c9ac41-4a38-4687-9af7-21daddf1b3cf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:18.566048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6d87b8fe-0a19-4199-ba39-1d46456eac5e req-c0c9ac41-4a38-4687-9af7-21daddf1b3cf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:18.566480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6d87b8fe-0a19-4199-ba39-1d46456eac5e req-c0c9ac41-4a38-4687-9af7-21daddf1b3cf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:18.578396 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6d87b8fe-0a19-4199-ba39-1d46456eac5e req-c0c9ac41-4a38-4687-9af7-21daddf1b3cf service nova] Creating event network-changed:f1eeb2a2-2d32-478f-ab3e-2481c9e407b2 for instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 on n-h2-833090-19 Sep 08 11:28:18.584164 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6d87b8fe-0a19-4199-ba39-1d46456eac5e req-c0c9ac41-4a38-4687-9af7-21daddf1b3cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107507 Sep 08 11:28:18.584782 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3905/7579] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:18.615947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-af594a7e-4c3f-4859-b052-9a0cafd919ae tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 204 len: 0 microversion: 2.1 time: 0.145319 Sep 08 11:28:18.616550 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3675/7580] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:28:18 2022] DELETE /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:28:18.627357 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:18.628220 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:18.635996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:18.636574 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:18.637097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:18.637947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:18.644151 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:18.644664 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:18.791242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:18.799274 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5ebb5fe8-5e43-49e4-bcd5-40ebda79f8bc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1686 microversion: 2.1 time: 0.177004 Sep 08 11:28:18.799891 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3906/7581] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:18 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:19.825390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:19.826153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:19.833544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:19.834047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:19.834502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:19.835216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:19.835735 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:19.836172 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:20.058854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:20.067004 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7b5c8ce8-fad4-46de-8a68-d259839f0933 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1686 microversion: 2.1 time: 0.247107 Sep 08 11:28:20.067602 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3676/7582] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:19 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1686 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:20.883761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-624f5f98-2bb1-45ad-8000-91e7e4ddb74f req-5a77b7a6-9510-4ba5-9275-365b0d6adcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28f95e8-d422-49a4-b9de-b1c0cbed4551", "name": "network-vif-deleted", "tag": "f1eeb2a2-2d32-478f-ab3e-2481c9e407b2"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:20.896721 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-624f5f98-2bb1-45ad-8000-91e7e4ddb74f req-5a77b7a6-9510-4ba5-9275-365b0d6adcd3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:20.897425 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-624f5f98-2bb1-45ad-8000-91e7e4ddb74f req-5a77b7a6-9510-4ba5-9275-365b0d6adcd3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:20.898136 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-624f5f98-2bb1-45ad-8000-91e7e4ddb74f req-5a77b7a6-9510-4ba5-9275-365b0d6adcd3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:20.911326 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-624f5f98-2bb1-45ad-8000-91e7e4ddb74f req-5a77b7a6-9510-4ba5-9275-365b0d6adcd3 service nova] Creating event network-vif-deleted:f1eeb2a2-2d32-478f-ab3e-2481c9e407b2 for instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 on n-h2-833090-19 Sep 08 11:28:20.917486 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-624f5f98-2bb1-45ad-8000-91e7e4ddb74f req-5a77b7a6-9510-4ba5-9275-365b0d6adcd3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038117 Sep 08 11:28:20.918100 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3907/7583] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:21.090179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:21.090812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:21.098084 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:21.098592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:21.099046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:21.099799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:21.100268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:21.100710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:21.137705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:21.138213 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:21.138660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:21.139128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lazy-loading 'fault' on Instance uuid f28f95e8-d422-49a4-b9de-b1c0cbed4551 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:28:21.190182 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:21.199063 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b1e11fc-3f66-4bfa-b7a0-48216a252e8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 200 len: 1355 microversion: 2.1 time: 0.112678 Sep 08 11:28:21.199696 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3677/7584] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:21 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:22.223774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:22.224475 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: f28f95e8-d422-49a4-b9de-b1c0cbed4551] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:22.230691 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:22.231191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:22.231647 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:22.232334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:22.232783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:22.233210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:22.246606 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] HTTP exception thrown: Instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 could not be found. Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Request method failure captured: Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 HTTP/1.1 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGdDvQ4bOagPdxMXbvY9R87pvfe5zOnpmcJ6FKLSGrdAPtLTE4sOqTISDSdYt8nwAmX-GXRhRQQqqvKN0mD9yNMqNuMv9_uwMsVuQhC-0zcpRP0G7mEdN4Pq0vFOsyVhdcUCBP72f_PDTW7puEgzAF46EN5haIFuSkoWEmDOkialksTE Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_16028a298b3c4773b0b2b225a6955ed6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dcd718e39efa44fe8b5541b58b71eb37 Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 could not be found. Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'f28f95e8-d422-49a4-b9de-b1c0cbed4551'} Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 could not be found. Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 could not be found. Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:28:22.248260 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 could not be found. Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Returning 404 to user: Instance f28f95e8-d422-49a4-b9de-b1c0cbed4551 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a7c1c934-06a7-4ca9-b245-3e95d1a59f4e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551" status: 404 len: 111 microversion: 2.1 time: 0.031091 Sep 08 11:28:22.253498 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3908/7585] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:22 2022] GET /compute/v2.1/servers/f28f95e8-d422-49a4-b9de-b1c0cbed4551 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:28:25.572174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df0a2923-6c8c-4fcb-96f6-5fd78d4603c5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '.version_select at 0x7f234bfaae50>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:25.600654 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df0a2923-6c8c-4fcb-96f6-5fd78d4603c5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-125608798" status: 202 len: 0 microversion: 2.1 time: 0.032425 Sep 08 11:28:25.601425 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3678/7586] 10.222.0.59 () {58 vars in 1281 bytes} [Thu Sep 8 11:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-125608798 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:28:25.629948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-357514bb-81ad-4de6-ac94-ba76703e310c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: .version_select at 0x7f235114ce50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1833237969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgWGymn0l7QvIossoB6/hNS1N9llWBErONWOGhffuyaVuBFELo3TcmxOIVTr7sTvLFVHtmY6pBenEzyK/LixDQn4sNEWvfPqegx1iqemhpEDqea7FQR+z5hx8jL+fgDqA=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:25.647387 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-357514bb-81ad-4de6-ac94-ba76703e310c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:28:25.653831 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-357514bb-81ad-4de6-ac94-ba76703e310c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:28:25.673209 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-357514bb-81ad-4de6-ac94-ba76703e310c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [dcede2e2-00be-4640-97df-519dabdb8975] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:28:26.681691 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [None req-357514bb-81ad-4de6-ac94-ba76703e310c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [dcede2e2-00be-4640-97df-519dabdb8975] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 49580. Sep 08 11:28:26.698354 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-357514bb-81ad-4de6-ac94-ba76703e310c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.072356 Sep 08 11:28:26.698989 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3909/7587] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:28:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:32.257326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-525706567", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "1a8b199c-00e1-401f-b8f0-183b7e2aac42"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1833237969", "security_groups": [{"name": "tempest-secgroup-smoke-1756121924"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:32.272199 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:32.382262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] validate_networks() for [('1a8b199c-00e1-401f-b8f0-183b7e2aac42', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:28:32.884580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:28:32.885961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:28:32.886634 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:28:32.887293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:28:32.887953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:28:32.905410 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:32.905924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:32.906430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:32.907149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:32.911365 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:32.911922 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:32.938594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:28:32.947775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:28:32.962656 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:28:32.965506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:28:33.030084 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17bf0fc2-a6a4-4619-8318-d6148d66a06e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777001 Sep 08 11:28:33.031029 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3679/7588] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:28:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:28:33.042762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-14e56ddc-9ce7-4c33-9ebc-3b7ab7fd4e37 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:33.044094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-14e56ddc-9ce7-4c33-9ebc-3b7ab7fd4e37 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:33.054678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=12 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:33.162886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-14e56ddc-9ce7-4c33-9ebc-3b7ab7fd4e37 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:33.189919 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-14e56ddc-9ce7-4c33-9ebc-3b7ab7fd4e37 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1266 microversion: 2.1 time: 0.150809 Sep 08 11:28:33.190792 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3910/7589] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:33 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:34.231722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:34.232532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:34.240352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:34.240997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:34.241750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:34.242623 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:34.243174 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:34.243769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:34.309542 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:34.318702 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f18e0d77-2a13-4f12-86ea-c1689af8ebb2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1318 microversion: 2.1 time: 0.092368 Sep 08 11:28:34.335032 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3680/7590] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:34 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:35.343418 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:35.344064 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:35.351327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.351854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.352302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:35.353834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.354308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.354748 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:35.514262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:35.523300 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76182ca6-8420-4e0c-80e1-ab41d360b2e6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1392 microversion: 2.1 time: 0.184318 Sep 08 11:28:35.523956 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3911/7591] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:35 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:35.925127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-4a7f4bae-7772-42a6-a546-0e739e703f92 req-c454f83d-88e6-43c6-81fd-a7d078082b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:35.939165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4a7f4bae-7772-42a6-a546-0e739e703f92 req-c454f83d-88e6-43c6-81fd-a7d078082b6b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:35.939694 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4a7f4bae-7772-42a6-a546-0e739e703f92 req-c454f83d-88e6-43c6-81fd-a7d078082b6b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:35.940140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-4a7f4bae-7772-42a6-a546-0e739e703f92 req-c454f83d-88e6-43c6-81fd-a7d078082b6b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:35.962625 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-4a7f4bae-7772-42a6-a546-0e739e703f92 req-c454f83d-88e6-43c6-81fd-a7d078082b6b service nova] Creating event network-changed:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h1-833090-19 Sep 08 11:28:35.969267 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-4a7f4bae-7772-42a6-a546-0e739e703f92 req-c454f83d-88e6-43c6-81fd-a7d078082b6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049029 Sep 08 11:28:35.970077 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3681/7592] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:36.548809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:36.549380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:36.557010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:36.557508 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:36.558080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.558794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:36.559264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:36.559723 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:36.698861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:36.706986 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c7b5c542-8a5a-4127-9d6f-30413813711d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1392 microversion: 2.1 time: 0.162343 Sep 08 11:28:36.707689 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3912/7593] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:36 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:37.731920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:37.732639 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:37.738863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:37.739305 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:37.739788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:37.740495 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:37.740967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:37.741412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:37.881577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:37.892402 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d60a4a24-dae3-4175-a612-faf8237d9e18 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1392 microversion: 2.1 time: 0.165553 Sep 08 11:28:37.893000 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3682/7594] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:37 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:38.915485 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:38.916212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:38.922955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:38.923446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:38.923921 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:38.924633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:38.925089 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:38.925519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:39.057706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:39.065753 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-33db4e56-49cd-4705-94e8-de67085df409 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1392 microversion: 2.1 time: 0.154263 Sep 08 11:28:39.066333 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3913/7595] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:38 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:40.090343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:40.090966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:40.097683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:40.098179 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:40.098631 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:40.099330 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:40.099827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:40.100272 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:40.233819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:40.241676 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-149ddedc-1d44-4585-8548-9add2da98086 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1392 microversion: 2.1 time: 0.156142 Sep 08 11:28:40.242252 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3683/7596] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:40 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:41.263923 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:41.264729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:41.271654 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:41.272271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:41.272794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:41.273609 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:41.274100 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:41.274592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:41.336173 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-0096ab84-8de9-429e-acbb-c20e5f0fa0ab req-201060e0-bb19-4c35-97a3-e058da04592b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "name": "network-vif-plugged", "status": "completed", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:41.346934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0096ab84-8de9-429e-acbb-c20e5f0fa0ab req-201060e0-bb19-4c35-97a3-e058da04592b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:41.347563 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0096ab84-8de9-429e-acbb-c20e5f0fa0ab req-201060e0-bb19-4c35-97a3-e058da04592b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:41.347904 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-0096ab84-8de9-429e-acbb-c20e5f0fa0ab req-201060e0-bb19-4c35-97a3-e058da04592b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:41.361079 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-0096ab84-8de9-429e-acbb-c20e5f0fa0ab req-201060e0-bb19-4c35-97a3-e058da04592b service nova] Creating event network-vif-plugged:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h1-833090-19 Sep 08 11:28:41.366528 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-0096ab84-8de9-429e-acbb-c20e5f0fa0ab req-201060e0-bb19-4c35-97a3-e058da04592b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104035 Sep 08 11:28:41.367309 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3684/7597] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:41.432719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:41.440759 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-92c61fc9-d046-4696-a1e7-e1028bec266f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1392 microversion: 2.1 time: 0.180763 Sep 08 11:28:41.441354 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3914/7598] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:41 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:42.465701 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:42.466449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:42.473849 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:42.474331 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:42.474787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:42.475530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:42.476002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:42.476448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:42.620794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:42.629019 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-dfc536e6-9da6-444c-bf30-93d173c52dd7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1565 microversion: 2.1 time: 0.169017 Sep 08 11:28:42.629607 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3685/7599] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:42 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:28:42.652597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:42.653217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:42.660269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:42.660744 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:42.661191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:42.661906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:42.662368 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:42.662805 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:42.802874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:42.813049 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d131bb2d-ea77-4238-a1d7-489ad32a29bb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1565 microversion: 2.1 time: 0.164753 Sep 08 11:28:42.813979 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3915/7600] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:42 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:28:44.745138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-c8575575-704f-4726-a953-9c30cca8b5d2 req-644f5481-1431-4a34-8e34-11700e9549e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:28:44.747248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:28:44.747910 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:28:44.750099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:44.756400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:44.757679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:28:44.765969 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c8575575-704f-4726-a953-9c30cca8b5d2 req-644f5481-1431-4a34-8e34-11700e9549e0 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:44.766454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c8575575-704f-4726-a953-9c30cca8b5d2 req-644f5481-1431-4a34-8e34-11700e9549e0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:44.766893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-c8575575-704f-4726-a953-9c30cca8b5d2 req-644f5481-1431-4a34-8e34-11700e9549e0 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:44.775240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:44.775779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:44.776236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:44.776960 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:28:44.777430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:28:44.777879 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:28:44.789390 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-c8575575-704f-4726-a953-9c30cca8b5d2 req-644f5481-1431-4a34-8e34-11700e9549e0 service nova] Creating event network-changed:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h1-833090-19 Sep 08 11:28:44.795716 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-c8575575-704f-4726-a953-9c30cca8b5d2 req-644f5481-1431-4a34-8e34-11700e9549e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054063 Sep 08 11:28:44.796363 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3916/7601] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:28:45.215866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:28:45.224511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3fd0a88-267e-45e5-98ee-de2fe5259967 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1565 microversion: 2.1 time: 0.487181 Sep 08 11:28:45.225673 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3686/7602] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:28:44 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1565 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:06.468415 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:29:06.469080 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action (ip 10.222.0.59) !!! Sep 08 11:29:06.469985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:06.470735 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=32 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:06.475564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:06.477822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:06.487830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:06.488314 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:06.488750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:06.489443 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:06.489899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:06.490328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:06.544376 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3a7efce9-1771-4c6d-83fb-b3b112e3e0ce tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action" status: 200 len: 24570 microversion: 2.1 time: 0.077550 Sep 08 11:29:06.545275 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3917/7603] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:29:06 2022] POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:29:12.930804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:12.933122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:12.936227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:12.937114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:29:12.943268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:12.943790 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:12.944237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:12.944941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:12.945406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:12.945841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:12.986883 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:12.993189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Old instance type m1.heat2, new instance type m1.heat {{(pid=122456) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 11:29:13.001227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:29:13.002333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:29:13.002333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:29:13.003079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:29:13.003079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:29:13.067732 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b5a44cfd-4713-4f97-9bf8-a48837daf97c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action" status: 202 len: 0 microversion: 2.1 time: 0.140759 Sep 08 11:29:13.068352 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3687/7604] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:29:12 2022] POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:29:13.077505 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:13.078222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:13.086015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:13.086518 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:13.086968 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:13.087839 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:13.088288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:13.088799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:13.232086 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:13.240586 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2477b3dc-43ed-4c0d-9bbc-9c89fdd03254 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1693 microversion: 2.1 time: 0.166949 Sep 08 11:29:13.243515 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3918/7605] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:13 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:14.265530 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:14.266083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:14.272864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:14.273379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:14.273842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:14.274564 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:14.275041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:14.275520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:14.416914 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:14.425180 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-34c98842-b432-4873-8181-84f7c92e11f2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1693 microversion: 2.1 time: 0.164677 Sep 08 11:29:14.425735 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3688/7606] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:14 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:15.449476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:15.450520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:15.465337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:15.466324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:15.466772 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:15.467495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:15.467960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:15.468396 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:15.609147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:15.616947 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-191e3f8d-5a76-4ba8-af9d-2ead43fa3622 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.171406 Sep 08 11:29:15.617528 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3919/7607] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:15 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:16.641560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:16.642190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:16.649349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:16.649857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:16.650318 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:16.651035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:16.651533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:16.651981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:16.783820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:16.791690 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1951ffc5-2b53-413e-bd44-a18f4b903fe7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.154073 Sep 08 11:29:16.792261 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3689/7608] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:16 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:17.815448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:17.816071 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:17.823165 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:17.823702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:17.824157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:17.825535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:17.826009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:17.826450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:17.969221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:17.977493 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-320254d0-d4f1-49b2-ae49-3e2d5b4dfcab tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.165982 Sep 08 11:29:17.978076 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3920/7609] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:17 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:19.001801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:19.002372 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:19.009270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:19.009768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:19.010216 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:19.010926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:19.011393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:19.011854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:19.154261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:19.162131 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-53be1990-739d-4159-8c23-a33211d0bdb7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.164601 Sep 08 11:29:19.162701 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3690/7610] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:18 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:20.185430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:20.186063 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:20.192927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:20.193406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:20.193842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:20.194531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:20.194982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:20.195405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:20.342122 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:20.350813 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a47ed5d-d8a3-490b-9881-33dc74b540c2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.169300 Sep 08 11:29:20.351398 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3921/7611] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:20 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:21.374800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:21.375336 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:21.382611 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:21.383105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:21.383625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:21.384340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:21.384803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:21.385242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:21.526576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:21.534953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-131e1d7e-84c3-49d2-bdc5-1f935a625228 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.164592 Sep 08 11:29:21.535539 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3691/7612] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:21 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:22.558688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:22.559307 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:22.565978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:22.566945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:22.567393 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:22.568770 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:22.569240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:22.570359 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:22.709663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:22.718064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-85a9a1fa-570e-421e-a1fc-3f1241d11a36 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.163725 Sep 08 11:29:22.718637 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3922/7613] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:22 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:23.741691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:23.742332 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:23.751253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:23.751796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:23.752264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:23.753000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:23.753458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:23.753908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:23.889953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:23.898112 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e694b874-8f98-48a4-a5a3-77d238cf945f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.160422 Sep 08 11:29:23.898691 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3692/7614] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:23 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:24.923093 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:24.923740 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:24.930849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:24.931344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:24.931819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:24.932535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:24.932997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:24.933433 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:25.072306 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:25.080292 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-56010776-56d4-4e2e-807f-522de7bf66a3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.161713 Sep 08 11:29:25.080870 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3923/7615] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:24 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:26.105073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:26.105705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:26.113184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:26.113692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:26.114149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:26.114874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:26.115344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:26.115819 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:26.265491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:26.273321 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bac90301-9017-4a0e-bb8d-d5359639570a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1698 microversion: 2.1 time: 0.172222 Sep 08 11:29:26.273895 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3693/7616] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:26 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:27.296528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:27.297147 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:27.303987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:27.304480 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:27.304913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:27.305600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:27.306055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:27.306476 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:27.444755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:27.453707 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-075b6632-d005-4f43-98f3-3aee21410a9e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1697 microversion: 2.1 time: 0.161054 Sep 08 11:29:27.454308 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3924/7617] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:27 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:27.611800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "name": "network-vif-unplugged", "status": "completed", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:27.621609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:27.622114 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:27.622570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:27.635101 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] Creating event network-vif-unplugged:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h2-833090-19 Sep 08 11:29:27.640477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122456) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:29:27.652548 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-98af2cf1-2b20-45bb-bb81-4ca450151ddc req-a77e08f4-c738-43a7-8621-985afe7efe8b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102334 Sep 08 11:29:27.653242 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3694/7618] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:29:28.476971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:28.477620 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:28.484887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:28.485383 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:28.485825 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:28.486530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:28.486997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:28.487426 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:28.623908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:28.632603 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8c44661d-2e8d-4148-a319-2fc9d7654e77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1697 microversion: 2.1 time: 0.159542 Sep 08 11:29:28.633193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3925/7619] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:28 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:29.657851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:29.658566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:29.665125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:29.665632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:29.666087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:29.666824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:29.667281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:29.667749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:29.670004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:29.680459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:29.680932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:29.681358 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:29.693464 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] Creating event network-changed:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h2-833090-19 Sep 08 11:29:29.698821 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-19', 'n-h2-833090-19'} {{(pid=122457) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 11:29:29.710952 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-b82a5a16-9042-4339-8f8e-175f21904faa req-2f71475f-aa51-46b0-9bb1-45f7516a4787 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044546 Sep 08 11:29:29.711513 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3926/7620] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:29:29.809577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:29.818064 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b0f165ed-e784-488b-a18a-a2e37e5f8699 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1695 microversion: 2.1 time: 0.165387 Sep 08 11:29:29.818718 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3695/7621] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:29 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:29:30.843658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:30.844369 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:30.850832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:30.851316 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:30.851793 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:30.852487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:30.852944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:30.853375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:30.999446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:31.007553 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-968bcdc5-f483-49b8-90e4-fa9fde6ffbd1 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1695 microversion: 2.1 time: 0.169035 Sep 08 11:29:31.008127 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3927/7622] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:30 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:32.080528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:32.081170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:32.087256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.087805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.088268 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.089069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.089549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.090006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.229678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:32.237407 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7763a6ca-c395-4ef8-9ac0-7890c84f3d86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1692 microversion: 2.1 time: 0.210802 Sep 08 11:29:32.238001 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3696/7623] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:32 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:32.259896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:32.260395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:32.268077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.268567 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.269009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.269702 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.270158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.270586 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.329207 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bc8f3926-448e-45b5-bd65-33fb574ea496 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action" status: 204 len: 0 microversion: 2.1 time: 0.073135 Sep 08 11:29:32.329851 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3928/7624] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:29:32 2022] POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:29:32.338493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:32.339234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:32.347674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.348222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.348689 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.349423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.349926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.350373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.487248 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:32.495598 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-40f8f82b-0599-430c-ad91-e2fd635afe86 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1692 microversion: 2.1 time: 0.161361 Sep 08 11:29:32.496195 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3697/7625] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:32 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:32.519651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:32.520303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:32.526590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.527074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.527573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.528269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:32.528756 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:32.529182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:32.670494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:32.679684 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-9d752271-2a1b-49d6-b27c-c0fb81ee267a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1692 microversion: 2.1 time: 0.164363 Sep 08 11:29:32.680466 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3929/7626] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:32 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:33.704314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:29:33.705044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:29:33.712341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:33.712881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:33.713361 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:33.714093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:33.714644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:33.715113 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:33.856734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:29:33.865185 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d67bba0c-c37b-438a-99b6-9a9427052270 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1684 microversion: 2.1 time: 0.164865 Sep 08 11:29:33.865768 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3698/7627] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:29:33 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:29:34.811719 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-31856907-596a-42b5-a147-2233a8c5b2f2 req-f8872fc0-09f4-4a1f-bf9f-5aff194dcc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "name": "network-vif-plugged", "status": "completed", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:29:34.822854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-31856907-596a-42b5-a147-2233a8c5b2f2 req-f8872fc0-09f4-4a1f-bf9f-5aff194dcc7c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:29:34.823792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-31856907-596a-42b5-a147-2233a8c5b2f2 req-f8872fc0-09f4-4a1f-bf9f-5aff194dcc7c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:29:34.824298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-31856907-596a-42b5-a147-2233a8c5b2f2 req-f8872fc0-09f4-4a1f-bf9f-5aff194dcc7c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:29:34.836663 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-31856907-596a-42b5-a147-2233a8c5b2f2 req-f8872fc0-09f4-4a1f-bf9f-5aff194dcc7c service nova] Creating event network-vif-plugged:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h2-833090-19 Sep 08 11:29:34.841713 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-31856907-596a-42b5-a147-2233a8c5b2f2 req-f8872fc0-09f4-4a1f-bf9f-5aff194dcc7c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Sep 08 11:29:34.842383 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3930/7628] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:30:06.086327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:06.088667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:06.090744 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=28 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:06.091638 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:06.099215 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:06.099759 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:06.100224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:06.100973 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:06.101458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:06.101906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:06.174866 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3627bdfe-b787-4726-a2df-f9ec17015ca9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action" status: 200 len: 24567 microversion: 2.1 time: 0.089780 Sep 08 11:30:06.175571 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3699/7629] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:30:06 2022] POST /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213/action => generated 24567 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:30:23.214569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=28 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:23.215811 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:23.221295 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-5a60db2b-1817-4d23-9847-6746c2c088f3 req-8b143910-cf3b-4cb3-a783-e73d5d0fa5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:23.222332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:23.222523 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:23.228463 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:23.229353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:23.233743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:23.234295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:23.234732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5a60db2b-1817-4d23-9847-6746c2c088f3 req-8b143910-cf3b-4cb3-a783-e73d5d0fa5ae service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:23.234880 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:23.235265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5a60db2b-1817-4d23-9847-6746c2c088f3 req-8b143910-cf3b-4cb3-a783-e73d5d0fa5ae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:23.235447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:23.235742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-5a60db2b-1817-4d23-9847-6746c2c088f3 req-8b143910-cf3b-4cb3-a783-e73d5d0fa5ae service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:23.236112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:23.236553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:23.249845 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-5a60db2b-1817-4d23-9847-6746c2c088f3 req-8b143910-cf3b-4cb3-a783-e73d5d0fa5ae service nova] Creating event network-changed:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h2-833090-19 Sep 08 11:30:23.255591 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-5a60db2b-1817-4d23-9847-6746c2c088f3 req-8b143910-cf3b-4cb3-a783-e73d5d0fa5ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038892 Sep 08 11:30:23.256608 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3700/7630] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:30:23.268743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:30:23.358628 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d68d1ec5-c395-46d3-a3ef-2ba31d2d700f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 204 len: 0 microversion: 2.1 time: 0.148023 Sep 08 11:30:23.359603 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3931/7631] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:30:23 2022] DELETE /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:30:23.369774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:23.370501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:23.376725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:23.377224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:23.378201 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:23.378912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:23.379379 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:23.379846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:23.521131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:23.529111 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-24cadaef-bee0-4aea-8e2a-901616f6c077 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1690 microversion: 2.1 time: 0.164890 Sep 08 11:30:23.529703 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3701/7632] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:23 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:24.554820 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:24.555547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:24.562429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:24.562919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:24.563361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:24.564184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:24.564641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:24.565112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:24.698789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:24.707318 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1ca47398-48a2-47e0-874a-438edd591000 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1690 microversion: 2.1 time: 0.157595 Sep 08 11:30:24.707930 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3932/7633] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:24 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:25.447206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-cee2552a-ed26-4b18-a9c5-42cc1fc7f82a req-d402db1e-3beb-4257-ab26-640ac7fa4b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213", "name": "network-vif-deleted", "tag": "3e5c6922-ba45-4dae-be13-c03ef950ebb9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:25.458655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cee2552a-ed26-4b18-a9c5-42cc1fc7f82a req-d402db1e-3beb-4257-ab26-640ac7fa4b32 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:25.459162 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cee2552a-ed26-4b18-a9c5-42cc1fc7f82a req-d402db1e-3beb-4257-ab26-640ac7fa4b32 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:25.459642 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-cee2552a-ed26-4b18-a9c5-42cc1fc7f82a req-d402db1e-3beb-4257-ab26-640ac7fa4b32 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:25.471580 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-cee2552a-ed26-4b18-a9c5-42cc1fc7f82a req-d402db1e-3beb-4257-ab26-640ac7fa4b32 service nova] Creating event network-vif-deleted:3e5c6922-ba45-4dae-be13-c03ef950ebb9 for instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 on n-h2-833090-19 Sep 08 11:30:25.477214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-cee2552a-ed26-4b18-a9c5-42cc1fc7f82a req-d402db1e-3beb-4257-ab26-640ac7fa4b32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033879 Sep 08 11:30:25.477830 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3702/7634] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:30:25.731985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:25.732612 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:25.740452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:25.740948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:25.741397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:25.742123 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:25.742582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:25.743015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:25.777260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:25.777751 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:25.778199 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:25.778655 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lazy-loading 'fault' on Instance uuid ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:30:25.825022 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:25.833453 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae125fd4-6226-49c8-a122-909a834dac6e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 200 len: 1356 microversion: 2.1 time: 0.105300 Sep 08 11:30:25.834050 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3933/7635] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:25 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:26.860688 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:26.861414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:26.867683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:26.868194 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:26.868649 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:26.869363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:26.869844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:26.870290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:26.883976 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] HTTP exception thrown: Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 could not be found. Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Request method failure captured: Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 HTTP/1.1 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGdDvQ4bOagPdxMXbvY9R87pvfe5zOnpmcJ6FKLSGrdAPtLTE4sOqTISDSdYt8nwAmX-GXRhRQQqqvKN0mD9yNMqNuMv9_uwMsVuQhC-0zcpRP0G7mEdN4Pq0vFOsyVhdcUCBP72f_PDTW7puEgzAF46EN5haIFuSkoWEmDOkialksTE Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_16028a298b3c4773b0b2b225a6955ed6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: dcd718e39efa44fe8b5541b58b71eb37 Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 could not be found. Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': 'ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213'} Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 could not be found. Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 could not be found. Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:30:26.885624 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 could not be found. Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Returning 404 to user: Instance ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-73f4b447-4667-4f64-b1dd-3fb71a3e513d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213" status: 404 len: 111 microversion: 2.1 time: 0.031662 Sep 08 11:30:26.890823 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3703/7636] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:26 2022] GET /compute/v2.1/servers/ecf35b5b-e4f7-4fb9-a193-dfd8e6b6a213 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:30:30.516527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4997415e-5eb1-4625-bf31-c1f626b32a8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '.version_select at 0x7f2350501af0>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:30.540786 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4997415e-5eb1-4625-bf31-c1f626b32a8b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1833237969" status: 202 len: 0 microversion: 2.1 time: 0.027879 Sep 08 11:30:30.541696 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3934/7637] 10.222.0.59 () {58 vars in 1284 bytes} [Thu Sep 8 11:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1833237969 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:30:30.568837 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8ea36bbe-fe2f-4858-9b5f-657b0dbbd16b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: .version_select at 0x7f23486ed940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1780624901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQT+D2aKt6oDPWXwEczeGawGjlBi8TLv9XEN1h2lwTQUXVOqIiNcmZ6vHSrpOWiemgE1MlzsLcVVjFGQ8L+6Jr9UkVWak7DEbDV3q1iA3lZqxpvOgAVmAaKkCzZwqdmIg=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:30.585868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8ea36bbe-fe2f-4858-9b5f-657b0dbbd16b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:30:30.591023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-8ea36bbe-fe2f-4858-9b5f-657b0dbbd16b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:30:30.615543 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8ea36bbe-fe2f-4858-9b5f-657b0dbbd16b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050702 Sep 08 11:30:30.616159 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3704/7638] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:30:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:30:36.064689 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1938536348", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "331b4c38-61c0-4b80-b102-1a71d3e37943"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1780624901", "security_groups": [{"name": "tempest-secgroup-smoke-503031625"}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:36.076896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:36.196366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] validate_networks() for [('331b4c38-61c0-4b80-b102-1a71d3e37943', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:30:36.927080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:30:36.927550 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:30:36.928074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:30:36.928493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:30:36.928916 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:30:36.938033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:36.938575 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:36.938967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:36.939745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:36.940320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:36.940763 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:36.959138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:30:36.964640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:30:36.978241 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:30:36.980611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:30:37.028829 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ec238b05-7acd-4a88-9950-bb2f4f4c8277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.968059 Sep 08 11:30:37.036276 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3935/7639] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:30:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:30:37.039505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:37.043841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-db44dfe4-5d89-45ed-a0cd-afd8aafcb412 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:37.044604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-db44dfe4-5d89-45ed-a0cd-afd8aafcb412 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:37.112520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-db44dfe4-5d89-45ed-a0cd-afd8aafcb412 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:37.122643 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-db44dfe4-5d89-45ed-a0cd-afd8aafcb412 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1267 microversion: 2.1 time: 0.084610 Sep 08 11:30:37.123274 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3705/7640] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:37 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:38.147083 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:38.148537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:38.165248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:38.165752 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:38.166275 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:38.167024 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:38.167749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:38.168193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:38.267249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:38.278254 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b111cd0a-df61-4edf-b9a5-bd53556adbe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1327 microversion: 2.1 time: 0.136087 Sep 08 11:30:38.279174 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3936/7641] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:38 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:39.304878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:39.305675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:39.319416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:39.320664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:39.321242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:39.322774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:39.323370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:39.324470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:39.481242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:39.491261 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a32ff89a-1d93-4586-90c0-81ad54909c7f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.190690 Sep 08 11:30:39.491938 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3706/7642] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:39 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:39.818182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-cd1e3c85-63b8-42a5-be10-04021c438bfc req-870e234b-789e-4dd3-8788-0726ff671ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f", "tag": "9b9744d8-2070-4d64-b48e-2cbc0bee9af9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:39.830389 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd1e3c85-63b8-42a5-be10-04021c438bfc req-870e234b-789e-4dd3-8788-0726ff671ec5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:39.830869 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd1e3c85-63b8-42a5-be10-04021c438bfc req-870e234b-789e-4dd3-8788-0726ff671ec5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:39.831344 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-cd1e3c85-63b8-42a5-be10-04021c438bfc req-870e234b-789e-4dd3-8788-0726ff671ec5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:39.846643 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-cd1e3c85-63b8-42a5-be10-04021c438bfc req-870e234b-789e-4dd3-8788-0726ff671ec5 service nova] Creating event network-changed:9b9744d8-2070-4d64-b48e-2cbc0bee9af9 for instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f on n-h1-833090-19 Sep 08 11:30:39.853184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-cd1e3c85-63b8-42a5-be10-04021c438bfc req-870e234b-789e-4dd3-8788-0726ff671ec5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039916 Sep 08 11:30:39.854328 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3937/7643] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:30:40.515954 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:40.516591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:40.524930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:40.525696 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:40.526161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:40.526908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:40.527386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:40.527871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:40.667373 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:40.675913 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ef4944a7-49b8-4b58-a5c3-0da0e5d02bcc tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.164021 Sep 08 11:30:40.676495 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3707/7644] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:40 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:41.701032 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:41.701727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:41.708519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:41.708996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:41.709429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:41.710125 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:41.710577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:41.711004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:41.857422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:41.865400 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-deef2b1e-c97a-4658-85fe-9ddb599d2716 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.169527 Sep 08 11:30:41.866026 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3938/7645] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:41 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:42.889105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:42.889766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:42.897340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:42.897908 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:42.898297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:42.899014 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:42.899507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:42.899986 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:43.029126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:43.037555 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6ac4f460-4773-4ff5-8081-547f0703dcc8 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.152446 Sep 08 11:30:43.038138 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3708/7646] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:42 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:44.062656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:44.064038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:44.070764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:44.071255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:44.071725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:44.072440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:44.072901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:44.073335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:44.211262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:44.219131 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6c76cff4-5257-44fa-9d0e-ef6b3e598f91 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.160289 Sep 08 11:30:44.228838 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3939/7647] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:44 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:45.242928 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:45.243682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:45.250386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:45.250894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:45.251353 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:45.252097 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:45.253242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:45.253691 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:45.387043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:45.394744 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62656f0c-43bb-4262-b7ff-960c501cd27d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.155862 Sep 08 11:30:45.395311 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3709/7648] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:45 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:45.832182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-eec96d87-6037-4539-bfbf-f3e2fe5a31ec req-19058e94-b6bc-4e79-b108-8e8b366fe723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f", "name": "network-vif-plugged", "status": "completed", "tag": "9b9744d8-2070-4d64-b48e-2cbc0bee9af9"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:45.843706 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eec96d87-6037-4539-bfbf-f3e2fe5a31ec req-19058e94-b6bc-4e79-b108-8e8b366fe723 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:45.844225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eec96d87-6037-4539-bfbf-f3e2fe5a31ec req-19058e94-b6bc-4e79-b108-8e8b366fe723 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:45.844631 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-eec96d87-6037-4539-bfbf-f3e2fe5a31ec req-19058e94-b6bc-4e79-b108-8e8b366fe723 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:45.856817 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-eec96d87-6037-4539-bfbf-f3e2fe5a31ec req-19058e94-b6bc-4e79-b108-8e8b366fe723 service nova] Creating event network-vif-plugged:9b9744d8-2070-4d64-b48e-2cbc0bee9af9 for instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f on n-h1-833090-19 Sep 08 11:30:45.862723 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-eec96d87-6037-4539-bfbf-f3e2fe5a31ec req-19058e94-b6bc-4e79-b108-8e8b366fe723 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Sep 08 11:30:45.863370 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3940/7649] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:30:46.418153 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:46.418774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:46.425775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:46.426274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:46.426730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:46.427430 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:46.427920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:46.428360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:46.559969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:46.568240 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-52e85d11-b191-4de8-9c95-b0d35270d6cd tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1392 microversion: 2.1 time: 0.154009 Sep 08 11:30:46.568811 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3710/7650] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:46 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:47.590860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:47.591657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:47.596055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:47.596789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:47.605223 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:47.605712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:47.606159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:47.606862 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:47.607325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:47.607787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:47.748334 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:47.756588 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a6301e2d-b102-4b52-90ae-d1342a5f8c5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1564 microversion: 2.1 time: 0.168059 Sep 08 11:30:47.757154 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3941/7651] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:47 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:47.776531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:30:47.781541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:47.782169 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:47.788404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:47.788896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:47.789352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:47.790165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:47.790699 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:47.791138 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:47.930060 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:47.937819 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-acd8922b-1ef8-4873-828c-d78ab755ffee tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1564 microversion: 2.1 time: 0.162163 Sep 08 11:30:47.938389 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3711/7652] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:47 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:30:49.561603 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:30:49.562466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:30:49.563889 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-442b320f-f2f1-4f1b-bdb2-8e4c755fc937 req-64cddf7e-b556-4803-b353-022397f7d8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f", "tag": "9b9744d8-2070-4d64-b48e-2cbc0bee9af9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:30:49.570105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:49.570857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:49.571607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:49.572429 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:49.574454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:49.575140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:49.576386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-442b320f-f2f1-4f1b-bdb2-8e4c755fc937 req-64cddf7e-b556-4803-b353-022397f7d8bd service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:30:49.576884 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-442b320f-f2f1-4f1b-bdb2-8e4c755fc937 req-64cddf7e-b556-4803-b353-022397f7d8bd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:30:49.578083 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-442b320f-f2f1-4f1b-bdb2-8e4c755fc937 req-64cddf7e-b556-4803-b353-022397f7d8bd service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:30:49.597817 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-442b320f-f2f1-4f1b-bdb2-8e4c755fc937 req-64cddf7e-b556-4803-b353-022397f7d8bd service nova] Creating event network-changed:9b9744d8-2070-4d64-b48e-2cbc0bee9af9 for instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f on n-h1-833090-19 Sep 08 11:30:49.603866 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-442b320f-f2f1-4f1b-bdb2-8e4c755fc937 req-64cddf7e-b556-4803-b353-022397f7d8bd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043655 Sep 08 11:30:49.604741 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3712/7653] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:30:49.742170 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:30:49.751430 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-38e4c173-9eb8-4a4e-85b1-a121bf8c64eb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1564 microversion: 2.1 time: 0.193971 Sep 08 11:30:49.752238 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3942/7654] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:30:49 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:10.992501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:10.993262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=38 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:10.998249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:11.000913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:11.008392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:11.008898 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:11.009356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:11.010087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:11.010557 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:11.011000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:11.069993 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d45524e1-93d6-4a15-9bee-e30df4cd0c8e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action" status: 200 len: 24561 microversion: 2.1 time: 0.079350 Sep 08 11:31:11.070675 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3713/7655] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:31:10 2022] POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action => generated 24561 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:31:17.406465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f621e059-a0fc-47c8-a0a9-c50ba8e25d6b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:17.409111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:17.409778 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:17.416713 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f621e059-a0fc-47c8-a0a9-c50ba8e25d6b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:17.417202 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f621e059-a0fc-47c8-a0a9-c50ba8e25d6b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:17.417646 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f621e059-a0fc-47c8-a0a9-c50ba8e25d6b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:17.441849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f621e059-a0fc-47c8-a0a9-c50ba8e25d6b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Going to try to stop instance {{(pid=122457) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 11:31:17.483885 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f621e059-a0fc-47c8-a0a9-c50ba8e25d6b tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action" status: 202 len: 0 microversion: 2.1 time: 0.081201 Sep 08 11:31:17.484510 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3943/7656] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:31:17 2022] POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:31:17.493525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:17.494919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:17.502617 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:17.503206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:17.504449 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:17.505249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:17.505775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:17.506236 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:17.642399 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:17.650426 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fb1d7472-0b43-4e81-9b3e-ed6e7ccb9275 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.161309 Sep 08 11:31:17.651001 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3714/7657] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:17 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:18.675602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:18.676336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:18.682538 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:18.683019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:18.683484 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:18.684183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:18.684637 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:18.685066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:18.818191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:18.826664 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-faace02f-f5bf-416f-891e-f8f6aebcf4e2 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.156267 Sep 08 11:31:18.827257 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3944/7658] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:18 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:31:19.852746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:19.853472 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:19.861015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:19.861516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:19.861967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:19.862681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:19.863150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:19.863622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:20.004335 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:20.012689 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f15e0106-7122-48d6-9706-78db09963063 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.164227 Sep 08 11:31:20.013265 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3715/7659] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:19 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:21.036953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:21.037619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:21.044824 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:21.045327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:21.045767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:21.046482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:21.046947 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:21.047380 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:21.188755 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:21.196763 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a77febab-ac32-4c3d-a095-de4bb748c31f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.164076 Sep 08 11:31:21.197354 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3945/7660] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:21 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:31:22.220591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:22.221226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:22.228584 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:22.229605 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:22.230087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:22.230800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:22.231267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:22.231746 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:22.365700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:22.374235 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1b84df8e-ac85-4421-8662-41fa3ae9c406 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.157636 Sep 08 11:31:22.374820 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3716/7661] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:22 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:23.398886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:23.399481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:23.406203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:23.406682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:23.407119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:23.407841 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:23.408293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:23.408718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:23.539836 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:23.547822 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b58c5fc-de4a-4d8c-8922-23e909d949f4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.153158 Sep 08 11:31:23.548587 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3946/7662] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:23 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:24.571340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:24.572004 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:24.579425 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:24.580195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:24.580389 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:24.581102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:24.581567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:24.582006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:24.714251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:24.722408 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5d05bc21-49f9-4c37-b2ad-46126bf52945 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.154944 Sep 08 11:31:24.723000 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3717/7663] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:24 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:25.746106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:25.746724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:25.753690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:25.754182 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:25.754619 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:25.755318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:25.755807 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:25.756240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:25.899036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:25.907033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-83f3404a-a3a1-4a86-8617-695bfee0719f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.165311 Sep 08 11:31:25.919737 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3947/7664] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:25 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:26.931796 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:26.932431 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:26.939363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:26.939888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:26.940345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:26.941046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:26.941511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:26.941951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:27.074620 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:27.082781 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f0f1e5ec-e1d0-4913-92b0-67adc28353af tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1693 microversion: 2.1 time: 0.154898 Sep 08 11:31:27.083361 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3718/7665] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:26 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:28.106758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:28.107378 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:28.114435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:28.114928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:28.115374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:28.116108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:28.116577 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:28.117009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:28.258075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:28.266704 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-014ba015-ad7d-439f-9a3a-586e0f12e869 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1670 microversion: 2.1 time: 0.164369 Sep 08 11:31:28.267291 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3948/7666] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:28 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:29.362095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:29.364252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:29.371062 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:29.371591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:29.372041 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:29.372743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:29.373208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:29.373644 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:29.427164 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-68a887f4-67f9-474a-91f8-f54240a7eca4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action" status: 200 len: 35124 microversion: 2.1 time: 0.068870 Sep 08 11:31:29.427870 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3719/7667] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:31:29 2022] POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action => generated 35124 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:31:29.439981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0dd2649e-d9c0-449b-bd00-a60e07232339 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:29.446918 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dd2649e-d9c0-449b-bd00-a60e07232339 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:29.447407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dd2649e-d9c0-449b-bd00-a60e07232339 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:29.447890 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0dd2649e-d9c0-449b-bd00-a60e07232339 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:29.470337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0dd2649e-d9c0-449b-bd00-a60e07232339 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Going to try to start instance {{(pid=122457) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 11:31:29.513801 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0dd2649e-d9c0-449b-bd00-a60e07232339 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action" status: 202 len: 0 microversion: 2.1 time: 0.077549 Sep 08 11:31:29.514334 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3949/7668] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:31:29 2022] POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:31:29.524043 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:29.524762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:29.532789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:29.533307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:29.533769 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:29.534471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:29.534935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:29.535381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:29.687274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:29.695361 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cc19959-54ba-4368-b183-d4be2403bc99 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1679 microversion: 2.1 time: 0.176285 Sep 08 11:31:29.696161 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3720/7669] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:29 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:30.722006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:31:30.722610 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:30.729020 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:30.730101 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:30.730535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:30.731225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:30.731701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:30.732132 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:30.875112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:31:30.884048 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-42a7b12c-b248-43e1-afb8-6e465393cc06 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1683 microversion: 2.1 time: 0.167128 Sep 08 11:31:30.884653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3950/7670] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:31:30 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:31:55.085503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:31:55.087828 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:31:55.090482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=16 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:55.091171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=44 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:31:55.092479 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:31:55.092648 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action (ip 10.222.0.59) !!! Sep 08 11:31:55.104445 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:55.104981 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:55.105461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:55.106178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:31:55.106658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:31:55.107637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:31:55.163535 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9440d6d2-9120-4ec6-909a-843a83e93279 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action" status: 200 len: 59681 microversion: 2.1 time: 0.081879 Sep 08 11:31:55.165279 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3721/7671] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:31:55 2022] POST /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f/action => generated 59681 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:32:02.182530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:02.183175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:02.185823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-af6cbf2a-a840-417b-83b3-5b6c0ff13ebe req-fb8b2104-ba82-4d45-8179-db80586ea1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f", "tag": "9b9744d8-2070-4d64-b48e-2cbc0bee9af9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:02.189883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=16 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:02.190990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:02.192711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:02.193650 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:02.193812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:02.194498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:02.195139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:02.195597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:02.201356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-af6cbf2a-a840-417b-83b3-5b6c0ff13ebe req-fb8b2104-ba82-4d45-8179-db80586ea1f9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:02.202024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-af6cbf2a-a840-417b-83b3-5b6c0ff13ebe req-fb8b2104-ba82-4d45-8179-db80586ea1f9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:02.202573 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-af6cbf2a-a840-417b-83b3-5b6c0ff13ebe req-fb8b2104-ba82-4d45-8179-db80586ea1f9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:02.215498 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-af6cbf2a-a840-417b-83b3-5b6c0ff13ebe req-fb8b2104-ba82-4d45-8179-db80586ea1f9 service nova] Creating event network-changed:9b9744d8-2070-4d64-b48e-2cbc0bee9af9 for instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f on n-h1-833090-19 Sep 08 11:32:02.220957 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-af6cbf2a-a840-417b-83b3-5b6c0ff13ebe req-fb8b2104-ba82-4d45-8179-db80586ea1f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039786 Sep 08 11:32:02.222159 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3722/7672] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:32:02.225961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:32:02.322709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-bf6a53cc-b282-4036-a45c-f83b79725d5f tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 204 len: 0 microversion: 2.1 time: 0.143567 Sep 08 11:32:02.327145 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3951/7673] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:32:02 2022] DELETE /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:32:02.333492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:02.334279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:02.341208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:02.341894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:02.342354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:02.343093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:02.343612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:02.344063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:02.494127 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:02.502947 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bad4565d-fe7e-4ad4-ae20-b34de5e72f43 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1689 microversion: 2.1 time: 0.173970 Sep 08 11:32:02.503553 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3723/7674] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:02 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:03.527488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:03.529382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:03.536373 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:03.536858 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:03.537296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:03.538006 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:03.538456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:03.538884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:03.676894 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:03.685428 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ad15bdb4-6ccf-4723-ab5c-ed862a1de445 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 200 len: 1689 microversion: 2.1 time: 0.161779 Sep 08 11:32:03.686018 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3952/7675] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:03 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:04.235087 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-eb1b7c07-ed16-46bd-bbfc-c6d0efb41406 req-2b24c194-6e44-4d37-9803-6b8bf59a9c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f", "name": "network-vif-deleted", "tag": "9b9744d8-2070-4d64-b48e-2cbc0bee9af9"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:04.245567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eb1b7c07-ed16-46bd-bbfc-c6d0efb41406 req-2b24c194-6e44-4d37-9803-6b8bf59a9c72 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:04.246077 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eb1b7c07-ed16-46bd-bbfc-c6d0efb41406 req-2b24c194-6e44-4d37-9803-6b8bf59a9c72 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:04.246527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-eb1b7c07-ed16-46bd-bbfc-c6d0efb41406 req-2b24c194-6e44-4d37-9803-6b8bf59a9c72 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:04.258639 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-eb1b7c07-ed16-46bd-bbfc-c6d0efb41406 req-2b24c194-6e44-4d37-9803-6b8bf59a9c72 service nova] Creating event network-vif-deleted:9b9744d8-2070-4d64-b48e-2cbc0bee9af9 for instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f on n-h1-833090-19 Sep 08 11:32:04.263554 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-eb1b7c07-ed16-46bd-bbfc-c6d0efb41406 req-2b24c194-6e44-4d37-9803-6b8bf59a9c72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Sep 08 11:32:04.264164 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3724/7676] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:32:04.710456 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:04.711237 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:04.718293 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:04.718788 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:04.719234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:04.719974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:04.720431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:04.720863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:04.735425 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] HTTP exception thrown: Instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f could not be found. Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Request method failure captured: Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f HTTP/1.1 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGdDvQ4bOagPdxMXbvY9R87pvfe5zOnpmcJ6FKLSGrdAPtLTE4sOqTISDSdYt8nwAmX-GXRhRQQqqvKN0mD9yNMqNuMv9_uwMsVuQhC-0zcpRP0G7mEdN4Pq0vFOsyVhdcUCBP72f_PDTW7puEgzAF46EN5haIFuSkoWEmDOkialksTE Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_16028a298b3c4773b0b2b225a6955ed6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dcd718e39efa44fe8b5541b58b71eb37 Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f could not be found. Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f'} Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f could not be found. Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f could not be found. Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:32:04.737240 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f could not be found. Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Returning 404 to user: Instance 5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4a2f8bc0-bd5a-4d19-a466-b4669e937c3a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f" status: 404 len: 111 microversion: 2.1 time: 0.032341 Sep 08 11:32:04.742214 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3953/7677] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:04 2022] GET /compute/v2.1/servers/5fd15a4f-8c6d-4dfc-8aec-577fa59ed00f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:32:08.074115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e68f18d-e20c-46f8-8370-95ff4696d5cb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '.version_select at 0x7f2348686940>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:08.098156 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e68f18d-e20c-46f8-8370-95ff4696d5cb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1780624901" status: 202 len: 0 microversion: 2.1 time: 0.029487 Sep 08 11:32:08.098828 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3725/7678] 10.222.0.59 () {58 vars in 1284 bytes} [Thu Sep 8 11:32:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1780624901 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:32:08.131366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d3e00449-f011-4dd6-bfd7-a2ca6d8f0ed4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: .version_select at 0x7f23504bd1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1352847194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNipQHxh0Xf7XFHxmxk9/mCW27cLuLElR1oVPUWx7ABOgKHAixupVbOuTEbhpBL6+u0izcOQiQbY0ojA/oNzHuWz8fJuAMRdJkug3+S26rqiHS3afC51RN85n8TRiWfGYw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:08.147865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d3e00449-f011-4dd6-bfd7-a2ca6d8f0ed4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:32:08.154549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-d3e00449-f011-4dd6-bfd7-a2ca6d8f0ed4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:32:08.179200 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d3e00449-f011-4dd6-bfd7-a2ca6d8f0ed4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051687 Sep 08 11:32:08.179866 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3954/7679] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:32:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:32:13.906241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-642721348", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "networks": [{"uuid": "b7887d67-3d06-493e-ac2d-6cada9b0954c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1352847194", "security_groups": [{"name": "tempest-secgroup-smoke-1486672842"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:14.157534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] validate_networks() for [('b7887d67-3d06-493e-ac2d-6cada9b0954c', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:32:14.256102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=14 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:14.594896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:32:14.595822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:32:14.596516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:32:14.596988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:32:14.597554 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:32:14.609045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:14.610209 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:14.610931 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:14.613464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:14.614249 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:14.614947 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:14.641093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:32:14.656279 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Getting quotas for user dcd718e39efa44fe8b5541b58b71eb37 and project 16028a298b3c4773b0b2b225a6955ed6. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:32:14.675500 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:32:14.677868 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:32:14.745340 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5a6a1268-9142-48d9-8555-1ad4b885bc77 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844417 Sep 08 11:32:14.746133 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3726/7680] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:32:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:32:14.755857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:14.759964 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eac7582c-7af4-457f-8813-3bfdf8f2620a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:14.760582 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eac7582c-7af4-457f-8813-3bfdf8f2620a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:14.988317 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eac7582c-7af4-457f-8813-3bfdf8f2620a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:14.995831 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eac7582c-7af4-457f-8813-3bfdf8f2620a tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1266 microversion: 2.1 time: 0.241742 Sep 08 11:32:15.008017 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3955/7681] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:14 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:32:16.024548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:16.026738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:16.037709 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:16.038477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:16.039137 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:16.040096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:16.041476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:16.042102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:16.151355 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:16.162124 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6151723b-1273-4c4f-99cc-be64b463922d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1326 microversion: 2.1 time: 0.143355 Sep 08 11:32:16.162738 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3727/7682] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:16 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:17.185898 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:17.186517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:17.204423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:17.206015 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:17.208034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:17.209363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:17.210061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:17.226409 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:17.466242 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:17.474639 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-322db588-efa6-4939-8dce-0bba5138b277 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.292888 Sep 08 11:32:17.475653 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3956/7683] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:17 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:18.050806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-d48c40bd-c87e-4056-b920-9c20ca024dd1 req-7c7eff75-ac22-4945-826b-1d2ed9cd0292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849c401e-a081-4656-b768-3d1e16a20efa", "tag": "28a6ee1e-b79b-4926-91f4-3949e22876c4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:18.064443 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d48c40bd-c87e-4056-b920-9c20ca024dd1 req-7c7eff75-ac22-4945-826b-1d2ed9cd0292 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:18.065241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d48c40bd-c87e-4056-b920-9c20ca024dd1 req-7c7eff75-ac22-4945-826b-1d2ed9cd0292 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:18.065692 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-d48c40bd-c87e-4056-b920-9c20ca024dd1 req-7c7eff75-ac22-4945-826b-1d2ed9cd0292 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:18.077511 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-d48c40bd-c87e-4056-b920-9c20ca024dd1 req-7c7eff75-ac22-4945-826b-1d2ed9cd0292 service nova] Creating event network-changed:28a6ee1e-b79b-4926-91f4-3949e22876c4 for instance 849c401e-a081-4656-b768-3d1e16a20efa on n-h2-833090-19 Sep 08 11:32:18.082756 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-d48c40bd-c87e-4056-b920-9c20ca024dd1 req-7c7eff75-ac22-4945-826b-1d2ed9cd0292 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036299 Sep 08 11:32:18.083809 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3728/7684] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:32:18.498178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:18.498796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:18.506860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:18.507536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:18.508050 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:18.508842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:18.509579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:18.510068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:18.643285 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:18.651155 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ccb931b6-e859-44b3-b69b-4066ddbe1c22 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.156903 Sep 08 11:32:18.651765 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3957/7685] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:18 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:19.675673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:19.676390 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:19.682546 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:19.683047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:19.683523 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:19.684227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:19.684695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:19.685130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:19.824711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:19.832566 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ee6a9c9a-f6de-48ca-821a-2883fc353607 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.162026 Sep 08 11:32:19.833146 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3729/7686] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:19 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:20.863295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:20.864981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:20.877653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:20.878521 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:20.879106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:20.880406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:20.881262 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:20.882107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:21.154794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:21.162779 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ed30eb22-fe39-49f4-8450-7144acef0aa6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.307159 Sep 08 11:32:21.163727 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3958/7687] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:20 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:22.188548 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:22.189710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:22.197424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:22.197927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:22.198382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:22.199115 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:22.199632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:22.200073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:22.334321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:22.342686 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-08e91bad-efce-463d-a7a3-baf4a3d88873 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.158242 Sep 08 11:32:22.343261 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3730/7688] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:22 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:23.366527 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:23.367060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:23.374069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:23.374553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:23.374989 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:23.375707 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:23.376153 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:23.376579 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:23.515192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:23.522975 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d5c0e876-bba2-46f2-972a-6ce430a61db3 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.160618 Sep 08 11:32:23.523584 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3959/7689] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:23 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:23.704820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-7208a277-e2b8-4b95-933f-8f81a9a86a03 req-f8933640-bc4c-408e-b7d3-c547ca46c7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849c401e-a081-4656-b768-3d1e16a20efa", "name": "network-vif-plugged", "status": "completed", "tag": "28a6ee1e-b79b-4926-91f4-3949e22876c4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:23.717469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7208a277-e2b8-4b95-933f-8f81a9a86a03 req-f8933640-bc4c-408e-b7d3-c547ca46c7f5 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:23.717990 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7208a277-e2b8-4b95-933f-8f81a9a86a03 req-f8933640-bc4c-408e-b7d3-c547ca46c7f5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:23.718448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-7208a277-e2b8-4b95-933f-8f81a9a86a03 req-f8933640-bc4c-408e-b7d3-c547ca46c7f5 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:23.730880 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-7208a277-e2b8-4b95-933f-8f81a9a86a03 req-f8933640-bc4c-408e-b7d3-c547ca46c7f5 service nova] Creating event network-vif-plugged:28a6ee1e-b79b-4926-91f4-3949e22876c4 for instance 849c401e-a081-4656-b768-3d1e16a20efa on n-h2-833090-19 Sep 08 11:32:23.736227 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-7208a277-e2b8-4b95-933f-8f81a9a86a03 req-f8933640-bc4c-408e-b7d3-c547ca46c7f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035723 Sep 08 11:32:23.737211 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3731/7690] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:32:24.547598 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:24.548255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:24.555143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:24.555660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:24.556111 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:24.556814 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:24.557282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:24.557808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:24.697159 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:24.705345 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97018e84-f46f-4f64-8107-62c4ed6ec65d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1392 microversion: 2.1 time: 0.161734 Sep 08 11:32:24.705937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3960/7691] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:24 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:25.732757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:25.733502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:25.735489 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:25.736183 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:25.737863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:25.744580 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:25.745082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:25.745536 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:25.746269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:25.746739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:25.747207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:25.888533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:25.897154 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a6daa170-b4e6-407b-849c-799c00d6d0c4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1564 microversion: 2.1 time: 0.168649 Sep 08 11:32:25.897785 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3732/7692] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:25 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:25.920055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:25.920671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:25.922613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:32:25.928871 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:25.929366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:25.929850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:25.930563 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:25.931023 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:25.931478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:26.066266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:26.074202 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-833a9a81-eb0d-47e5-9d2a-150a8a3a4895 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1564 microversion: 2.1 time: 0.158186 Sep 08 11:32:26.074787 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3961/7693] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:25 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:32:27.727122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:32:27.728398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:32:27.730781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-831611bb-1557-4b2a-a63d-527509be91c7 req-82c95459-d8e6-4835-91b9-b53b97cec649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849c401e-a081-4656-b768-3d1e16a20efa", "tag": "28a6ee1e-b79b-4926-91f4-3949e22876c4"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:32:27.742789 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:27.743613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:27.745950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:27.746192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-831611bb-1557-4b2a-a63d-527509be91c7 req-82c95459-d8e6-4835-91b9-b53b97cec649 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:27.746736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:32:27.746860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-831611bb-1557-4b2a-a63d-527509be91c7 req-82c95459-d8e6-4835-91b9-b53b97cec649 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:27.747841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:32:27.748021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-831611bb-1557-4b2a-a63d-527509be91c7 req-82c95459-d8e6-4835-91b9-b53b97cec649 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:27.748751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:32:27.760096 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-831611bb-1557-4b2a-a63d-527509be91c7 req-82c95459-d8e6-4835-91b9-b53b97cec649 service nova] Creating event network-changed:28a6ee1e-b79b-4926-91f4-3949e22876c4 for instance 849c401e-a081-4656-b768-3d1e16a20efa on n-h2-833090-19 Sep 08 11:32:27.765409 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-831611bb-1557-4b2a-a63d-527509be91c7 req-82c95459-d8e6-4835-91b9-b53b97cec649 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038336 Sep 08 11:32:27.766502 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3962/7694] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:32:27.990452 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:32:27.999504 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-674df510-3304-4a63-944a-037be35d89b5 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1564 microversion: 2.1 time: 0.276681 Sep 08 11:32:28.000101 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3733/7695] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:32:27 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1564 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:01.303112 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:01.305638 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:01.308004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:01.309009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=38 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:01.316750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:01.317243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:01.317952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:01.318773 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:01.319232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:01.319693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:01.395527 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2b20ae44-bedb-401d-ba1f-fdc892963b0d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action" status: 200 len: 24574 microversion: 2.1 time: 0.096657 Sep 08 11:33:01.396188 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3963/7696] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:33:01 2022] POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action => generated 24574 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:33:31.838370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:31.839224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=36 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:31.843485 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:31.844150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:31.851063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:31.851596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:31.852314 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:31.853033 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:31.853512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:31.853967 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:31.877327 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lazy-loading 'flavor' on Instance uuid 849c401e-a081-4656-b768-3d1e16a20efa {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:33:31.949405 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e288829a-e9bf-4b92-b52e-720dda4f1148 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action" status: 202 len: 0 microversion: 2.1 time: 0.112561 Sep 08 11:33:31.950103 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3734/7697] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:33:31 2022] POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:33:31.960651 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:31.961340 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:31.964066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:31.964717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=4 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:31.970963 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:31.971511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:31.971991 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:31.972708 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:31.973160 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:31.973587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:32.110704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:32.119297 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2cadd46f-861c-49f7-9c8c-c281c4feead9 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1690 microversion: 2.1 time: 0.164519 Sep 08 11:33:32.119893 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3964/7698] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:31 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:33:33.146070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:33.146710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:33.153000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:33.153504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:33.153964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:33.154680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:33.155152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:33.155627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:33.289184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:33.297035 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7e7b71c2-d193-4c16-bbce-8b9a3bd11215 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1690 microversion: 2.1 time: 0.157341 Sep 08 11:33:33.297606 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3735/7699] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:33 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:34.322597 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:34.323139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:34.331914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:34.332410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:34.332856 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:34.333559 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:34.334017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:34.334449 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:34.483095 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:34.491005 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d08d0db8-cce9-48e7-a24d-a85c85303fe4 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1673 microversion: 2.1 time: 0.172515 Sep 08 11:33:34.491622 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3965/7700] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:34 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:35.586827 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:35.589009 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:35.597547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:35.598069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:35.598531 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:35.599307 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:35.599816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:35.600269 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:35.667635 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-966b4920-5b57-480e-b4bd-85bb3264411d tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action" status: 200 len: 35484 microversion: 2.1 time: 0.084597 Sep 08 11:33:35.668588 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3736/7701] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:33:35 2022] POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action => generated 35484 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:33:35.680154 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:35.680678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:35.687553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:35.688048 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:35.688492 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:35.689240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:35.689674 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:35.690107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:35.758926 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-75a21064-d2ac-4a76-b42a-f1f36958da5e tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action" status: 202 len: 0 microversion: 2.1 time: 0.082458 Sep 08 11:33:35.760104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3966/7702] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:33:35 2022] POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:33:35.769367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:35.770118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:35.777286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:35.777820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:35.778246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:35.778961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:35.779569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:35.779995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:35.994690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:36.002606 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4e2c00d2-8ce0-459f-b264-e856a3c43bfb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1679 microversion: 2.1 time: 0.238018 Sep 08 11:33:36.003803 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3737/7703] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:35 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:37.028019 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:37.028726 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:37.035922 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:37.036413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:37.036859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:37.037565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:37.038028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:37.038464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:37.172729 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:37.181033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-3084d0cb-a08e-4308-a9f3-c5451554b5a6 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1679 microversion: 2.1 time: 0.157335 Sep 08 11:33:37.181612 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3967/7704] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:37 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:38.204558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:38.205196 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:38.212081 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:38.212591 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:38.213056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:38.213772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:38.214247 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:38.214695 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:38.353348 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:38.361186 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-27bdd28f-4d5e-47c5-b3ed-e5a0194d0959 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1682 microversion: 2.1 time: 0.160625 Sep 08 11:33:38.361780 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3738/7705] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:38 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:38.457495 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:38.459688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:38.467099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:38.467606 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:38.468168 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:38.468917 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:38.469435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:38.469874 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:38.546967 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-23949bc2-454b-43b8-ab67-d57becbb2f3c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action" status: 200 len: 35484 microversion: 2.1 time: 0.093879 Sep 08 11:33:38.547663 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3968/7706] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:33:38 2022] POST /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa/action => generated 35484 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 11:33:39.563099 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:39.563660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:39.570971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:39.571503 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:39.571956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:39.572675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:39.573146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:39.573586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:39.606070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:33:39.647158 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-947bdb50-ff8d-46c2-8db4-b7abbf75706c req-e76cb467-75b3-4617-9107-9be70944dabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849c401e-a081-4656-b768-3d1e16a20efa", "tag": "28a6ee1e-b79b-4926-91f4-3949e22876c4"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:39.661461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-947bdb50-ff8d-46c2-8db4-b7abbf75706c req-e76cb467-75b3-4617-9107-9be70944dabf service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:39.662110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-947bdb50-ff8d-46c2-8db4-b7abbf75706c req-e76cb467-75b3-4617-9107-9be70944dabf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:39.662680 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-947bdb50-ff8d-46c2-8db4-b7abbf75706c req-e76cb467-75b3-4617-9107-9be70944dabf service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:39.675995 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-947bdb50-ff8d-46c2-8db4-b7abbf75706c req-e76cb467-75b3-4617-9107-9be70944dabf service nova] Creating event network-changed:28a6ee1e-b79b-4926-91f4-3949e22876c4 for instance 849c401e-a081-4656-b768-3d1e16a20efa on n-h2-833090-19 Sep 08 11:33:39.680924 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-947bdb50-ff8d-46c2-8db4-b7abbf75706c req-e76cb467-75b3-4617-9107-9be70944dabf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118382 Sep 08 11:33:39.681877 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3969/7707] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:33:39.693610 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-d3285168-88d5-4994-bdca-b2aeb054f8fa tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 204 len: 0 microversion: 2.1 time: 0.134070 Sep 08 11:33:39.694967 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3739/7708] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:33:39 2022] DELETE /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:33:39.704382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:39.705094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:39.711382 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:39.711913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:39.712360 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:39.713069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:39.713533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:39.713967 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:39.855950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:39.865003 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fba20267-b4cd-4242-9651-ff8bc153cceb tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1688 microversion: 2.1 time: 0.165423 Sep 08 11:33:39.865700 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3970/7709] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:39 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:40.891668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:40.892312 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:40.899618 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:40.900134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:40.900594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:40.901339 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:40.901816 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:40.902266 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:41.050996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:41.060537 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-f7d835b6-eedb-4317-bb6f-42852765c0d7 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1688 microversion: 2.1 time: 0.173253 Sep 08 11:33:41.061497 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3740/7710] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:40 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:33:42.086070 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:42.086943 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:42.095497 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:42.095997 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:42.096448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:42.097178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:42.097643 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:42.098078 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:42.309091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd718e39efa44fe8b5541b58b71eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16028a298b3c4773b0b2b225a6955ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:33:42.318781 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-5cee1adf-7676-437a-b0f5-b8b39936702c tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 200 len: 1570 microversion: 2.1 time: 0.237483 Sep 08 11:33:42.319367 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3971/7711] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:42 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:33:42.389646 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-141f93e5-cc13-4821-8306-5101aaa2a87a req-c4a6ef72-695b-4f41-8c00-4c210afc7d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849c401e-a081-4656-b768-3d1e16a20efa", "name": "network-vif-deleted", "tag": "28a6ee1e-b79b-4926-91f4-3949e22876c4"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:42.400212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-141f93e5-cc13-4821-8306-5101aaa2a87a req-c4a6ef72-695b-4f41-8c00-4c210afc7d40 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:42.400711 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-141f93e5-cc13-4821-8306-5101aaa2a87a req-c4a6ef72-695b-4f41-8c00-4c210afc7d40 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:42.401161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-141f93e5-cc13-4821-8306-5101aaa2a87a req-c4a6ef72-695b-4f41-8c00-4c210afc7d40 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:42.412871 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-141f93e5-cc13-4821-8306-5101aaa2a87a req-c4a6ef72-695b-4f41-8c00-4c210afc7d40 service nova] Creating event network-vif-deleted:28a6ee1e-b79b-4926-91f4-3949e22876c4 for instance 849c401e-a081-4656-b768-3d1e16a20efa on n-h2-833090-19 Sep 08 11:33:42.418132 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-141f93e5-cc13-4821-8306-5101aaa2a87a req-c4a6ef72-695b-4f41-8c00-4c210afc7d40 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Sep 08 11:33:42.418792 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3741/7712] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:33:43.342363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:43.342961 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] [instance: 849c401e-a081-4656-b768-3d1e16a20efa] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:33:43.349971 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:43.350466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:43.350914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:43.351658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:33:43.352384 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:33:43.352819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:33:43.366326 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] HTTP exception thrown: Instance 849c401e-a081-4656-b768-3d1e16a20efa could not be found. Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Request method failure captured: Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa HTTP/1.1 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGdDvQ4bOagPdxMXbvY9R87pvfe5zOnpmcJ6FKLSGrdAPtLTE4sOqTISDSdYt8nwAmX-GXRhRQQqqvKN0mD9yNMqNuMv9_uwMsVuQhC-0zcpRP0G7mEdN4Pq0vFOsyVhdcUCBP72f_PDTW7puEgzAF46EN5haIFuSkoWEmDOkialksTE Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/16028a298b3c4773b0b2b225a6955ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_16028a298b3c4773b0b2b225a6955ed6", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 16028a298b3c4773b0b2b225a6955ed6 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1554673860 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: dcd718e39efa44fe8b5541b58b71eb37 Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1554673860-project Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 849c401e-a081-4656-b768-3d1e16a20efa could not be found. Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '849c401e-a081-4656-b768-3d1e16a20efa'} Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849c401e-a081-4656-b768-3d1e16a20efa could not be found. Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849c401e-a081-4656-b768-3d1e16a20efa could not be found. Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:33:43.368080 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849c401e-a081-4656-b768-3d1e16a20efa could not be found. Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Returning 404 to user: Instance 849c401e-a081-4656-b768-3d1e16a20efa could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2bc8812e-a1f8-4cdb-a6ce-0d3474b92361 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa" status: 404 len: 111 microversion: 2.1 time: 0.031189 Sep 08 11:33:43.372892 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3972/7713] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:33:43 2022] GET /compute/v2.1/servers/849c401e-a081-4656-b768-3d1e16a20efa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:33:46.688471 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-033dd9da-2e81-4816-b3af-580beaa41a82 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] Calling method '.version_select at 0x7f234bfaa1f0>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:33:46.712045 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-033dd9da-2e81-4816-b3af-580beaa41a82 tempest-TestNetworkAdvancedServerOps-1554673860 tempest-TestNetworkAdvancedServerOps-1554673860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1352847194" status: 202 len: 0 microversion: 2.1 time: 0.029321 Sep 08 11:33:46.713031 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3742/7714] 10.222.0.59 () {58 vars in 1284 bytes} [Thu Sep 8 11:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1352847194 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:33:58.234661 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=18 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:58.235434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:58.406695 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-905d6747-5c1e-42d6-a2f4-fd1ef1e5baf3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'create', calling method: .version_select at 0x7f2350527430>, body: {"keypair": {"name": "tempest-TestShelveInstance-72532793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp1M5svHtQJoxLejy7+BWHWOWeUMXDtedQySPxzrqskmWRZDQ+wM8HHCkRRA2tTbbyqjqnzRh97puewrRlIUDp47dckmL+EkDWnbdCq9WGPj+u+G2EweaMFQxjzoat8wQ=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:58.424536 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-905d6747-5c1e-42d6-a2f4-fd1ef1e5baf3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:33:58.434924 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-905d6747-5c1e-42d6-a2f4-fd1ef1e5baf3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for user 89dc8bfafafd48139fc0f6233c90e98c and project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:33:58.463617 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-905d6747-5c1e-42d6-a2f4-fd1ef1e5baf3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.234317 Sep 08 11:33:58.464257 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3973/7715] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:33:58 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:33:59.478259 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1471665119", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-72532793", "security_groups": [{"name": "tempest-secgroup-smoke-1919734957"}], "networks": [{"uuid": "9f389097-4f17-4041-b32a-86f1161b837a"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:33:59.489750 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:59.490734 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:33:59.602772 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] validate_networks() for [('9f389097-4f17-4041-b32a-86f1161b837a', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:34:00.114766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:34:00.115203 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:34:00.115722 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:34:00.116150 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:34:00.116603 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:34:00.125549 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:00.126046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:00.126492 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:00.127226 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:00.127991 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:00.128149 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:00.146455 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:34:00.153143 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for user 89dc8bfafafd48139fc0f6233c90e98c and project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:34:00.166755 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:34:00.169220 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:34:00.226477 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0ebccd94-a608-490e-932a-13b7ad55c13c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752328 Sep 08 11:34:00.227731 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3743/7716] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:33:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:34:00.239879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d922565a-ae50-45bf-9164-a545d2289938 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:00.240489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d922565a-ae50-45bf-9164-a545d2289938 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:00.299698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d922565a-ae50-45bf-9164-a545d2289938 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:00.308086 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d922565a-ae50-45bf-9164-a545d2289938 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1245 microversion: 2.1 time: 0.072535 Sep 08 11:34:00.309479 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3974/7717] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:00 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:01.344024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:01.345388 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:01.357756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:01.361211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:01.362073 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:01.365195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:01.365871 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:01.366544 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:01.466125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:01.475151 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-efacbc15-b297-4847-9f11-413d6f7a08d2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1305 microversion: 2.1 time: 0.146173 Sep 08 11:34:01.475714 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3744/7718] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:01 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:02.498330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:02.499028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:02.506794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:02.507289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:02.507830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:02.508613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:02.509139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:02.509633 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:02.785704 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:02.793566 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-25615842-c78d-4d19-bcd6-12bb765c3633 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.299206 Sep 08 11:34:02.794175 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3975/7719] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:02 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:03.230340 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1facd114-a746-4da7-8c59-d457fcff4ff6 req-5b1d9759-3990-4700-8ea9-7193891c0c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:34:03.245076 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1facd114-a746-4da7-8c59-d457fcff4ff6 req-5b1d9759-3990-4700-8ea9-7193891c0c11 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:03.245572 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1facd114-a746-4da7-8c59-d457fcff4ff6 req-5b1d9759-3990-4700-8ea9-7193891c0c11 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:03.246189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1facd114-a746-4da7-8c59-d457fcff4ff6 req-5b1d9759-3990-4700-8ea9-7193891c0c11 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:03.261588 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1facd114-a746-4da7-8c59-d457fcff4ff6 req-5b1d9759-3990-4700-8ea9-7193891c0c11 service nova] Creating event network-changed:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h1-833090-19 Sep 08 11:34:03.267928 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1facd114-a746-4da7-8c59-d457fcff4ff6 req-5b1d9759-3990-4700-8ea9-7193891c0c11 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042845 Sep 08 11:34:03.269152 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3745/7720] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:34:03.816920 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:03.817481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:03.824351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:03.824838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:03.825279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:03.825979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:03.826435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:03.826864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:03.972461 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:03.981593 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c745282f-f455-4b9b-9910-882e3f3699f8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.168825 Sep 08 11:34:03.982193 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3976/7721] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:03 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:05.005844 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:05.006566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:05.012867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:05.013364 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:05.013822 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:05.014534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:05.015006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:05.015450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:05.151208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:05.159063 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6e27dad3-238d-4bf0-ab2a-367fbb79392e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.158874 Sep 08 11:34:05.159668 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3746/7722] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:04 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:06.181910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:06.182555 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:06.189490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:06.189981 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:06.190422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:06.191115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:06.191607 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:06.192041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:06.324827 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:06.333265 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7b56d35a-d233-48bb-a364-2b8022e44d0d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.155260 Sep 08 11:34:06.333840 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3977/7723] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:06 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:07.357048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:07.357679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:07.365146 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:07.365643 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:07.366090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:07.366798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:07.367264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:07.367747 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:07.504423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:07.512103 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-58ec152c-8fed-4324-8898-6d732f768895 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.159546 Sep 08 11:34:07.512679 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3747/7724] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:07 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:08.534857 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:08.535493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:08.543073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:08.543599 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:08.544047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:08.544781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:08.545240 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:08.545675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:08.680428 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:08.688972 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a1eb2755-43c1-4a33-a21b-7db67b83d06f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.158210 Sep 08 11:34:08.689563 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3978/7725] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:08 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:08.919190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-14417b1a-6a7f-4ebb-b0de-8a7c7dcf1849 req-d1b8b6f9-e43f-4823-887f-1783e4185f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "name": "network-vif-plugged", "status": "completed", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:34:08.929437 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-14417b1a-6a7f-4ebb-b0de-8a7c7dcf1849 req-d1b8b6f9-e43f-4823-887f-1783e4185f6d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:08.929930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-14417b1a-6a7f-4ebb-b0de-8a7c7dcf1849 req-d1b8b6f9-e43f-4823-887f-1783e4185f6d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:08.930377 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-14417b1a-6a7f-4ebb-b0de-8a7c7dcf1849 req-d1b8b6f9-e43f-4823-887f-1783e4185f6d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:08.945066 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-14417b1a-6a7f-4ebb-b0de-8a7c7dcf1849 req-d1b8b6f9-e43f-4823-887f-1783e4185f6d service nova] Creating event network-vif-plugged:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h1-833090-19 Sep 08 11:34:08.950647 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-14417b1a-6a7f-4ebb-b0de-8a7c7dcf1849 req-d1b8b6f9-e43f-4823-887f-1783e4185f6d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116310 Sep 08 11:34:08.951315 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3748/7726] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:34:09.713222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:09.713842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:09.720838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:09.721328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:09.721776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:09.722528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:09.722936 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:09.723370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:09.856632 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:09.864878 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-54c8899a-e26c-4ad6-b78a-f6189f69077d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1371 microversion: 2.1 time: 0.155636 Sep 08 11:34:09.865476 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3979/7727] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:09 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:10.885943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:34:10.886739 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:34:10.891412 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:10.892164 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:10.900160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:10.900586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:10.901039 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:10.901762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:10.902232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:10.902679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:11.056427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:11.066882 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5f98b94b-e318-445d-adc2-8b3293656530 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1554 microversion: 2.1 time: 0.182129 Sep 08 11:34:11.067503 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3749/7728] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:10 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:11.098700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:34:11.099569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:34:11.101329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:34:11.107779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:11.108273 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:11.108711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:11.109437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:11.109888 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:11.110313 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:11.249644 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:34:11.258138 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6bb83b5e-1adc-4a49-964c-c0c1d18e825d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1554 microversion: 2.1 time: 0.163834 Sep 08 11:34:11.258734 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3980/7729] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:34:11 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:34:13.048257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a16a21fd-0a4d-4eca-b561-34fe053a08bd req-4130e3a1-3585-431f-934c-fc8367040c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:34:13.064846 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a16a21fd-0a4d-4eca-b561-34fe053a08bd req-4130e3a1-3585-431f-934c-fc8367040c6e service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:34:13.065941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a16a21fd-0a4d-4eca-b561-34fe053a08bd req-4130e3a1-3585-431f-934c-fc8367040c6e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:34:13.066919 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a16a21fd-0a4d-4eca-b561-34fe053a08bd req-4130e3a1-3585-431f-934c-fc8367040c6e service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:34:13.086087 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a16a21fd-0a4d-4eca-b561-34fe053a08bd req-4130e3a1-3585-431f-934c-fc8367040c6e service nova] Creating event network-changed:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h1-833090-19 Sep 08 11:34:13.092953 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a16a21fd-0a4d-4eca-b561-34fe053a08bd req-4130e3a1-3585-431f-934c-fc8367040c6e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050018 Sep 08 11:34:13.094181 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3750/7730] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:07.359887 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:36:07.360828 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:36:07.361362 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:07.362394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=36 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:07.363896 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:36:07.364047 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d/action (ip 10.222.0.59) !!! Sep 08 11:36:07.368785 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:07.369325 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:07.378551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:07.379043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:07.379509 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:07.380210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:07.380669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:07.381102 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:07.405186 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lazy-loading 'flavor' on Instance uuid 383c17b2-59e0-4618-a663-f11310e7a59d {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:36:07.597682 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-702e123a-bc3a-49a2-b8dc-e89f285fdaa9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d/action" status: 202 len: 0 microversion: 2.1 time: 0.239605 Sep 08 11:36:07.598499 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3981/7731] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:36:07 2022] POST /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:36:07.606382 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0068dc00-0656-43bb-80ca-d0cc800bda7b] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 11:36:07.607800 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:07.609582 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=32 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:07.616682 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:07.618206 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:07.626224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:07.626730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:07.627181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:07.627929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:07.628398 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:07.628842 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:07.770283 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:07.778807 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-808e1463-eb94-4bc5-963e-2ee237b7539e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.175640 Sep 08 11:36:07.779387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3751/7732] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:07 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:36:08.807762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:08.808466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:08.821296 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50420. Sep 08 11:36:08.822948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:08.823438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:08.823906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:08.824615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:08.825069 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:08.825501 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:08.829107 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50422. Sep 08 11:36:08.964397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:08.972572 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f0992f6b-422c-4188-a544-835a285478f6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.174006 Sep 08 11:36:08.973158 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3982/7733] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:08 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:09.996963 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:09.997575 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:10.005622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:10.006130 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:10.006592 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:10.007438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:10.007814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:10.008264 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:10.024250 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] [0068dc00-0656-43bb-80ca-d0cc800bda7b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50426. Sep 08 11:36:10.149466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:10.157515 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fde3b1d3-88f5-40bd-9847-35b0a9134c93 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.165219 Sep 08 11:36:10.158101 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3752/7734] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:09 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:11.180919 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:11.181531 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:11.188346 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:11.188830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:11.189264 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:11.189959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:11.190405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:11.190830 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:11.323958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:11.331899 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-be8bf54b-637b-48a0-b5ba-29c44551e31a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.154828 Sep 08 11:36:11.332504 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3983/7735] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:11 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:12.356854 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:12.357400 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:12.364280 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:12.364788 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:12.365246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:12.365964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:12.366441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:12.366895 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:12.499715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:12.507574 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-77a16bd3-e8ad-43af-a5ad-0785e9095be6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.155734 Sep 08 11:36:12.508152 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3753/7736] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:12 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:13.530949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:13.531596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:13.538686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:13.539179 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:13.539669 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:13.540450 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:13.540912 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:13.541349 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:13.683743 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:13.691646 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e188c736-4b28-420d-aba0-380b845eb299 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.164634 Sep 08 11:36:13.692226 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3984/7737] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:13 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:14.717829 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:14.718464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:14.725458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:14.725961 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:14.726417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:14.727132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:14.727651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:14.728741 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:14.859265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:14.867087 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e69c75ac-a901-4dff-b79f-a72e3de2e907 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.153275 Sep 08 11:36:14.867678 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3754/7738] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:14 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:36:15.890517 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:15.891127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:15.901915 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:15.902408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:15.902847 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:15.903665 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:15.904121 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:15.904547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:16.039282 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:16.047714 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2da8df31-7163-4e88-ba01-2a86d4d860ad tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.161485 Sep 08 11:36:16.048293 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3985/7739] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:15 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:17.071821 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:17.072454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:17.080015 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:17.080518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:17.080976 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:17.081684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:17.082158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:17.082601 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:17.218324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:17.226425 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf7804a5-d2f6-47ea-b95e-90363a4e95a5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.158546 Sep 08 11:36:17.227025 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3755/7740] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:17 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:18.250255 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:18.250854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:18.257954 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:18.258436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:18.258882 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:18.259720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:18.260180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:18.261105 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:18.397673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:18.405751 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d78fa8a9-b3c5-4f51-b7b4-4ddad3594608 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1698 microversion: 2.1 time: 0.159378 Sep 08 11:36:18.406367 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3986/7741] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:18 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:19.429207 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:19.429851 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:19.436958 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:19.437467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:19.437943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:19.438654 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:19.439133 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:19.439612 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:19.583091 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:19.592411 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-443a2f5a-1f61-44f9-b379-9a00034b9457 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1698 microversion: 2.1 time: 0.167111 Sep 08 11:36:19.592990 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3756/7742] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:19 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:20.616765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:20.618042 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:20.630315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:20.631144 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:20.631833 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:20.632759 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:20.633462 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:20.634061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:20.800717 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:20.810672 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cf05032a-7098-4a7e-b6f8-1d9cbbf240e3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.198313 Sep 08 11:36:20.815442 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3987/7743] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:20 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:21.553048 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-42199888-da1b-4af8-801a-642bee0908ca req-7187385f-0532-4800-ab94-311597b9e978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "name": "network-vif-plugged", "status": "completed", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:21.591386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-42199888-da1b-4af8-801a-642bee0908ca req-7187385f-0532-4800-ab94-311597b9e978 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:21.593596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-42199888-da1b-4af8-801a-642bee0908ca req-7187385f-0532-4800-ab94-311597b9e978 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:21.594324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-42199888-da1b-4af8-801a-642bee0908ca req-7187385f-0532-4800-ab94-311597b9e978 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:21.639620 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-42199888-da1b-4af8-801a-642bee0908ca req-7187385f-0532-4800-ab94-311597b9e978 service nova] Creating event network-vif-plugged:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h1-833090-19 Sep 08 11:36:21.645427 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-42199888-da1b-4af8-801a-642bee0908ca req-7187385f-0532-4800-ab94-311597b9e978 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096770 Sep 08 11:36:21.646372 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3757/7744] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:21.837539 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:21.838243 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:21.845323 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:21.845815 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:21.846474 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:21.847352 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:21.847850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:21.848283 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:22.001753 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:22.010595 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7f0b0d63-f863-45c3-8412-341463568954 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.177574 Sep 08 11:36:22.011287 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3988/7745] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:21 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:23.035893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:23.036652 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:23.043700 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:23.044660 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:23.044955 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:23.045683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:23.046152 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:23.046774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:23.200074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:23.214875 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-76d11cec-c21a-4a64-9cad-97c598ca5c24 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.184328 Sep 08 11:36:23.215807 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3758/7746] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:23 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:24.240951 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:24.242233 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:24.249865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:24.250366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:24.250804 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:24.251545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:24.252008 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:24.252506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:24.403762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:24.412020 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a8df0f59-36af-4c0a-804c-7f20fe49b4bb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.175089 Sep 08 11:36:24.416042 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3989/7747] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:24 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:25.435502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:25.436132 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:25.443507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:25.444028 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:25.444491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:25.445228 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:25.445707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:25.446160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:25.601516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:25.610278 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-51056aec-9daa-478c-a985-0fee85caf91b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.178565 Sep 08 11:36:25.610883 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3759/7748] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:25 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:26.636623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:26.638187 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:26.646860 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:26.648585 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:26.649103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:26.649913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:26.650447 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:26.650952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:26.800258 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:26.806541 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7a1b0f6-3028-4539-8cf4-059004a97317 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.174416 Sep 08 11:36:26.807215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3990/7749] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:26 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:27.831238 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:27.832602 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:27.841766 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:27.842371 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:27.842896 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:27.843997 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:27.845257 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:27.845782 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:28.101577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:28.113453 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4c48d3da-acaf-434c-ad05-38f846dc25b1 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.286907 Sep 08 11:36:28.119517 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3760/7750] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:27 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:29.144490 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:29.145094 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:29.153059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:29.153561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:29.154010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:29.154746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:29.155212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:29.155687 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:29.298683 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:29.306709 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-b5becdc8-6bb8-42b3-98ce-e65ef2322629 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1693 microversion: 2.1 time: 0.167363 Sep 08 11:36:29.307323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3991/7751] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:29 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:30.330855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:30.331540 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:30.338551 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:30.339057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:30.339570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:30.340338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:30.340836 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:30.341326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:30.482456 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:30.490392 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6426697a-cd37-44bb-81c5-1d3bc4d51a1a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1675 microversion: 2.1 time: 0.163490 Sep 08 11:36:30.490983 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3761/7752] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:30 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:31.515221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:31.515866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:31.522876 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:31.523371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:31.523854 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:31.524569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:31.525027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:31.525459 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:31.663565 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:31.671477 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-97a15304-c409-4149-8754-cb9a9c849750 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1675 microversion: 2.1 time: 0.160800 Sep 08 11:36:31.672070 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3992/7753] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:31 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:32.694292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:32.694903 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:32.701820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:32.702321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:32.702777 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:32.703516 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:32.703993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:32.704438 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:32.842719 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:32.850619 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-65d50d89-43cd-4fd5-9763-fc531630d0cc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1618 microversion: 2.1 time: 0.160226 Sep 08 11:36:32.851208 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3762/7754] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:32 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1618 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:32.875014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:32.875660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:32.882520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:32.883012 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:32.883482 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:32.884197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:32.884648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:32.885084 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:32.972254 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122457) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 11:36:33.040644 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c2da7c10-f6af-4a7c-b841-d1b8280cd069 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d/action" status: 202 len: 0 microversion: 2.1 time: 0.169341 Sep 08 11:36:33.041278 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3993/7755] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:36:32 2022] POST /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:36:33.049508 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:33.050136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:33.056241 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:33.056742 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:33.057197 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:33.057911 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:33.058418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:33.058891 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:33.204509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:33.212476 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9716fd1a-01c4-4512-ac02-4a2449324863 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1626 microversion: 2.1 time: 0.166774 Sep 08 11:36:33.213057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3763/7756] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:33 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1626 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:36:33.513829 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-963ea4a7-d9dc-4bd3-a0e4-9c6165212de6 req-d89350e1-1d31-40a6-bebd-758fdea74536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "name": "network-vif-unplugged", "status": "completed", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:33.524537 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-963ea4a7-d9dc-4bd3-a0e4-9c6165212de6 req-d89350e1-1d31-40a6-bebd-758fdea74536 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:33.525913 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-963ea4a7-d9dc-4bd3-a0e4-9c6165212de6 req-d89350e1-1d31-40a6-bebd-758fdea74536 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:33.526361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-963ea4a7-d9dc-4bd3-a0e4-9c6165212de6 req-d89350e1-1d31-40a6-bebd-758fdea74536 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:33.539174 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.compute.server_external_events [req-963ea4a7-d9dc-4bd3-a0e4-9c6165212de6 req-d89350e1-1d31-40a6-bebd-758fdea74536 service nova] Unable to find a host for instance 383c17b2-59e0-4618-a663-f11310e7a59d. Dropping event network-vif-unplugged {{(pid=122457) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 11:36:33.540290 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-963ea4a7-d9dc-4bd3-a0e4-9c6165212de6 req-d89350e1-1d31-40a6-bebd-758fdea74536 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031323 Sep 08 11:36:33.541171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3994/7757] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 11:36:34.236935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:34.237589 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:34.244450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:34.244957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:34.245417 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:34.246136 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:34.246615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:34.247058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:34.378441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:34.387422 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8c20bfc-bf9f-4ea8-b328-b30f934f82a0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.153347 Sep 08 11:36:34.388084 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3764/7758] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:34 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:35.285446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-dab8624d-489b-4f5a-bf15-5c03b1675731 req-76d73939-e7ab-4bf9-93b1-5836fd33af74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:35.296454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dab8624d-489b-4f5a-bf15-5c03b1675731 req-76d73939-e7ab-4bf9-93b1-5836fd33af74 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:35.297547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dab8624d-489b-4f5a-bf15-5c03b1675731 req-76d73939-e7ab-4bf9-93b1-5836fd33af74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:35.297987 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-dab8624d-489b-4f5a-bf15-5c03b1675731 req-76d73939-e7ab-4bf9-93b1-5836fd33af74 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:35.302819 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:35.312130 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-dab8624d-489b-4f5a-bf15-5c03b1675731 req-76d73939-e7ab-4bf9-93b1-5836fd33af74 service nova] Creating event network-changed:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h2-833090-19 Sep 08 11:36:35.318221 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-dab8624d-489b-4f5a-bf15-5c03b1675731 req-76d73939-e7ab-4bf9-93b1-5836fd33af74 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036164 Sep 08 11:36:35.318863 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3995/7759] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:35.411920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:35.412565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:35.419758 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:35.420271 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:35.420726 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:35.421442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:35.421916 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:35.422392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:35.663359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:35.671687 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3e6e9f52-2227-4ccd-a22a-6db7c74f2dce tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.263487 Sep 08 11:36:35.672113 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3765/7760] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:35 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:36.696090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:36.696791 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:36.705978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:36.706464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:36.706903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:36.707767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:36.708227 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:36.708658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:36.857892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:36.866033 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1b72c2f0-d93a-4f37-8482-8f62f5cd3770 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.174190 Sep 08 11:36:36.873621 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3996/7761] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:36 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:37.891002 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:37.891683 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:37.900342 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=31 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:37.902881 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:37.903427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:37.903925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:37.904661 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:37.905427 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:37.905877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:37.911080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=87 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:38.063262 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:38.073020 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1f739fa1-f281-42a6-aa3c-95095d43d805 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.186480 Sep 08 11:36:38.073664 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3766/7762] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:37 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:39.097701 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:39.098365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:39.100535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:36:39.115044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:39.116074 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:39.116781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:39.117870 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:39.118580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:39.119272 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:39.581658 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:39.590560 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f509efb6-cb39-4d7c-b9fd-759235d9501b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.497134 Sep 08 11:36:39.591162 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3997/7763] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:39 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:40.616316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:40.616952 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:40.624202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:40.624725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:40.625192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:40.626003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:40.626527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:40.626994 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:40.796432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:40.804946 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-845c815c-9edf-4456-a8d6-33bedca7f818 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.192859 Sep 08 11:36:40.815993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3767/7764] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:40 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:41.831837 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:41.832494 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:41.840224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:41.841038 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:41.841489 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:41.842203 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:41.842660 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:41.843088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:42.020526 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:42.029182 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-884c2cba-c68e-4575-b764-3e87d38fecea tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.202667 Sep 08 11:36:42.029874 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3998/7765] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:41 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:43.054240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:43.054882 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:43.061893 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:43.062404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:43.062860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:43.063616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:43.064093 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:43.064538 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:43.208935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:43.220071 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a58bdc2d-e0c3-47e6-9f9b-a5b9dab7e075 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.169576 Sep 08 11:36:43.221198 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3768/7766] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:43 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:44.248300 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:44.248974 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:44.255940 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:44.256435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:44.256878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:44.257583 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:44.258041 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:44.258478 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:44.402733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:44.410570 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6a0985db-d3e4-4eab-94fe-a174e8f9ef22 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.166949 Sep 08 11:36:44.411154 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 3999/7767] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:44 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:45.435106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:45.435754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:45.442824 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:45.443324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:45.443811 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:45.444526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:45.445000 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:45.445447 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:45.575888 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:45.583744 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-bf5fabcd-b4ce-45f3-85f0-5a9c4421836e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.153056 Sep 08 11:36:45.584331 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3769/7768] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:45 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:46.607411 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:46.608029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:46.614803 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:46.615279 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:46.615745 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:46.616436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:46.616879 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:46.617302 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:46.750367 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:46.758184 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cc9fc317-593e-4bfb-908a-51b676071a94 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.155073 Sep 08 11:36:46.758766 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4000/7769] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:46 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:47.782664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:47.783293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:47.790195 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:47.790705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:47.791167 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:47.791930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:47.792406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:47.792863 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:47.926166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:47.934293 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0fd2694a-c3aa-4f6f-be3e-9dcd4e04ce20 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.155584 Sep 08 11:36:47.934879 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3770/7770] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:47 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:48.957946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:48.959178 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:48.966549 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.967332 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.968146 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:48.969423 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:48.970232 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:48.971030 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:49.119287 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:49.127435 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cf2646bc-f512-4176-92e2-6561ab3d5b30 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.173236 Sep 08 11:36:49.127946 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4001/7771] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:48 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:50.152507 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:50.153159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:50.160435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:50.160937 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:50.161382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:50.162096 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:50.162558 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:50.162996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:50.300665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:50.308600 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa2b8886-ea7f-43a0-8795-bbb77f9def2e tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.160065 Sep 08 11:36:50.309801 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3771/7772] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:50 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:51.117076 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ba569334-69bb-4d07-b9ca-77a71af009b2 req-c4210469-a71b-4bdd-a1b7-329599e56ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "name": "network-vif-plugged", "status": "completed", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:36:51.128884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba569334-69bb-4d07-b9ca-77a71af009b2 req-c4210469-a71b-4bdd-a1b7-329599e56ae6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.129210 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba569334-69bb-4d07-b9ca-77a71af009b2 req-c4210469-a71b-4bdd-a1b7-329599e56ae6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.129666 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ba569334-69bb-4d07-b9ca-77a71af009b2 req-c4210469-a71b-4bdd-a1b7-329599e56ae6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.141937 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ba569334-69bb-4d07-b9ca-77a71af009b2 req-c4210469-a71b-4bdd-a1b7-329599e56ae6 service nova] Creating event network-vif-plugged:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h2-833090-19 Sep 08 11:36:51.147009 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ba569334-69bb-4d07-b9ca-77a71af009b2 req-c4210469-a71b-4bdd-a1b7-329599e56ae6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Sep 08 11:36:51.147807 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4002/7773] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:36:51.332063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:51.332632 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:51.339804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.340350 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.340812 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.341539 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:51.342017 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:51.342466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:51.506306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:51.514764 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-50dd2b2e-0faf-4876-9508-750c85d69a8c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.186956 Sep 08 11:36:51.515343 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3772/7774] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:51 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:52.540886 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:52.541627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:52.548415 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:52.548903 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:52.549351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:52.550061 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:52.550519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:52.550949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:52.697926 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:52.705765 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-45dee099-cc26-4f72-9585-7bb060caafa5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1684 microversion: 2.1 time: 0.170223 Sep 08 11:36:52.706366 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4003/7775] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:52 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:36:53.730098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:36:53.731878 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:36:53.739234 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:53.739770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:53.740317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:53.741056 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:36:53.741529 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:36:53.741969 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:36:53.878395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:36:53.886308 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7ec7ec49-ca22-4420-a7b7-9f18b08396e9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1671 microversion: 2.1 time: 0.160748 Sep 08 11:36:53.887583 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3773/7776] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:36:53 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:39.139678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=13 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:39.140684 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=44 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:39.142173 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:38:39.142354 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d (ip 10.222.0.59) !!! Sep 08 11:38:39.146738 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1459b375-7dc3-41bd-96ce-24c2156bede4] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:38:39.148422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=15 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:39.149096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:39.149250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=47 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:39.149779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:39.150816 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:38:39.150816 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Sep 08 11:38:39.152166 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:38:39.152166 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Sep 08 11:38:39.165677 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.165928 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.166335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:39.167065 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.167553 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.167990 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:39.196797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:38:39.243670 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-f6210a4e-db5e-4c05-937f-a33f06cfb0f6 req-10445c8c-0167-47af-afd2-9a7b8f915e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:39.254671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f6210a4e-db5e-4c05-937f-a33f06cfb0f6 req-10445c8c-0167-47af-afd2-9a7b8f915e03 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.255185 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f6210a4e-db5e-4c05-937f-a33f06cfb0f6 req-10445c8c-0167-47af-afd2-9a7b8f915e03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.255848 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-f6210a4e-db5e-4c05-937f-a33f06cfb0f6 req-10445c8c-0167-47af-afd2-9a7b8f915e03 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:39.271082 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-f6210a4e-db5e-4c05-937f-a33f06cfb0f6 req-10445c8c-0167-47af-afd2-9a7b8f915e03 service nova] Creating event network-changed:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h2-833090-19 Sep 08 11:38:39.278467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-f6210a4e-db5e-4c05-937f-a33f06cfb0f6 req-10445c8c-0167-47af-afd2-9a7b8f915e03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139348 Sep 08 11:38:39.279687 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3774/7777] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:39.294148 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-02d97a13-4ad0-423b-932f-83e8da577404 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "DELETE /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 204 len: 0 microversion: 2.1 time: 0.157666 Sep 08 11:38:39.294746 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4004/7778] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:38:39 2022] DELETE /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:38:39.303877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:39.304941 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:39.313090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.313090 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.313567 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:39.315481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:39.315481 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:39.315799 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:39.516154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:39.524796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-c324e155-3c85-462e-93e0-4ef7d9c0d896 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.225549 Sep 08 11:38:39.525387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3775/7779] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:39 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:40.550324 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:40.551034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:40.558375 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:40.558866 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:40.559397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:40.560130 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:40.560593 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:40.561027 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:40.758818 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:40.766927 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-76a7f704-4319-4021-9f03-c77f16f1a76d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1677 microversion: 2.1 time: 0.221037 Sep 08 11:38:40.767529 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4005/7780] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:40 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:41.493763 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] [1459b375-7dc3-41bd-96ce-24c2156bede4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50718. Sep 08 11:38:41.540565 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-24bd17ff-96b4-4a6c-953b-3c0577e39bae req-dbba35e2-4398-4e5c-94c4-50f1e34cbc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383c17b2-59e0-4618-a663-f11310e7a59d", "name": "network-vif-deleted", "tag": "82061f20-fa3e-4b3f-84fa-262f48d4c8f1"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:41.550192 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-24bd17ff-96b4-4a6c-953b-3c0577e39bae req-dbba35e2-4398-4e5c-94c4-50f1e34cbc1c service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:41.550684 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-24bd17ff-96b4-4a6c-953b-3c0577e39bae req-dbba35e2-4398-4e5c-94c4-50f1e34cbc1c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:41.551128 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-24bd17ff-96b4-4a6c-953b-3c0577e39bae req-dbba35e2-4398-4e5c-94c4-50f1e34cbc1c service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:41.568672 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-24bd17ff-96b4-4a6c-953b-3c0577e39bae req-dbba35e2-4398-4e5c-94c4-50f1e34cbc1c service nova] Creating event network-vif-deleted:82061f20-fa3e-4b3f-84fa-262f48d4c8f1 for instance 383c17b2-59e0-4618-a663-f11310e7a59d on n-h2-833090-19 Sep 08 11:38:41.574692 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-24bd17ff-96b4-4a6c-953b-3c0577e39bae req-dbba35e2-4398-4e5c-94c4-50f1e34cbc1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094039 Sep 08 11:38:41.575368 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3776/7781] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:41.790914 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:41.791653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:41.798796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:41.799530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:41.800073 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:41.800863 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:41.801328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:41.801766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:41.836266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:41.836966 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:41.837925 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:41.838397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lazy-loading 'fault' on Instance uuid 383c17b2-59e0-4618-a663-f11310e7a59d {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:38:41.881840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:38:41.890865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cb3cd3af-4934-4308-b814-8bea1ca9ab70 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 200 len: 1335 microversion: 2.1 time: 0.104162 Sep 08 11:38:41.891245 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4006/7782] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:41 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:38:42.916541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:42.917261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 383c17b2-59e0-4618-a663-f11310e7a59d] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:38:42.923745 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:42.924244 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:42.924703 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:42.925408 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:38:42.925906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:38:42.926370 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:38:42.940024 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] HTTP exception thrown: Instance 383c17b2-59e0-4618-a663-f11310e7a59d could not be found. Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Request method failure captured: Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d HTTP/1.1 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGdMgWhIe-8hC295-fI8QXzpCjtvSf5dvhhXi979iZ4bqkcGzGi3XY7OsbZygcMpUlmj7voFa9uw55xRtmZLqyLHMY-nVRcHLmuAva5M3f71_UPRlRxPuLeP8BjNO6uchyfJ7g2XlA852TOxPyNl_EBOB0z0WbRGQzx3QOP70jdP5-7M Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: 5d7e63b9f3de40428b09410adeb46d05 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestShelveInstance-1211553416 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5d7e63b9f3de40428b09410adeb46d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5d7e63b9f3de40428b09410adeb46d05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5d7e63b9f3de40428b09410adeb46d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5d7e63b9f3de40428b09410adeb46d05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestShelveInstance-1211553416 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: 5d7e63b9f3de40428b09410adeb46d05 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestShelveInstance-1211553416 Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestShelveInstance-1211553416-project Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 89dc8bfafafd48139fc0f6233c90e98c Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestShelveInstance-1211553416-project Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 383c17b2-59e0-4618-a663-f11310e7a59d could not be found. Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '383c17b2-59e0-4618-a663-f11310e7a59d'} Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383c17b2-59e0-4618-a663-f11310e7a59d could not be found. Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383c17b2-59e0-4618-a663-f11310e7a59d could not be found. Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:38:42.941676 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383c17b2-59e0-4618-a663-f11310e7a59d could not be found. Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Returning 404 to user: Instance 383c17b2-59e0-4618-a663-f11310e7a59d could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-812163bb-61ea-40f7-b00a-b22cc730d2db tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d" status: 404 len: 111 microversion: 2.1 time: 0.032473 Sep 08 11:38:42.947833 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3777/7783] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:38:42 2022] GET /compute/v2.1/servers/383c17b2-59e0-4618-a663-f11310e7a59d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:38:43.107329 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-adca0c79-faed-4315-a14b-a9e5ced52227 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '.version_select at 0x7f2351424f70>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:38:43.133359 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-adca0c79-faed-4315-a14b-a9e5ced52227 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-72532793" status: 202 len: 0 microversion: 2.1 time: 0.029851 Sep 08 11:38:43.134128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4007/7784] 10.222.0.59 () {58 vars in 1248 bytes} [Thu Sep 8 11:38:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-72532793 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:38:43.156170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-be54f1f8-68d0-4d03-9cb6-6d0dac3a2fb2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'create', calling method: .version_select at 0x7f235078c670>, body: {"keypair": {"name": "tempest-TestShelveInstance-327761830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCwaSOpL0dl6ni2x31TSbe0TrsEZWjHm0FUic2VdgXzLcanaQhSs/+NBn0mxIzoQpeadUmVfGsaacWie1b5ess8ET5ta/Tyd43IGtx47iQuRFFMhzNEUhUcBsKE3/zQ8A=="}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:43.172158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-be54f1f8-68d0-4d03-9cb6-6d0dac3a2fb2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:38:43.177359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-be54f1f8-68d0-4d03-9cb6-6d0dac3a2fb2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for user 89dc8bfafafd48139fc0f6233c90e98c and project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'key_pairs'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:38:43.206533 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-be54f1f8-68d0-4d03-9cb6-6d0dac3a2fb2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054291 Sep 08 11:38:43.207148 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3778/7785] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:38:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:38:59.524035 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:59.524945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:38:59.529004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-775518485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-327761830", "security_groups": [{"name": "tempest-secgroup-smoke-1313657034"}], "networks": [{"uuid": "9f389097-4f17-4041-b32a-86f1161b837a"}], "block_device_mapping_v2": [{"uuid": "6bcab8aa-26ab-402a-af44-10e049feaec2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:38:59.669883 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.network.neutron [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] validate_networks() for [('9f389097-4f17-4041-b32a-86f1161b837a', None, None, None, None, None)] {{(pid=122457) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:39:00.067835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Flavor limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:39:00.068221 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Image limits 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:39:00.068710 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Flavor pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:39:00.069161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Image pref 0:0:0 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:39:00.069581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.virt.hardware [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:39:00.078766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.079315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.079799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.080569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:00.081056 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:00.081535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:00.101118 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:39:00.106525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Getting quotas for user 89dc8bfafafd48139fc0f6233c90e98c and project 5d7e63b9f3de40428b09410adeb46d05. Resources: {'instances', 'cores', 'ram'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:39:00.165868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Going to run 1 instances... {{(pid=122457) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:39:00.168181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bcab8aa-26ab-402a-af44-10e049feaec2',volume_size=None,volume_type=None)] {{(pid=122457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:39:00.300938 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dd17fdbc-812a-41ca-9ad2-b038a8e65cae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779029 Sep 08 11:39:00.301953 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4008/7786] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:38:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:39:00.311184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=12 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:00.311983 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=4 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:00.312840 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:00.316774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8e3cb582-4dec-4111-ae69-6ecf5b77ab6c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:00.317406 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8e3cb582-4dec-4111-ae69-6ecf5b77ab6c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:00.376208 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8e3cb582-4dec-4111-ae69-6ecf5b77ab6c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:00.384093 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8e3cb582-4dec-4111-ae69-6ecf5b77ab6c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1087 microversion: 2.1 time: 0.074618 Sep 08 11:39:00.385124 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3779/7787] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:00 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:01.409139 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:01.411930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:01.421932 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:01.422738 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:01.423892 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:01.424734 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:01.425303 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:01.425859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:01.495386 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:01.505108 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7014e9a2-d1bd-4afd-a65f-72d300374705 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1203 microversion: 2.1 time: 0.100441 Sep 08 11:39:01.505975 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4009/7788] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:01 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:39:02.528721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:02.529270 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:02.537966 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:02.538458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:02.539052 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:02.539857 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:02.540338 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:02.540783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:02.788276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:02.796645 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e658a867-b5cf-4937-abf9-2d8d0b7bf40f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1271 microversion: 2.1 time: 0.271995 Sep 08 11:39:02.809486 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3780/7789] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:02 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:03.185668 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-da615baf-dae4-454f-bac0-d1bac1f335c9 req-91566942-2a07-49d4-8dfc-3393713cdf68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:03.201341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-da615baf-dae4-454f-bac0-d1bac1f335c9 req-91566942-2a07-49d4-8dfc-3393713cdf68 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:03.201993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-da615baf-dae4-454f-bac0-d1bac1f335c9 req-91566942-2a07-49d4-8dfc-3393713cdf68 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:03.202572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-da615baf-dae4-454f-bac0-d1bac1f335c9 req-91566942-2a07-49d4-8dfc-3393713cdf68 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:03.216718 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-da615baf-dae4-454f-bac0-d1bac1f335c9 req-91566942-2a07-49d4-8dfc-3393713cdf68 service nova] Creating event network-changed:816ae7f3-4cc6-4414-bf25-c7ff312099e7 for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 on n-h1-833090-19 Sep 08 11:39:03.223415 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-da615baf-dae4-454f-bac0-d1bac1f335c9 req-91566942-2a07-49d4-8dfc-3393713cdf68 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042301 Sep 08 11:39:03.224541 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4010/7790] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 11:39:03.821274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:03.821906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:03.829794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:03.830306 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:03.830823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:03.831583 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:03.832063 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:03.832512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:04.077664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:04.085930 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-502df716-ce53-478f-a993-ad6576c92626 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1271 microversion: 2.1 time: 0.269197 Sep 08 11:39:04.086987 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3781/7791] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:03 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:05.109376 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:05.110081 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:05.117406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:05.117901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:05.118351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:05.119055 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:05.119548 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:05.119985 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:05.267295 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:05.276342 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-399d6c18-9dcf-427a-a9da-510f750eb2c3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1271 microversion: 2.1 time: 0.171475 Sep 08 11:39:05.277773 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4011/7792] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:05 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:06.299047 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:06.299732 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:06.306596 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:06.307021 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:06.307502 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:06.308223 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:06.308687 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:06.309122 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:06.453071 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:06.461522 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-48f34f9a-00ab-44c0-82b8-b9068d235c2a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1271 microversion: 2.1 time: 0.166485 Sep 08 11:39:06.462106 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3782/7793] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:06 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:07.485004 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:07.485613 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:07.492535 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:07.493017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:07.493451 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:07.494138 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:07.494591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:07.495014 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:07.625849 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:07.633871 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-57524c86-cd80-44e1-8b76-b79e2d524540 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.153079 Sep 08 11:39:07.634457 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4012/7794] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:07 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:08.657927 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:08.658571 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:08.665581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:08.666024 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:08.666484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:08.667202 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:08.667704 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:08.668151 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:08.799586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:08.808206 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-a226c088-dfb5-4a4b-a553-8a8ab776938f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.154878 Sep 08 11:39:08.808788 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3783/7795] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:08 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:09.831301 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:09.831889 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:09.838013 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:09.838502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:09.838944 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:09.839675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:09.840152 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:09.840581 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:09.979733 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:09.987811 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-48e88ac2-6fc2-4cde-bf6c-99ba9f38e676 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.160767 Sep 08 11:39:09.988401 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4013/7796] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:09 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:11.011926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:11.011926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:11.014375 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:11.020356 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:11.020867 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:11.021334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:11.022057 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:11.022534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:11.022982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:11.163841 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:11.171949 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-57dd2a7f-50c8-4419-b285-29d367c31020 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.165403 Sep 08 11:39:11.172540 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3784/7797] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:11 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:12.194259 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:12.194878 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:12.196950 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:12.197628 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:39:12.205224 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:12.205715 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:12.206161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:12.206896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:12.207355 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:12.207817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:12.349587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:12.357677 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d9ee2535-98ce-49e1-9e06-cc87c794ef0b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.167380 Sep 08 11:39:12.358256 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4014/7798] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:12 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:13.386743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:13.387311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:13.394046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:13.394561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:13.395016 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:13.395756 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:13.396235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:13.396686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:13.530435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:13.538212 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-e566c3de-528b-4ba6-b092-f38d27c4b3c8 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.155649 Sep 08 11:39:13.538790 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3785/7799] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:13 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:14.562115 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:14.562663 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:14.569627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:14.570120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:14.571197 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:14.571931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:14.572388 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:14.572822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:14.708572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:14.716571 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e7f30dca-5377-4d61-ba96-f9416cd0b8a7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.158450 Sep 08 11:39:14.717396 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4015/7800] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:14 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:15.740411 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:15.741044 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:15.749126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:15.749629 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:15.750092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:15.750808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:15.751285 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:15.751757 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:15.890738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:15.899421 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-93183121-94ac-482d-a192-85f5beb5e1b7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.162973 Sep 08 11:39:15.900247 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3786/7801] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:15 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:16.392454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-28430c01-64f8-4f3e-999b-03bf5f75a5ab req-2ae87d85-5e4d-47ec-9a7d-27a651b80e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "name": "network-vif-plugged", "status": "completed", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:16.402642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28430c01-64f8-4f3e-999b-03bf5f75a5ab req-2ae87d85-5e4d-47ec-9a7d-27a651b80e28 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:16.403131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28430c01-64f8-4f3e-999b-03bf5f75a5ab req-2ae87d85-5e4d-47ec-9a7d-27a651b80e28 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:16.403667 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-28430c01-64f8-4f3e-999b-03bf5f75a5ab req-2ae87d85-5e4d-47ec-9a7d-27a651b80e28 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:16.415361 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-28430c01-64f8-4f3e-999b-03bf5f75a5ab req-2ae87d85-5e4d-47ec-9a7d-27a651b80e28 service nova] Creating event network-vif-plugged:816ae7f3-4cc6-4414-bf25-c7ff312099e7 for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 on n-h1-833090-19 Sep 08 11:39:16.420382 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-28430c01-64f8-4f3e-999b-03bf5f75a5ab req-2ae87d85-5e4d-47ec-9a7d-27a651b80e28 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081957 Sep 08 11:39:16.420978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4016/7802] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:39:16.922574 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:16.923205 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:16.931673 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:16.932181 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:16.932668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:16.933396 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:16.933866 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:16.934310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:17.070993 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:17.078834 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4df46402-652a-43ee-b40b-00d0e168d7cf tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1259 microversion: 2.1 time: 0.160211 Sep 08 11:39:17.079412 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3787/7803] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:16 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:18.103217 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:18.103959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:18.110600 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:18.111090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:18.111568 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:18.112267 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:18.112732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:18.113162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:18.248479 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:18.256368 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f3de46d2-e3be-49bc-8030-52cecd152efc tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1443 microversion: 2.1 time: 0.158466 Sep 08 11:39:18.256946 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4017/7804] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:18 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:18.279525 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:39:18.280189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:39:18.287029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:18.287604 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:18.288067 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:18.288787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:18.289316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:18.289773 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:18.429433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:39:18.437961 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1ebf3166-966d-4304-9a81-63b01a2618f3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1443 microversion: 2.1 time: 0.162375 Sep 08 11:39:18.438521 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3788/7805] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:39:18 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:39:20.084573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-3f18d1b0-7bac-4a44-92ad-dd185ab3b01c req-b9c6db2e-3067-42f0-938b-6b339e64fb3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:39:20.094700 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f18d1b0-7bac-4a44-92ad-dd185ab3b01c req-b9c6db2e-3067-42f0-938b-6b339e64fb3f service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:39:20.095184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f18d1b0-7bac-4a44-92ad-dd185ab3b01c req-b9c6db2e-3067-42f0-938b-6b339e64fb3f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:39:20.095653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-3f18d1b0-7bac-4a44-92ad-dd185ab3b01c req-b9c6db2e-3067-42f0-938b-6b339e64fb3f service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:39:20.108137 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-3f18d1b0-7bac-4a44-92ad-dd185ab3b01c req-b9c6db2e-3067-42f0-938b-6b339e64fb3f service nova] Creating event network-changed:816ae7f3-4cc6-4414-bf25-c7ff312099e7 for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 on n-h1-833090-19 Sep 08 11:39:20.113456 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-3f18d1b0-7bac-4a44-92ad-dd185ab3b01c req-b9c6db2e-3067-42f0-938b-6b339e64fb3f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032803 Sep 08 11:39:20.114074 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4018/7806] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:15.403352 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0068dc00-0656-43bb-80ca-d0cc800bda7b] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:41:15.404395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=22 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:15.405441 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=54 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:15.406929 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:41:15.407209 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6/action (ip 10.222.0.59) !!! Sep 08 11:41:15.412715 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:15.413291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:15.422359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:15.422862 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:15.423309 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:15.424050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:15.424514 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:15.424950 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:15.449506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lazy-loading 'flavor' on Instance uuid 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:41:15.522262 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-aa3fe84c-5a8b-4a36-b133-778b3fda8a35 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6/action" status: 202 len: 0 microversion: 2.1 time: 0.121179 Sep 08 11:41:15.523449 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3789/7807] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:41:15 2022] POST /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:41:15.529892 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:41:15.531431 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:41:15.532464 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:15.533034 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=50 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:15.534211 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:41:15.534380 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 (ip 10.222.0.59) !!! Sep 08 11:41:15.540682 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:15.541407 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:15.551128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:15.551679 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:15.552126 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:15.552835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:15.553297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:15.553731 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:15.694150 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:15.702742 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cbbdf230-887f-4724-8a26-f8109551a2c6 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.174849 Sep 08 11:41:15.703323 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4019/7808] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:15 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:16.729237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:16.729956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:16.738956 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:16.739448 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:16.739918 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:16.740645 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:16.741109 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:16.741541 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:16.744841 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] [0068dc00-0656-43bb-80ca-d0cc800bda7b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50984. Sep 08 11:41:16.877469 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:16.886020 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-117d1b1f-07bd-4c09-b8ec-3c57c1b9a8ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.163359 Sep 08 11:41:16.886591 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3790/7809] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:16 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:17.909960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:17.910686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:17.921618 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:17.922108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:17.922551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:17.923260 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:17.923742 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:17.924176 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:17.928033 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50988. Sep 08 11:41:17.931823 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50990. Sep 08 11:41:18.066075 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:18.074294 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d8ab0f0c-16bf-42f5-a5c0-2e633430d8e7 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.168329 Sep 08 11:41:18.074884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4020/7810] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:17 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:19.097345 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:19.097988 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:19.104992 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:19.105504 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:19.105964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:19.106680 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:19.107158 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:19.107637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:19.242013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:19.250207 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ac482b4c-f0ca-4c07-824b-0238cada8ee9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.156811 Sep 08 11:41:19.250788 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3791/7811] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:19 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:20.274627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:20.275266 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:20.282413 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:20.282899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:20.283337 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:20.284072 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:20.284530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:20.284949 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:20.426162 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:20.434310 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4848ee8a-7b96-4909-8670-97a672020e5f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.164385 Sep 08 11:41:20.434905 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4021/7812] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:20 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:21.458380 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:21.459022 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:21.466404 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:21.466926 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:21.467494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:21.468251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:21.468716 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:21.469166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:21.604092 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:21.612350 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-10a88c73-c67e-4b21-996d-5952a416f640 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.158007 Sep 08 11:41:21.612934 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3792/7813] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:21 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:22.637051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:22.637685 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:22.644907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:22.645397 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:22.645832 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:22.646530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:22.646982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:22.647410 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:22.778993 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:22.787004 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-69691e68-a936-480f-a14e-3dd4c14ce4ba tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.154835 Sep 08 11:41:22.787608 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4022/7814] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:22 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:23.810232 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:23.810847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:23.817804 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:23.818310 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:23.818770 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:23.820003 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:23.820482 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:23.820933 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:23.960434 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:23.968326 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-8bdaaa8d-8631-4dd8-9526-828d8e4a1a04 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.162033 Sep 08 11:41:23.968912 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3793/7815] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:23 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:24.991175 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:24.991955 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:24.999364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:24.999893 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:25.000341 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:25.001053 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:25.001515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:25.001948 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:25.138642 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:25.146638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-04ab489b-213a-40d4-a141-22b77b22513b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.159387 Sep 08 11:41:25.147215 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4023/7816] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:24 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:26.170929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:26.171593 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:26.179786 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:26.180292 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:26.180743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:26.181459 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:26.181924 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:26.182366 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:26.328678 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:26.337275 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7105beb8-1b3a-4a6a-8dd8-3c1bcc4ebdf2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.170172 Sep 08 11:41:26.337871 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3794/7817] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:26 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:27.361107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:27.361930 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:27.369616 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:27.370106 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:27.370552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:27.371253 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:27.371749 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:27.372188 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:27.503430 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:27.511304 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0bb948c1-0e55-4c1d-9277-8e45aca13201 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.154287 Sep 08 11:41:27.511906 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4024/7818] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:27 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:28.534446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:28.535075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:28.542079 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:28.542581 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:28.543031 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:28.543810 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:28.544278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:28.544717 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:28.685329 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:28.693457 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-7401ab97-2100-4f18-bf91-8b2c0c6d67b9 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.162946 Sep 08 11:41:28.694233 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3795/7819] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:28 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:29.717400 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:29.718010 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:29.724846 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:29.725328 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:29.725765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:29.726454 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:29.726910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:29.727336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:29.871229 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:29.879580 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dbac6095-e8ec-458d-b8bf-a15ee7dfe187 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1569 microversion: 2.1 time: 0.166008 Sep 08 11:41:29.880173 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4025/7820] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:29 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:29.903886 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:29.904526 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:29.911616 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:29.912120 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:29.912570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:29.913344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:29.913813 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:29.914253 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:29.998803 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122456) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 11:41:30.067981 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3c1a4f38-c14b-4760-9928-48c6dc35bde4 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "POST /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6/action" status: 202 len: 0 microversion: 2.1 time: 0.167669 Sep 08 11:41:30.068617 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3796/7821] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:41:29 2022] POST /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:41:30.077905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:30.078765 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:30.086297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:30.086797 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:30.087245 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:30.088031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:30.088543 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:30.089017 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:30.227011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:30.235631 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e029b9eb-0e92-40b2-99d5-53afbcf17f1b tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1517 microversion: 2.1 time: 0.161837 Sep 08 11:41:30.236471 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4026/7822] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:30 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:30.844545 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-da666a78-b076-4e87-831d-827cfc94e554 req-68f77ca8-43d7-4989-b45c-e3ca415fd7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "name": "network-vif-unplugged", "status": "completed", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:30.855391 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da666a78-b076-4e87-831d-827cfc94e554 req-68f77ca8-43d7-4989-b45c-e3ca415fd7b7 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:30.855930 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da666a78-b076-4e87-831d-827cfc94e554 req-68f77ca8-43d7-4989-b45c-e3ca415fd7b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:30.856376 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-da666a78-b076-4e87-831d-827cfc94e554 req-68f77ca8-43d7-4989-b45c-e3ca415fd7b7 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:30.868413 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.compute.server_external_events [req-da666a78-b076-4e87-831d-827cfc94e554 req-68f77ca8-43d7-4989-b45c-e3ca415fd7b7 service nova] Unable to find a host for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6. Dropping event network-vif-unplugged {{(pid=122456) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 11:41:30.869951 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-da666a78-b076-4e87-831d-827cfc94e554 req-68f77ca8-43d7-4989-b45c-e3ca415fd7b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029356 Sep 08 11:41:30.870556 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3797/7823] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 11:41:31.259768 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:31.260491 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:31.267434 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:31.267960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:31.268408 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:31.269109 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:31.269566 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:31.270005 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:31.404783 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:31.412589 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1f2f0284-e0aa-4a14-89b9-5eec32e3de9c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1517 microversion: 2.1 time: 0.157259 Sep 08 11:41:31.413180 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4027/7824] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:31 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:32.436086 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:32.436845 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:32.444140 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:32.445211 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:32.445667 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:32.446381 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:32.446864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:32.447308 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:32.584929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:32.593374 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-62c8e61b-fec0-4f7c-ad35-022c20dd252c tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1517 microversion: 2.1 time: 0.161438 Sep 08 11:41:32.593971 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3798/7825] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:32 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:33.618385 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:33.619002 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:33.625906 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:33.626394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:33.626826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:33.627705 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:33.628011 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:33.628437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:33.764911 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:33.773072 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-075b6d4d-c0dd-4e9f-8929-d09023551be5 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1517 microversion: 2.1 time: 0.158720 Sep 08 11:41:33.773655 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4028/7826] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:33 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:34.796457 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:34.797134 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:34.804650 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:34.805156 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:34.805615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:34.806334 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:34.806807 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:34.807251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:34.941792 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:34.949813 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9f237e72-dc71-49d1-8fa4-4794ebb8c90a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1519 microversion: 2.1 time: 0.157295 Sep 08 11:41:34.950431 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3799/7827] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:34 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:35.973131 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:35.973885 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:35.981727 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:35.982363 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:35.982834 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:35.983573 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:35.984036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:35.984467 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:36.125761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:36.134867 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-277fd364-8dbe-4933-b198-bd620177b225 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1519 microversion: 2.1 time: 0.165667 Sep 08 11:41:36.136104 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4029/7828] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:35 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:37.158576 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:37.159102 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:37.166278 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:37.166781 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:37.167267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:37.168032 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:37.168524 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:37.168962 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:37.307906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:37.315798 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6d590320-277b-4ff8-ad52-5ee2588f97e0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1519 microversion: 2.1 time: 0.161325 Sep 08 11:41:37.316387 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3800/7829] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:37 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:38.340602 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:38.341161 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:38.348163 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:38.348653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:38.349097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:38.349796 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:38.350251 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:38.351336 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:38.489218 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:38.498034 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-10ad1d60-25ec-458b-8a10-38dda2903138 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1519 microversion: 2.1 time: 0.160751 Sep 08 11:41:38.498957 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4030/7830] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:38 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:39.521847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:39.522414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:39.529347 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:39.529859 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:39.530315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:39.531034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:39.531533 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:39.531984 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:39.678635 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:39.687194 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9cc17bdf-3951-48ae-a2e8-1809d56894ae tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1519 microversion: 2.1 time: 0.169344 Sep 08 11:41:39.687815 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3801/7831] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:39 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:40.710422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:40.710992 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:40.717960 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:40.718452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:40.718895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:40.719630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:40.720092 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:40.720530 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:40.855246 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:40.863379 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6b98962e-a9d3-45ef-853c-18f3d20b11dd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.157098 Sep 08 11:41:40.863978 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4031/7832] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:40 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:41.887681 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:41.888233 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:41.894850 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:41.895344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:41.895826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:41.896535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:41.897006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:41.898311 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:42.033798 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:42.042442 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4d5957d5-70f4-4fad-a109-55ca25bf9cc2 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.158739 Sep 08 11:41:42.043039 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3802/7833] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:41 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:43.066309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:43.066958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:43.073982 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:43.074466 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:43.074908 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:43.075640 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:43.076103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:43.076533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:43.209884 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:43.217967 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-1c18c629-1614-4ac2-a66a-f0249cf90a4a tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.155738 Sep 08 11:41:43.218559 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4032/7834] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:43 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:44.243131 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:44.243768 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:44.251237 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:44.252147 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:44.252609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:44.253326 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:44.253805 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:44.254252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:44.259019 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:44.394905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:44.403551 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9e920ff1-aaa1-4e48-aed3-6b5494f90ddd tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.164778 Sep 08 11:41:44.404150 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3803/7835] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:44 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:45.426249 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:45.426865 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:45.433800 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:45.434288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:45.434736 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:45.435431 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:45.435935 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:45.436370 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:45.565956 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:45.568212 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=89 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:45.575790 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-91339076-445e-48a5-845f-aab21f59a143 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.153396 Sep 08 11:41:45.576394 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4033/7836] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:45 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:46.602125 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:46.602869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:46.605964 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:46.613553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:46.614154 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:46.614708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:46.615674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:46.616160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:46.616633 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:46.754493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:46.762869 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-086ab275-e133-4602-b3f7-3ffe10daf920 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.166810 Sep 08 11:41:46.763472 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3804/7837] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:46 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:47.787192 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:47.787809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:47.791033 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=31 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:41:47.796541 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:47.797036 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:47.797481 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:47.798190 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:47.798653 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:47.799088 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:47.937437 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:47.947678 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-8976d31d-ffe8-4afd-b787-56067df21af0 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.164202 Sep 08 11:41:47.948779 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4034/7838] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:47 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:48.972118 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:48.972753 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:48.980359 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:48.980877 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:48.981341 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:48.982082 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:48.982561 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:48.983007 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:49.124738 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:49.132667 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2e3f959e-f9cd-4f94-83a8-05bc83ef9220 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.164543 Sep 08 11:41:49.133257 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3805/7839] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:48 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:50.156098 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:50.156657 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:50.163624 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:50.164107 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:50.164546 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:50.165231 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:50.165686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:50.166108 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:50.302047 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:50.310407 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ceeef632-3152-4ee5-b7d9-4538b9bf82a3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.158316 Sep 08 11:41:50.310984 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4035/7840] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:50 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:50.989072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-c8141bcd-f599-499b-b432-77a457aa28a1 req-c157e536-2bd4-4667-9e2e-a02ab5ca8003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "name": "network-vif-plugged", "status": "completed", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:41:51.000780 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c8141bcd-f599-499b-b432-77a457aa28a1 req-c157e536-2bd4-4667-9e2e-a02ab5ca8003 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:51.001671 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c8141bcd-f599-499b-b432-77a457aa28a1 req-c157e536-2bd4-4667-9e2e-a02ab5ca8003 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:51.002119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-c8141bcd-f599-499b-b432-77a457aa28a1 req-c157e536-2bd4-4667-9e2e-a02ab5ca8003 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:51.013596 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-c8141bcd-f599-499b-b432-77a457aa28a1 req-c157e536-2bd4-4667-9e2e-a02ab5ca8003 service nova] Creating event network-vif-plugged:816ae7f3-4cc6-4414-bf25-c7ff312099e7 for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 on n-h1-833090-19 Sep 08 11:41:51.018979 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-c8141bcd-f599-499b-b432-77a457aa28a1 req-c157e536-2bd4-4667-9e2e-a02ab5ca8003 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033916 Sep 08 11:41:51.019614 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3806/7841] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:41:51.334183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:51.334789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:51.341873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:51.342289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:51.342746 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:51.343435 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:51.343910 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:51.344331 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:51.480533 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:51.488684 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2ec11294-a760-477a-baf4-b50d1150d909 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1575 microversion: 2.1 time: 0.158503 Sep 08 11:41:51.489252 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4036/7842] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:51 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:41:52.513690 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:41:52.514407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:41:52.521511 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:52.522006 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:52.522454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:52.523217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:41:52.523762 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:41:52.524212 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:41:52.661298 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:41:52.669150 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b7b083dc-8be3-4d96-9f8c-57e98cd0f613 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1562 microversion: 2.1 time: 0.159796 Sep 08 11:41:52.669727 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3807/7843] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:41:52 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:06.621289 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=5 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:06.622054 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=19 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:06.622878 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:43:06.623017 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:43:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 (ip 10.222.0.59) !!! Sep 08 11:43:06.624735 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:43:06.625569 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=7 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:06.626101 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:43:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 (ip 10.222.0.59) !!! Sep 08 11:43:06.626668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=24 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:06.628407 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:43:06.628664 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:43:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Sep 08 11:43:06.632617 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:06.633120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:06.635217 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-ebb9bfa4-19e1-434b-bbdd-01e5ce5c3c30 req-1927ad5f-da7b-471b-a8bb-fff0e4201ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:06.645180 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:06.646761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:06.647201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:06.647386 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ebb9bfa4-19e1-434b-bbdd-01e5ce5c3c30 req-1927ad5f-da7b-471b-a8bb-fff0e4201ab3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:06.647945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:06.648178 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ebb9bfa4-19e1-434b-bbdd-01e5ce5c3c30 req-1927ad5f-da7b-471b-a8bb-fff0e4201ab3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:06.648394 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:06.648785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-ebb9bfa4-19e1-434b-bbdd-01e5ce5c3c30 req-1927ad5f-da7b-471b-a8bb-fff0e4201ab3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:06.649051 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:06.662973 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-ebb9bfa4-19e1-434b-bbdd-01e5ce5c3c30 req-1927ad5f-da7b-471b-a8bb-fff0e4201ab3 service nova] Creating event network-changed:816ae7f3-4cc6-4414-bf25-c7ff312099e7 for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 on n-h1-833090-19 Sep 08 11:43:06.668403 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-ebb9bfa4-19e1-434b-bbdd-01e5ce5c3c30 req-1927ad5f-da7b-471b-a8bb-fff0e4201ab3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046225 Sep 08 11:43:06.669408 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3808/7844] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:06.679662 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:43:06.778902 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-dae48eff-544e-426b-8d9d-61c3ca65826d tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 204 len: 0 microversion: 2.1 time: 0.159140 Sep 08 11:43:06.780654 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4037/7845] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:43:06 2022] DELETE /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:43:06.790506 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:06.791256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:06.800743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:06.801470 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:06.802184 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:06.803035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:06.803637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:06.804163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:06.965432 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:06.973987 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-176cefa2-9d89-44c3-836f-692970fdba49 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.188471 Sep 08 11:43:06.974669 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3809/7846] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:06 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:07.998564 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:07.999298 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:08.006440 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:08.006927 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:08.007371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:08.008099 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:08.008552 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:08.008979 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:08.162826 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:08.171261 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8b99ab2-94e5-41a2-8ffb-7416ee6c790f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1568 microversion: 2.1 time: 0.176647 Sep 08 11:43:08.171856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4038/7847] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:07 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:08.751119 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-93564371-4a88-44c2-b0c0-84b4973d4493 req-c05d95ef-c225-4c77-a66c-81cd8a0b170b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6", "name": "network-vif-deleted", "tag": "816ae7f3-4cc6-4414-bf25-c7ff312099e7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:08.766105 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-93564371-4a88-44c2-b0c0-84b4973d4493 req-c05d95ef-c225-4c77-a66c-81cd8a0b170b service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:08.766763 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-93564371-4a88-44c2-b0c0-84b4973d4493 req-c05d95ef-c225-4c77-a66c-81cd8a0b170b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:08.767240 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-93564371-4a88-44c2-b0c0-84b4973d4493 req-c05d95ef-c225-4c77-a66c-81cd8a0b170b service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:08.784508 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-93564371-4a88-44c2-b0c0-84b4973d4493 req-c05d95ef-c225-4c77-a66c-81cd8a0b170b service nova] Creating event network-vif-deleted:816ae7f3-4cc6-4414-bf25-c7ff312099e7 for instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 on n-h1-833090-19 Sep 08 11:43:08.789797 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-93564371-4a88-44c2-b0c0-84b4973d4493 req-c05d95ef-c225-4c77-a66c-81cd8a0b170b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042944 Sep 08 11:43:08.790428 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3810/7848] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:09.194405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:09.194962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:09.202711 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:09.203206 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:09.203698 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:09.204404 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:09.204864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:09.205296 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:09.269181 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:09.278340 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-525b567d-54b4-4db9-9881-5b36d259a567 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1218 microversion: 2.1 time: 0.087862 Sep 08 11:43:09.278937 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4039/7849] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:09 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:10.303501 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:10.304159 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:10.311808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:10.312315 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:10.312767 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:10.313494 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:10.313957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:10.314395 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:10.381261 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:10.390494 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0f9eef51-fa60-45e6-91cb-4039ce37d102 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1218 microversion: 2.1 time: 0.091384 Sep 08 11:43:10.391101 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3811/7850] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:10 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:11.414225 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:11.414864 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:11.422327 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:11.422809 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:11.423248 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:11.424044 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:11.424498 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:11.424953 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:11.491366 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:11.500130 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c6d5f08a-1dab-481e-b811-ff36720ce7fb tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1218 microversion: 2.1 time: 0.089870 Sep 08 11:43:11.515487 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4040/7851] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:11 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:12.524286 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:12.524920 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:12.531806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:12.532319 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:12.532779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:12.533505 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:12.533982 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:12.534424 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:12.597929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89dc8bfafafd48139fc0f6233c90e98c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7e63b9f3de40428b09410adeb46d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:12.606027 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b8b90694-d60d-4252-aa34-e0bf892140b3 tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 200 len: 1218 microversion: 2.1 time: 0.085740 Sep 08 11:43:12.606618 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3812/7852] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:12 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:13.628873 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:13.629488 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] [instance: 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:13.636693 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:13.637183 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:13.637623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:13.638335 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:13.638792 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:13.639835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:13.654161 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] HTTP exception thrown: Instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 could not be found. Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Request method failure captured: Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 HTTP/1.1 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGdMgWhIe-8hC295-fI8QXzpCjtvSf5dvhhXi979iZ4bqkcGzGi3XY7OsbZygcMpUlmj7voFa9uw55xRtmZLqyLHMY-nVRcHLmuAva5M3f71_UPRlRxPuLeP8BjNO6uchyfJ7g2XlA852TOxPyNl_EBOB0z0WbRGQzx3QOP70jdP5-7M Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: 5d7e63b9f3de40428b09410adeb46d05 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestShelveInstance-1211553416 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5d7e63b9f3de40428b09410adeb46d05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5d7e63b9f3de40428b09410adeb46d05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5d7e63b9f3de40428b09410adeb46d05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5d7e63b9f3de40428b09410adeb46d05", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestShelveInstance-1211553416 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: 5d7e63b9f3de40428b09410adeb46d05 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestShelveInstance-1211553416 Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestShelveInstance-1211553416-project Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 89dc8bfafafd48139fc0f6233c90e98c Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestShelveInstance-1211553416-project Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 could not be found. Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': '3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6'} Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 could not be found. Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 could not be found. Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:43:13.656844 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 could not be found. Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Returning 404 to user: Instance 3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f9942f2d-8001-49d0-9862-20dfe79ba1ee tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6" status: 404 len: 111 microversion: 2.1 time: 0.033355 Sep 08 11:43:13.662140 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4041/7853] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:13 2022] GET /compute/v2.1/servers/3986cf4d-ea8b-4e01-bc2a-e0e19a2c86b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:43:13.829467 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-b6cc5e12-f4e7-430a-b43a-19dd1221bd7f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] Calling method '.version_select at 0x7f2350b62430>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:13.861698 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-b6cc5e12-f4e7-430a-b43a-19dd1221bd7f tempest-TestShelveInstance-1211553416 tempest-TestShelveInstance-1211553416-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327761830" status: 202 len: 0 microversion: 2.1 time: 0.037157 Sep 08 11:43:13.862639 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3813/7854] 10.222.0.59 () {58 vars in 1251 bytes} [Thu Sep 8 11:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327761830 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 11:43:31.627779 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:31.630561 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:31.838318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-61666088-656c-4a95-ab22-3d980fccfd1a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Action: 'create', calling method: .version_select at 0x7f23512fac10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1495786158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNPmmTlypavbKGC1CsjPRiKJ6l0jvDOXQF2RdOsNObmMa3bW7ivEfB9bQWqD+oDozJYZy713QlWo3ui57qAtrWZYrmF8kxsuv6fnc/3mLzlwdEaO0KyYMuGmF07jvZpAw=="}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:31.854448 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-61666088-656c-4a95-ab22-3d980fccfd1a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Getting quotas for project f341f7873f484a31a542388c178920fd. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:43:31.860519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.quota [None req-61666088-656c-4a95-ab22-3d980fccfd1a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Getting quotas for user 81a5fc971bc34264b8fb8dadca178719 and project f341f7873f484a31a542388c178920fd. Resources: {'key_pairs'} {{(pid=122457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:43:31.891814 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-61666088-656c-4a95-ab22-3d980fccfd1a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.269693 Sep 08 11:43:31.892359 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4042/7855] 10.222.0.59 () {60 vars in 1159 bytes} [Thu Sep 8 11:43:31 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:32.900727 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=22 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:32.902820 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:32.907627 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-65260281", "imageRef": "fe14f6a4-d144-40d8-8fee-904fb43a30eb", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1495786158", "security_groups": [{"name": "tempest-secgroup-smoke-616291465"}], "networks": [{"uuid": "d3a94a21-ac6a-41a3-93fb-68ec3b45f2e6"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:33.022104 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] validate_networks() for [('d3a94a21-ac6a-41a3-93fb-68ec3b45f2e6', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:43:33.442477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:43:33.442925 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:43:33.443422 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:43:33.443905 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:43:33.444352 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:43:33.456706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:33.457321 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:33.457971 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:33.458946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:33.459519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:33.460005 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:33.486368 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Getting quotas for project f341f7873f484a31a542388c178920fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:43:33.493224 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Getting quotas for user 81a5fc971bc34264b8fb8dadca178719 and project f341f7873f484a31a542388c178920fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:43:33.507050 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:43:33.509454 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fe14f6a4-d144-40d8-8fee-904fb43a30eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:43:33.569804 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-ecf448cf-2bfe-4c74-89c1-15437db7e355 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672282 Sep 08 11:43:33.572506 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3814/7856] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:43:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:43:33.585648 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-eb9e6ccb-687b-41a3-9ac4-54d4f098be6f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:33.586452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-eb9e6ccb-687b-41a3-9ac4-54d4f098be6f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:33.660794 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-eb9e6ccb-687b-41a3-9ac4-54d4f098be6f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:33.669997 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-eb9e6ccb-687b-41a3-9ac4-54d4f098be6f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1247 microversion: 2.1 time: 0.089109 Sep 08 11:43:33.673331 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4043/7857] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:33 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:34.702978 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:34.704402 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:34.716393 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:34.720793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:34.721453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:34.723414 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:34.723935 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:34.724382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:34.800446 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:34.810190 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6a75e6cf-c36a-4b36-ae3c-9100555aaac6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1317 microversion: 2.1 time: 0.117567 Sep 08 11:43:34.812668 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3815/7858] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:34 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1317 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:35.834077 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:35.834611 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:35.842671 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.843712 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.844656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.845551 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:35.846066 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:35.846678 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:35.991592 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:36.000865 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-f8f49865-b6fd-4fdf-a453-d9a1a42adbf0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1372 microversion: 2.1 time: 0.170720 Sep 08 11:43:36.001723 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4044/7859] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:35 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:36.220281 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-a6e04b65-c3ed-4af5-84eb-cdaf307df658 req-99d6e542-a6f6-4750-83a5-a8f5626cbb9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:36.231382 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a6e04b65-c3ed-4af5-84eb-cdaf307df658 req-99d6e542-a6f6-4750-83a5-a8f5626cbb9a service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:36.231915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a6e04b65-c3ed-4af5-84eb-cdaf307df658 req-99d6e542-a6f6-4750-83a5-a8f5626cbb9a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:36.232360 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-a6e04b65-c3ed-4af5-84eb-cdaf307df658 req-99d6e542-a6f6-4750-83a5-a8f5626cbb9a service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:36.244316 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-a6e04b65-c3ed-4af5-84eb-cdaf307df658 req-99d6e542-a6f6-4750-83a5-a8f5626cbb9a service nova] Creating event network-changed:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:43:36.249268 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-a6e04b65-c3ed-4af5-84eb-cdaf307df658 req-99d6e542-a6f6-4750-83a5-a8f5626cbb9a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034043 Sep 08 11:43:36.250196 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3816/7860] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:37.025250 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:37.025859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:37.032899 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:37.033392 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:37.033838 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:37.034547 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:37.035009 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:37.035444 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:37.187996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:37.196456 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-2c4a4148-1f3c-4a04-8458-87c734e0548a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1372 microversion: 2.1 time: 0.174989 Sep 08 11:43:37.197357 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4045/7861] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:37 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:38.220721 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:38.221436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:38.227686 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:38.228189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:38.228648 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:38.229354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:38.229826 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:38.230276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:38.371444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:38.379792 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-17b5d47b-8635-4dda-a69f-7a4f1e4ce0de tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1372 microversion: 2.1 time: 0.164778 Sep 08 11:43:38.380375 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3817/7862] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:38 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:39.402342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:39.403615 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:39.411119 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:39.411673 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:39.412120 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:39.413184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:39.413656 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:39.414096 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:39.563532 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:39.571680 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-285be101-c0ef-4306-a3c7-007a1d86660d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1372 microversion: 2.1 time: 0.173213 Sep 08 11:43:39.572259 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4046/7863] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:39 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:40.594907 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:40.595710 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:40.602923 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:40.603433 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:40.603943 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:40.604668 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:40.605304 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:40.605779 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:40.865346 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:40.873478 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-85084fb8-ffdb-4f72-b3b6-8a3bc8d99c02 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1372 microversion: 2.1 time: 0.283171 Sep 08 11:43:40.874046 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3818/7864] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:40 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:41.473315 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-33089897-4c65-4140-ad0d-8ab3dfbd138f req-fe491f90-b7f8-44cd-9fc9-a5eaca5c7644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "name": "network-vif-plugged", "status": "completed", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:41.485201 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-33089897-4c65-4140-ad0d-8ab3dfbd138f req-fe491f90-b7f8-44cd-9fc9-a5eaca5c7644 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:41.485690 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-33089897-4c65-4140-ad0d-8ab3dfbd138f req-fe491f90-b7f8-44cd-9fc9-a5eaca5c7644 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:41.486128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-33089897-4c65-4140-ad0d-8ab3dfbd138f req-fe491f90-b7f8-44cd-9fc9-a5eaca5c7644 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:41.498408 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-33089897-4c65-4140-ad0d-8ab3dfbd138f req-fe491f90-b7f8-44cd-9fc9-a5eaca5c7644 service nova] Creating event network-vif-plugged:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:43:41.506514 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-33089897-4c65-4140-ad0d-8ab3dfbd138f req-fe491f90-b7f8-44cd-9fc9-a5eaca5c7644 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036937 Sep 08 11:43:41.507428 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4047/7865] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:43:41.896227 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:41.896970 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:41.903637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:41.904161 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:41.904621 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:41.905847 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:41.906615 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:41.907070 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:42.039349 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:42.047230 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-0d52798c-3987-4f9f-a000-e6fc9013f599 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1372 microversion: 2.1 time: 0.155140 Sep 08 11:43:42.047844 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3819/7866] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:41 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:43.071782 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:43.072502 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:43.079191 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.079699 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.080143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.080842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.081294 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.081720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.272842 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:43.280983 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4e84c96b-39f7-4e1b-90f2-93df06edf75e tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1557 microversion: 2.1 time: 0.213864 Sep 08 11:43:43.281593 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4048/7867] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:43 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:43.305012 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:43:43.305725 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:43:43.312751 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.313246 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.313708 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.314435 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:43.314913 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:43.315363 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:43.454547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:43:43.465736 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-5c743fa7-5974-4365-9612-5da0fac16f5a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1557 microversion: 2.1 time: 0.164596 Sep 08 11:43:43.466356 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3820/7868] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:43:43 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:43:45.432029 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=6 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:43:45.487978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-ee80aa99-3284-447a-bfc0-15ae0e5f9f69 req-7e758a66-bc30-4009-abfa-ec13a504d5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:43:45.497789 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ee80aa99-3284-447a-bfc0-15ae0e5f9f69 req-7e758a66-bc30-4009-abfa-ec13a504d5a6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:43:45.498288 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ee80aa99-3284-447a-bfc0-15ae0e5f9f69 req-7e758a66-bc30-4009-abfa-ec13a504d5a6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:43:45.498762 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-ee80aa99-3284-447a-bfc0-15ae0e5f9f69 req-7e758a66-bc30-4009-abfa-ec13a504d5a6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:43:45.510100 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-ee80aa99-3284-447a-bfc0-15ae0e5f9f69 req-7e758a66-bc30-4009-abfa-ec13a504d5a6 service nova] Creating event network-changed:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:43:45.515853 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-ee80aa99-3284-447a-bfc0-15ae0e5f9f69 req-7e758a66-bc30-4009-abfa-ec13a504d5a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087897 Sep 08 11:43:45.516761 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4049/7869] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:40.704285 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0068dc00-0656-43bb-80ca-d0cc800bda7b] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 11:45:40.704894 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:40.705423 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:40.706297 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:40.707045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=34 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:40.708163 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 11:45:40.708349 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:45:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601/action (ip 10.222.0.59) !!! Sep 08 11:45:40.719566 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-289533728"}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:40.721939 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:40.732274 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:40.732787 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:40.733250 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:40.733977 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:40.734453 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:40.734929 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:40.942388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-208cf17f-848e-41a5-9b9f-0ab3b2342470 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "POST /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601/action" status: 202 len: 0 microversion: 2.1 time: 0.240270 Sep 08 11:45:40.943063 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3821/7870] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:45:40 2022] POST /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 11:45:46.088947 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:45:46.091293 n-d-833090-19 devstack@n-api.service[122457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:45:46.092193 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:46.093371 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=28 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:46.094406 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:45:46.094894 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:45:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Sep 08 11:45:46.184528 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-54862be2-2290-401e-b13d-db2b27a528f9 req-24d375be-4ab3-4bd6-9a60-4bc935c05ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "name": "network-vif-plugged", "status": "completed", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:46.196941 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-54862be2-2290-401e-b13d-db2b27a528f9 req-24d375be-4ab3-4bd6-9a60-4bc935c05ab6 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:46.197605 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-54862be2-2290-401e-b13d-db2b27a528f9 req-24d375be-4ab3-4bd6-9a60-4bc935c05ab6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:46.198037 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-54862be2-2290-401e-b13d-db2b27a528f9 req-24d375be-4ab3-4bd6-9a60-4bc935c05ab6 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:46.214414 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-54862be2-2290-401e-b13d-db2b27a528f9 req-24d375be-4ab3-4bd6-9a60-4bc935c05ab6 service nova] Creating event network-vif-plugged:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:45:46.219726 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-54862be2-2290-401e-b13d-db2b27a528f9 req-24d375be-4ab3-4bd6-9a60-4bc935c05ab6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132878 Sep 08 11:45:46.220972 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4050/7871] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:54.529838 n-d-833090-19 devstack@n-api.service[122456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1459b375-7dc3-41bd-96ce-24c2156bede4] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 11:45:54.531344 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:54.532296 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:54.537775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2068018630", "imageRef": "ff229b58-7727-4b38-bab8-b286ed39cba7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1495786158", "security_groups": [{"name": "tempest-secgroup-smoke-616291465"}], "networks": [{"uuid": "d3a94a21-ac6a-41a3-93fb-68ec3b45f2e6"}]}} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:54.563100 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] [0068dc00-0656-43bb-80ca-d0cc800bda7b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51486. Sep 08 11:45:54.648698 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.network.neutron [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] validate_networks() for [('d3a94a21-ac6a-41a3-93fb-68ec3b45f2e6', None, None, None, None, None)] {{(pid=122456) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 11:45:55.022416 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Flavor limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 11:45:55.022865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Image limits 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 11:45:55.023362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Flavor pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 11:45:55.023825 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Image pref 0:0:0 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 11:45:55.024293 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.virt.hardware [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 11:45:55.033160 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:55.033665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:55.034123 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:55.034874 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:55.035674 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:55.036129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:55.054384 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Getting quotas for project f341f7873f484a31a542388c178920fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 11:45:55.059855 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.quota [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Getting quotas for user 81a5fc971bc34264b8fb8dadca178719 and project f341f7873f484a31a542388c178920fd. Resources: {'instances', 'cores', 'ram'} {{(pid=122456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 11:45:55.072577 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Going to run 1 instances... {{(pid=122456) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 11:45:55.075165 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff229b58-7727-4b38-bab8-b286ed39cba7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 11:45:55.124248 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-908b9980-811b-43a7-97c7-55d0bdbb68cf tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.595869 Sep 08 11:45:55.125057 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3822/7872] 10.222.0.59 () {60 vars in 1147 bytes} [Thu Sep 8 11:45:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 11:45:55.138784 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-636a6386-7d90-4048-803f-bece2bed9dc9 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:55.139520 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-636a6386-7d90-4048-803f-bece2bed9dc9 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:55.152349 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd46a557-fe5e-4301-891f-7e1c8aa830c4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51500. Sep 08 11:45:55.154123 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] [be00a15f-52f4-49c4-9fb7-8b1421641715] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51502. Sep 08 11:45:55.202761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-636a6386-7d90-4048-803f-bece2bed9dc9 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:55.210891 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-636a6386-7d90-4048-803f-bece2bed9dc9 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1249 microversion: 2.1 time: 0.077798 Sep 08 11:45:55.211856 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4051/7873] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:55 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:56.234864 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:56.235679 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:56.246869 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:56.247383 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:56.247865 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:56.248594 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:56.249075 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:56.249521 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:56.267034 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] [1459b375-7dc3-41bd-96ce-24c2156bede4] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51516. Sep 08 11:45:56.323242 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:56.332852 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-306c42b9-e4f9-466a-8cd5-d47a99c324c5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1309 microversion: 2.1 time: 0.103330 Sep 08 11:45:56.347430 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3823/7874] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:56 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:57.357060 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:57.358525 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:57.362308 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:45:57.379596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:57.380422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:57.380958 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:57.381769 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:57.382322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:57.385799 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:57.619758 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:57.628549 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-cf51cbf4-8208-4209-a810-b61ee9df373c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.275959 Sep 08 11:45:57.644429 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4052/7875] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:57 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 11:45:58.090458 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-65b9ccfd-f893-4c1f-b195-b0f9cc957db7 req-f87c3ba6-2715-40d3-b296-02eca4e9a922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "name": "network-vif-unplugged", "status": "completed", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:45:58.106512 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-65b9ccfd-f893-4c1f-b195-b0f9cc957db7 req-f87c3ba6-2715-40d3-b296-02eca4e9a922 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:58.107367 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-65b9ccfd-f893-4c1f-b195-b0f9cc957db7 req-f87c3ba6-2715-40d3-b296-02eca4e9a922 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:58.108013 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-65b9ccfd-f893-4c1f-b195-b0f9cc957db7 req-f87c3ba6-2715-40d3-b296-02eca4e9a922 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:58.122887 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-65b9ccfd-f893-4c1f-b195-b0f9cc957db7 req-f87c3ba6-2715-40d3-b296-02eca4e9a922 service nova] Creating event network-vif-unplugged:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:45:58.128699 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-65b9ccfd-f893-4c1f-b195-b0f9cc957db7 req-f87c3ba6-2715-40d3-b296-02eca4e9a922 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046166 Sep 08 11:45:58.129863 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3824/7876] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:45:58.655859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:58.656718 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:58.665351 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:58.665835 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:58.666269 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:58.666977 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:58.667446 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:58.667895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:58.822090 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:45:58.831873 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-07cb7a60-f951-45c3-8998-738b1ed51a4c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.179624 Sep 08 11:45:58.852266 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4053/7877] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:58 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:45:59.861450 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:45:59.862095 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:45:59.869713 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:59.870235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:59.870814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:45:59.871775 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:45:59.872256 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:45:59.872801 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:00.032774 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:00.041001 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9c096888-2674-41ac-b2c8-bd7b5ec7313a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.185034 Sep 08 11:46:00.041580 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3825/7878] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:45:59 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:01.067767 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:01.068868 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:01.076270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:01.076720 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:01.077166 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:01.078087 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:01.078545 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:01.078978 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:01.243897 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:01.252442 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-6977b552-c935-4a3a-9458-ef89cb835371 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.188559 Sep 08 11:46:01.253162 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4054/7879] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:01 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:02.276754 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:02.277707 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:02.285333 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:02.285996 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:02.286461 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:02.287324 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:02.288609 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:02.289069 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:02.440054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:02.447901 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-4ef72711-40cb-4b24-91a1-4440575d25c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.175535 Sep 08 11:46:02.448480 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3826/7880] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:02 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:03.471596 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:03.473085 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:03.480764 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:03.481634 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:03.482338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:03.483338 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:03.484059 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:03.484725 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:03.632068 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:03.640341 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4cd22b6f-6ad1-4468-9cbf-713d7152ae56 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.172618 Sep 08 11:46:03.640931 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4055/7881] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:03 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:04.665129 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:04.665793 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:04.672663 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:04.673171 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:04.673637 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:04.674354 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:04.674830 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:04.675276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:04.812074 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:04.819811 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-1c466188-654a-4b44-bad4-6820d238973d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.161298 Sep 08 11:46:04.820383 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3827/7882] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:04 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:05.843569 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:05.844157 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:05.846859 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell0:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:05.852465 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:05.852952 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:05.853398 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:05.854103 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:05.854562 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:05.854996 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:05.988623 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:05.996535 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-ae51c28a-0757-4da9-8ec3-c076eabd1a50 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.157045 Sep 08 11:46:05.997108 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4056/7883] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:05 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:07.020108 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:07.021493 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:07.027651 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:07.028466 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell0:SELECT=6 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:07.031749 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:07.032267 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:07.032730 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:07.033468 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:07.033945 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:07.035072 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:07.185860 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:07.194159 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2066ae0a-506e-40d6-a0c6-2fae3e123ccc tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.177908 Sep 08 11:46:07.195843 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3828/7884] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:07 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:07.214110 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-db3a4f4e-2b28-4e8d-9b91-b203fe1a6606 req-5a7fd554-a7a4-4cbe-90e7-5e922f6c76e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:07.226817 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-db3a4f4e-2b28-4e8d-9b91-b203fe1a6606 req-5a7fd554-a7a4-4cbe-90e7-5e922f6c76e2 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:07.227374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-db3a4f4e-2b28-4e8d-9b91-b203fe1a6606 req-5a7fd554-a7a4-4cbe-90e7-5e922f6c76e2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:07.227905 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-db3a4f4e-2b28-4e8d-9b91-b203fe1a6606 req-5a7fd554-a7a4-4cbe-90e7-5e922f6c76e2 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:07.239627 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-db3a4f4e-2b28-4e8d-9b91-b203fe1a6606 req-5a7fd554-a7a4-4cbe-90e7-5e922f6c76e2 service nova] Creating event network-changed:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:46:07.245415 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-db3a4f4e-2b28-4e8d-9b91-b203fe1a6606 req-5a7fd554-a7a4-4cbe-90e7-5e922f6c76e2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038103 Sep 08 11:46:07.246128 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4057/7885] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:46:08.223317 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:08.224106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:08.232078 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:08.232595 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:08.233622 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:08.233794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:08.234265 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:08.234706 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:08.374752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:08.382632 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2bd2fe94-51bb-4f96-98f9-1ff6151814ae tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.164051 Sep 08 11:46:08.395719 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3829/7886] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:08 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:09.405850 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:09.406470 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:09.414395 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:09.414887 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:09.415330 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:09.416062 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:09.416529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:09.416962 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:09.578436 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:09.599104 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-0deb1935-1fa1-4597-a317-9e88a569c142 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.197467 Sep 08 11:46:09.599884 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4058/7887] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:09 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:10.627023 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:10.627675 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:10.635064 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:10.635585 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:10.636040 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:10.636752 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:10.637222 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:10.637664 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:10.774743 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:10.782467 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fbba7888-e7e2-4f50-bbaf-06c244cc41c0 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.159402 Sep 08 11:46:10.783034 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3830/7888] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:10 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:11.805542 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:11.806297 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:11.813309 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:11.813855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:11.814322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:11.815025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:11.815506 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:11.815938 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:11.960902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:11.969404 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-fa726975-b041-4128-8e8e-9700c46bfb2c tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.167717 Sep 08 11:46:11.970202 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4059/7889] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:11 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:12.992496 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:12.993252 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:13.000235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:13.000736 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:13.001191 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:13.001901 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:13.002374 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:13.002814 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:13.137906 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:13.145633 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-9fe670fd-e45b-455f-bb53-ca1fcebdb3f5 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.157325 Sep 08 11:46:13.146212 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3831/7890] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:12 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:13.975263 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-8910e81a-4a16-446a-8115-0f92ce95e8c5 req-20f72e80-d615-4108-bf46-4b750339b41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "name": "network-vif-plugged", "status": "completed", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:13.990931 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8910e81a-4a16-446a-8115-0f92ce95e8c5 req-20f72e80-d615-4108-bf46-4b750339b41d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:13.991580 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8910e81a-4a16-446a-8115-0f92ce95e8c5 req-20f72e80-d615-4108-bf46-4b750339b41d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:13.992172 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-8910e81a-4a16-446a-8115-0f92ce95e8c5 req-20f72e80-d615-4108-bf46-4b750339b41d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:14.004960 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-8910e81a-4a16-446a-8115-0f92ce95e8c5 req-20f72e80-d615-4108-bf46-4b750339b41d service nova] Creating event network-vif-plugged:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:46:14.010627 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-8910e81a-4a16-446a-8115-0f92ce95e8c5 req-20f72e80-d615-4108-bf46-4b750339b41d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039175 Sep 08 11:46:14.011674 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4060/7891] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:46:14.168885 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:14.169528 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:14.176362 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:14.176875 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:14.177343 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:14.178066 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:14.178547 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:14.179001 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:14.312607 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:14.320772 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-01b7b6b6-4a79-417b-89f4-f2a19c59deb6 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.155801 Sep 08 11:46:14.322138 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3832/7892] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:14 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:15.344572 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:15.345276 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:15.352965 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:15.353452 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:15.353896 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:15.354587 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:15.355043 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:15.355486 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:15.495222 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:15.503378 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-e6b7b8cd-57c5-464f-9c87-06b216e80f9a tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1374 microversion: 2.1 time: 0.163129 Sep 08 11:46:15.504171 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4061/7893] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:15 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:16.526832 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:16.527444 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:16.534290 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:16.534794 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:16.535251 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:16.535995 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:16.536464 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:16.536934 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:16.676451 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:16.684342 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-209b4e64-1aa3-4b63-b2f8-4ff52dcec667 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1559 microversion: 2.1 time: 0.161385 Sep 08 11:46:16.684927 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3833/7894] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:16 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:16.706732 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:46:16.707374 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:46:16.710270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=27 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:46:16.716290 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:16.716775 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:16.717211 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:16.717907 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:16.718353 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:16.718774 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:16.850342 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:46:16.858132 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d10dc8c5-6786-4f0b-ae33-91f2780d425d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1559 microversion: 2.1 time: 0.155411 Sep 08 11:46:16.858704 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4062/7895] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:46:16 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:46:18.464912 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-3453647f-a401-4dd6-862e-b004c6cb34eb req-c6f0e91b-ebfb-49c2-a4fe-da8764c4afdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:46:18.476534 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3453647f-a401-4dd6-862e-b004c6cb34eb req-c6f0e91b-ebfb-49c2-a4fe-da8764c4afdb service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:46:18.477029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3453647f-a401-4dd6-862e-b004c6cb34eb req-c6f0e91b-ebfb-49c2-a4fe-da8764c4afdb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:46:18.477474 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-3453647f-a401-4dd6-862e-b004c6cb34eb req-c6f0e91b-ebfb-49c2-a4fe-da8764c4afdb service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:46:18.489293 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-3453647f-a401-4dd6-862e-b004c6cb34eb req-c6f0e91b-ebfb-49c2-a4fe-da8764c4afdb service nova] Creating event network-changed:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:46:18.495388 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-3453647f-a401-4dd6-862e-b004c6cb34eb req-c6f0e91b-ebfb-49c2-a4fe-da8764c4afdb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035672 Sep 08 11:46:18.496360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3834/7896] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:19.212686 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:19.213487 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=58 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:19.214370 n-d-833090-19 devstack@n-api.service[122457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:48:19.214515 n-d-833090-19 devstack@n-api.service[122457]: Thu Sep 8 11:48:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda/action (ip 10.222.0.59) !!! Sep 08 11:48:19.220091 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1479648572"}} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:19.222591 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:19.234855 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:19.235365 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:19.235822 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:19.236529 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:19.236980 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:19.237422 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:19.440638 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-c9399f17-1650-46ce-88c8-eb45f7440f18 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "POST /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda/action" status: 202 len: 0 microversion: 2.1 time: 0.230053 Sep 08 11:48:19.441295 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4063/7897] 10.222.0.59 () {60 vars in 1278 bytes} [Thu Sep 8 11:48:19 2022] POST /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 11:48:26.599325 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:26.600806 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=66 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:26.602479 n-d-833090-19 devstack@n-api.service[122456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 11:48:26.602659 n-d-833090-19 devstack@n-api.service[122456]: Thu Sep 8 11:48:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Sep 08 11:48:26.609570 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-438b3c6d-18f9-4d91-8f3f-d19f7e913c12 req-aecfa125-0320-4613-92b5-8d451ff04e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "name": "network-vif-plugged", "status": "completed", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:26.627418 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-438b3c6d-18f9-4d91-8f3f-d19f7e913c12 req-aecfa125-0320-4613-92b5-8d451ff04e83 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:26.627953 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-438b3c6d-18f9-4d91-8f3f-d19f7e913c12 req-aecfa125-0320-4613-92b5-8d451ff04e83 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:26.628407 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-438b3c6d-18f9-4d91-8f3f-d19f7e913c12 req-aecfa125-0320-4613-92b5-8d451ff04e83 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:26.641011 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-438b3c6d-18f9-4d91-8f3f-d19f7e913c12 req-aecfa125-0320-4613-92b5-8d451ff04e83 service nova] Creating event network-vif-plugged:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:48:26.645090 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-438b3c6d-18f9-4d91-8f3f-d19f7e913c12 req-aecfa125-0320-4613-92b5-8d451ff04e83 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047898 Sep 08 11:48:26.645684 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3835/7898] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:39.747319 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:39.748021 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:39.755861 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_api:SELECT=2 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:39.756902 n-d-833090-19 devstack@n-api.service[122457]: DEBUG dbcounter [-] [122457] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:39.758442 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-1abdd5e1-e41a-492e-87af-72d08dfb1067 req-cc9c58b4-0183-4cc0-ba67-c140ab34e01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:39.760493 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:39.761364 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:39.762097 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:39.763405 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:39.764128 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:39.764787 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:39.770080 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_cell1:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:39.771477 n-d-833090-19 devstack@n-api.service[122456]: DEBUG dbcounter [-] [122456] Writing DB stats nova_api:SELECT=2 {{(pid=122456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 11:48:39.793518 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1abdd5e1-e41a-492e-87af-72d08dfb1067 req-cc9c58b4-0183-4cc0-ba67-c140ab34e01d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:39.794163 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1abdd5e1-e41a-492e-87af-72d08dfb1067 req-cc9c58b4-0183-4cc0-ba67-c140ab34e01d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:39.794625 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-1abdd5e1-e41a-492e-87af-72d08dfb1067 req-cc9c58b4-0183-4cc0-ba67-c140ab34e01d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:39.801750 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Going to try to terminate instance {{(pid=122457) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:48:39.807796 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-1abdd5e1-e41a-492e-87af-72d08dfb1067 req-cc9c58b4-0183-4cc0-ba67-c140ab34e01d service nova] Creating event network-changed:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:48:39.813214 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-1abdd5e1-e41a-492e-87af-72d08dfb1067 req-cc9c58b4-0183-4cc0-ba67-c140ab34e01d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061806 Sep 08 11:48:39.814007 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3836/7899] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:39.890720 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-4fec2665-4026-4fa8-8192-3e1547885c16 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 204 len: 0 microversion: 2.1 time: 0.148346 Sep 08 11:48:39.899558 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4064/7900] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:48:39 2022] DELETE /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:48:39.901915 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:39.903235 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:39.910098 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:39.910890 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:39.911553 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:39.912476 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:39.912951 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:39.913392 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:40.355045 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:40.363006 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-6cfc0b07-a811-4f50-afdb-1f66a5c14d46 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1683 microversion: 2.1 time: 0.465885 Sep 08 11:48:40.363612 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3837/7901] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:39 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1683 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:40.636946 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-065e037b-a12b-4281-9135-bf4b4c468246 req-46a8f762-f2c6-4cc4-8db6-99013841906d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "name": "network-vif-unplugged", "status": "completed", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:40.646761 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-065e037b-a12b-4281-9135-bf4b4c468246 req-46a8f762-f2c6-4cc4-8db6-99013841906d service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:40.647271 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-065e037b-a12b-4281-9135-bf4b4c468246 req-46a8f762-f2c6-4cc4-8db6-99013841906d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:40.648867 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-065e037b-a12b-4281-9135-bf4b4c468246 req-46a8f762-f2c6-4cc4-8db6-99013841906d service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:40.664815 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-065e037b-a12b-4281-9135-bf4b4c468246 req-46a8f762-f2c6-4cc4-8db6-99013841906d service nova] Creating event network-vif-unplugged:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:48:40.670434 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-065e037b-a12b-4281-9135-bf4b4c468246 req-46a8f762-f2c6-4cc4-8db6-99013841906d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037501 Sep 08 11:48:40.671209 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4065/7902] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:41.388106 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:41.388728 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:41.395535 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:41.396035 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:41.396484 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:41.397190 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:41.397655 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:41.398126 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:41.587436 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:41.597747 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-df72f795-5a99-454d-92d5-cf3598a964dd tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1683 microversion: 2.1 time: 0.214183 Sep 08 11:48:41.598360 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3838/7903] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:41 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:42.386808 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-280da4ae-3240-45af-a1ef-fcdb61d9a969 req-b3718a0d-9ff0-4ef3-b58a-42de654c21f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e0eed9-2545-4955-af69-e1ffaadcbfda", "name": "network-vif-deleted", "tag": "b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:42.396813 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-280da4ae-3240-45af-a1ef-fcdb61d9a969 req-b3718a0d-9ff0-4ef3-b58a-42de654c21f9 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:42.397318 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-280da4ae-3240-45af-a1ef-fcdb61d9a969 req-b3718a0d-9ff0-4ef3-b58a-42de654c21f9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:42.398234 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-280da4ae-3240-45af-a1ef-fcdb61d9a969 req-b3718a0d-9ff0-4ef3-b58a-42de654c21f9 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:42.409803 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-280da4ae-3240-45af-a1ef-fcdb61d9a969 req-b3718a0d-9ff0-4ef3-b58a-42de654c21f9 service nova] Creating event network-vif-deleted:b8b7d423-0ccb-457f-84fc-7e7dc2a94d8f for instance c7e0eed9-2545-4955-af69-e1ffaadcbfda on n-h2-833090-19 Sep 08 11:48:42.415064 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-280da4ae-3240-45af-a1ef-fcdb61d9a969 req-b3718a0d-9ff0-4ef3-b58a-42de654c21f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110512 Sep 08 11:48:42.415696 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4066/7904] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:42.621527 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:42.622170 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:42.629303 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:42.629823 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:42.630291 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:42.631029 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:42.631532 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:42.632491 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:42.668054 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:42.668578 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:42.669034 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:42.669520 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.objects.instance [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lazy-loading 'fault' on Instance uuid c7e0eed9-2545-4955-af69-e1ffaadcbfda {{(pid=122456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:48:42.715613 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.policy [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122456) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:42.725052 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-3f690775-4f39-4595-8d62-185800f03f4f tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 200 len: 1339 microversion: 2.1 time: 0.107749 Sep 08 11:48:42.725654 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3839/7905] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:42 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:43.749511 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:43.750213 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: c7e0eed9-2545-4955-af69-e1ffaadcbfda] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:43.756675 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:43.757184 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:43.757627 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:43.758322 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:43.758781 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:43.759219 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:43.776389 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.wsgi [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] HTTP exception thrown: Instance c7e0eed9-2545-4955-af69-e1ffaadcbfda could not be found. Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Request method failure captured: Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: request: GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda HTTP/1.1 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Accept: application/json Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Accept-Encoding: identity Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Connection: close Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Content-Length: 0 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Content-Type: application/json Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Host: 10.222.0.59 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: Openstack-System-Scope: None Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: User-Agent: python-urllib3/1.26.12 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Auth-Token: gAAAAABjGdVe0p9mX9b-QxiX8WbkELYQSSBbzUGCc1qyumyvZCoWhDFdwn7nmCH4-XfbQY9seKtTPxAezPaOzWalyQbBHlUsq2gsk9LUELYWKcIayz5IQ3Ds4ilNDDJXisfIipcwIwQgysRjEMGnfZZaVrU5Gompbqv7zE2Eh1oszJ80PPSlau8 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Id: None Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Domain-Name: None Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Identity-Status: Confirmed Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Is-Admin-Project: True Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Id: default Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Domain-Name: Default Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Id: f341f7873f484a31a542388c178920fd Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Project-Name: tempest-TestSnapshotPattern-1437588313 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Role: reader,member Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Roles: reader,member Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f341f7873f484a31a542388c178920fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f341f7873f484a31a542388c178920fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f341f7873f484a31a542388c178920fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f341f7873f484a31a542388c178920fd", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant: tempest-TestSnapshotPattern-1437588313 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Id: f341f7873f484a31a542388c178920fd Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-Tenant-Name: tempest-TestSnapshotPattern-1437588313 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-User: tempest-TestSnapshotPattern-1437588313-project Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Id: default Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Domain-Name: Default Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Id: 81a5fc971bc34264b8fb8dadca178719 Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: X-User-Name: tempest-TestSnapshotPattern-1437588313-project Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: method: > Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: exception: Instance c7e0eed9-2545-4955-af69-e1ffaadcbfda could not be found. Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: action_args: {'id': 'c7e0eed9-2545-4955-af69-e1ffaadcbfda'} Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e0eed9-2545-4955-af69-e1ffaadcbfda could not be found. Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e0eed9-2545-4955-af69-e1ffaadcbfda could not be found. Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:43.778025 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e0eed9-2545-4955-af69-e1ffaadcbfda could not be found. Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: ERROR nova.api.openstack.wsgi Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Returning 404 to user: Instance c7e0eed9-2545-4955-af69-e1ffaadcbfda could not be found. {{(pid=122457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-7699ba59-fa61-4506-b88a-29a79288db72 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda" status: 404 len: 111 microversion: 2.1 time: 0.035068 Sep 08 11:48:43.783895 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4067/7906] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:43 2022] GET /compute/v2.1/servers/c7e0eed9-2545-4955-af69-e1ffaadcbfda => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:48:45.132519 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:45.133046 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:45.134945 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [req-6a71204d-5406-4078-801f-eae6a2b207c4 req-b36c107d-1907-4f87-804d-0fe5fb632136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:45.140509 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:45.141100 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:45.141785 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:45.142586 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:45.143058 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:45.143665 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:45.146361 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6a71204d-5406-4078-801f-eae6a2b207c4 req-b36c107d-1907-4f87-804d-0fe5fb632136 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:45.146840 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6a71204d-5406-4078-801f-eae6a2b207c4 req-b36c107d-1907-4f87-804d-0fe5fb632136 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:45.147270 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [req-6a71204d-5406-4078-801f-eae6a2b207c4 req-b36c107d-1907-4f87-804d-0fe5fb632136 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:45.160131 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.compute.server_external_events [req-6a71204d-5406-4078-801f-eae6a2b207c4 req-b36c107d-1907-4f87-804d-0fe5fb632136 service nova] Creating event network-changed:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:48:45.166185 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [req-6a71204d-5406-4078-801f-eae6a2b207c4 req-b36c107d-1907-4f87-804d-0fe5fb632136 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034877 Sep 08 11:48:45.166793 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4068/7907] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:45.171940 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Going to try to terminate instance {{(pid=122456) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 11:48:45.262877 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-2d059994-f012-4f64-8247-7d06f4034b8d tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "DELETE /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 204 len: 0 microversion: 2.1 time: 0.134064 Sep 08 11:48:45.263977 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3840/7908] 10.222.0.59 () {58 vars in 1239 bytes} [Thu Sep 8 11:48:45 2022] DELETE /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 11:48:45.275320 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:45.276630 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:45.293901 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:45.294812 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:45.295724 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:45.296776 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:45.297438 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:45.298031 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:45.509766 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:45.518627 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-d7fa6f91-94d1-44d1-9d92-f099b1624afb tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1682 microversion: 2.1 time: 0.249842 Sep 08 11:48:45.519225 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4069/7909] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:45 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:46.443560 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [req-abd296d3-d4e7-47df-a962-48ea9593dee7 req-f88c0697-cb25-4551-88b9-ba500bfe61e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a31138-54de-4aa2-a76d-339478d16601", "name": "network-vif-deleted", "tag": "9d22d55f-494d-4b2d-b9f5-3a375162e8a7"}]} {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 11:48:46.454957 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-abd296d3-d4e7-47df-a962-48ea9593dee7 req-f88c0697-cb25-4551-88b9-ba500bfe61e3 service nova] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:46.455783 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-abd296d3-d4e7-47df-a962-48ea9593dee7 req-f88c0697-cb25-4551-88b9-ba500bfe61e3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:46.456479 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [req-abd296d3-d4e7-47df-a962-48ea9593dee7 req-f88c0697-cb25-4551-88b9-ba500bfe61e3 service nova] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:46.467510 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.compute.server_external_events [req-abd296d3-d4e7-47df-a962-48ea9593dee7 req-f88c0697-cb25-4551-88b9-ba500bfe61e3 service nova] Creating event network-vif-deleted:9d22d55f-494d-4b2d-b9f5-3a375162e8a7 for instance 74a31138-54de-4aa2-a76d-339478d16601 on n-h1-833090-19 Sep 08 11:48:46.472297 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [req-abd296d3-d4e7-47df-a962-48ea9593dee7 req-f88c0697-cb25-4551-88b9-ba500bfe61e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033081 Sep 08 11:48:46.472993 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3841/7910] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Sep 8 11:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 11:48:46.544104 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:46.544845 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.compute.api [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122457) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:46.552590 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:46.553143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:46.553641 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:46.555143 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:46.555688 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:46.556127 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:46.590028 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:46.590519 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:46.590959 n-d-833090-19 devstack@n-api.service[122457]: DEBUG oslo_concurrency.lockutils [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:46.591406 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.objects.instance [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lazy-loading 'fault' on Instance uuid 74a31138-54de-4aa2-a76d-339478d16601 {{(pid=122457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 11:48:46.633515 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.policy [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a5fc971bc34264b8fb8dadca178719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f341f7873f484a31a542388c178920fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122457) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 11:48:46.641441 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-78fba794-87e6-4f33-abb6-63fd3450ae04 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 200 len: 1337 microversion: 2.1 time: 0.102157 Sep 08 11:48:46.642011 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4070/7911] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:46 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 1337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 11:48:47.666316 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '>' {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:47.666946 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.compute.api [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] [instance: 74a31138-54de-4aa2-a76d-339478d16601] Fetching instance by UUID {{(pid=122456) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 11:48:47.673166 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:47.673658 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:47.674107 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:47.674808 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Acquiring lock "52f990e6-f314-4e63-bea0-82e6545e9daa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 11:48:47.675276 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 11:48:47.675748 n-d-833090-19 devstack@n-api.service[122456]: DEBUG oslo_concurrency.lockutils [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Lock "52f990e6-f314-4e63-bea0-82e6545e9daa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 11:48:47.692547 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.wsgi [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] HTTP exception thrown: Instance 74a31138-54de-4aa2-a76d-339478d16601 could not be found. Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Request method failure captured: Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: request: GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 HTTP/1.1 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Accept: application/json Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Accept-Encoding: identity Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Connection: close Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Content-Length: 0 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Content-Type: application/json Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Host: 10.222.0.59 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: Openstack-System-Scope: None Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: User-Agent: python-urllib3/1.26.12 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Auth-Token: gAAAAABjGdVe0p9mX9b-QxiX8WbkELYQSSBbzUGCc1qyumyvZCoWhDFdwn7nmCH4-XfbQY9seKtTPxAezPaOzWalyQbBHlUsq2gsk9LUELYWKcIayz5IQ3Ds4ilNDDJXisfIipcwIwQgysRjEMGnfZZaVrU5Gompbqv7zE2Eh1oszJ80PPSlau8 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Id: None Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Domain-Name: None Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Identity-Status: Confirmed Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Is-Admin-Project: True Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Id: default Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Domain-Name: Default Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Id: f341f7873f484a31a542388c178920fd Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Project-Name: tempest-TestSnapshotPattern-1437588313 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Role: reader,member Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Roles: reader,member Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f341f7873f484a31a542388c178920fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f341f7873f484a31a542388c178920fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f341f7873f484a31a542388c178920fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f341f7873f484a31a542388c178920fd", "adminURL": "http://10.222.0.59:8080"}]}] Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant: tempest-TestSnapshotPattern-1437588313 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Id: f341f7873f484a31a542388c178920fd Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-Tenant-Name: tempest-TestSnapshotPattern-1437588313 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-User: tempest-TestSnapshotPattern-1437588313-project Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Id: default Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Domain-Name: Default Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Id: 81a5fc971bc34264b8fb8dadca178719 Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: X-User-Name: tempest-TestSnapshotPattern-1437588313-project Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: method: > Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: exception: Instance 74a31138-54de-4aa2-a76d-339478d16601 could not be found. Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: action_args: {'id': '74a31138-54de-4aa2-a76d-339478d16601'} Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: {{(pid=122456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a31138-54de-4aa2-a76d-339478d16601 could not be found. Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a31138-54de-4aa2-a76d-339478d16601 could not be found. Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 11:48:47.694189 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a31138-54de-4aa2-a76d-339478d16601 could not be found. Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: ERROR nova.api.openstack.wsgi Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: DEBUG nova.api.openstack.wsgi [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Returning 404 to user: Instance 74a31138-54de-4aa2-a76d-339478d16601 could not be found. {{(pid=122456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: INFO nova.api.openstack.requestlog [None req-fa6810c8-2ab2-45df-a1d2-8811c4bc6171 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601" status: 404 len: 111 microversion: 2.1 time: 0.035231 Sep 08 11:48:47.699705 n-d-833090-19 devstack@n-api.service[122456]: [pid: 122456|app: 0|req: 3842/7912] 10.222.0.59 () {58 vars in 1236 bytes} [Thu Sep 8 11:48:47 2022] GET /compute/v2.1/servers/74a31138-54de-4aa2-a76d-339478d16601 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 11:48:47.853247 n-d-833090-19 devstack@n-api.service[122457]: DEBUG nova.api.openstack.wsgi [None req-a91ca80f-e5e7-4753-877d-97f333995a10 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] Calling method '.version_select at 0x7f2351288430>' {{(pid=122457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 11:48:47.879148 n-d-833090-19 devstack@n-api.service[122457]: INFO nova.api.openstack.requestlog [None req-a91ca80f-e5e7-4753-877d-97f333995a10 tempest-TestSnapshotPattern-1437588313 tempest-TestSnapshotPattern-1437588313-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1495786158" status: 202 len: 0 microversion: 2.1 time: 0.030292 Sep 08 11:48:47.879951 n-d-833090-19 devstack@n-api.service[122457]: [pid: 122457|app: 0|req: 4071/7913] 10.222.0.59 () {58 vars in 1257 bytes} [Thu Sep 8 11:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1495786158 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)